You may not want certain pages of your site crawled because they might not be useful to users if found in a search engine's search results. If you do want to prevent search engines from crawling your pages, Google Search Console has a friendly robots.txt generator to help you create this file. Note that if your site uses subdomains and you wish to have certain pages not crawled on a particular subdomain, you'll have to create a separate robots.txt file for that subdomain. For more information on robots.txt, we suggest this Webmaster Help Center guide on using robots.txt files13.

A navigational page is a simple page on your site that displays the structure of your website, and usually consists of a hierarchical listing of the pages on your site. Visitors may visit this page if they are having problems finding pages on your site. While search engines will also visit this page, getting good crawl coverage of the pages on your site, it's mainly aimed at human visitors.
While most of the links to your site will be added gradually, as people discover your content through search or other ways and link to it, Google understands that you'd like to let others know about the hard work you've put into your content. Effectively promoting your new content will lead to faster discovery by those who are interested in the same subject. As with most points covered in this document, taking these recommendations to an extreme could actually harm the reputation of your site.
Description meta tags are important because Google might use them as snippets for your pages. Note that we say "might" because Google may choose to use a relevant section of your page's visible text if it does a good job of matching up with a user's query. Adding description meta tags to each of your pages is always a good practice in case Google cannot find a good selection of text to use in the snippet. The Webmaster Central Blog has informative posts on improving snippets with better description meta tags18 and better snippets for your users19. We also have a handy Help Center article on how to create good titles and snippets20.
The new digital era has enabled brands to selectively target their customers that may potentially be interested in their brand or based on previous browsing interests. Businesses can now use social media to select the age range, location, gender and interests of whom they would like their targeted post to be seen by. Furthermore, based on a customer's recent search history they can be ‘followed’ on the internet so they see advertisements from similar brands, products and services,[40] This allows businesses to target the specific customers that they know and feel will most benefit from their product or service, something that had limited capabilities up until the digital era.

While working at a Fortune 100 company for nine years before moving to lead my current team, I became fascinated by customer behavior. What kinds of digital offerings most deeply engage customers in their digital lives? I started by looking at some case studies of the products, services, communications and experiences that had been embraced and adopted by customers during the first two decades of the internet. Over a period of seven years working on inbound marketing campaigns, what I found was a recurring pattern of three behaviors that drove the adoption of new digital experiences, which I call the three core behaviors of a network:
As the number of sites on the Web increased in the mid-to-late 1990s, search engines started appearing to help people find information quickly. Search engines developed business models to finance their services, such as pay per click programs offered by Open Text[7] in 1996 and then Goto.com[8] in 1998. Goto.com later changed its name[9] to Overture in 2001, was purchased by Yahoo! in 2003, and now offers paid search opportunities for advertisers through Yahoo! Search Marketing. Google also began to offer advertisements on search results pages in 2000 through the Google AdWords program. By 2007, pay-per-click programs proved to be primary moneymakers[10] for search engines. In a market dominated by Google, in 2009 Yahoo! and Microsoft announced the intention to forge an alliance. The Yahoo! & Microsoft Search Alliance eventually received approval from regulators in the US and Europe in February 2010.[11]
Understanding Mobiles: Understanding mobile devices is a significant aspect of digital marketing because smartphones and tablets are now responsible for 64% of the time US consumers are online (Whiteside, 2016).[44] Apps provide a big opportunity as well as challenge for the marketers because firstly the app needs to be downloaded and secondly the person needs to actually use it. This may be difficult as ‘half the time spent on smartphone apps occurs on the individuals single most used app, and almost 85% of their time on the top four rated apps’ (Whiteside, 2016).[44] Mobile advertising can assist in achieving a variety of commercial objectives and it is effective due to taking over the entire screen, and voice or status is likely to be considered highly; although the message must not be seen or thought of as intrusive (Whiteside, 2016).[44] Disadvantages of digital media used on mobile devices also include limited creative capabilities, and reach. Although there are many positive aspects including the users entitlement to select product information, digital media creating a flexible message platform and there is potential for direct selling (Belch & Belch, 2012).[46]
There are many reasons explaining why advertisers choose the SEM strategy. First, creating a SEM account is easy and can build traffic quickly based on the degree of competition. The shopper who uses the search engine to find information tends to trust and focus on the links showed in the results pages. However, a large number of online sellers do not buy search engine optimization to obtain higher ranking lists of search results, but prefer paid links. A growing number of online publishers are allowing search engines such as Google to crawl content on their pages and place relevant ads on it.[16] From an online seller's point of view, this is an extension of the payment settlement and an additional incentive to invest in paid advertising projects. Therefore, it is virtually impossible for advertisers with limited budgets to maintain the highest rankings in the increasingly competitive search market.
With the development of this system, the price is growing under the high level of competition. Many advertisers prefer to expand their activities, including increasing search engines and adding more keywords. The more advertisers are willing to pay for clicks, the higher the ranking for advertising, which leads to higher traffic.[15] PPC comes at a cost. The higher position is likely to cost $5 for a given keyword, and $4.50 for a third location. A third advertiser earns 10% less than the top advertiser, while reducing traffic by 50%.[15] The investors must consider their return on investment and then determine whether the increase in traffic is worth the increase.

One way marketers can reach out to consumers, and understand their thought process is through what is called an empathy map. An empathy map is a four step process. The first step is through asking questions that the consumer would be thinking in their demographic. The second step is to describe the feelings that the consumer may be having. The third step is to think about what the consumer would say in their situation. The final step is to imagine what the consumer will try to do based on the other three steps. This map is so marketing teams can put themselves in their target demographics shoes.[71] Web Analytics are also a very important way to understand consumers. They show the habits that people have online for each website.[72] One particular form of these analytics is predictive analytics which helps marketers figure out what route consumers are on. This uses the information gathered from other analytics, and then creates different predictions of what people will do so that companies can strategize on what to do next, according to the peoples trends.[73]

Facebook Ads and other social media ad platforms, for example, are pay-per-click platforms that do not fall under the SEM category. Instead of showing your ads to people who are searching for similar content like search ads do, social media sites introduce your product to people who happen to be just browsing through their feeds. These are two very, very different types of online advertising.


UC Davis, one of the nation’s top-ranked research universities, is a global leader in agriculture, veterinary medicine, sustainability, environmental and biological sciences, and technology. With four colleges and six professional schools, UC Davis and its students and alumni are known for their academic excellence, meaningful public service and profound international impact.
In addition to giving you insight into the search volume and competition level of keywords, most keyword research tools will also give you detailed information about the average or current estimated CPC for particular keywords are. This is particularly important for businesses with smaller ad budgets and this feature allows you to predict whether certain keywords will be truly beneficial to your ad campaigns or if they’ll cost too much.
Keep resources crawlable. Blocking page resources can give Google an incomplete picture of your website. This often happens when your robots.txt file is blocking access to some or all of your page resources. If Googlebot doesn't have access to a page's resources, such as CSS, JavaScript, or images, we may not detect that it's built to display and work well on a mobile browser. In other words, we may not detect that the page is "mobile-friendly," and therefore not properly serve it to mobile searchers.

Not every single ad will appear on every single search. This is because the ad auction takes a variety of factors into account when determining the placement of ads on the SERP, and because not every keyword has sufficient commercial intent to justify displaying ads next to results. However, the two main factors that Google evaluates as part of the ad auction process are your maximum bid and the Quality Score of your ads.


Many blogging software packages automatically nofollow user comments, but those that don't can most likely be manually edited to do this. This advice also goes for other areas of your site that may involve user-generated content, such as guest books, forums, shout-boards, referrer listings, etc. If you're willing to vouch for links added by third parties (for example, if a commenter is trusted on your site), then there's no need to use nofollow on links; however, linking to sites that Google considers spammy can affect the reputation of your own site. The Webmaster Help Center has more tips on avoiding comment spam40, for example by using CAPTCHAs and turning on comment moderation.
Influencer marketing: Important nodes are identified within related communities, known as influencers. This is becoming an important concept in digital targeting. It is possible to reach influencers via paid advertising, such as Facebook Advertising or Google Adwords campaigns, or through sophisticated sCRM (social customer relationship management) software, such as SAP C4C, Microsoft Dynamics, Sage CRM and Salesforce CRM. Many universities now focus, at Masters level, on engagement strategies for influencers.
Video advertising - This type of advertising in terms of digital/online means are advertisements that play on online videos e.g. YouTube videos. This type of marketing has seen an increase in popularity over time.[52] Online Video Advertising usually consists of three types: Pre-Roll advertisements which play before the video is watched, Mid-Roll advertisements which play during the video, or Post-Roll advertisements which play after the video is watched.[53] Post-roll advertisements were shown to have better brand recognition in relation to the other types, where-as "ad-context congruity/incongruity plays an important role in reinforcing ad memorability".[52] Due to selective attention from viewers, there is the likelihood that the message may not be received.[54] The main advantage of video advertising is that it disrupts the viewing experience of the video and therefore there is a difficulty in attempting to avoid them. How a consumer interacts with online video advertising can come down to three stages: Pre attention, attention, and behavioural decision.[55] These online advertisements give the brand/business options and choices. These consist of length, position, adjacent video content which all directly affect the effectiveness of the produced advertisement time,[52] therefore manipulating these variables will yield different results. Length of the advertisement has shown to affect memorability where-as longer duration resulted in increased brand recognition.[52] This type of advertising, due to its nature of interruption of the viewer, it is likely that the consumer may feel as if their experience is being interrupted or invaded, creating negative perception of the brand.[52] These advertisements are also available to be shared by the viewers, adding to the attractiveness of this platform. Sharing these videos can be equated to the online version of word by mouth marketing, extending number of people reached.[56] Sharing videos creates six different outcomes: these being "pleasure, affection, inclusion, escape, relaxation, and control".[52] As well, videos that have entertainment value are more likely to be shared, yet pleasure is the strongest motivator to pass videos on. Creating a ‘viral’ trend from mass amount of a brands advertisement can maximize the outcome of an online video advert whether it be positive or a negative outcome.
Collaborative Environment: A collaborative environment can be set up between the organization, the technology service provider, and the digital agencies to optimize effort, resource sharing, reusability and communications.[38] Additionally, organizations are inviting their customers to help them better understand how to service them. This source of data is called User Generated Content. Much of this is acquired via company websites where the organization invites people to share ideas that are then evaluated by other users of the site. The most popular ideas are evaluated and implemented in some form. Using this method of acquiring data and developing new products can foster the organizations relationship with their customer as well as spawn ideas that would otherwise be overlooked. UGC is low-cost advertising as it is directly from the consumers and can save advertising costs for the organisation.
Once consumers can access this content, they want to engage with something that fits their needs and is sensory and interactive — from the early popularity of web portals to the spread of online video, to the next generation virtual realities. Their digital desires are marked by a thirst for content. The old media adage that “content is king" is correct. There is no question that the desire to engage with content is a key driver of customer behavior.
Another part of SEM is social media marketing (SMM). SMM is a type of marketing that involves exploiting social media to influence consumers that one company’s products and/or services are valuable.[22] Some of the latest theoretical advances include search engine marketing management (SEMM). SEMM relates to activities including SEO but focuses on return on investment (ROI) management instead of relevant traffic building (as is the case of mainstream SEO). SEMM also integrates organic SEO, trying to achieve top ranking without using paid means to achieve it, and pay per click SEO. For example, some of the attention is placed on the web page layout design and how content and information is displayed to the website visitor. SEO & SEM are two pillars of one marketing job and they both run side by side to produce much better results than focusing on only one pillar.
Creating the link between SEO and PPC represents an integral part of the SEM concept. Sometimes, especially when separate teams work on SEO and PPC and the efforts are not synced, positive results of aligning their strategies can be lost. The aim of both SEO and PPC is maximizing the visibility in search and thus, their actions to achieve it should be centrally coordinated. Both teams can benefit from setting shared goals and combined metrics, evaluating data together to determine future strategy or discuss which of the tools works better to get the traffic for selected keywords in the national and local search results. Thanks to this, the search visibility can be increased along with optimizing both conversions and costs.[21]

A content marketer, for example, can create a series of blog posts that serve to generate leads from a new ebook the business recently created. The company's social media marketer might then help promote these blog posts through paid and organic posts on the business's social media accounts. Perhaps the email marketer creates an email campaign to send those who download the ebook more information on the company. We'll talk more about these specific digital marketers in a minute.
×