Start learning with our library of video tutorials taught by experts. Get started

Analyzing Your Website to Improve SEO
Illustration by Richard Downs

Understanding why indexing is important


From:

Analyzing Your Website to Improve SEO

with Peter Kent

Video: Understanding why indexing is important

The very first thing we should do is find out if your site is indexed in the search engines yet. You may know this already, but if not, go to Google and search by typing the words 'site:' and then your site's domain name, no spaces anywhere, just site: domain name. For instance, site:twotreesoliveoil.com. press Enter or click the Search button and Google will show you a list of pages it has indexed on the specified site. Look up here and you can see how many pages Google has indexed.

Watch this entire course now—plus get access to every course in the library. Each course includes high-quality videos taught by expert instructors.

Become a member
please wait ...
Analyzing Your Website to Improve SEO
1h 43m Intermediate Jun 29, 2011 Updated Oct 12, 2012

Viewers: in countries Watching now:

In this course, search engine optimization (SEO) expert Peter Kent walks step-by-step through the process of reviewing the content and markup of an existing web site to improve its ranking in search engine results. This course offers a consultant's take on how to analyze each component—from keywords to content to code—and determine what improvements are necessary to become more visible to search engines like Yahoo!, Bing, and Google.

This course was updated on 10/12/2012.

Topics include:
  • Understanding why indexing is important
  • Using the Google AdWords Keyword Tool
  • Dealing with frames, iframes, and popups
  • Working with SEO-friendly URLs
  • Using meta tags
  • Clearing source code clutter
  • Building links within the site
  • Working with Google+
  • Reviewing page content
  • Building and submitting an HTML and XML sitemap
  • Garnering links outside the site
Subjects:
Online Marketing Web SEO Marketing Small Business Marketing
Author:
Peter Kent

Understanding why indexing is important

The very first thing we should do is find out if your site is indexed in the search engines yet. You may know this already, but if not, go to Google and search by typing the words 'site:' and then your site's domain name, no spaces anywhere, just site: domain name. For instance, site:twotreesoliveoil.com. press Enter or click the Search button and Google will show you a list of pages it has indexed on the specified site. Look up here and you can see how many pages Google has indexed.

In this case, you can see that Google has 85 pages in the index. This can be useful to know, but at least it can give you a goal. If you've got a hundred pages on your site and Google's indexed five, clearly you have a problem. It could be the Google is having problems getting to all the pages, or perhaps you have so few links to the site that it just doesn't think the site is worth indexing fully. Each page is listed below. The first line, the link, comes in the page's title tag. Now the text below is usually, though not always, from the description meta tag.

We'll talk about these items in a later video. In fact, I often use the site: search syntax as a way to not only find out what pages are indexed, but to get a quick look at what the title and description tags look like. Below you'll see the URL of the web page, and you'll also find a little cached link. Click that link to view the page that Google has cached, that it has saved. The cache is a stored page, a copy of what the page looked like the last time Google crawled the page. You can see up here in fact, the date and time that Google grabbed the page last.

The Google cache can be very handy for seeing what a page looked like in the recent past. I've helped clients recover damage to lost web pages for instance by pulling a copy from the cache. The site: domain name syntax also works on Bing, as you can see here. In this case, we're getting many fewer results than we found in Google. Hopefully that number will go up once we have optimized the site properly. As for Yahoo, well, Yahoo gets its searches out from Bing now, so whatever you see in Bing, you should see in Yahoo.

Still, if you do want to see it in Yahoo, be aware that the site: domain name syntax will work, but probably not in the main search box at Yahoo.com. It will work on the Yahoo site explorer page, which you can find at siteexplorer.search.yahoo.com. Or just search for site: domain name at the main Yahoo page. Yahoo will load a Site Explorer page in which it tells you that it can't find the results. Add site: back in and try again, and you'll get the results.

So what if you can't find your site in the search engines? First check the syntax. Did you type site: domain name probably? Remember, no spaces. If you type it correctly though and still nothing is found, what's going on? There is a slight chance that a problem with your robots.txt file could stop your site being indexed. A small typo can kill your site. robots.txt is a file in the root of your web site that provides instructions to web bots such as search engine spiders. This text is common. It simply tells spiders to stay out of the cgi-bin directory.

This tells robots that they can index the entire site. This however tells the search engines to stay out of the entire site. So a tiny change can kill your site in the search engines. It doesn't happen very often, but I have seen it. Most likely though, the problem lies elsewhere. It could be that the site is structured in such a manner that the search engines can't move from page to page, although in this case at least the homepage is usually indexed by Google. More likely is that there are so few links pointing to your site from other web sites, or not at all, that the search engines haven't found your site, or consider it unimportant.

We'll learn more about these issues in a later video.

Find answers to the most frequently asked questions about Analyzing Your Website to Improve SEO.


Expand all | Collapse all
please wait ...
This course was updated on 10/12/2012. What changed?
We added three movies to keep the course as current as possible. The new movies cover rich snippets, the Panda/Penguin upgrades to the Google search algorithm, and incorporating Google+ into your marketing and search engine optimization strategies.
 
Share a link to this course

What are exercise files?

Exercise files are the same files the author uses in the course. Save time by downloading the author's files instead of setting up your own files, and learn by following along with the instructor.

Can I take this course without the exercise files?

Yes! If you decide you would like the exercise files later, you can upgrade to a premium account any time.

Become a member Download sample files See plans and pricing

Please wait... please wait ...
Upgrade to get access to exercise files.

Exercise files video

How to use exercise files.

Learn by watching, listening, and doing, Exercise files are the same files the author uses in the course, so you can download them and follow along Premium memberships include access to all exercise files in the library.
Upgrade now


Exercise files

Exercise files video

How to use exercise files.

For additional information on downloading and using exercise files, watch our instructional video or read the instructions in the FAQ.

This course includes free exercise files, so you can practice while you watch the course. To access all the exercise files in our library, become a Premium Member.

join now Upgrade now

Are you sure you want to mark all the videos in this course as unwatched?

This will not affect your course history, your reports, or your certificates of completion for this course.


Mark all as unwatched Cancel

Congratulations

You have completed Analyzing Your Website to Improve SEO.

Return to your organization's learning portal to continue training, or close this page.


OK
Become a member to add this course to a playlist

Join today and get unlimited access to the entire library of video courses—and create as many playlists as you like.

Get started

Already a member?

Become a member to like this course.

Join today and get unlimited access to the entire library of video courses.

Get started

Already a member?

Exercise files

Learn by watching, listening, and doing! Exercise files are the same files the author uses in the course, so you can download them and follow along. Exercise files are available with all Premium memberships. Learn more

Get started

Already a Premium member?

Exercise files video

How to use exercise files.

Ask a question

Thanks for contacting us.
You’ll hear from our Customer Service team within 24 hours.

Please enter the text shown below:

The classic layout automatically defaults to the latest Flash Player.

To choose a different player, hold the cursor over your name at the top right of any lynda.com page and choose Site preferencesfrom the dropdown menu.

Continue to classic layout Stay on new layout
Exercise files

Access exercise files from a button right under the course name.

Mark videos as unwatched

Remove icons showing you already watched videos if you want to start over.

Control your viewing experience

Make the video wide, narrow, full-screen, or pop the player out of the page into its own window.

Interactive transcripts

Click on text in the transcript to jump to that spot in the video. As the video plays, the relevant spot in the transcript will be highlighted.

Are you sure you want to delete this note?

No

Notes cannot be added for locked videos.

Thanks for signing up.

We’ll send you a confirmation email shortly.


Sign up and receive emails about lynda.com and our online training library:

Here’s our privacy policy with more details about how we handle your information.

Keep up with news, tips, and latest courses with emails from lynda.com.

Sign up and receive emails about lynda.com and our online training library:

Here’s our privacy policy with more details about how we handle your information.

   
submit Lightbox submit clicked
Terms and conditions of use

We've updated our terms and conditions (now called terms of service).Go
Review and accept our updated terms of service.