Search engines and directories: Knowing the difference

Everyone wants their blog indexed by the major search engines. It’s a reasonable desire on the part of a blogger.

The most important search engines are Google, Yahoo Search, MSN Search, the new Amazon owned A9.com, Ask Jeeves, AOL Search, Teoma, and Wisenut.

Without inclusion in the search engine listings, there is no chance of receiving any search related visitor traffic, for your most important keywords.

In fact, you will receive no search engine generated web traffic at all. For that reason, and many others, your blog must get indexed by the most important internet search engines.

You often hear people suggest, that you must either manually or electronically submit your website or blog, to the various search engines. Don’t listen to them. There is no need to submit your site to the search engines.

Ever.

The entire idea, of needing to submit a blog or website to the search engines, is simply a myth. A better idea is to let their spiders find and crawl your blog. They will index you.

The search engines make regular crawls of the internet. Their computer program robots, more popularly called spiders, are constantly crawling the world wide web searching for new websites. One of those sites will be yours.

All you need to provide for the spiders is an open path into your site. Once that pathway is opened, the little robot spiders will crawl your site.

All you need to do is make that visit, for the robot spiders, an easy and inviting one. The spiders will take care of the rest.

There is no good reason to submit to the search engines. Unlike internet directories, like the Open Directory Project (better known as DMOZ), the various free blog directories, or the Yahoo! Directory which require manual submissions, the search engines index sites without your ever submitting to them.

You will definitely want to add your blog to the many free blog directories. Some of them will list your blog by its URL, while others index your blog's RSS feed. As you know, RSS stands for Really Simple Syndication, or Rich Site Summary, depending upon whom you ask, the day of the week, and the alignment of the planets.

One of the best lists of directory submission links, for blog URLs and RSS feeds, is found at Robin Good's Master New Media blog.

Remember, those submissions are for blog directories, not for the major search engines.

The search engines are an entirely different breed of internet beast from directories.

Directories require submissions. Search engines do not. Repeat that chant, and you won't go wrong.

A website or blog will be indexed, with as little as one link, from a site already indexed by the search engine. For example, if a blog that is already included in the Google search engine links to your blog, the spiders will follow that link.

Once the spiders crawl your blog, it’s almost immediately part of the Google index. It’s that simple. Users of the Google Toolbar can also tell, they have been indexed, as their PageRank meter will turn from grey to white.

It is thought, by a number of search engine optimization professionals, that a site found by Google will rank higher than one that uses Google’s site submission process.

There are also many people who believe, perhaps with some good evidence, that websites using Google’s submission page don’t get included by the search engine industry leader at all. There are those who also believe that the Google submission page doesn't even work at all.

While I wouldn't go that far into the realm of Google conspiracy theories and speculation, it is true that your blog or website is much better off being discovered and indexed by Google, all on its own.

Other search engines, notably Teoma and Wisenut, are often difficult for some novice webmasters to even locate the submission page. Many search engines simply don’t have easily located free submission options. Of course, that is not always a bad thing, as search engine submissions, through their submission pages, are often very slow.

Their only method of inclusion, is often to have their spider crawl a link, from one of their indexed websites to your new site. While experienced web professionals usually have no difficulty in getting indexed, by all of the search engines, many novices find the process very difficult.

Once a blog is indexed by the search engines, it remains indexed. There is simply no need to keep submitting it. There is also a myth that each and every page of a site must be submitted separately for inclusion. That is simply not the case.

There is also no need to submit to the hundreds of minor search engines on the internet. Inclusion in the majors is usually enough for virtually all practical purposes.

The problem that arises then, for many new bloggers, is getting that first link from an already indexed blog or website. There are several good and proven techniques for getting a previously indexed link to your site.

One time proven method of getting a link, to your blog is to offer a link exchange to other bloggers, whose sites are already indexed. A friend or business associate is likely to swap links readily with you.

Out of a number of link exchange requests, you are certain to achieve at least one link into your blog. That is enough to get your site crawled by a spider.

Another technique for getting an incoming link, that also pays long term benefits, is submitting your site to an internet blog directory. There are many smaller directories that provide almost instant inclusion. Since the directories are often crawled on an almost daily basis, your site will be indexed in as little as one or two days.

Posting in message forums will get your site visited by a search engine spider. Many internet discussion forums allow for the use of a signature link back to your website. If they do, be certain to use one for your posts.

Like adding your site to a directory, joining a message forum can pay off with a link to your site getting you indexed now. It can also pay long term dividends by providing you with a solid reputation as an expert in your field. Don’t waste such a valuable opportunity foolishly by being an irresponsible poster.

Create top quality content for your blog. People will always link to a blog that has strong content that is useful and informative to their own visitors. By providing interesting and helpful poss, other website owners will link to your blog naturally. Those incoming links serve as natural entries for search engine spiders.

There is simply no need to submit your blog to the major search engines for inclusion. The search engine spiders will find your blog on their own.

There are many good ways to add those important incoming links, to serve as pathways for the spiders. Create an entry to your site and the spiders will crawl right in and make themselves at home.

Let the search engine spiders find your blog or website all by themselves.

It’s the best way to be indexed by the search engines.

Tags: , , , .






Archives