Submitting to the Search Engines and WebCrawlers

 When you want your brand new site to be indexed into major search engines, you usually go to their free submit page and submit your website, correct? Seems like the right thing to do, right?

Well, many people fail to realize that not submitting your site is usually better than actually submitting it.

Let, me explain.

All the search engines, or the MAJOR ones, for our discussion here have what are called webcrawlers. Now, webcrawlers are little programs that go out onto the web and search or "crawl" around looking for websites that are not already indexed into their databases.

Google search engine is a well-known engine that does this, its webcrawler "GOOGLEBOT" crawls the web looking for "non-existent" sites that are not in their index(database). To see evidence of this, look at your stats for your website and see if Googlebot has crawled your site lately, chances are it has.

-- Start SideNote --

My personal experience indicates that Google actually prefers this method, crawling and indexing, rather than using their Free Submit page.

-- End SideNote --

Basically if you want to get your site indexed into Google and the Major search engines, simply post it and wait,... I realize this seems like a weird or bad idea, but take my word for it,... IT WORKS.

Another idea is that, if you already have a site that is indexed already in Google, simply put a small link to your new site toward the top of the page thats already indexed and when Google crawls your already indexed site it will automatically index your new site, since it has yet to be indexed. Easy huh?

A site map can do the same thing. In order to get all your webpages for your new site indexed simply link your sitemap of your new site as above, and when it crawls your existing site, it will index all the pages of your new site, via your sitemap.

Two points to always note: Link all your important pages into a sitemap, important pages first, and link to another already existent site, and let the major engines find your pages on their own, via webcrawling.

NOTE: The above works for FREE search engines that have crawlers, Google for example. See my previous article I wrote last week on PPC and PPI.