Remember that there are many factors
that contribute to how search engines
work, and some of them are closely-guarded
secrets. Google, the most popular search engine,
keeps parts of their operation under wraps
to prevent fraud and dishonesty.
Web Spiders and Bots
In the old days of the Internet,
a website would often have to be
submitted directly to a search engine
in order for listing on that search engine.
This was often the only way to gain a listing
on a site like Yahoo! because directory
listing sites relied on human editors to select
the topics and contents of directory listings.
Some search engines had rudimentary ways
to search pages on the Internet. The problem
is that search engines hadn’t yet developed
the ability to filter results very well.
By using a search engine, the user couldn’t
be assured that he or she would even
come upon pages related to the keywords
typed into the search engine.
Today, however, no submission is
necessary in order to be listed in search engines....
http://www.promotionworld.com/marketing/article/090902-How-Search-Engines-Work
|