How Do Search Engines Work - Web Crawlers
It is the search engines that lastly fetch your webplace to the perceive of the prospective clients. thus it is better to know how these search engines actually work and how they offering information to the client initiating a search.
There are really two types of search engines. The first is by robots called crawlers or spiders.
hunt Engines use spiders to directory webplaces. When you suggest your webplace pages to a search engine by completing their essential submission page, the search engine spider will directory your full place. A ‘spider’ is an automated list that is run by the search engine scheme. Spider holidays a web place, read the stuffing on the actual place, the place’s Meta tags and also chase the relatives that the place connects. The spider then income all that information back to a chief depository, where the numbers is directoryed. It will holiday each bond you have on your webplace and directory those places as well. Some spiders will only directory a certain number of pages on your place, so don’t originate a place with 500 pages!
The spider will periodically arrival to the places to prove for any information that has altered. The frequency with which this happens is establishd by the moderators of the search engine.
A spider is almost like a book where it contains the chart of stuffings, the actual stuffing and the relatives and references for all the webplaces it finds during its search, and it may directory up to a million pages a day.
Example: Excite, Lycos, AltaVista and Google.
When you ask a search engine to locate information, it is actually incisive through the directory which it has originated and not actually incisive the Web. Different search engines make different rankings because not every search engine uses the same algorithm to search through the indices.
One of the stuff that a search engine algorithm scans for is the frequency and place of keywords on a web page, but it can also notice artificial keyword stuffing or spamdexing. Then the algorithms evaluate the way that pages bond to other pages in the Web. By proveing how pages bond to each other, an engine can both establish what a page is about, if the keywords of the bonded pages are related to the keywords on the initial page.