Good topic even I would want to know about the procedure of creating a Search Engine.Well web crawlers with reference to Google are spiders that crawl for content relating to the keywords of a website.The fresher the content the earlier it is cached.A web crawler could be built with the help of any programming language such as php or java.But I can't say much about the rest.Would love an explanation as to how a search engine is built. |