Yahoo! Slurp

Yahoo! Slurp

Yahoo! Slurp is a web crawler (Robots) of Yahoo Search Engine.

The Yahoo! Slurp crawler collects documents from the Web to build a searchable index for search services using the Yahoo! Search engine. These documents are discovered and crawled because other web pages contain links directing to these documents.

Yahoo! Slurp has support for frames and makes an effort to crawl complex URLs such as those generated by forms, content generation systems, and dynamic page generation software.

To know more about Yahoo! Slurp visit: http://help.yahoo.com/l/us/yahoo/search/webcrawler/