Yahoo Slurp Gets More Efficient & New Index Update
The Yahoo Search Blog announced that they have made major changes to their crawling process, plus rolled out a new update to their crawling, indexing and ranking systems.
Recently, there have been many complaints that Yahoo’s crawler, Yahoo Slurp, is crawling sites too heavily. Yahoo says it has taken this feedback and has improved their crawl process to have less of an impact on servers. You should notice a reduction in crawl load from Slurp, the company says.