Found this in my logs, Inktomi Slurp? |
Question And Answer Category: Website |
Question: |
| Dear BlankHelp Team, I was wondering after checking my website logs, what is Inktomi Slurp? Seems to be in the bot section of my AWStats page, but never heard of it before. Thanks, Tim |
Our Advice and Answer: |
| Dear Tim, Inktomi Slurp is Yahoo's website crawling program, Yahoo's spider. The only concerns you should have about Inktomi Slurp is if it is crawling around directories or files that it should not be. If so, update your robots.txt file to tell it to exclude certain files and directories, and you might want to make that command generic enough for all search engine spiders to follow. Glad we can help, The BlankHelp Team |
Website Help and Advice Notice: |
| Treat all advice, information, and suggestions as UNprofessional help. Like all professionals who help you, you are worked with on a one on one basis. Because we are not meeting with you, we cannot provide any professional advice. So treat this site is solely for informational and educational purposes. Terms and Conditions |
