Hacker News new | past | comments | ask | show | jobs | submit login

Google doesn't respect crawl-delay, sadly. They rely on the Webmaster Tools setting, which is unavailable to me as I've described.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: