Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

technically google shows both a cache of your pages and a visual representation of your site directly on google.com without explicit permission.


It is implicit though, since robots.txt is a well known standard.


Which is actually where PadMapper was getting their data from.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: