Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Do you use any kinda algorithm for crawling/fetching content from reddit?


Not particularly. The one thing that helps but most people don't know about reddit is the fact that adding a .json to the end of each url displays the content of that page in json format.

for example: reddit.com/r/funny.json

This make crawling/fetching content from reddit much more trivial than old school web crawling.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: