Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Cross posting this for Erowid:

---

We are trying to collect a record of all tweets and retweets of hashtag:

#ThanksSasha

and

#Shulgin

We want to continue to track these. So we don't want just an output, but a way to grab all existing tweets and collect them going forward.

We would also like to grab google plus matching posts as well, but twitter is the first target.

If someone has PHP and twitter experience, it seems like a pretty easy application to write a scraper that saves the data to sql, xml, or text.

We want a downloadable data file that can be updated over time.

I spent a while looking for existing tools and didn't find anything that could provide a downloadable, reliable format that we could use to try to track this.

Thanks for any help or suggestions of services that would provide that data as a lump, without having to have one of us manually slog through many, many clicks and parsing extremely obscure HTML/js.

earth

earth@erowid.org



As much as I love Erowid, I've had an impossible time trying to contact them for using their experience vault for research. I have the time and the skillset to make the application they're looking for, but I highly doubt Earth would get back to me.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: