Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It sounds like Selenium may be in the general area of your wishes: afaik there are browser extensions that create a workflow for Selenium, which I think you then run with scripts in e.g. Python. If you're in data science, Python is probably already useful for data processing.

Alternatively, other Selenium-like ‘headless browsers’ may also have visual tools for creating workflows—e.g. PhantomJS and such. See https://alternativeto.net/software/selenium/

Maybe there's even something for Scrapy, which is made for scraping in the first place, as the name indicates.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: