Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
wordpad
14 days ago
|
parent
|
context
|
favorite
| on:
Guy running a Google rival from his laundry room
Why can't crawling be crowd sourced? It would solve ip rotation and spread the load
6510
14 days ago
|
next
[–]
https://yacy.net
catlikesshrimp
14 days ago
|
parent
|
next
[–]
Too bad it doesn't support android. It is much more energy efficient than anything else I can spare (for 100% uptime contribution)
Poomba
14 days ago
|
prev
|
next
[–]
That’s how residential proxies work, in a perverse way
chiefsearchaco
14 days ago
|
prev
[–]
Common crawl sort of serves this function. I use it. It's a really good foundation.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: