Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
xnx
on Dec 14, 2023
|
parent
|
context
|
favorite
| on:
Show HN: I scraped 25M Shopify products to build a...
Weird. I think it did change. Google cache shows a 2229 line file:
https://webcache.googleusercontent.com/search?q=cache%3Ahttp...
capableweb
on Dec 14, 2023
[–]
Seems it might be looking at the referrer. Loading
https://www.shopify.com/robots.txt
from clicking the link shows the weird line while opening it in a private browser window shows the right one.
Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
