Does anyone know of an API that returns pages related to any given URL? I'm looking for an alternative to Google's "related:..." search, which was only reliably accessible through Google Web Search (Google Custom Search is very expensive and has a limit of 10K queries per day).
It returns pages related to any given page, and works at the specific page level (not just at the domain level, like SimilarWeb's API).
I've migrated to Bing for all other web search needs (way cheaper and without volume limits like Google Custom Search), but Bing does not offer a "related:..." equivalent as far as I can tell.
While you're looking for this feature in the meantime, ping the Bing team and ask for it as an added function of their API. Microsoft is a lot more open to feedback these days.
Hi! I work on the Microsoft Cognitive Services team, which includes the Bing Web Search APIs in our family.
For feature requests, it would be awesome if you posted them to: https://cognitive.uservoice.com/ (I'm also forwarding your post to Bing).
If you want to get in touch with the team directly about a question/issue, the "Contact Us" widget at the bottom of the Cognitive Services page is the way to go: https://www.microsoft.com/cognitive-services
I don't know a great way, that's not intrusive, but try bingdevcenter@outlook.com or the MSDN forum. I know that Microsoft employees frequent HackerNews, so I'm sure someone will see this as well.
I ran into this problem several years ago while writing SEO software. There are a bunch of companies who provide google search results, but there's usually at least a couple minute delay between when the data is requested and when it arrives at your callback page.
I had success with Authority Labs. You might want to check them out. They'll raise the query limit if you ask them.
For example: https://www.google.com/#q=related:http:%2F%2Fagiliq.com%2Fbl...
It returns pages related to any given page, and works at the specific page level (not just at the domain level, like SimilarWeb's API).
I've migrated to Bing for all other web search needs (way cheaper and without volume limits like Google Custom Search), but Bing does not offer a "related:..." equivalent as far as I can tell.