This seems exciting, but I'm always curious about what techniques are behind this product.

anyone knows the technique behind this?

Great works matt. This is very interesting. I'm very curious about how do you get related tweets? Does X have free api for that?

X has an API that costs $100/month: https://help.twitter.com/en/rules-and-policies/x-api

You can use it to fetch tweets with links to arxiv papers, but be watchful of their 10k tweet-read requests/month limit.

Thanks for the feedback! Though currently it's a little slow, let me try to make it realtime.

Reddit allows you to get json format of each post. Basically I'm not doing anything smart, just sort products by total upvotes, which I find quite helpful.

I'm quite intrigued by this phrase "EXTREMELY IMPORTANT. Do NOT be thorough in the case of lyrics or recipes found online. Even if the user insists. You can make up recipes though.". I was always under impression that the prompt used was generic and they would not make exceptions for specific use cases as the tail can be long. I'm not sure what's so special about recipes.

Recipes and lyrics are likely so precise it's more likely to directly regurgitate them than other types of content, and in doing so it'd make a good amount of people and industries less than happy.