> I'm usually just selecting the one that answered first Which is why you random... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

janalsncm 89 days ago | parent | context | favorite | on: OpenAI O3-Mini

> I'm usually just selecting the one that answered first

Which is why you randomize the order. You aren’t a tester.

56% vs 44% may not be noise. That’s why we have p values. It depends on sample size.

jhardy54 88 days ago [–]

The order doesn't matter. They often generate tokens at different speeds, and produce different lengths of text. "The one that answered first" != "The first option"

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact