Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Rlhf wasn't introduced by openai. And GPT is a pretty standard transformer, no? Yes they did it at scale and it speaks volumes on their production skills, but OP was asking about research


GPT is a specific instantiation of a transformer, and doing next token prediction was an openAI thing. Transformers were a big part of it, but GPT was def proposed but openAI




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: