Sort of. Part of the training for a model includes telling it which parts of a s... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Accujack on May 18, 2023 \| parent \| context \| favorite \| on: Ask HN: Can someone ELI5 transformers and the “Att... Sort of. Part of the training for a model includes telling it which parts of a sentence are important... a human points and clicks.

testrun on May 18, 2023 | [–]

This is extremely important to know. That the relationships between words in the sentence are actually trained by human evaluation.

breezeTrowel on May 18, 2023 | | [–]

They are not.

mollerhoj on May 18, 2023 | [–]

No, thats incorrect. The connections are automatically deduced from the training data (which is just vast amounts of raw text).

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact