If all the weights are either 1, 0 or -1, isn't this what biological neurons do? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		checker659 on Feb 28, 2024 \| parent \| context \| favorite \| on: The Era of 1-bit LLMs: ternary parameters for cost... If all the weights are either 1, 0 or -1, isn't this what biological neurons do?

nathan_compton on Feb 28, 2024 [–]

Not even remotely. I suppose you could kind of say that activations are boolean in the sense that neurons emit spikes, but arguably significant information is encoded in spike timing.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact