INT2 ternary is equivalent to INT1 + binary mask. Nvidia supprted INT1 matrix mu... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Klipper3 on Feb 28, 2024 \| parent \| context \| favorite \| on: The Era of 1-bit LLMs: ternary parameters for cost... INT2 ternary is equivalent to INT1 + binary mask. Nvidia supprted INT1 matrix multiply in RTX20 and RTX30 generations, nobody used it, so they removed INT1 support from RTX40 generation.

ByThyGrace on Feb 29, 2024 [–]

What I get from your comment is now older RTX gens are going to be in high demand soon.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact