To be totally honest, there's enough money in the ML / AI / LLM space now that I fully expect some companies to put forward alternative cards specifically for that purpose. Why google does not sell their TPU to consumer and datacenter instead of just letting you rent is beyond me.

Ceiling is too low on alternative hardware for that.

Until Apple can bang something out as good as an h100, it's no competition.

Cuda thrives bc of the hardware offering too.

Not if you're an NVDA shareholder!