Im sold, but it appears there isn’t a single place in my major metro of 7 million that will offer in store demo and purchase? Do they not want my money?!

What I've noticed is he sounds a lot less measured and more jittery now than he did before. I remember videos of talks he did in the early 2000's and his zero to one lecture series that were pretty smooth and articulate, his interviews recently have him seem a lot more nervous (for lack of a better word)

I agree because I don’t want to get fired or get audited

Jeez -2! No sense of humor left, my comment was sent to the very end. That´s sad and says a lot. Is it because I forgot to mention Grok, that you are pissed :)) It is a joke for god sake, laugh it while you still can. What a narrative damn.

Correct, she stole a bad idea

I think Anduril's mission is great but I'd never work for a man who directly funded fascism in my own country. Would be cool if there was a more woke defense contractor that wasn't captured by institutional rot like Raytheon and Lockheed

I chatted with someone on the language side of the project (I believe the same project) and it was fascinating how ambitious the concept was. I do wish it was finished or open sourced though

Yep, and the common mantra is that "ambitious" and "v1" shall never occur together in the same sentence.

I’m honestly skeptical of the utility of the Fremont as the specs currently appear. Seems like not enough horsepower compared to the competitor consoles - the Steam Deck was so good because price to performance to battery life is still hard to beat and only now encroached by the Switch 2, it simply didn’t have a console like competitor.

How do you know someone worked at Google?

Don’t worry, they’ll tell you

Isn't the new trend to train in lower precision anyway?

Today, training in "low precision" probably means computing FP8 x FP8 -> FP32. The FP32 accumulation is still important, but otherwise yes this works, especially if we're talking about MXFP8 as supported on Blackwell [0].

What's less proven is a recipe using MXFP4 x MXFP4 -> FP32 compute, e.g. [1], which needs more involved techniques to work. But if you get it to work stably, that pathway is running at full throughput on 5090.

[0]: https://arxiv.org/abs/2506.08027 [1]: https://arxiv.org/abs/2502.20586

Interesting. My assumption was one of the innovations of DeepSeek and the modern GPT models was performing low precision pretraining rather than just finetuning further. I didn't realize you still need accumulation at a higher precision anyway

Only GPU-poors run Q-GaLore and similar tricks.

Even the large cloud AI services are focusing on this too, because it drives down the average "cost per query", or whatever you want to call it. For inference, arguably more even than training, the smaller and more efficient they can get it, the better their bottom line.

For inference of course; the OP I replied to mentioned training though.

I’m still surprised the steam deck runs so well even with games installed to microSD - I’m not sure how they do it.

The answer is probably that disk read speed just isn't that important for casual applications like games.

We had a lot of great games even when storage was spinning rust.

It’s actually essential for more serious games without loading screens, which is why for example the PS5 ships with and mandates fast SSDs.

I would guess that's only a small percentage of popular games, though. The Steam Deck and the PS5 probably don't attract the same kind of gamer.

Grand theft auto games on the PS2 ran without loading screens

Many games have done it historically, almost always with trade offs.

Today it’s possible to do it in almost any game if you are guaranteed a fast SSD and the consoles do that.

Yeah, I am using my Deck with 512GB sdcard and could never tell it is actually running from sdcard. It does a lot of game updates and always finishes those in reasonable time, at least for me. That card is going strong with all the writes going on on steam deck

decent SD cards can do 200 or 300 MB/s of reads now

Those speeds are... complicated.

UHS-I cards easily go up to 100MB/s. This is the baseline for a modern SD card.

After that you can add more pins for UHS-II. This is used in a bunch of devices and goes up to 300MB/s, but you can't assume anything will have it. And UHS-III was dead on arrival.

Alternatively you can add a different set of more pins for SD Express. It can do gigabytes per second and is probably the future. It's backwards compatible with UHS-I, but not II or III.

And also SanDisk made their own spec for overclocking UHS-I which some things support. It can do about 200MB/s.

The steam deck supports none of those upgrade paths. You get about 100MB/s.

Not in the Steam Deck, it maxes out at 104Mb/s.

Considering the insane tempuratures the cards reach, and that it destroys brand new SD cards, I don't want them going any faster until it works safely.

The Steam Deck only supports up to UHS-I. There are UHS-II and UHS-III cards out there that support higher bandwidth.