Aren't you kind of stuck with smaller models on the mini though? Even with the pro you'd be stuck with a max of four daisy chained over thunderbolt and with the 160 gig memory bandwidth you'd probably be far better off with other configurations.

They can be connected to share ram and processing.

Depending on the use case for known processes the LLM requirements are much, much, simpler and lower to make and keep it more predictable.

I really haven't seen any 16gb Mac Mini cluster setups running large models at any appreciable speed for the reasons previously provided. Do you happen to have examples that folks are actually using?

Neat.. Roughly.. 1.6 TB of RAM? Was there a view of how you say that being allocated and split up or was there spare capacity too?