IIRC, aside from government surplus auctions (which is an easy way of getting 3 dozen if you pick up on site), I think the right keywords to use are “shock mount” and some variations on military surplus, rack, case, etc.
Local pickup is the key for these things - anyone living near a major metro should inquire where the state/county/city auction location is (though sometimes they auction “in place” so pay attention).
I got something like 6 steelcase filing cabinets for $160 - even renting a truck to pick them up was still a huge savings.
From government auctions or sometimes, weirdos. You can find them on eBay and other sites sometimes too, but like other people mentioned, local pickup and bulk buys are key because otherwise with freight shipping you’ll pay 100 usd / 1u or more. Bit more information.. these have caps in the front and back for travel, but if you’re not worried about cooling and willing to drill cable holes for usage these have great sound isolation. Construction is similar to pelican cases or similar, but way more beefy. Typical individual chassis are usually 4u, sometimes 8, but not more afaik.. maybe because everything in the field should be a 4 man lift, max.
After so many years, so many people still believe in this user control paradigm.
Giving users control works for the slim percentage of power users. Most users will end up obliterated by scammers and other unsavory characters.
Perhaps there is a way to give control to today's users (that includes my non-technical mother) and still secure them against the myriad of online threats. If anyone knows of a paper or publication that addresses this, I'd love to read it.
If you want privacy, that's the only way to get it. As Apple has demonstrated, giving the platform owner control means eroding your privacy with no recourse and still getting obliterated by scammers.
It was astounding. It became day for a few seconds and then it broke off into a half dozen pieces or so. It left an incandescent trail behind.
It looked incredibly close. I had the feeling we were going to hear it coming down nearby in a few seconds, but it ended up in the Atlantic Ocean (actually not that far from us since we were by the ocean, but far enough).
So glad we were having drinks outside and I wasn't grabbing anything in the house!
Looking at the reaction of the girl in the video, I wondered... when you see something out of the ordinary like that, do you get the ape/lizard brain instinct of "oh shit the sky is on fire, better hide under a rock"?
I have seen enough meteors in video to recognise one in real life, but I wonder if for a split second the fight-flight instinct kicks in before reason prevails.
I haven't touched this in a while, but you can train NNs in a distributed fashion and what GP described is roughly the most basic version of model parallelism, where there is a copy of the model on each node, each node receives a batch of data, and the gradients get synchronized after each batch (so they again start from the same point like you mention).
Most modern large models cannot be trained on one instance of anything (GPU, accelerators, whatever), so there's no alternative to distributed training. They also wouldn't even fit in the memory of one GPU/accelerator, so there are even more complex ways to split the model across instances.
And their bottleneck is what? Data transfer. State is gigantic and needs to be frequently synchronized. That's why it can only work with sophisticated, ultra high bandwidth, specialized interconnects. They employ some tricks here and there but they don't scale that well, ie. with MoE you get factor of 8 scaling and it comes at a cost of lower overall number of parameters. They of course do parallelism as much as they can at model/data/pipeline levels but it's a struggle in a setting of fastest interconnects there are on the planet. Those techniques don't transfer onto networks normal people are using, using "distrubuted" phrase to describe both is conflating those two settings with dramatically different properties. It's a bit like saying that you could make L1 or L2 cpu cache bigger by connecting multiple cpus with network cable. It doesn't work like that.
You can't scale averaging parallel runs much. You need to munch through evolutions/iterations fast.
You can't ie. start with random state, schedule parallel training averaging it all out and expect that you end up with well trained network in one step.
Every next step invalidates input state for everything and the state is gigantic.
It's dominated by huge transfers at high frequency.
You can't for example have 2x gpus connected with network cable and expect speedup. You need to put them on the same motherboard to have any gains.
SETI for example is unlike that - it can be easily distributed - partial readonly snapshot, intense computation, thin result submission.
Not disputing all of that, but telling the GP flat out "no" is incorrect, especially when distributed training and inference are the only way to run modern massive models.
Inference - you can distribute much better than training. You don't need specialized interconnects for inference.
The question was:
> > There is probably a simple answer to this question, but why isn't it possible to use a decentralized architecture like in crypto mining to train models?
> Can you copy a neural network, train each copy on a different part of the dataset, and merge them back together somehow?
The answer is flat out no.
It doesn't mean parallel computation doesn't happen. Everything, including single gpu, is massively parallel computation.
Does copying happen? Yes, but it's short lived and dominates, ie. data transfer is bottleneck and they go out of their ways to avoid it.
Distributing training in decentralized architecture fashion is not possible.
This is what I meant with timing: Germany's innovative younger people are held captive by a large conservative older generation that is pushing for security, which leads to overarching bureaucracy. This is especially bad in Germany because the government tries to regulate every tiny detail. Due to missing digitalization, they are failing on a grant scale.
On the other hand, this doesn't mean as you say that Germany has no potential to be an innovation hub. It just cannot use the potential currently. If you live here, you will see many good signs: Open source is strong. Chaos Computer Club mentality spreads and there is a fighting back against the government digital opression.
>you will see many good signs: Open source is strong. Chaos Computer Club mentality spreads and there is a fighting back against the government digital opression.
Sure, but those things alone don't build future product companies and market leaders worth trillions of dollars.
I also don't get it. I worked there for 8 years. I'm southern european and there was always a "half joke" about our lazyness. But we worked the hardest. My local colleagues were incredibly entitled and produced very little value.
In my opinion, Germany was at some point at the top of the world in most aspects, and the people became complacent over time. Which leads us to where we are today. Enshittification is palpable in every single aspect of society. No one cares about doing a good job anymore. Getting something done takes months where it should take days. And then that thing you got done breaks in a few weeks.
I'm sorry for the rant. I got pretty burned out of living there.
In Denmark, the only places without triphase power are some very old apartments in inner Copenhagen. To be fair, some of those apartments predate US independence by a hundred years. Those buildings do have triphasic power, but had a silly scheme where each apartment got two random phases.
All houses have triphasic power (usually 35A per phase, sometimes 63A), and all apartment buildings with electrics from the last 2-3 decades provide triphasic power to each apartment as well.
Our ovens and cooktops expect triphasic power, with a two-phase downgraded configuration for backup.
As someone with 0 idea about semiconductors development: How does making your own chip compare to using FPGAs when you need low quantities? What things can you do with your own IC that you cannot do with FPGAs?
It's more of a principle achievement, like, "hey Intel, come cause a shooting spree at my local grocery store while I'm there, because, anybody who did similar DIY things in the automobile-hydrogen space met a similar fate from that industry!" [1]
