Hi folks!
I love running local small models, but it's quite annoying to attempt to compare them using benchmarks. Not only are they scattered around, they often don't even share the same ones.
So I built Tiny League for those of use who care about small models. By small, I'm aiming at 3-200B, which is a range that I consider both capable and able to run at home (for those who have unified memory like mac, strix or spark)
I'm limiting the model list to models released after April and excluding models that are trained for specific use-cases.
The next level of time and effort would be to benchmark the models yourself. I am interested in x86-64 CPU benchmarks, but that's probably niche and there will be more interest in benchmarks on a modest GPU. The most common amount of VRAM on Steam (https://store.steampowered.com/hwsurvey/Steam-Hardware-Softw...) is 16 GB, followed closely by 8 GB.
1. works fine for me, are you sure you don't have any other filters active that might result in 0 models?
2. good idea, a few people have requested that. It becomes a little bit more difficult when models have engrams, but I will consider!
3. There are some tools to do that, I personally don't like them. I understand the convenience but I am staying away from that. There are many factors at play, not all models work the same way, even if they use the same VRAM. Not to speak of using quants and how each quant may affect a model differently
If by "genetic modification" you mean "random genetic mutation" formally known as stenospermocarpy.
Seedless grapes existed in the Mediterranean centuries ago. The now-popular Thompson seedless was brought from the Ottoman empire in 1872.
Similar story with bananas and the parthenocarpy mutation. Then you layer selective breeding on top of that to create complete sterility due to triploidy.
Others like the babaco papaya are just simple sterile interspecific hybrids.
So nature actually does make seedless fruit by accident quite often. It's just that you need humans to come along and clonally propagate them.
wow, what kind of stuff does that script do? I've seen non-vision models analyze images, but mostly histograms, color averages etc. This one seems to actually understand the image itself and reproduce the layout, very impressive
nice of you to think that by evening you get cooler air :D we have had days where the only time of the day where the outside temp was lower than indoor's was between 01-07. So either you stay up to open the windows, or wait till early morning... but then you just get 1-2 hrs before having to close everything again
In addition, in some places (where I live) the air quality is extremely poor for much of the summer due to wildfire smoke. So even if you do get a cool night, if you don't have AC you have to choose between maintaining some level of air quality indoors or cooling your house.
Yeah, anecdotally night time temperatures have gotten much worse the last decade. But in the 90s-2010s you could easily get by without air-conditioning and no misery, with just passive temperature control.
If you live in a brick/stone hours you can still go a long way by maximally ventilating house at nigh and during the day keeping sun out (shutters, awning e.t.c) and keep ventilation minimal. It would not help if the nights are warm (so you'd need AC) but there are still many more days with cold nights and by using shutters and timed ventilation you can reduce AC energy use.
AC full on without other measures and passive thermal control techniques are no only two available options, one can combine them.
Many years ago I lived in a brick apartment and the afternoon/evening sun would hit the wall next to my bedroom, making it very hot at night. I started going out with buckets of water to splash on the wall a few times each evening and it made a real difference. A white sheet hung across the wall might have helped more. Lots of things can be done if you don’t mind looking silly :) Unless you’re in the an area with high temp and high humidity. That is bad.
Do those also cover the apartment walls? I've only seen large awnings covering walls in detached houses, and even then it's relatively rare to cover walls that aren't close to doors.
I did vibe coded one, where It downloads images from my (currently defunct) immich server album, dithers them for 4 color inky display, downloads the weather data and display them. It's a fun little one. I wish the inky only had a "faster than 30secs full refresh" partial update capability.
So I built Tiny League for those of use who care about small models. By small, I'm aiming at 3-200B, which is a range that I consider both capable and able to run at home (for those who have unified memory like mac, strix or spark)
I'm limiting the model list to models released after April and excluding models that are trained for specific use-cases.
Appreciate all sorts of feedback :)
reply