Turns out RefCOCO had a bunch of bad data inside of it. Not just with the masks, but also with the prompts like "slut on phone" and "bitch kid". RefCOCO-M cleans it up.
My understanding is that, while all 8B are loaded into memory, for each token inference step only 2B are selected and used - so tokens are produced faster because there is less computation needed.
Hoping someone will correct me if that's not the right mental model!
Moondream released a new model preview this week. One of the improvements is a much bigger context window. To take advantage, I created a sample project that uses the query and detect skills to auto-label all the objects in an image.
If you need to label a bunch of training data for fine tuning or RL this can remove a bunch of extra work.
Not perfect but sharing early because some people requested it to help kickstart their own projects.
I'm not certain but it appears that it is not illegal to discriminate based on the school's ranking in the hiring process. It would, however, be illegal if it were based on a demographic stereotype a school is associated with.
That said, it still might not be a good idea to reject people just based on their school's rank.