author says we made no progress towards agi, also gives no definition for what the "i" in agi is, or how we would measure meaningful progress in this direction.
in a somewhat ironic twist, it seems like the authors internal definition for "intelligence" fits much closer with 1950s. good old-fashioned AI, doing proper logic and algebra. literally all the progress we made in ai in the last 20 years in ai is precisely because we abandoned this narrow-minded definition of intelligence.
Maybe I'm a grumpy old fart but none of these are new arguments. Philosophy of mind has an amazingly deep and colorful wealth of insights in this matter, and I don't know why this is not required reading for anyone writing a blog on ai.
> or how we would measure meaningful progress in this direction.
"First, we should measure is the ratio of capability against the quantity of data and training effort. Capability rising while data and training effort are falling would be the interesting signal that we are making progress without simply brute-forcing the result.
The second signal for intelligence would be no modal collapse in a closed system. It is known that LLMs will suffer from model collapse in a closed system where they train on their own data."
I agree that those both are very helpful metrics, but they are not a definition of intelligence.
yes, humans can learn to comprehend and speak language with magnitudes less examples than llms, however we also have very specific hardware for that evolved over millions of years — it's plausible that language acquisition in humans is more akin to fine-tuning in llms than training them from ground up. Either way, this metric is comparing apples to oranges when it comes to comparing real and artificial intelligence.
model collapse is a problem in ai that needs to be solved, and maybe it's even a necessary condition for true intelligence, though certainly not a sufficient one, and hence not an equivalent definition of intelligence either.
The bar you asked for was "meaningful progress". And as you state, "both are very helpful metrics", it seems the bar is met to the degree it can be.
I don't think we will see a definitive test as we can't even precisely define it. Other than heuristic signals such as stated above, the only thing left is just observing performance in the real world. But I think the current progress as measured by "benchmarks" is terribly flawed.
Good observation! Lower co2 concentration isn't caused by simply inhaling more oxygen, but rather by blowing off too much co2.
Co2 is produced by the body, and the rate at which it is produced doesn't change much if you breathe pure oxygen. it's how we get rid of the co2 is what is being modulated during breathwork.
The tingles and muscle cramps (tetany) are a normal byproduct (basically your neurons on your smallest muscles and under your skin get more excitable due to a molecular rube goldber machine set off by lower CO2 balance in your blood). It's uncomfortable, but unless you are suffering from epilepsy not dangerous and there's no lasting effects.
That said when facilitate breathwork sessions i trade the peaceful hippie music for edm (and it actually works better because it encourages people to stay with the rhythm and get into the same mildly trance-like state you might get into while exercising to repetitive music).
it's an incredibly hard workout, depending on the style you're actually using a lot of muscles that you don't typically exercise, so your body wants to naturally give up after a while. it took me probably 6-8 sessions until I could reliably do one myself.
i am a (former) neuroscientist and breathwork facilitator (mostly conscious connected breath) — AMA.
the effect of decreased co2 concentration on vasoconstrictions (and also alkalosis-induced tetany, ie your muscles cramping, which happens a lot during breathwork) are well known [1], but i've never seen them quantified in such a clear way. It's cool to see mainstream science give it a closer look!
This is a bit off topic, but what do you think about people doing nitrous recreationally? It's always concerned me that people are inhaling close to pure nitrous oxide and holding it in. I've always wondered if this creates damaging low-oxygen conditions without the normal reflexes kicking in, and if this can cause brain/neuronal damage.
I believe in medical settings it's delivered in a mixture with O2, but in recreational settings it's usually inhaled directly.
I see a lot more talk about the risks of vitamin B12 depletion, and not much talk about O2 deprivation, so not sure if everyone else is crazy or if it's me who is the crazy one.
I'm not one to tell people not to have fun, but i also lost a friend to respiratory failure after prolonged nitrous abuse, and had more then one start having auditory hallucinations. I think it's waning in popularity compared to 10 years ago, but maybe I'm just out of touch with what the kids get high on these days
In zero tolerance Sweden, nitrous is oddly perfectly legal. In fact, I recently got a cheerful flyer from our municipal waste disposal company announcing that empty 1L nitrous bottles can now be left with common household hazardous waste.
I was being treated with nitrous medically. I asked the anaesthesiologist about how it works recreationally and his answer was that yes, it was mostly just hypoxia.
This is easily falsified by a cursory internet search about the physiological mechanism behind nitrous oxide's effects. It is appalling that a medical professional would so confidently give you an uneducated, crackpot answer. The exact same mechanism which knocks you out gives you euphoria at lower doses.
If someone holds their breath long enough to cause hypoxia when inhaling nitrous oxide, they have other problems. You can easily hold your breath 1-2 minutes while sitting on a couch without experiencing hypoxia. If you're experiencing euphoria as strong as what nitrous oxide causes from hypoxia, you're basically about to die.
This is why you shouldn't trust experts on stuff outside their speciality, this answer is just wrong.
You don't even need to research it, the lived experience of being in a dentist office with mixed oxygen and nitrous produces the recreational effects - if it was mostly hypoxia, having oxygen mixed in would have a greatly diminished "recreational" effect.
I mean, it is true most people doing it recreationally are giving themselves mild to severe hypoxia, but that doesn't mean the effect is caused by hypoxia
You don't get half the oxygen. You get as much oxygen as you would during normal calm breathing, which is pretty shallow. Basically, you take a normal breath, which is about 50% lung volume, and then fill your lung up to max capacity with n2o.
But you know what? Pulse oximeters are pretty cheap nowadays. Try it for yourself.
As a Neuroscientist and breathwork facilitator, do you think there is any harm in intentional apnea (e.g. free diving, static holds, ect)?
At what point does cell damage (not necessarily death), kick in? As someone involved in these sports, I operate under the assumption that any damage would kick in after loss of consciousness. For example, if I hold my breath, even for 4 or 5 minutes but dont pass out, that is an indication I am still in the range of safe practice. Anecdotally, I know many people who have spent their lives doing breathholds, and they dont seem any worse for wear.
Are there any high quality studies that look at potential brain damage prior to loss of consciousness?
Does this help? I am a physicist with interest in these subjects and have always been wary of breathwork because of tetany and the following studies. What do experts closer to this field make of these?
Ref. [2] is especially concerning to me in pushing in any sort of static apnea training or breathwork: "The time to complete the interference card test was positively correlated with maximal static apnea duration (r = 0.73, p < 0.05) and the number of years of breath-hold diving training (r = 0.79, p < 0.001)."
So the tetany in breathwork is generally caused by the decreased CO2 concentration causing respiratory alkalosis (ie blood gets more alkaline and has a ph balance of > 7.5), which in turn causes the protein albumin to bind more strongly to calcium and not release it as it's supposed to, and calcium is an important regulator in voltage gated ion channels in neurons.
Long story short, your neurons get just a tad bit more excitable because calcium that usually acts like the bouncer to the hot club is busy snogging albumin. That has very little effect in places in the body, but in motor neurons that control your smallest muscles (face and hand), and in sensory neurons under your skin it does move the needle — that causes the muscles to contract and your skin to feel tingly, both exactly the same cause.
This is the reason people with epilepsy should _NOT_ do breathwork, but for otherwise healthy adults there are no negative long term effects of respiratory alkalosis — a few normal breaths to balance out your co2 and the symptoms will go away.
Could you please explain more about the Ref[2], what does it mean beyond what is in article and how serious is it?
"These findings suggest that breath-hold diving training over several years may cause mild, but persistent, short-term memory impairments"
Can you tell more about recreational nitrous oxide and when does the "damage occur"?
Is there the same thing with wim hof?
(like for example with oximeter 80 Sp02 or below?)
I got in wimhof/oxide around 80 Sp02 the interesting thing is I got this feeling with fighting to hold my breath but below 90 I kinda needed to convince myself that I should breath in both cases,
Being a non-expert I can't attempt to speculate on your questions in good faith! All I was suggesting to the parent is that perhaps these articles offer as evidence of damage being done without pushing to the point of unconsciousness? Feedback is definitely welcome by an expert.
In a medical setting, where I am more familiar with it, tetany is never good. Personally it is also wildly uncomfortable. Perhaps it's fine and somehow pushing through it is part of the "experience", but if I want an altered consciousness I'll stick to a psilocybin-based retreat every 5-10 years and my meditation practice in between :D.
Hyperspell | Backend (Python), NLP, and Data Engineers | https://hyperspell.com | SF + remote in US timezones
Hyperspell is building RAG-as-a-service, allowing developers to build AI apps in minutes, not months — think Plaid for unstructured data. There are many great products for people who want to build their own RAG pipeline. Hyperspell is there for those who don’t.
We have built machine learning & NLP products since way before it was cool. You will join as on of our first engineers working on a technically complex product with many moving parts and lots of things to figure out. That’s okay, because you’re an excellent figurer-outer. In fact, that’s what you’re world class at (at least) two things: you like figuring things out.
Say hello at jobs@hyperspell.com and tell us about yourself. We‘ll write back.
Honestly... chatGPT kind of wins this one.