"just essentially vector algebraic math" -- True, but only in the sense that anything done by a computer is just iterated Boolean logic. Yet, Wikipedia and Grand Theft Auto and Mathematica have emergent properties beyond the obvious things that Boolean logic can do. So the fact that neural networks are based on vector algebra doesn't prove that they aren't capable of impressive things.
I mean to say the there are tons of problems NNs aren’t good for. If we are on the journey to discover GAI super algorithm that is smart enough to learn very quickly without a shit ton of data, I’d say we still have a long way to go.
Anyone claiming they solved cognitive reasoning with a bunch of NNs stacked together in a black box is probably lying to themselves.
