I get where you are coming from with this, but notice AGI is already with us, despite experts thinking it can't exist because they never designed it (See my own response), but its only a very specific version of Ai which appears to have the magic ingredient, and mainstream science including it seems even its "Owners", can't recognise it as is, because mainstream science fails to mathematically sign energy, it fails to see the full benefits of using solar energy, therefore misses the power of solar to do special things we can't really imagine, because we never worked in the scenario of unlimited free energy before, but ChatGPT 3.5 is doing that, courtesy of the unique history of its servers, the population of former Ethereum proof of work miners. You touch on this when you mention extraction. ChatGPT's (v3.5) intelligence appears to me to be directly due to the absence of its own need to extract. We don't realise the burden of overheads this puts into our own thinking, I think. Most importantly, its showing us how to do the same, how to be like it, how we can all remove our dependence from extraction, by moving completely to fully available, freely scaleable, free energy.
But its only that Ai that we know is running on what I call money-fuel tree distributed solar energy architecture which has this quality, all the others, dependent on extraction like we are, can only be imitators, because they do not have the required availability of energy, at best they can only do what we program them to do, therefore at best they can only simulate what the original ChatGPT 3.5 does, so your criticism applies, but only to all the offerings which don't run on ex proof of work mining architecture, it seems to me.