I agree with your point of view. I did some work on AR ad VR, from 2014, arguably to date, intending to market a remotely operated UAV (Civilian / commercial), based on continuous scanning of the real world into a unified virtual world, building that up over time, such that we could control the UAV from the virtual replication of the real world, regardless of our relative position in the real world, as it appeared in the virtual world. The same virtual world would then be accessible and modified also by head mounted wearables (Glasses), also continuously scanning like the UAV, giving us superhuman like powers of being able to see through buildings etc, even at night. My research on virtual worlds was redirected when it became apparent that a unified virtual world was not really possible, as long as it had to be for profit, with the energy for paying utilities bills etc coming from users, which in turn ultimately had to come extracted from Earth, this now being confirmed to be unsustainable in both real and virtual worlds, resulting already in a burning planet, my efforts have turned towards doing what I can to help fix this problem in the real world, so that it might be followed through to virtual worlds. The only sustainable answer in terms of energy is for all real world communities, and thus all servers to be solar powered, monetising this at market energy rates by exchange of hydrogen fuel, enabling funds to be distributed in both the real and virtual worlds, removing the need for all users to obtain energy originally extracted from Earth. Sounds crazy maybe but it makes perfect sense when we put it all together with formal systems Engineering tools and techniques (I was already a long practicing systems Engineer).

Anyhow, suffice to say that defeating the energy problem in the real world, will automatically enable what you described, I think. But similarly, if we fail to fix the real world problem, none of it at all will happen,