Stable Diffusion AI Creates Dream Worlds for VR and Metaverse

Similar to what smartphone cameras accomplished for photography, generative AI is likewise the cornerstone for the further spread of 3D content. Current generative AI systems, in the opinion of well-known Silicon Valley venture capital firm Sequoia Capital, are the forerunners of a computing revolution.

First Preview of Generative AI in VR Utilizing Stable Diffusion

Currently, a developer is leveraging a VR environment created by the open-source Stable Diffusion to show the possibilities of generative AI.

Stable Diffusion and the Touchdesigner programming language are combined by the creator to create what he refers to as an “immersive latent space in real time.” He reveals further improvements and cites the subsequent video as evidence of the technology’s potential in the future. You can roam about freely in the virtual reality world of Stable Diffusion, according to the developer.

The creator claims that a side effect of the current Stable Diffusion implementation is that items in the video permanently alter when you stare at them for a prolonged period of time. The picture AI creates a fresh version of an object after assuming that it could have drawn it more accurately with more time to spare.

There are still a lot of technical issues that need to be resolved, particularly with geometry and the merging of various camera locations. This ideal system is a generative AI that builds 3D environments from any given footage. There may have already been tests with this, but it would be wonderful if it managed to escape the lab like Stable Diffusion did.

Stable Diffusion for VR Panoramas