Nvidia-ai generates working driving simulator based on real images




It has been possible for a while to use ai to make renders. Nvidia has achieved a breakthrough in this area. The company has succeeded in making the first video game demo with ai-generated graphics, based on existing video images.

Nvidia reports that it has trained the applied artificial intelligence on existing video images. The final demo is a simple driving simulator, where disembarkation or other interactions with the world are not possible. Even the graphics are not great, but the result is pretty special.

According to The Verge , the software developers of Nvidia de ai have partly based on Pix2Pix . This open source system attempts to convert drawings into lifelike portraits and was developed by order of the Dutch Public Broadcasting. In addition, Nvidia’s ai uses a general adversarial network algorithm.

The process of rendering starts with the collection of visual material. Subsequently, it is divided into different frames, each with its own category, such as the trees, the sky and buildings. The general adversarial network is then allowed to analyze the frames, after which it generates its own version of the frames. Nvidia Tesla V100 GPUs were used for training the AI; according to Nvidia, creating the driving simulator was not possible without Tensor cores.

In these ways, the developers have created a virtual environment using an engine, in this case the Unreal Engine 4. The deep learning algorithms use this environment to generate graphics for each category in real time and these on the engine created by the engine. paste models.

To show the demo, a single, very powerful gpu was used: the Titan V. Nevertheless, the frame rate remains at 25 frames per second and the ai change the textures per frame. It is not very nice to watch, but Nvidia emphasizes that the technology is still in its infancy. Bryan Cantazaro, vice president of Nvidia’s Applied Deep Learning Department, says it can take decades to get to the market.


In: A Technology & Gadgets Asked By: [23225 Red Star Level]

Answer this Question

You must be Logged In to post an Answer.

Not a member yet? Sign Up Now »