Google Research shows expressions Fri-wearer in mixed reality




Daydream Labs and Google Research experimenting with technology to show outsiders what a person sees with VR glasses virtual reality, including the facial expressions of the person. They “remove” in the mixed reality rendering the VR goggles.

According to Google, it is a problem that you can not see what looks a VR glasses wearer and is also an obstacle that several people in a VR environment can not see each other’s facial expression. With avatars that can last, but Google test with mixed reality in order to arrive at a representation in which virtual reality, and the actual person are combined.

The researchers generated before with a camera a 3D model of a person’s face, which takes less than a minute. They then build a database of phrases like viewing directions and eyeblinks by users to watch a moving dot on the screen.

For the mixed reality images take a camera simply the user for a greenscreen up to then project onto the background displaying the virtual reality world. A marker on the headset helps calibration between camera and VR goggles. By this calibration, the 3D face model can be placed on the VR goggles, even if the user moves his head.

The HTC Vive used by the researchers are oogtrackingtechnieken processed by SMI. The information from these sensors is connected to the database of eye movements, allowing a real-time representation of the eyes on the VR glasses can be placed. Google uses 3D of vision and machine learning technology to carry light and other adjustments to make more natural playback.

Daydream Labs and Google Research expect that social interaction will increase in VR environments. Their experiments to make less prominent the headset can help natural reproduction of video conferencing and gaming Fri, so expect them.


In: A Technology & Gadgets Asked By: [22034 Red Star Level]

Answer this Question

You must be Logged In to post an Answer.

Not a member yet? Sign Up Now »