California programmers working on a system for the recognition of emotions Oculus Rift

Hao Li, an assistant professor at the University of Southern California, published his work to draw down additional realism to the virtual world. He руководит development of , whereby Oculus Rift, head-mounted display, can real-time считывать facial expressions by .

Since ancient times the main computer means of transmitting emotions were smiles. Then came webcams and video chats, you can freely see companion. But what if you nebhodimo transmit facial expressions in virtual reality? Or recognize emotions to use this information to draw the game avatars?

Of course, the face recognition system for video there . That's just this task is much more complicated when using virtual reality glasses - such as the Oculus Rift. The massive unit closes 2/3 persons - in the best case, the camera will see the user's mouth. What to do?

The answer is found Hao Li - programmer, researcher and fashion model , who was born in Germany and has a Taiwanese roots. With a team of like-minded people, and under the strict auspices of the social network Facebook (Oculus bought the project in 2014), they have developed a system of recognition of facial expressions for users Oculus Rift.



The lower part of the face the camera recognizes. The prototype camera using Intel RealSense 3D, Sticky on a massive holder for points. Perhaps the end device can be arranged in a miniature camera bottom points. Work facial muscles of the upper part of the face recognizing eight strain gauges (strain gauges), built on the perimeter of the seal into the soft points. Judging from the video, the system works fairly accurately.

With this system, we can convey emotions on your avatar in virtual chat rooms and games, or to take into account facial expressions, for example, when talking to the NPC. The system complements the new virtual reality realistic detail.



Of course, there are disadvantages in the prior art. Also mentioned inconvenient mounting the camera (that is solved), while there is the need for an initial "calibrating" a specific user - you will have a few smileys Scorch system to correlated real data specific person with their templates. But this phase of the developers hope to eliminate in the future, when will gain a decent base "grimaces" from different people.

Another feature - the system requirements. Himself Oculus Rift требователен to iron , and this system, of course. For normal operation at a rate of 30 FPS will need Core i7-4820K, 32GB RAM and a GTX 980.

The system is not likely to appear together with the first copy of the glasses, which, after a long development, will be available in начале next year .

Source: geektimes.ru/post/250834/