Artificial intelligence face-tracking for a semi-virtual reality gaming experience

Virtual reality (VR) and VR-like experiences are important because they create immersive environments that can enhance learning, training, and community in new ways. We explored the effect of artificial intelligence (AI) face-tracking technology on the immersiveness of video games. AI face-tracking works by tracking horizontal movements of a player’s head that allows for rotation of the game point of view based on the player’s head position. Virtual reality offers the most immersive gaming experience but is out of reach for many players because of the high cost of VR goggles. We hypothesized that AI face-tracking offers a semi-VR experience at a lower price. To determine if applying AI face-tracking technology increases immersiveness, we conducted two experiments on participants to consider both subjective and objective criteria. For the subjective test, participants played a video game both with and without AI face-tracking and rated each experience. For the objective test, participants played a different video game with a loud sound and flash of light. They were randomly assigned to one group with or without face-tracking. We monitored changes to heart rate with Fitbit devices to approximate the immersiveness the player felt. Players who experienced the “scare” in the game with face-tracking had a higher average increase in heart rate compared to those who played the game without face-tracking. In the subjective survey, we saw that participants felt more immersed with the face-tracking. Our data suggests that AI face-tracking technology increases the immersiveness of gaming and offers a more cost-effective alternative to VR.