Google's Project Gameface hands-free 'mouse' launches on Android

At last year's Google I/O developer conference, the company introduced Project Gameface, a hands-free gaming "mouse" that allows users to control a computer's cursor with movements of their head and facial gestures. This year, Google has announced that it has open-sourced more code for Project Gameface, allowing developers to build Android applications that can use the technology. 

The tool relies on the phone's front camera to track facial expressions and head movements, which can be used to control a virtual cursor. A user could smile to "select" items onscreen, for instance, or raise their left eyebrow to go back to the home screen on an Android phone. In addition, users can set thresholds or gesture sizes for each expression, so that they can control how prominent their expressions should be to trigger a specific mouse action. 

The company developed Project Gameface with gaming streamer Lance Carr, who has muscular dystrophy that weakens his muscles. Carr used a head-tracking mouse to game before a fire destroyed his home, along with his expensive equipment. The early version of Project Gameface was focused on gaming and uses a webcam to detect facial expressions, though Google had known from the start that it had a lot of other potential uses. 

For the tool's Android launch, Google teamed up with an Indian organization called Incluzza that supports people with disabilities. The partnership gave the company the chance to learn how Project Gameface can help people with disabilities further their studies, communicate with friends and family more easily and find jobs online. Google has released the project's open source code on GitHub and is hoping that more developers decide to "leverage it to build new experiences."

Catch up on all the news from Google I/O 2024 right here!

This article originally appeared on Engadget at https://www.engadget.com/googles-project-gameface-hands-free-mouse-launches-on-android-123029158.html?src=rss https://www.engadget.com/googles-project-gameface-hands-free-mouse-launches-on-android-123029158.html?src=rss
Created 19d | May 15, 2024, 12:40:07 PM


Login to add comment

Other posts in this group

Breville InFizz Fusion review: The bubble master

A long time ago I watched ">a video about John Nese, owner of the iconic Galco’s Soda Pop Stop in LA, and one thing

Jun 3, 2024, 7:40:22 PM | Engadget
Leaked Google database reveals its secret privacy and security failures

A collection of leaked internal Google privacy cases provides a rare glimpse into the company’s volume and handling of breaches, accidents and other incidents.

Jun 3, 2024, 7:40:21 PM | Engadget
Sony's PS VR2 adaptor for PC will arrive on August 7 with a $60 price tag

Sony revealed earlier this year that it was working on a way to make the

Jun 3, 2024, 5:30:21 PM | Engadget
Our favorite mesh Wi-Fi router system is on sale for a record-low price

The TP-Link Deco AXE5400 WI-Fi mesh router system is on

Jun 3, 2024, 5:30:20 PM | Engadget
Sonos Ace headphones review: An impressive but incomplete debut

When Dolby made a play for the headphones market in 2018, its tech-packed Dime

Jun 3, 2024, 3:20:07 PM | Engadget
NVIDIA's latest AI feature is in-game help

If you've ever wanted an AI assistant to do make sure your PC is optimized for whatever game you're playing, NVIDIA may have the answer. The company is showing off a new demo called

Jun 3, 2024, 3:20:06 PM | Engadget