Skip to main content

Phones could one day identify you by your grip

Your phone might one day stay safe from thieves by identifying you by your grip.

Researchers at Louisiana State University have found a way to use artificial intelligence (A.I.) to help phones analyze how users are holding them. The method could help determine if the phones are in the hands of their owners or someone else’s, according to a new study.

“A.I. has a strong capability to learn and identify a user’s biometric features, especially when there are not many dedicated or high-fidelity sensors available on mobile phones,” computer science professor Chen Wang, one of the study’s authors, said in an interview.

Know thyself

mbile trends FaceID
Elijah Nouvelage/Getty Images

Wang’s invention works when you grip your phone. The phone’s mic records the sound when a notification tone is played. An A.I.-based algorithm processes the sound and extracts biometric features to match the user’s feature profile or recorded hand grip. If there is a match, the verification is successful, and the notification preview is displayed on the screen. Otherwise, only the number of notifications pending is shown.

Because people have different hand sizes, finger lengths, holding strengths, and hand shapes, the impacts on sounds are different and can be learned and distinguished by A.I., Wang said. Researchers call these body measurements and calculations related to human characteristics biometrics.

Because people have different hand sizes, finger lengths, holding strengths, and hand shapes, the impacts on sounds are different and can be learned and distinguished by A.I.

“A.I. provides a way to leverage the readily available and low-cost sensors on mobile devices, such as cameras, microphones, touchscreen, and motion sensors, to identify a user,” he added. “In addition to the traditional physiological biometrics, such as the face, iris, and fingerprint, A.I. is also good for extracting behavioral biometrics, including body motions, finger gestures, signatures, hand movements, voices, and gait patterns, which are believed harder to replicate by an adversary.”

Man holding the iPhone 13 Pro showing its rear panel.
Dan Baker / Digital Trends

In an interview, Dan Simion, the vice president of AI & Analytics at the technology firm Capgemini Americas said that A.I. is useful for recognizing users because it can make up for human weaknesses.

“In many cases, recognition is based on security codes or passwords to determine if something like a phone does in fact belong to that particular person,” he added. “But the concern and limitation with using things like security questions are that they can be stolen, or passwords can be forgotten by users. A.I. is useful as an alternative because it’s eliminating the risk of those limitations.”

A.I. for recognition

You’ve probably already encountered A.I. identification. Many forms of A.I. are used to recognize users including facial recognition, voice recognition, and fingerprints, Simion said. The technology is used for accessing mobile phones and it may soon find its way into other gadgets like wearables, he added.

“For example, if the person’s heart rate is much higher than usual, or their activity level is much lower, the A.I. can recognize those anomalies because they don’t fit with the cognitive patterns of the normal device owner.”

OnePlus 10 Pro seen from the side.
Andy Boxall/Digital Trends

However, A.I. recognition still has its drawbacks. Wang said most A.I.-based user recognition methods still require the user to actively input biometric data. That won’t work when the user’s participation is not immediate, such as when the device is shared with friends or family members or when a message notification automatically shows up on the locked screen.

Also, biometrics are subject to what researchers call replay attacks. For example, an adversary could physically forge the user’s face, fingerprint, and iris based on 3D printing, and A.I. can also be exploited to replicate the user’s face, voice, and other biometrics digitally.

A.I. will increasingly be used to classify behavior patterns to determine whether those patterns represent nefarious behavior or determine whether a system is under attack.

According to Dave Maher, a blockchain and secure computing expert and the CTO of Intertrust, said in an interview, in the future, A.I. that tracks patterns will be used to detect cyber threats. A.I. will increasingly be used to classify behavior patterns to determine whether those patterns represent nefarious behavior or determine whether a system is under attack.

One example is the Mirai botnet, which Maher compared to a mutating virus that infects IoT systems. The botnet can marshall large numbers of devices to attack the networks that those devices are members of.

“A.I. will be used to identify the viruses and their mutant counterparts,” Maher said.

Another project Chen is working on could make sure your shopping is safer. This system uses a phone-gripping hand for verification at kiosks, such as the self-checkout at a grocery store.
When a user holds a phone close to the kiosk for NFC-based or QR-code authentication, the back of the user’s gripping hand is captured by a camera on the booth.

“An A.I.-based method will process the gripping-hand image and compare it against the user’s registered hand image by checking the gripping hand’s shape, skin patterns/color, and gripping gesture,” Chen added.

Editors' Recommendations

Sascha Brodsky
Sascha Brodsky is a writer who focuses on consumer technologies and privacy issues for a broad range of outlets. He’s been…
No, the Journal app on your iPhone isn’t spying on you
Apple Journal app on an iPhone 15 Pro.

If you've spent any time on Facebook, TikTok, or any other social media site over the last couple of days, there's a chance you've seen people claiming that your iPhone is spying on you — specifically, with a feature called "Journaling Suggestions."

One post I stumbled across on Facebook made it sound rather frightening, warning me that the feature shares my FULL NAME and EXACTLY where I'm located to anyone nearby. The post told me to go and toggle the setting off immediately because it was "Very scary stuff!!"

Read more
If you like Genshin Impact, you’ll love this new OnePlus phone
OnePlus 12R Genshin Impact Edition.

OnePlus has just unveiled a special, limited edition OnePlus 12R. It's the new Genshin Impact Edition, and it was announced during MWC 2024. This special edition version of the OnePlus 12R has been tailor-made for fans of Genshin Impact with a unique design that showcases Keqing. The Keqing theming is not just on the hardware itself but through a fully customized version of OxygenOS, accessories, and bonus extras that any Genshin Impact fan will appreciate.

According to OnePlus President and COO Kinder Liu, the collaboration with HoYoverse is meant to deliver a gateway to a wider gaming universe without compromising graphics or performance. OnePlus has made sure to push the boundaries of the device to ensure that gamers get uninterrupted high-quality graphics and gameplay with heavy-duty game titles.

Read more
Qualcomm wants to add these crazy AI tools to your Android phone
Qualcomm Snapdragon 8 Gen 3 media asset.

At Mobile World Congress 2024, Qualcomm is adding more to its portfolio of AI-on-phone tricks facilitated by the Snapdragon series silicon for Android phones.  The chipmaker has already showcased some impressive AI capabilities for the Snapdragon 8 Gen 3 flagship, such as voice-activated media editing, on-device image generation using Stable Diffusion, and a smarter virtual assistant built atop large language models from the likes of Meta.

Today, the company is adding more grunt to those AI superpowers. The first is the ability to run a Large Language and Vision Assistant (LLaVa) on a smartphone. Think of it as a chatbot like ChatGPT that has been granted Google Lens abilities. As such, Qualcomm’s solution can not only accept text input, but also process images.

Read more