Hand Gesture Recognition Using Frequency‐Modulated Continuous Wave Radar on Tactile Displays for the Visually Impaired

Touchscreens are essential parts of many electronics in daily lives of sighted people in the digital information era. On the other hand, visually impaired users rely on tactile displays as one of the key communication devices to interact with the digital world. However, due to their working mechanism and the uneven surface of tactile displays, one of the key features of screens for sighted users is surprisingly challenging to implement: precision touch input. To overcome this, a hand gesture recognition system is developed using a frequency‐modulated continuous wave millimeter‐wave radar. A multifeature encoder method is used to obtain the range and velocity information from the radar to translate the data into spectrogram images. Gesture recognition is implemented for common input gestures: single/double‐click, swipe‐right/left, scroll‐up/down, zoom‐in/out, and rotate‐anticlockwise/clockwise. The gesture recognition and classification are based on machine learning, support vector machines, deep learning, and convolutional neural network approaches. The chosen model You‐Only‐Look‐Once (YOLOv8) shows a high accuracy of 97.1% by iterating only 30 epochs with only 500 collected data samples per gesture. This research paves the way toward using radar sensors not only for tactile displays but also for other digital devices in human–computer interaction.

Location
Deutsche Nationalbibliothek Frankfurt am Main
Extent
Online-Ressource
Language
Englisch

Bibliographic citation
Hand Gesture Recognition Using Frequency‐Modulated Continuous Wave Radar on Tactile Displays for the Visually Impaired ; day:15 ; month:12 ; year:2024 ; extent:7
Advanced intelligent systems ; (15.12.2024) (gesamt 7)

Creator
Hamza, Ahmed
Prabhulingaiah, Santosh Kumar
Pezeshkpour, Pegah
Rapp, Bastian E.

DOI
10.1002/aisy.202400663
URN
urn:nbn:de:101:1-2412161307228.566929706039
Rights
Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
Last update
15.08.2025, 7:30 AM CEST

Data provider

This object is provided by:
Deutsche Nationalbibliothek. If you have any questions about the object, please contact the data provider.

Associated

Other Objects (12)