Article’s

Gesture Recognition and Translate into Regional Language System

Pranav Daithankar

(07 – 2026)

DOI:

 

Communication through hand gestures is a natural and intuitive form of human interaction, yet individuals with speech and hearing impairments face significant barriers in expressing themselves to the general public who may not understand sign language. Traditional sign language interpretation requires human translators, which is costly, limited in availability, and unsuitable for real-time, everyday communication. To address these challenges, this paper proposes an automated Gesture Recognition and Translate into Regional Language System that integrates flex sensor-based finger gesture detection with accelerometer-based hand movement tracking. The system employs an Arduino Nano microcontroller to process sensor data and recognizes predefined gestures corresponding to letters, words, or phrases. Recognized gestures are translated into regional languages such as Hindi, Marathi, Tamil, or Kannada and displayed on a 16×2 LCD screen. An optional audible output provides spoken translation for enhanced accessibility. By combining flex sensors for finger bending detection and an accelerometer for hand orientation, the system achieves accurate, low-cost, and real-time gesture recognition suitable for daily use. This portable, cost-effective, and user-friendly solution is ideal for hearing and speech-impaired individuals, classroom settings, and public assistance centers.

 

 

Scroll to Top