Real-Time Translation of Indian Sign Language using LSTM

Ebey Abraham, Akshatha Nayak, Ashna Iqbal

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Sign language is the only medium of communication for the speech-impaired community while the rest of the population communicate verbally. This project aims to bridge this communication gap by proposing a novel approach to interpret the static and dynamic signs in the Indian Sign Language and convert them to speech. A sensor glove, with flex sensors to detect the bending of each finger and an IMU to read the orientation of the hand, is used to collect data about the actions. This data is then wirelessly transmitted and classified into corresponding speech outputs. LSTM networks were studied and implemented for classification of gesture data because of their ability to learn long-term dependencies. The designed model could classify 26 gestures with an accuracy of 98%, showing the feasibility of using LSTM based neural networks for the purpose of sign language translation.

    Original languageEnglish
    Title of host publication2019 Global Conference for Advancement in Technology, GCAT 2019
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    ISBN (Electronic)9781728136943
    DOIs
    Publication statusPublished - 10-2019
    Event2019 Global Conference for Advancement in Technology, GCAT 2019 - Bangalore, India
    Duration: 18-10-201920-10-2019

    Publication series

    Name2019 Global Conference for Advancement in Technology, GCAT 2019

    Conference

    Conference2019 Global Conference for Advancement in Technology, GCAT 2019
    CountryIndia
    CityBangalore
    Period18-10-1920-10-19

    All Science Journal Classification (ASJC) codes

    • Computer Vision and Pattern Recognition
    • Energy Engineering and Power Technology
    • Control and Optimization
    • Artificial Intelligence
    • Computer Networks and Communications
    • Computer Science Applications

    Fingerprint Dive into the research topics of 'Real-Time Translation of Indian Sign Language using LSTM'. Together they form a unique fingerprint.

  • Cite this

    Abraham, E., Nayak, A., & Iqbal, A. (2019). Real-Time Translation of Indian Sign Language using LSTM. In 2019 Global Conference for Advancement in Technology, GCAT 2019 [8978343] (2019 Global Conference for Advancement in Technology, GCAT 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/GCAT47503.2019.8978343