Backhand-View-Based Continuous-Signed-Letter Recognition Using a Rewound Video Sequence and the Previous Signed-Letter Information
บทความในวารสาร
ผู้เขียน/บรรณาธิการ
กลุ่มสาขาการวิจัยเชิงกลยุทธ์
รายละเอียดสำหรับงานพิมพ์
รายชื่อผู้แต่ง: Chophuk P., Chamnongthai K.
ผู้เผยแพร่: Institute of Electrical and Electronics Engineers
ปีที่เผยแพร่ (ค.ศ.): 2021
วารสาร: IEEE Access (2169-3536)
Volume number: 9
หน้าแรก: 40187
หน้าสุดท้าย: 40197
จำนวนหน้า: 11
นอก: 2169-3536
eISSN: 2169-3536
ภาษา: English-Great Britain (EN-GB)
ดูในเว็บของวิทยาศาสตร์ | ดูบนเว็บไซต์ของสำนักพิมพ์ | บทความในเว็บของวิทยาศาสตร์
บทคัดย่อ
In sign language, when signed letters are continuously spelled based on backhand view, a previous signed letter influences the trajectory of hand and fingers approaching the pause duration for signing the current signed letter. Since those varied trajectories are regarded as parts of the current signed letter, hand gesture during pause duration of the current signed letter is regarded as insufficient for recognition of the current signed letter. The previous signed letters, and trajectories of hand and fingers between the previous and the current signed letters should be included as data for classification. This paper proposes a method of backhand-view-based continuous-signed-letter recognition using a rewound video sequence with previous signed letter. In the method, a hand shape of previous signed letter and trajectories of finger joints moving from the previous signed letter to the current one are detected, features are then extracted, and finally, the features are classified for signed letter recognition. To evaluate performance of the proposed method, experiments with 10 participants were performed 20 times each, and the results revealed 96.07% accuracy approximately which were improved significantly from the conventional methods using forehand and backhand. © 2013 IEEE.
คำสำคัญ
backhand view, Continuous signed letter, LSTM, previous signed-letter, rewound video
ติดต่อสอบถามเพิ่มเติมได้ที่