A 3D-CNN Siamese Network for Motion Gesture Sign Language Alphabets Recognition
Conference proceedings article
ผู้เขียน/บรรณาธิการ
กลุ่มสาขาการวิจัยเชิงกลยุทธ์
รายละเอียดสำหรับงานพิมพ์
รายชื่อผู้แต่ง: Jirathampradub H., Nukoolkit C., Suriyathumrongkul K., Watanapa B.
ผู้เผยแพร่: Hindawi
ปีที่เผยแพร่ (ค.ศ.): 2020
ชื่อชุด: IAIT
เลขในชุด: 11
Volume number: 1
หน้าแรก: 1
หน้าสุดท้าย: 6
จำนวนหน้า: 6
ISBN: 9781450377591
นอก: 0146-9428
eISSN: 1745-4557
ภาษา: English-Great Britain (EN-GB)
บทคัดย่อ
Sign language recognition is developed for assisting hearing-and speech-impaired people who communicate with others by using hand gestures as a nonverbal communication. The system aims to translate still images or video frames of sign gestures to a corresponding message, word or alphabet of a designated language. For the American Sign Language (ASL), there are alphabets of J and Z out of 26 letters which require motion gesture and cannot be recognized using static 2-dimension images as usually possible for the others. Their starting gesture also causes a confusion with the other alphabets, esp. I and D. Samples of these two alphabets J and Z, are scarce. This paper developed a n-shot 3D-CNN deep learning Siamese network model to recognize J and Z and address the said problems. Two experiments were conducted to give insight into the performance of the proposed 3D-CNN Siamese network and the improvement using regularization and dilation techniques. The effect of the number of shot in the Siamese model to the performance of the recognition is also provided in the second experiment. © 2020 ACM.
คำสำคัญ
3D-Convolutional Neural Network, American Sign Language
ติดต่อสอบถามเพิ่มเติมได้ที่