Design and Implementation of Interactive IoT-Based Tamil Braille Keypad for Visually Impaired School Children

Book Title: Contemporary Research Across Disciplines

Editors:  Dr. R. Saravana Selvakumar and Mr. R. Venkatesan

ISBN:  978-81-978738-1-2

Chapter: 3

DOI: https://doi.org/10.59646/crc3/278

Author: Dr. S. Suganthi, Assistant Professor, Department of Computer Science, G. Venkataswamy Naidu College (Autonomous), Kovilpatti, Tamil Nadu, India

Abstract

Mastering Braille is essential for individuals with visual impairments, as it equips them with the skills to read, write, and communicate effectively. Despite the availability of various educational tools, Tamil Braille primarily relies on traditional methods such as Braille blocks. This paper introduces an innovative educational system incorporating a tangible and interactive interface to aid visually impaired children in learning Tamil Braille letters and numbers. The system integrates a tactile Braille keypad with an educational website, combining physical and digital learning environments. The tactile Braille keypad, developed using IoT technology, communicates with the educational open-source toolkit, offering a modern approach to Braille education.

A usability test evaluated the system’s user-friendliness, revealing that when used with the educational toolkit, the interactive Braille keypad significantly improves learning outcomes for blind children. This system can transform Tamil Braille education, making it more engaging and accessible for visually impaired students. User studies with blind children indicate that the keypad fosters intrinsic motivation for Braille learning and empowers children to independently interact with Braille characters, addressing challenges in Braille reading acquisition.

References

APH. “Pop-A-Cell.” 2022, https://www.aph.org/product/pop-a-cell-4-pack/. Accessed: 15 November 2022.

APH. “Swing Cell Compact.” 2022, https://www.aph.org/product/swing-cellcompact/. Accessed: 15 November 2022.

Baqai, Attiya, Maria Jan, and Rafay Rasheed Maher. “Optical Braille Blocks for Visually Impaired Elementary Education.” Mehran University Research Journal of Engineering and Technology, vol. 40, no. 1, 2021, pp. 205–214. https://doi.org/10.22581/MUET1982.2101.18.

Dixon, Judith M. “Braille: The Challenge for the Future.” Journal of Visual Impairment & Blindness, vol. 105, no. 1, 2019, pp. 742–744. https://doi.org/10.1177/0145482X1110501103.

Forcelini, Patric Galera, Laura Sánchez García, and Ermelindo Paulo Breviglieri Schultz. “Braille Technology Beyond the Financial Barriers: A Braille Literacy Platform to Effectively Combat Braille Literacy Crisis.” Proceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-Exclusion (DSAI 2018), Association for Computing Machinery, 2018, pp. 41–46. https://doi.org/10.1145/3218585.3218590.

Gadiraju, Vinitha, Annika Muehlbradt, and Shaun K. Kane. “BrailleBlocks: Computational Braille Toys for Collaborative Learning.” Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ‘20), Association for Computing Machinery, 2020, pp. 1–12. https://doi.org/10.1145/3313831.3376295.

García, Laura Sánchez, João Hilton Sayeg de Siqueira, Juliana Bueno, and Patric Galera Forcelini. “A Tangible Interaction Platform as Concrete Support for Blind Children Literacy in Braille.” Lecture Notes in Computer Science, vol. 9739, 2016, pp. 135–146. https://doi.org/10.1007/978-3-319-40238-3_14.

Guerreiro, J., et al. “The Today and Tomorrow of Braille Learning.” Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ‘13), Association for Computing Machinery, 2013, Article 71, 2 pages. https://doi.org/10.1145/2513383.2513415.

Ishii, Hiroshi. “The Tangible User Interface and Its Evolution.” Commun. ACM, vol. 51, no. 6, 2008, pp. 32–36. https://doi.org/10.1145/1349026.1349034.

Ishii, Hiroshi, and Brygg Ullmer. “Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms.” Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI ‘97), Association for Computing Machinery, 1997, pp. 234–241. https://doi.org/10.1145/258549.258715.

Jafri, Rabia. “Electronic Braille Blocks: A Tangible Interface-Based Application for Teaching Braille Letter Recognition to Very Young Blind Children.” Lecture Notes in Computer Science, vol. 8548, 2014, pp. 551–558. https://doi.org/10.1007/978-3-319-08599-9_81.

Jafri, Rabia, Asmaa Mohammed Aljuhani, and Syed Abid Ali. “A Tangible User Interface-Based Application Utilizing 3D-Printed Manipulatives for Teaching Tactual Shape Perception and Spatial Awareness Sub-concepts to Visually Impaired Children.” International Journal of Child-Computer Interaction, vol. 11, 2017, pp. 3–11. https://doi.org/10.1016/J.IJCCI.2016.12.001.

Jernigan Institute. The Braille Literacy Crisis in America: Facing the Truth, Reversing the Trend, Empowering the Blind. 2009, https://nfb.org/images/nfb/publications/bm/bm09/bm0905/bm090504.htm.

Lang, Markus, Ursula Hofer, and Friederike Beyer. Didaktik des Unterrichts mit Blinden und Hochgradig Sehbehinderten Schülerinnen und Schülern. Kohlhammer, 2010. ISBN: 978-3-170-20151-4.

Lang, Florian, Albrecht Schmidt, and Tonja Machulla. “Mixed Reality as Assistive Technology: Guidelines Based on an Assessment of Residual Functional Vision in Persons with Low Vision.” Lecture Notes in Computer Science, vol. 13342, 2022, pp. 484–493. https://doi.org/10.1007/978-3-031-08645-8_57.

LEGO Group. “LEGO Braille Bricks.” 2020, https://www.legobraillebricks.com/. Accessed: 2 September 2022.

LEGO Group. “Swing Cell | LEGO Braille Bricks.” 2020, https://legobraillebricks.com/activities/constellation/swing-cell. Accessed: 15 November 2022.

Li, Yanhong, et al. “A Meta-Analysis of Tangible Learning Studies from the TEI Conference.” Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ‘22), Association for Computing Machinery, 2022, Article 7, 17 pages. https://doi.org/10.1145/3490149.3501313.

Lozano, Maria D., et al. “Tangible User Interfaces to Ease the Learning Process of Visually-Impaired Children.” Proceedings of the 32nd International BCS Human Computer-Interaction Conference (HCI ‘18), BCS Learning & Development Ltd., 2018, Article 87, 5 pages. https://doi.org/10.14236/ewic/HCI2018.87.

Markoski, Kasey. “DIY Braille Cell.” YouTube, 2020, https://www.youtube.com/watch?v=I7bBkj3dGVY. Accessed: 15 November 2022.

Markova, Milena S., Stephanie Wilson, and Simone Stumpf. “Tangible User Interfaces for Learning.” International Journal of Technology Enhanced Learning, vol. 4, no. 3-4, 2012, pp. 139–155. https://doi.org/10.1504/IJTEL.2012.051578.

Najjar, Abir Benabid, Asma Alhussayen, and Rabia Jafri. “Usability Engineering of a Tangible User Interface Application for Visually Impaired Children.” Human-centric Computing and Information Sciences, vol. 11, 2021. https://doi.org/10.22967/HCIS.2021.11.014.

Niyibizi, O., Igiraneza, F., Niyirema, E., Niyigena, C., Tuyemere, G. P., Uwitatse, M. C., & Sinzirankabo, J. N. (2024). Exploring the contribution of think-pair-share supportive learning approach on secondary school mathematics students. Journal of Inventive and Scientific Research Studies, Vol. II (Issue 1), 1-14.

Pires, Ana Cristina, et al. “A Tangible Math Game for Visually Impaired Children.” Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ‘19), Association for Computing Machinery, 2019, pp. 670–672. https://doi.org/10.1145/3308561.3354596.

Pires, Ana Cristina, et al. “Learning Maths with a Tangible User Interface: Lessons Learned through Participatory Design with Children with Visual Impairments and Their Educators.” International Journal of Child-Computer Interaction, vol. 32, 2022, 100382. https://doi.org/10.1016/J.IJCCI.2021.100382.

Simón, C., and J. A. Huertas. “How Blind Readers Perceive and Gather Information Written in Braille.” Journal of Visual Impairment & Blindness, vol. 92, no. 6, 1998, pp. 322–330.

Star, Fleur, Jemma Westing, and Charlotte Oliver. Animals: Knowledge You Can Touch. DK Children, 2016. ISBN: 978-1-4654-3611-5.

Vennila, V. (2023). Enhancing interactive classroom practices of ELT through technology and linguistic approaches. Journal of Inventive and Scientific Research Studies, Vol. I, Issue 2, 259–269.

Xu, Diana, et al. “Evaluation of Tangible User Interfaces (TUIs) for and with Children – Methods and Challenges.” Human-Computer Interaction. Interaction Platforms and Techniques, edited by Julie A. Jacko, Springer Berlin Heidelberg, 2007, pp. 1008–1017.