Mobile augmented reality app for children with autism spectrum disorder to enrich vocabulary

pdf (ελληνικά)
Published: Dec 20, 2023
DOI: https://doi.org/10.12681/dial.33934
Keywords:
Augmented Reality Autism Spectrum Disorders Social Skills Vocabulary
Μαρία Κουκουνάρα
Κορνηλία Χατζηνικολάου
Αριστοτέλειο Πανεπιστήμιο Θεσσαλονίκης
https://orcid.org/0000-0002-0364-0041
Abstract

This article is about the use of technology of Augmented Reality (AR) in the field of special education and more specifically tries to enrich vocabulary of children with Autism Spectrum Disorder (ASD). In particular, this work aims to design and develop an educational app “Cardword”, which can be used in the future in the educational process. In order to examine the effectiveness of the application “Cardword”, after using and interacting with the AR application that was designed, the participants replied to personal semi-structed interviews and completed a written, structured questionnaire, which aimed to examine the usability of the application. The app was tested by 3 special users-educators and by 8 preschool children with ASD.  The application “Cardword” was created according to the design principles of constructivism and based on the usability heuristics by Nielsen (1993). The analysis of the data showed that the application “Cardword” can help children with ASD to enrich their vocabulary and can be considered as a valuable tool to achieve that. In conclusion, the AR application has positive results in the learning process, makes the children more engaged and increases their interest in learning.

Article Details
  • Section
  • New researchers
Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Authors who publish with this journal agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution Non-Commercial License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g. post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (preferably in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
Downloads
Download data is not yet available.
References
Abbott, C. (2003). ICT Changing education. Routledge.
Adhani, N. I., & Rambli, D. R. A. (2012). A Survey of Mobile Augmented Reality Applications. In 1st International Conference on Future Trends in Computing and Communication Technologies, 89-96.
Allen,K., Wallace, D., Renes, D., Bowen, S., & Burke, R. (2010). Use of Video Modeling to Teach Vocational Skills to Adolescents and Young Adults with Autism Spectrum Disorders. Education and Treatment of Children, 33 (3), 339-349 https://doi.org/10.1353/etc.0.0101.
Alkhattabi, M. (2017). Augmented reality as e-learning tool in primary schools’ education: Barriers to teachers’ adoption. International Journal of Emerging Technologies in Learning (iJET), 12(2), 91-100.
Al-Thani, D., Othman, A., & Mohannadi, A. (2021). A Learn App: Mobile augmented reality vocabulary learning application. Supported through Mada Innovation Program. Hamad Bin Khalifa University, Mada Center
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-5). Washington, DC: American Psychiatric Publishing.
Angela Di Serio (2013) Impact of an augmented reality system on students' motivation for a visual art course
Azuma, R. T. (1997). A Survey of Augmented Reality. Presence Teleoperators and Virtual Environments, σσ. 355-385.
Βογινδρούκας, Ι., Καραντάνος, Γ., Καμπούρογλου, Μ. & Παπαγεωργίου, Β. (2003). Δοκίμια: Αυτισμός- Διάχυτες διαταραχές της ανάπτυξης. Ίδρυμα για το παιδί «Η Παμμακάριστος».
Bacca, J., Baldiris, S., Fabregat, R., Graf, S., & Kinshuk. (2014). Augmented Reality Trends in Education: A Systematic Review of Research and Applications. Educational Technology & Society, 17(4), 133–149.
Baltaxe (1977). Pragmatic deficit in the language of autistic adolescents, In Journal of Pedriac Psychology.
Billinghurst, M. (2002). Augmented reality in education. New horizons for learning.
Billinghurst, M., & Duenser, A. (2012). Augmented reality in the classroom. Computer, 45(7), 56-63.
Billinghurst, M., Kato, H., & Myojin, S. (2009). Advanced interaction techniques for augmented reality applications. In International Conference on Virtual and Mixed Reality, 13-22. Springer: Berlin, Heidelberg.
Bozkurt, A. (2017). Augmented reality with mobile and ubiquitous learning: immersive,
enriched, situated, and seamless learning experiences. InDigital Tools for Seamless Learning, 27-41. IGI Global.
Bozgeyikli, L. & Katkoori, S. (2018). A Survey on Virtual Reality for Individuals with Autism Spectrum Disorder: Design Considerations. IEEE Tranctions on learning technologies, 133-151.
Bold, S., Golan O., Goodwin, A., S., & Zwaigenbaum L. (2010). What can technologies do for Autism Spectrum Disorders? SAGE Publications and the National Autistic Society, 155-159.
Capo, L. C. (2001). Autism, employment and the role of occupational therapy. A Journal of Prevention, Assessment, and Rehabilitation, 201–207
Carmigniani, J., Furht, B., Anisetti, M., Ceravolo, P., Damiani, E., & Ivkovic, M. (2011). Augmented reality technologies, systems and applications. Multimedia tools and applications, 51.
Chamberlain, B., Kasari, C., & Rotheram-Fuller, E. (2007). Involvement or isolation? The social networks of children with autism in regular classrooms. Journal of Autism and Developmental Disorders, 37, 230–242.
Clark, E. V. (1993). The lexicon in acquisition. Cambridge University Press.
Cohen, L., Manion, L., Morrison, K. (2008). Μεθοδολογία εκπαιδευτικής έρευνας. Νέα συμπληρωμένη αναθεωρημένη έκδοση. Αθήνα: Μεταίχμιο
Cox, M. J., Preston, C., & Cox, K. (1999) What Motivates Teachers to use ICT?. Paper presented at the British Educational Research Association Conference. Brighton.
Δρόσος, Δ., Βουγιούκας, Δ., Καλλίγερος, Ε., Κοκολάκής, Σ. & Σκιάνης, Χ. (2015). Εισαγωγή στην επιστήμη των υπολογιστών & επικοινωνιών. Αθήνα: Σύνδεσμος Ελληνικών Ακαδημαϊκών Βιβλιοθηκών.
da Silva, C. A., Fernandes, A. R., & Grohmann, A.P. (2014). STAR: speech therapy with augmented reality for children with autism spectrum disorders.
In International Conference on Enterprise Information Systems (pp. 379-396). Springer, Cham.
Delello, J. A. (2014). Insights from pre-service teachers using science-based augmented reality. Journal of computers in education, 1(4), 295-311.
Eells, J.M (1978). «Vocabulary Development» In C. Reynolds and L.Mann. Encyclopedia of special education. New York: John Willey & Sons Vol. 3, 1633.
Eriksson, B., Musialik, M., & Wanger, J. (2012). Gamification: engaging the future. University of Gothenbur
Escobedo, L., Tentori, M., Quintana, E., Favela, J., & Garcia-Rosas, D. (2014). Using augmented reality to help children with autism stay focused. IEEE Pervasive Computing, 13(1), 38-46.
Gale, C. M., Eikeseth, S., & Klintwall, L. (2019). Children with autism show atypical preference for non-social stimuli. Scientific Reports, 9(1), 10355.
Gillberg, C., & Coleman, M. (1992). The biology of the autistic syndromes. Mac Keith Press.
Gros, B. (2002). Knowledge Construction and Technology. Journal of Educational Multimedia and Hypermedia, 11(4), 323-343.
Hartmann, R.R.K. & James, Gr. (1998). Dictionary of Lexicography. London: Routledge.
Hattier, M. A., Matson, J. L., Tureck, K., & Horovitz, M. (2011). The effects of gender and age on repetitive and/or restricted behaviors and interests in adults with autism spectrum disorders and intellectual disability. Research in Developmental Disabilities,32(6), 2346–2351.
Hashim, H. U., Yunus, M., M., & Norman., H. (2022). A-Real-Vocab: An Augmented Reality English Vocabulary Mobile Application to Cater to Mild Autism Children in Response towards Sustainable Education for Children with Disabilities. Sustainability. 14(8):4831. https://doi.org/10.3390/su14084831
Henderson, S., & Yeow, J. (2012). iPad in education: A case study of iPad adoption and use in a primary school. In 45th Hawaii International Conference on System Science, 78-87. IEEE.
Hersen, M., & Bellack, A. S. (1977). Assessment of Social Skills. In A. R. Cininero, & K. S. Calhoun (Eds.), Handbook of Behavior Assessment (pp. 509-554). New York: Wiley.
Horwitz, E. H., Schoevers, R. A., Greaves-Lord, K., de Bildt, A., & Hartman, C. A. (2020). Adult manifestation of milder forms of autism spectrum disorder; autistic and non-autistic psychopathology. Journal of Autism and Developmental Disorders, 50(8), 2973–2986.
Huang, Y., Li, H., & Fong, R. (2016). Using Augmented Reality in early art education: a case study in Hong Kong kindergarten.Early Child Development and Care, 186(6), 879-894.
Huang, Z., Li, W., Hui, P., & Peylo, C. (2014). CloudRidAR: A cloud-based architecture for mobile augmented reality. In Proceedings of the 2014 workshop on Mobile augmented reality and robotic technology-based systems, 29-34. ACM.
Ίσαρη, Φ., Πουρκός, Μ. (2015). Συλλογή/ Παραγωγή Ποιοτικών Ερευνητικών Δεδομένων. Στο Ίσαρη Φ., Πουρκός, Μ. 2015. Ποιοτική μεθοδολογία έρευνας. Αθήνα: Σύνδεσμος Ελληνικών Ακαδημαϊκών Βιβλιοθηκών.
Ιωάννου - Παρασκευοπούλου, Ν. (1985). Εξελικτική́ ψυχολογία. Η ψυχική ζωή από τη σύλληψη ως την ενηλικίωση. Προσχολική ηλικία. Τόμος 2. Αθήνα: Πανεπιστήμιο Αθηνών
Ιωάννου - Παρασκευοπούλου, Ν. (1985). Εξελικτική́ ψυχολογία. Η ψυχική ζωή από τη σύλληψη ως την ενηλικίωση. Προσχολική ηλικία. Τόμος 3. Αθήνα: Πανεπιστήμιο Αθηνών
Jamali, S. S., Shiratuddin, M. F., & Wong, K. W. (2013). A review of augmented reality (AR) and mobile-augmented reality (mAR) technology: Learning in tertiary education. Learning in Higher Education, 20(2), 37-54.
Jordan, R. (2003). Social play and autistic spectrum disorders. A perspective on theory,implications, and educational approaches .Autism, 7(4), pp.347-360.
Κουτσούμπασης, Π. (2015). Αξιολόγηση Διαδραστικών Συστημάτων με Επίκεντρο τον Χρήστη. Σύνδεσμος Ελληνικών Ακαδημαϊκών Βιβλιοθηκών. Αθήνα.
Κυριαζή, Ν. (2011). Η κοινωνιολογική έρευνα. Κριτική επισκόπηση των μεθόδων και των τεχνικών. (Νέα διευρυμένη έκδοση). Αθήνα: Πεδίο.
Κωνσταντινίδης, Κ. (2016). Εκπαιδευτικό υλικό επαυξημένης πραγματικότητας για την πρωτοβάθμια εκπαίδευση: αντιλήψεις εκπαιδευτικών. (Μεταπτυχιακή διατριβή, Αριστοτέλειο Πανεπιστήμιο Θεσσαλονίκης, Ελλάδα). Ανακτήθηκε από: https://ikee.lib.auth.gr/record/286914/files/GRI-2017-18210.pdf
Kamarainen, A. M., Metcalf, S., Grotzer, T., Browne, A., Mazzuca, D., Tutwiler, M. S., & Dede, C. (2013). EcoMOBILE: Integrating augmented reality and probeware with environmental education field trips. Computers & Education, 68, 545-556.
Kaplan, H.L., & Sadock, B.J. (1985). Modern Synopsis of Comprehensive Textbook of Psychiatry IV. Williams and Wilkins, Baltimore.
Kerawalla, L., Luckin, R., Seljeflot, S., & Woolard, A. (2006). “Making it real”: exploring the potential of augmented reality for teaching primary school science. Virtual reality, 10(3-4), 163-174.
Khowaja, K., Al-Thani, D., Hassan, A.O., Shah, A., Salim, S.S. (2020). Mobile Augmented Reality App for Children with Autism Spectrum Disorder (ASD) to Learn Vocabulary (MARVoc): From the Requirement Gathering to Its Initial Evaluation. In: Fang, X. (eds) HCI in Games. HCII 2020. Lecture Notes in Computer Science(), vol 12211. Springer, Cham. https://doi.org/10.1007/978-3-030-50164-8_31
Kirkley, S. E., & Kirkley, J. R. (2005). Creating next generation blended learning environments using mixed reality, video games and simulations. TechTrends, 49(3), 42-53.
Klamer, L., Haddon, L. & Ling, R. (2000). The Qualitative Analysis of ICTs and Mobility, Time Stress and Social Networking. Report of EURESCOM P-903, Heidelberg.
Klopfer, E., & Sheldon, J., (2010). Augmenting your own reality: student authoring of science-based augmented reality games. New Directions for Youth Development, 128, 85–94.
Kuhl, J. (2000). A functional-design approach to motivation and self-regulation: The dynamics of personality systems and interactions. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 111–169). Academic Press.
Lee, S. E., Zhang, Y., Fang, Z., Srinivasan, S., Iyer, R., & Newell, D. (2009). Accelerating mobile augmented reality on a handheld platform. In 2009 IEEE International Conference on Computer Design. 419-426. IEEE.
Lorusso, M., Giorgetti, M Travellini S., Greci, L., Zangiacomi, A Mondellini, M., Sacco, M., Reni, G. (2018). Giok the Alien: An AR-Based Integrated System for the Empowerment of Problem-Solving, Pragmatic, and Social Skills in Pre-School Children. Sensors , 18, 2368, 1-16.
Μότσιου, Β. (1994) Στοιχεία Λεξικολογίας. Εισαγωγή́ στην Νεοελληνική́ Λεξικολογία. Αθήνα: Νεφέλη.
Maenner, M.J., Shaw, K.A., Baio, J., Washington, A., et al., (2020). Prevalence od Autism Spectrum Disorder Among Children Aged 8 Years – Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2016. MMWR Surveillance Summary, 69, 1-12
McCormick, C., Hepburn, S., Young G. S., & Rogers, S. J. (2016). Sensory symptoms in children with autism spectrum disorder: A systematic review. Journal of Evaluation in Clinical Practise, 13 (1), 120-129.
McMahon, D. D., Cihak, D. F., Wright, R. E., & Bell, S. M., (2016). Augmented reality for teaching science vocabulary to postsecondary education students with intellectual disabilities and autism. Journal of Research on Technology in Education, 48(1), 38-56
Molich, R. & Nielsen, J. (1990). Improving a Human-Computer Dialogue. Communications of the ACM, 33, 338-348.
Νούσκα, Δ. (2019). Σύγκριση της Υποκειμενικά Διαφαινόμενης Χρησιμότητας της Εφαρμογής Επαυξημένης Πραγματικότητας «Οι Κήποι των Ευτυχιών» με δυο διαφορετικούς τρόπους παρουσίασης σχεδιασμένη για μαθητές με μαθησιακές δυσκολίες μεταξύ των εκπαιδευτικών Ειδικής Αγωγής. Αριστοτέλειο Πανεπιστήμιο Θεσσαλονίκης. Διατμηματικό Πρόγραμμα Μεταπτυχιακών Σπουδών. «Τεχνολογίες Μάθησης – Επιστήμες της Αγωγής». Μεταπτυχιακή́ Εργασία.
Nielsen, J. (1993). Handbook Usability Engineering. Morgan Kaufmann, San Francisco.
Πασαλίδου, Χ. (2019). Σχεδίαση, Ανάπτυξη εκπαιδευτικής δραστηριότητας με αξιοποίηση της επαυξημένης πραγματικότητας και διερεύνηση των στάσεων των εκπαιδευτικών (Μεταπτυχιακή Εργασία). Παν. Μακεδονίας. Θεσσαλονίκη
Parhizkar, B., Obeidy, W. K., Chowdhury, S. A., Gebril, Z. M., Ngan, M. N. A., & Lashkari, A. H. (2012). Android Mobile Augmented Reality Application Based on Different Learning Theories for Primary School Children. In2012 International Conference on Multimedia Computing and Systems, 404-408. IEEE.
Preston, C., Cox, M. J., & Cox, K. M. J. (2000). Teachers as Innovators: An evaluation of the motivation of teachers to use information and communications technologies. Croydon: King’s College London and Mirandanet.
Radu (2014) ‘‘Augmented reality in education: A meta-review and cross-media analysis,’’ Pers. Ubiquitous Comput., vol. 18, no. 6, pp. 1533–1543.
Richard, E., Billaudeau, V., Richard, P., & Gaudin, G. (2007). Augmented Reality for rehabilitation of cognitive disabled children: A preliminary study. Virtual Rehabilitation, 102-108.
Roschelle, J. M., Pea, R. D., Hoadley, C. M., Gordon, D. N., & Means, B. M. (2001). Changing how and what children learn in school with computer-based technologies. Children and Computer Technology, 10 (2), 76-101.
Σιάκας, Σ. (2011). Μεθοδολογία Σχεδιασμού για την Αξιοποίηση των νέων Μέσων σε Παιδαγωγικές και Εκπαιδευτικές Δράσεις. Παιδαγωγικά Ρεύματα στο Αιγαίο Μάρτιος 2018.
Shree, N.T., & Selvarani A. G. (2022). An Interactive Number Learning Augmented Reality Application for Autistic Preschool Children. International Conference on Computer Communication and Informatics (ICCCI) pp. 1-4, doi: 10.1109/ICCCI54379.2022.9740948.
Sigman, M., & Capps, L. (1997). Children with autism: a development perspective, Harvard University Press.
Τσέλιος, Ν., Κομνηνού, Μ. & Αβούρης, Ν. (2002). Ευχρηστία Εκπαιδευτικού Λογισμικού: Προβλήματα και Προτάσεις. Οι ΤΠΕ στην εκπαίδευση. Ρόδος: Πανεπιστήμιο Αιγαίου
Tang, T.Y., Xu, J., Winoto, P. (2019). An Augmented Reality-Based Word-Learning Mobile Application for Children with Autism to Support Learning Anywhere and Anytime: Object Recognition Based on Deep Learning. In: Antona, M., Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Multimodality and Assistive Environments. HCII 2019. Lecture Notes in Computer Science(), vol 11573. Springer, Cham. https://doi.org/10.1007/978-3-030-23563-5_16
Tentori M. M. &. Hayes, G. R. (2010). Designing for interaction immediacy to enhance social skills of children with autism. In Proceedings of the 12th ACM international conference on Ubiquitous computing, 51–60.
Φιλιππούσης, Γ. (2017). Η αξιοποίηση της Επαυξημένης Πραγματικότητας (AR- AUGMENTED REALITY) και του Κώδικα Γρήγορης Απόκρισης (QR- CODE) για την υποστήριξη της μαθησιακής διαδικασίας. Μία δράση για το γνωστικό́ αντικείμενο της ιστορίας. Διεθνές Συνέδριο για την Ανοικτή́ & εξ Αποστάσεως Εκπαίδευση, 9(6Β), 1-8.
Vellowen, V., Karna, E., & Vimes, M., ( 2013). Supporting the strengths and activity of children with autism in a technology- enhanced learning environment. Proceedings of the International Conference on Cognition and Exploratory Learning in Digital Age.
Vinumol, Chowdhury, Kambam, & Muralidharan. (2013). Augmented Reality Based Interactive. Textbook: An Assistive Technology for Students with Learning Disability.
Wei, X., Weng, D., Liu, Y. & Wang, Y. (2015). Teaching based on augmented reality for a technical creative design course. Computers & Education, 81, 221-234.
Wu, H. K., Lee, S. W. Y., Chang, H. Y., & Liang, J. C. (2013). Current status, opportunities and challenges of augmented reality in education. Computers & education, 62, 41-49.
Χαρέλη, Χ. (2018). Η Γλωσσική Ανάπτυξη Παιδιού στο Φάσμα του Αυτισμού και η ενίσχυση της μέσα από δημιουργικές δραστηριότητες παιχνιδιού (Μεταπτυχιακή Εργασία). Παν. Μακεδονίας. Θεσσαλονίκη
Yilmaz, R. M. (2016). Educational magic toys developed with augmented reality technology for early childhood education. Computers in Human Behavior, 54, 240-248.