Information Technology Support of Education of Students With Autism: Aspects of Virtual Assistant Modeling

2021;
: pp. 122 - 130
1
Lviv Polytechnic National University, Department of Information Systems and Networks
2
Lviv Polytechnic National University

People with autism find that interacting with a computer or tablet is less stressful and more attractive than interacting with people. The analysis of information technologies developed both abroad and in Ukraine reveals the lack of systematic support for the education processes of people with autism. In this context, the development of personalized information technology support for the learning processes of such students is an urgent scientific and practical task. To achieve this goal it is necessary to explore the theoretical and methodological foundations of teaching people with autism and state the role of IT support of such education. Experts agree that the main areas of development of information technology to support the training of students with autism are the improvement of communication skills, improvement of social communication, and academic training.

The method of personalization of virtual content of information technologies developed or adjusted to support education of students with autism should take into account the results psychological diagnostics of a student, his/her educational abilities and needs, and also such method might involve the participation of paraprofessionals and parents of a student. When developing such a method, it should be taken into account that some students might use non-verbal communication only, and an algorithm for evaluating the emotions of a student with autism should be developed.

The most promising technologies which can be with an appropriate level of ease be adapted into the education of students with autism are augmented and virtual reality technologies. According to the developed method of personalization of virtual content of information technologies, different modeling and visualization software should be used.

  1. Bevan, B., Ryoo, J.J., Vanderwerff, A., Wilkinson, K., & Petrich, M. (2020). «I See Students Differently»: Following the Lead of Maker Educators in Defining What Counts as Learning. Frontiers in Education, 5, art. no. 121, . phttps://doi.org/10.3389/feduc.2020.00121
  2. Lee, J., Zhang, T., Chu, T.L., Gu, X., & Zhu, P. (2020). Effects of a fundamental motor skill-based afterschool program on children’s physical and cognitive health outcomes. International Journal of Environmental Research and Public Health, 17 (3), art. no. 733, . phttps://doi.org/10.3390/ijerph17030733
  3. Shestakevych, T., Pasichnyk, V., & Kunanets, N. (2019). Information and technology support of inclusive education in Ukraine. Advances in Intelligent Systems and Computing, 754, 746-758. phttps://doi.org/10.1007/978-3-319-91008-6_73
  4. Shestakevych, T. (2017). The method of education format ascertaining in program system of inclusive education support. Proceedings of the 12th International Scientific and Technical Conference on Computer Sciences and Information Technologies, CSIT 2017, 1, art. no. 8098786, 279-283. phttps://doi.org/10.1109/STC-CSIT.2017.8098786
  5. Andrunyk, V., Pasichnyk, V., Kunanets, N., & Shestakevych, T. (2019). Multimedia educational technologies for teaching students with autism. CEUR Workshop Proceedings, 2533: Proceedings of the 1st International workshop on digital content & smart multimedia (DCSMart 2019), Lviv, Ukraine, December 23-25, 2019. 1, 237-248.
  6. Andrunyk, V. (2020). Visualization of the content of information technologies: supporting the education of students with autism. Econtechmod. 9 (2), 11 - 18.
  7. Syahputra, M.F., Angkasih, A.P., Purnamawati, S., Andayani, U., Abdullah, D., Sriadhi, S., Iskandar, A., Rosida, T.M., Fitriany, J., Sari, I.N., Utama, M.D., & Nanuru, R.F. (2019). Implementation of Augmented Reality in Pretend Play Therapy for Children with Autism Spectrum Disorder. Journal of Physics: Conference Series, 1235 (1), art. no. 012104, . phttps://doi.org/10.1088/1742-6596/1235/1/012104
  8. Sun, L., Chen, R., Li, L., Yuan, B., Song, K., Pan, N., Cheng, T.-L., Chang, S., Lin, K., He, X., Wu, Q., Xu, F., Qiu, Z., & Wang, X. (2020). Visualization and correction of social abnormalities-associated neural ensembles in adult MECP2 duplication mice. Science Bulletin, 65 (14), 1192-1202. phttps://doi.org/10.1016/j.scib.2020.03.026
  9. McNaughton, D. & Light J. (2013). The iPad and Mobile Technology Revolution: Benefits and Challenges for Individuals who require Augmentative and Alternative Communication, Augmentative and Alternative Communication, 29:2, 107-116. phttps://doi.org/10.3109/07434618.2013.784930
  10. Horbova, M., & Andrunyk, V. (2020). Development of virtual reality platform for teaching children with special needs. Computational Linguistics and Intelligent Systems. Proceedings. 2020. Proceedings of the 4th International conference «Computational linguistics and intelligent systems» COLINS 2020 (Lviv, Ukraine
  11. June 23-24, 2020). Vol. II: Workshop, 170-177. phttps://doi.org/10.2478/rtuect-2020-0064
  12. Andrunyk, V., Shestakevych, T., & Pasichnyk, V. (2018). The technology of augmented and virtual reality in teaching children with ASD. Econtechmod: scientific journal, Lublin. 7(4), 59-64.
  13. Supruniuk, K. & Andrunyk, V. (2020). Design of AR interface for learning students with special needs. Computational Linguistics and Intelligent Systems. Proceedings : Proceedings of the 4th International conference «Computational linguistics and intelligent systems» COLINS 2020 (Lviv, Ukraine
  14. June 23-24, 2020), Vol. II: Workshop, 178-183. phttps://doi.org/10.31613/ceramist.2020.23.2.08
  15. Horbova, M., Andrunyk, V., & Chyrun, L. (2020). Virtual reality platform using ml for teaching children with special needs. CEUR Workshop Proceedings, 2631, 209-220.
  16. Andrunyk, V. & Yaloveha, O. (2021). AI system in monitoring of emotional state of a student with autism. Advances in Intelligent Systems and Computing (AISC). Vol. 1293: Selected papers from the International conference on computer science and information technologies, CSIT 2020, September 23-26, 2020, Zbarazh, Ukraine, 102-115. phttps://doi.org/10.1007/978-3-030-63270-0_7
  17. Amado, M.L., Ruiz, L.C., & Andrade-Arenas, L. (2021). Prototype of an augmented reality application for cognitive improvement in children with autism using the DesingScrum methodology. Advances in Science, Technology and Engineering Systems, 6 (1), 587-596. phttps://doi.org/10.25046/aj060163
  18. Khowaja, K., Banire, B., Al-Thani, D., Sqalli, M.T., Aqle, A., Shah, A., & Salim, S.S. (2020). Augmented reality for learning of children and adolescents with autism spectrum disorder (ASD): A systematic review. IEEE Access, 8, art. no. 9060971, 78779-78807. phttps://doi.org/10.1109/ACCESS.2020.2986608
  19. Baragash, R.S., Al-Samarraie, H., Moody, L., & Zaqout, F. (2020). Augmented Reality and Functional Skills Acquisition Among Individuals With Special Needs: A Meta-Analysis of Group Design Studies. Journal of Special Education Technology. https://doi.org/10.1177/0162643420910413. phttps://doi.org/10.1177/0162643420910413
  20. Mohd, C.K.N.C.K., Shahbodin, F., Suparjoh, S., & Khidir, N.A.S.M. (2019). Application of augmented reality in learning bakery for autism spectrum disorder. International Journal of Engineering and Advanced Technology, 9 (1), 2616-2620. phttps://doi.org/10.35940/ijeat.A9853.109119
  21. Wang, Y.-Y., Lai, A.-F., Shen, R.-K., Yang, C.-Y., Shen, V.R.L., & Chu, Y.-H. (2019). Modeling and verification of an intelligent tutoring system based on Petri net theory. Mathematical Biosciences and Engineering, 16 (5), 4947-4975. phttps://doi.org/10.3934/mbe.2019250
  22. Vörös, A., Darvas, D., Molnár, V., Klenik, A., Hajdu, Á., Jámbor, A., Bartha, T., & Majzik, I. (2016). PetriDotNet 1.5: Extensible Petri net editor and analyser for education and research Lecture. Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9698, 123-132. phttps://doi.org/10.1007/978-3-319-39086-4_9