Evaluating Student Learning Outcomes in Virtual Reality Adaptive Chemistry

Mohammad Farid Machfudin, Esther Irawati Setiawan, Kevin Jonathan Halim, Joan Santoso, Agung Bella Putra Utama, Gunawan Gunawan, Samuel Budi Wardana Kusuma, Vrijraj Singh, Tong Nam Tuan Vu

Abstract


This study evaluates the effectiveness of a Virtual Reality (VR)–based adaptive learning application in enhancing high school students’ understanding of chemical compounds. The primary objective was to quantitatively assess the impact of the VR intervention on student learning outcomes across two distinct cohorts (N = 78). A pretest–posttest control-group design was employed, with two parallel groups (Group A and Group B) to ensure internal validity and comparability of results. The findings consistently indicate a marked contrast between the experimental and control conditions. Students in the control groups showed declines in performance, with negative learning gains of −8.32 and −15.20, suggesting learning loss when conventional instructional methods were used. In contrast, students exposed to the VR-based adaptive learning application demonstrated positive learning gains of +2.90 and +9.70, reflecting meaningful improvements in conceptual understanding. Further analysis of the intervention’s impact revealed effect sizes ranging from medium (Cohen’s d = 0.722) to very large (d = 2.182). These results indicate not only statistical significance but also substantial practical significance. Overall, the findings provide strong empirical evidence that the VR-based adaptive learning application is effective in preventing learning loss and significantly enhancing students’ understanding of chemical compounds when compared to traditional instructional approaches.

Keywords


Adaptive Learning, Compound Structure, Virtual Reality, User Experience Questionnaire

Full Text:

PDF

References


Abdinejad, M., Talaie, B., Qorbani, H. S., & Dalili, S. (2021). Student Perceptions Using Augmented Reality and 3D Visualization Technologies in Chemistry Education. Journal of Science Education and Technology, 30(1), 87–96. https://doi.org/10.1007/s10956-020-09880-2

Alam, A., & Ullah, S. (2016). Adaptive 3D-Virtual Learning Environments: From Students’ Learning Perspective. 2016 International Conference on Frontiers of Information Technology (FIT), 7–10. https://doi.org/¬10.1109/FIT.2016.010

Bangay Shaun, & Preston Louise. (1998). AN investigation into factors influencing immersion in interactive virtual reality environments. https://doi.org/¬10.-3233/978-1-60750-902-8-43

Burt, M., & Louw, C. (2019). Virtual reality enhanced roller coasters and the future of entertainment – audience expectations. World Leisure Journal, 61(3), 183–199. https://doi.org/10.1080/16078055.2019.1639274

Calabuig-Moreno, F., González-Serrano, M. H., Fombona, J., & García-Tascón, M. (2020). The Emergence of Technology in Physical Education: A General Bibliometric Analysis with a Focus on Virtual and Augmented Reality. Sustainability, 12(7), 2728. https:¬//doi.org/10.3390/su12072728

Caneparo, L. (2001). Shared virtual reality for design and management: the Porta Susa project. Automation in Construction, 10(2), 217–228. https://doi.org/10.-1016/¬S0926-5805(99)00032-1

Clark, T. M. (2023). Investigating the Use of an Artificial Intelligence Chatbot with General Chemistry Exam Questions. Journal of Chemical Education, 100(5), 1905–1916. https://doi.org/10.1021/¬acs.jchemed.¬3c0-0¬027

de Back, T. T., Tinga, A. M., Nguyen, P., & Louwerse, M. M. (2020). Benefits of immersive collaborative learning in CAVE-based virtual reality. International Journal of Educational Technology in Higher Education, 17(1), 51. https://doi.org/10.1186/s41239-020-00228-9

Di Natale, A. F., Repetto, C., Riva, G., & Villani, D. (2020). Immersive virtual reality in K‐12 and higher education: A 10‐year systematic review of empirical research. British Journal of Educational Technology, 51(6), 2006–2033. https://doi.org/10.1111/bjet.13030

Dutta, S., Ranjan, S., Mishra, S., Sharma, V., Hewage, P., & Iwendi, C. (2024). Enhancing Educational Adaptability: A Review and Analysis of AI-Driven Adaptive Learning Platforms. 2024 4th International Conference on Innovative Practices in Technology and Management (ICIPTM), 1–5. https://doi.org/-10.1109/ICIPTM59628.2024.10563448

Essa, S. G., Celik, T., & Human-Hendricks, N. E. (2023). Personalized Adaptive Learning Technologies Based on Machine Learning Techniques to Identify Learning Styles: A Systematic Literature Review. IEEE Access, 11, 48392–48409. https://doi.org/10.¬1109/-ACCESS.¬2023.3276439

Hussain, R., Sabir, A., Lee, D.-Y., Zaidi, S. F. A., Pedro, A., Abbas, M. S., & Park, C. (2024). Conversational AI-based VR system to improve construction safety training of migrant workers. Automation in Construction, 160, 105315. https://doi.org/10.1016/¬j.autcon.2024.105315

Janecký, D., Kučera, E., Haffner, O., & Hricková, L. (2025). Development of an Interactive VR Application Using Unity: Its Impact on Learning and Performance. 2025 Cybernetics & Informatics (K&I), 1–6. https://doi.org/10.1109/KI64036.2025.10916426

Kesavan, R., Gay, D., Thevessen, D., Shah, J., & Mohan, C. (2023). Firestore: The NoSQL Serverless Database for the Application Developer. 2023 IEEE 39th International Conference on Data Engineering (ICDE), 3376–3388. https://doi.org/10.1109/¬ICDE-55515.2023.00259

Lendalay, A. R., Pabba, R., Katta, S. R., Ahmed, M. A., Karthik, R. U., & Prasad, K. S. (2024). Development and Implementation of a Virtual Reality Simulation for an Immersive College Environment Using the Unity Game Engine. 2024 IEEE North Karnataka Subsection Flagship International Conference (NKCon), 1–8. https://doi.org/10.1109/¬NKCon¬62728.-2024.10774914

Liu, M., Kang, J., Zou, W., Lee, H., Pan, Z., & Corliss, S. (2017). Using Data to Understand How to Better Design Adaptive Learning. Technology, Knowledge and Learning, 22(3), 271–298. https://doi.org/-10.1007/s10758-017-9326-z

Liu, M., McKelroy, E., Corliss, S. B., & Carrigan, J. (2017). Investigating the effect of an adaptive learning intervention on students’ learning. Educational Technology Research and Development, 65(6), 1605–1625. https://doi.org/10.1007/s11423-017-9542-1

Lui, A. L. C., Not, C., & Wong, G. K. W. (2023). Theory-Based Learning Design with Immersive Virtual Reality in Science Education: a Systematic Review. Journal of Science Education and Technology, 32(3), 390–432. https://doi.org/10.1007/s10956-023-10035-2

Makransky, G., Terkildsen, T. S., & Mayer, R. E. (2019). Adding immersive virtual reality to a science lab simulation increases presence but reduces learning. Learning and Instruction, 60, 225–236. https://doi.-org/¬10.¬1016/j.learninstruc.2017.12.007

Mittal, U., Sai, S., Chamola, V., & Sangwan, D. (2024). A Comprehensive Review on Generative AI for Education. IEEE Access, 12, 142733–142759. https://doi.org/10.1109/ACCESS.2024.3468368

Monter-Pozos, A., & González-Estrada, E. (2024). Testing the skew normal distribution using the Shapiro–Wilk test. Journal of Computational and Applied Mathematics, 440, 115649. https://doi.org/10.¬1016/-j.cam.2023.115649

Peirce, N., Conlan, O., & Wade, V. (2008). Adaptive Educational Games: Providing Non-invasive Personalised Learning Experiences. 2008 Second IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning, 28–35. https://-doi.¬org/10.1109/DIGITEL.2008.30

Salzman, M. C., Dede, C., Loftin, R. B., & Chen, J. (1999). A Model for Understanding How Virtual Reality Aids Complex Conceptual Learning. Presence: Tele¬operators and Virtual Environments, 8(3), 293–316. https://doi.org/10.1162/105474699566242

Segura, R. J., del Pino, F. J., Ogáyar, C. J., & Rueda, A. J. (2020). VR‐OCKS: A virtual reality game for learning the basic concepts of programming. Computer Applications in Engineering Education, 28(1), 31–41. https://doi.org/10.1002/cae.22172

Setiawan, E. I., Machfudin, M. F., Saputra, D. G., Santoso, J., Gunawan, G., & Kusuma, S. B. W. (2025). Evaluating User Experience of a Virtual Reality-Based Adaptive Learning Application on Chemical Compound Structures for High School Students. International Journal of Engineering, Science and Information Technology, 5(4), 427–433. https://doi.org/10.52088/ijesty.v5i4.1445

Song, H. W., & Yu, J. (2024). Effects of Augmented Reality based Dual-Task Proprioceptive Training on Postural Stability, Positioning Sensation and Cognition. Journal of Wireless Mobile Networks, Ubiquitous Computing, and Dependable Applications, 15(1), 88–103. https://doi.org/10.58346/JOWUA.2024.I1.007

Strielkowski, W., Grebennikova, V., Lisovskiy, A., Rakhimova, G., & Vasileva, T. (2025). AI‐driven adaptive learning for sustainable educational transformation. Sustainable Development, 33(2), 1921–1947. https://doi.org/10.1002/sd.3221

Tan, Y., Xu, W., Li, S., & Chen, K. (2022). Augmented and Virtual Reality (AR/VR) for Education and Training in the AEC Industry: A Systematic Review of Research and Applications. Buildings, 12(10), 1529. https://doi.org/10.3390/buildings12101529

van Dam, A., Laidlaw, D. H., & Simpson, R. M. (2002). Experiments in Immersive Virtual Reality for Scientific Visualization. Computers & Graphics, 26(4), 535–555. https://doi.org/10.1016/S0097-8493¬(02)00113-9

Vera-Olivera, H., Guo, R., Huacarpuma, R. C., Da Silva, A. P. B., Mariano, A. M., & Holanda, M. (2022). Data Modeling and NoSQL Databases - A Systematic Mapping Review. ACM Computing Surveys, 54(6), 1–26. https://doi.org/10.1145/3457608

Wang, S., Christensen, C., McBride, E., Kelly, H., Cui, W., Tong, R., Shear, L., Yarnall, L., & Feng, M. (2020). Identifying Gaps in Use of and Research on Adaptive Learning Systems. Proceedings of the 12th International Conference on Computer Supported Education, 118–124. https://doi.org/10.5220/¬00¬09¬5-9¬0¬701180124.




DOI: http://dx.doi.org/10.17977/um048v31i2p%25p

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Jurnal Ilmu Pendidikan

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.


Jurnal Ilmu Pendidikan
ISSN: 0215-9643 | E-ISSN: 2442-8655
Contact
Lembaga Penelitian dan Pengabdian Kepada Masyarakat (LP2M) Universitas Negeri Malang (UM)
Graha Rektorat, Floor 6, Jl. Semarang No 5 Malang 65145
Homepage: http://journal2.um.ac.id/index.php/jip
E-mail: [email protected]

Jurnal Ilmu Pendidikan is licensed under a Creative Commons Attribution 4.0 International License.

View My Stats