Towards an Objective Evaluation Layer: EEG-Based Assessment of Cognitive Engagement in AI-supported Immersive Cultural Heritage Experience

Tuğçe Ballı; E. Fatih Yetkin

doi:10.55630/dipp.2026.16.17

Authors

Tuğçe Ballı Department of Cybersecurity Engineering, Middle East Technical University Northern Cyprus Campus, Mersin 10, Türkiye
E. Fatih Yetkin Department of Management Information Systems, Kadir Has University, Istanbul, Türkiye

DOI:

https://doi.org/10.55630/dipp.2026.16.17

Keywords:

EEG, Immersive VR, Cognitive Engagement, Neuroadaptive Systems, Cultural Heritage

Abstract

This study investigates EEG-based evaluation of immersive VR experiences using a publicly available dataset of 51 participants exposed to visual and audiovisual simulations of the Edzná Maya archaeological site. Frontal theta, occipital alpha, and engagement index (beta / (alpha + theta)) are examined as cognitive engagement markers. The findings provide a neurophysiological baseline for future neuroadaptive AI-driven heritage VR systems.

References

Alonso-Valerdi, L. M., Rosado-Aíza, J. P., Domínguez-Morales, F. J., Pech-Canul, T. Y., Vázquez-Rodríguez, P. G., Navas-Reascos, G., & Ibarra-Zárate, D. I. (2025). EEG data of museum visitors experiencing visual and audiovisual simulations of Edzná, an archaeological site in Mexico. Data in Brief, 61, Article 111855. https://doi.org/10.1016/j.dib.2025.111855

Baceviciute, S., Terkildsen, T., & Makransky, G. (2021). Remediating learning from non-immersive to immersive media: Using EEG to investigate the effects of environmental embeddedness on reading in virtual reality. Computers & Education, 164, Article 104122. https://doi.org/10.1016/j.compedu.2020.104122

Bekele, M. K., Pierdicca, R., Frontoni, E., Malinverni, E. S., & Gain, J. (2018). A survey of augmented, virtual, and mixed reality for cultural heritage. Journal on Computing and Cultural Heritage (JOCCH), 11(2), 1–36. https://doi.org/10.1145/3145534

Choi, J. W., Kwon, H., Choi, J., Kaongoen, N., Hwang, C., Kim, M., Kim, B. H., & Jo, S. (2023). Neural applications using immersive virtual reality: A review on EEG studies. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 31, 1645–1658. https://doi.org/10.1109/TNSRE.2023.3254551

Colucci Cante, L., Di Martino, B., Graziano, M., Branco, D., & Pezzullo, G. J. (2024). Automated storytelling technologies for cultural heritage. In International Conference on Emerging Internet, Data & Web Technologies (pp. 597–606). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-53555-0_57

Esteves, D., Valente, M., Bendor, S. E., Andrade, A., & Vourvopoulos, A. (2025). Identifying EEG biomarkers of sense of embodiment in virtual reality: Insights from spatio-spectral features. Frontiers in Neuroergonomics, 6, Article 1572851. https://doi.org/10.3389/fnrgo.2025.1572851

Gramouseni, F., Tzimourta, K. D., Angelidis, P., Giannakeas, N., & Tsipouras, M. G. (2023). Cognitive assessment based on electroencephalography analysis in virtual and augmented reality environments, using head mounted displays: A systematic review. Big Data and Cognitive Computing, 7(4), Article 163. https://doi.org/10.3390/bdcc7040163

Hofmann, S. M., Klotzsche, F., Mariola, A., Nikulin, V., Villringer, A., & Gaebler, M. (2021). Decoding subjective emotional arousal from EEG during an immersive virtual reality experience. eLife, 10, Article e64812. https://doi.org/10.7554/eLife.64812

Langiulli, N., Calbi, M., Sbravatti, V., Umiltà, M. A., & Gallese, V. (2023). The effect of surround sound on embodiment and sense of presence in cinematic experience: A behavioral and HD-EEG study. Frontiers in Neuroscience, 17, Article 1222472. https://doi.org/10.3389/fnins.2023.1222472

Petukhov, I. V., Glazyrin, A. E., Gorokhov, A. V., Steshina, L. A., & Tanryverdiev, I. O. (2020). Being present in a real or virtual world: An EEG study. International Journal of Medical Informatics, 136, Article 103977. https://doi.org/10.1016/j.ijmedinf.2019.103977

Standen, B., Anderson, J., Sumich, A., & Heym, N. (2023). Effects of system- and media-driven immersive capabilities on presence and affective experience. Virtual Reality, 27, 371–384. https://doi.org/10.1007/s10055-021-00579-2

Tadayyoni, H., Ramirez Campos, M. S., Quevedo, A. J. U., & Murphy, B. A. (2024). Biomarkers of immersion in virtual reality based on features extracted from the EEG signals: A machine learning approach. Brain Sciences, 14(5), Article 470. https://doi.org/10.3390/brainsci14050470

Wang, Y. Y., Weng, T. H., Tsai, I. F., Kao, J. Y., & Chang, Y. S. (2023). Effects of virtual reality on creativity performance and perceived immersion: A study of brain waves. British Journal of Educational Technology, 54(2), 581–602. https://doi.org/10.1111/bjet.13264