In Proceedings of IEEE 2025 Conference on Games
A VR and AI-powered game-based approach to minimally-invasive social cognitive assessment
Frontotemporal dementia (FTD) is the second most common cause of young-onset dementia and is typically caused by frontal and/or temporal lobe degeneration. Early diagnosis of FTD is critical for effective treatment, but current diagnostic tools often lack the realism necessary to assess social cognitive abilities like emotion recognition and theory of mind. We propose a smart virtual reality (VR) solution to improve early FTD diagnosis by creating realistic social interactions in immersive environments. Our approach is two-fold: (i) a scriptwriting tool that provides neuropsychologists with generative AI support for writing a suitable dialog involving faux pas, picking characters and voicing them; (ii) a VR game in which patients observe the enactment of those scripted social scenarios, guided by a virtual companion. We discuss de main features of our current prototype, and identify some development and evaluation challenges ahead.
More Information
Gallery
Citation
BibTex
@inproceedings{bib:krijgsman:2025,
author = { Krijgsman, Caspar and Bidarra, Rafael },
title = { A VR and AI-powered game-based approach to minimally-invasive social cognitive assessment },
booktitle = { In Proceedings of IEEE 2025 Conference on Games },
editors = { Liu, J and Zhu J },
year = { 2025 },
publisher = { IEEE Press },
organization = { IEEE },
address = { Lisbon, Portugal },
url = { https://publications.graphics.tudelft.nl/papers/817 },
}