Cognitive augmentation systems through extended reality, artificial intelligence, and sensors: a human-computer interaction perspective

In an era increasingly shaped by digital and immersive technologies, this thesis explores how Extended Reality (XR), Artificial Intelligence (AI), and sensor integration are transforming cognitive augmentation from a Human-Computer Interaction (HCI) perspective. Through case studies in education, physical activity, and collaboration, this work demonstrates how these technologies address diverse user needs in everyday life. In education, an AI-powered Augmented Reality (AR) application supports language learning for dyslexic students with adaptive feedback, while an XR application strengthens spatial reasoning by teaching Rubik’s Cube notation. XR further demonstrates its potential by evaluating the effectiveness of embodied and audio-only virtual assistant guides in a puzzle-solving task. Beyond education, case studies extend to physical activity, where an AR application provides real-time feedback to optimize workouts, and Virtual Reality (VR) interfaces improve bi-manual interaction for individuals with limb loss. In everyday settings, a VR smart home study examines AI assistant engagement, while an AR family album application overlays metadata onto physical photos, enriching individual interactions with personal history. An Internet of Things (IoT)-integrated VR environment introduces real-time feedback that dynamically responds to user environmental changes. Collaboration is another key focus, with virtual office studies analyzing how communication quality affects teamwork and an AR experience facilitating family memory sharing. These case studies also highlight technological and usability challenges, providing insights that inform future improvements. The thesis adopts a mixed-method evaluation, combining quantitative performance metrics with qualitative user insights while exploring ethical considerations to inform responsible future research. In addition, a comparative analysis identifies universal design principles for creating effective XR, AI, and sensor-driven cognitive augmentation systems. In conclusion, the findings highlight the transformative potential of HCI-driven case studies in developing immersive, user-centered solutions. By integrating advanced technologies with interdisciplinary approaches, this research aims to address cognitive and social challenges while promoting responsible and ethical practices.