Immersive Learning System
Project Overview
Research scope & objectives
Interaction Design for Immersive VR Classrooms
This project focuses on the design of interaction in immersive VR classrooms generated from existing MOOC lectures. The work transfers interaction techniques established in video-based learning (VBL) research into immersive environments, and investigates which techniques are suited to a VR classroom, at what point in a lecture they should be introduced, and how they affect learner engagement. On this basis, the project develops an automated approach to planning the immersive experience, determining what interaction occurs, when it occurs, and how it is presented. The resulting system is evaluated against traditional video-based learning and optimized for consumer-grade VR headsets so that it remains accessible to a wide range of learners.
Multilingual LLMs for Immersive Classrooms
This project evaluates large language models' capabilities in Indian languages, including Hindi, Assamese, and Bengali, to enable multilingual interaction in immersive classrooms. We benchmark open-source and frontier models across a range of parameter scales to understand how performance varies with model size and accessibility. A key focus is cross-lingual question answering. A learner asks a question in an Indian language. The system retrieves relevant information from English source material and returns the answer in the learner's own language. We also explore audio input and output to support natural, spoken interaction between learners and the system. Together, these findings will help shape the design of multilingual support in immersive learning environments.