Enhancing Assistive Technology for Complex Communication Disorders with GenAI

Recipient: Leora Klee, majoring in Computer Science

Project Overview: Language is an integral part of self-expression. For people with language disorders (e.g., aphasia, autism), Augmentative and Alternative Communication (AAC) tools can enhance communication and self-expression, enabling them to better convey and exchange thoughts and emotions. Traditional symbol-based AAC devices, however, often fall short of expectations. Their complicated structures impose meta-linguistic and memory demands on the user and the supports offered are generally unable to flexibly adapt to emergent communication needs. Recent advances in generative AI offer new potential for designing assistive tools that facilitate communication. The goal of this research project will be to investigate the capabilities of generative AI for a range of possible communication supports and envisioning how these capabilities might be integrated into AAC interfaces.

SUPERVISORS

Jeremy Cooperstock is a professor in the department of Electrical and Computer Engineering, a member of the Centre for Intelligent Machines, and a founding member of the Centre for Interdisciplinary Research in Music Media and Technology at McGill University. He directs the Shared Reality Lab, which focuses on computer mediation to facilitate high-fidelity human communication and the synthesis of perceptually engaging, multimodal, immersive environments. 

Karyn Moffatt is an Associate Professor in the School of Information Studies at McGill University and the Canada Research Chair in Inclusive Social Computing. She leads the Accessible Computing Technologies Research Group where she studies how computing applications can be designed to be more inclusive of diverse needs and preferences across the lifespan, especially with respect to supporting social engagement and interaction.