Multimodal interfaces have been researched and positively evaluated in the context of improvement of task performance and skill communication. In this study we are discussing the possibilities to extend the notion and benefits of multimodal interfaces in support of cognitive tasks such as concept-forming, information organization and memory. Anecdotal evidence that this extension might be appropriate and promising is discussed and potential areas that could be supported in this way are described. Our study aims to bring together theoretical foundations coming from grounded cognition and connect them to practical study results in order to establish further research and evaluation directions.
Andreas Kratky. “Thinking with Our Hands - Theoretical Foundations of Multimodal Interfaces in Concept-Forming." In: Proceedings of Human-Computer Interaction, Tourism and Cultural Heritage. Bergamo, Blue Herons, 2014. CD-ROM
> Link to paper