Multimodal Human-Robot Interaction Using Generative Artificial Intelligence

  by   Deepak Sahoo






Departments Computer Science
DescriptionMultimodal Human-Robot Interaction (HRI) aims to make communication with robots more natural by combining multiple input and output channels such as speech, touch, gestures, and emotional cues. Generative Artificial Intelligence (AI) can significantly enhance this process by enabling robots to interpret complex multimodal signals and generate context-aware, human-like responses. In this project, you will design and implement a system that uses Generative AI to improve multimodal HRI in a specific scenario—such as assistive robotics, social companionship, or collaborative tasks. The goal is to demonstrate how generative AI can create richer, more intuitive interactions between humans and robots.
Preparation
Project Categories Artificial Intelligence (AI), Human Computer Interaction (HCI)
Project Keywords Computer Vision, Embedded Systems, Hardware, Internet of Things (IoT), Machine Learning, Mobile Applications, Robotics, Web Applications


Level of Studies

Level 6 (Undergraduate Year 3) yes
Level 7 (Masters) yes
Level 8 (PhD) yes