Towards An Affective Robot Companion for Audiology Rehabilitation: How Does Pepper Feel Today?

ULUER P. , Köse H., Oz B. K. , Can Aydinalev T., Barkana D. E.

29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020, Virtual, Naples, Italy, 31 August - 04 September 2020, pp.567-572 identifier identifier

  • Publication Type: Conference Paper / Full Text
  • Volume:
  • Doi Number: 10.1109/ro-man47096.2020.9223534
  • City: Virtual, Naples
  • Country: Italy
  • Page Numbers: pp.567-572
  • Keywords: Child-robot interaction, affective computing, socially assistive robots, humanoids


© 2020 IEEE.The motivation of this work is to develop an affective robot companion for audiology rehabilitation and to test the system with the deaf or hard of hearing children. Two robot modules are developed which are the multimodal stress/emotion/motivation recognition module for the robot to understand how the children feel, and behaviour and feedback module of the robot to show the children how the robot feels. In this study we only focus on the behaviour and feedback module of the robot. The selected affective/affirmative behaviours are tested by means of tablet games and employed on the robot during an audiology test, as a feedback mechanism. Facial data are used together with the surveys to evaluate the children's perception of the robot and the behaviour set.