Proceedings of the Annual Meeting of the Cognitive Science Society

We design F-2 companion robot, supporting natural multimodal communication. The robot is operated by a set of scripts,triggered by input speech and generating behavioral patterns in BML format. To make robots behavior as close as possibleto humans, we extract natural communication patterns from the Russian Emotional Corpus REC (over 400.000 annota-tions), reproduce key patterns in Blender 3D editor and export them to MySQL database (n = 220). For each generatedBML the software retrieves the corresponding movement from the database, joins compatible patterns and performs themon the robot. Robot can also receive the coordinates of surrounding human faces and simulate direct gazes towards theeyes of the addressee. It can also perform oriented (pointing) gestures: switch between directions or between severalinterlocutors. This allows us to model complex robot behavior, as shown in our experiment, increasing human satisfactionfrom robot-to-human interaction (Research is supported by the Russian Science Foundation, project No 19-18-00547).