Designing and implementing a platform for collecting multi-modal data of human-robot interaction

Brian Vaughan; Jing Guang Han; Emer Gilmartin; Nick Campbell

Designing and implementing a platform for collecting multi-modal data of human-robot interaction

Brian Vaughan, Jing Guang Han, Emer Gilmartin, Nick Campbell

Research output: Contribution to journal › Article › peer-review

Abstract

This paper details a method of collecting video and audio recordings of people interacting with a simple robot interlocutor. The interaction is recorded via a number of cameras and microphones mounted on and around the robot. The system utilised a number of technologies to engage with interlocutors including OpenCV, Python, and Max MSP. Interactions over a three month period were collected at The Science Gallery in Trinity College Dublin. Visitors to the gallery freely engaged with the robot, with interactions on their behalf being spontaneous and non-scripted. The robot dialogue was a set pattern of utterances to engage interlocutors in a simple conversation. A large number of audio and video recordings were collected over a three month period.

Original language	English
Pages (from-to)	7-17
Number of pages	11
Journal	Acta Polytechnica Hungarica
Volume	9
Issue number	1
Publication status	Published - 2012
Externally published	Yes

Keywords

Audio interface
Face detection
Human-robot interaction
Multi-modal data collection
Platformrobot
WOZ

Cite this

@article{c00c438676064d0dacfa44d28e5afb30,

title = "Designing and implementing a platform for collecting multi-modal data of human-robot interaction",

abstract = "This paper details a method of collecting video and audio recordings of people interacting with a simple robot interlocutor. The interaction is recorded via a number of cameras and microphones mounted on and around the robot. The system utilised a number of technologies to engage with interlocutors including OpenCV, Python, and Max MSP. Interactions over a three month period were collected at The Science Gallery in Trinity College Dublin. Visitors to the gallery freely engaged with the robot, with interactions on their behalf being spontaneous and non-scripted. The robot dialogue was a set pattern of utterances to engage interlocutors in a simple conversation. A large number of audio and video recordings were collected over a three month period.",

keywords = "Audio interface, Face detection, Human-robot interaction, Multi-modal data collection, Platformrobot, WOZ",

author = "Brian Vaughan and Han, \{Jing Guang\} and Emer Gilmartin and Nick Campbell",

year = "2012",

language = "English",

volume = "9",

pages = "7--17",

journal = "Acta Polytechnica Hungarica",

issn = "1785-8860",

publisher = "Obuda University",

number = "1",

}

TY - JOUR

T1 - Designing and implementing a platform for collecting multi-modal data of human-robot interaction

AU - Vaughan, Brian

AU - Han, Jing Guang

AU - Gilmartin, Emer

AU - Campbell, Nick

PY - 2012

Y1 - 2012

N2 - This paper details a method of collecting video and audio recordings of people interacting with a simple robot interlocutor. The interaction is recorded via a number of cameras and microphones mounted on and around the robot. The system utilised a number of technologies to engage with interlocutors including OpenCV, Python, and Max MSP. Interactions over a three month period were collected at The Science Gallery in Trinity College Dublin. Visitors to the gallery freely engaged with the robot, with interactions on their behalf being spontaneous and non-scripted. The robot dialogue was a set pattern of utterances to engage interlocutors in a simple conversation. A large number of audio and video recordings were collected over a three month period.

AB - This paper details a method of collecting video and audio recordings of people interacting with a simple robot interlocutor. The interaction is recorded via a number of cameras and microphones mounted on and around the robot. The system utilised a number of technologies to engage with interlocutors including OpenCV, Python, and Max MSP. Interactions over a three month period were collected at The Science Gallery in Trinity College Dublin. Visitors to the gallery freely engaged with the robot, with interactions on their behalf being spontaneous and non-scripted. The robot dialogue was a set pattern of utterances to engage interlocutors in a simple conversation. A large number of audio and video recordings were collected over a three month period.

KW - Audio interface

KW - Face detection

KW - Human-robot interaction

KW - Multi-modal data collection

KW - Platformrobot

KW - WOZ

UR - https://www.scopus.com/pages/publications/84859636584

M3 - Article

AN - SCOPUS:84859636584

SN - 1785-8860

VL - 9

SP - 7

EP - 17

JO - Acta Polytechnica Hungarica

JF - Acta Polytechnica Hungarica

IS - 1

ER -

Designing and implementing a platform for collecting multi-modal data of human-robot interaction

Abstract

Keywords

Fingerprint

Cite this