TY - GEN
T1 - Widening the evaluation net
AU - Mac Namee, Brian
AU - Dunne, Mark
PY - 2009
Y1 - 2009
N2 - Intelligent Virtual Agent (IVA) systems are notoriously difficult to evaluate, particularly due to the subjectivity involved. From the various efforts to develop standard evaluation schemes for IVA systems the scheme proposed by Isbister & Doyle, which evaluates systems across five categories, seems particularly appropriate. To examine how these categories are being used, the evaluations presented in the proceedings of IVA '07 and IVA '08 are summarised and the extent to which the five categories in the Isbister & Doyle scheme are used is highlighted.
AB - Intelligent Virtual Agent (IVA) systems are notoriously difficult to evaluate, particularly due to the subjectivity involved. From the various efforts to develop standard evaluation schemes for IVA systems the scheme proposed by Isbister & Doyle, which evaluates systems across five categories, seems particularly appropriate. To examine how these categories are being used, the evaluations presented in the proceedings of IVA '07 and IVA '08 are summarised and the extent to which the five categories in the Isbister & Doyle scheme are used is highlighted.
UR - http://www.scopus.com/inward/record.url?scp=70350363093&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-04380-2_74
DO - 10.1007/978-3-642-04380-2_74
M3 - Conference contribution
AN - SCOPUS:70350363093
SN - 3642043798
SN - 9783642043796
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 525
EP - 526
BT - Intelligent Virtual Agents - 9th International Conference, IVA 2009, Proceedings
T2 - 9th International Conference on Intelligent Virtual Agents, IVA 2009
Y2 - 14 September 2009 through 16 September 2009
ER -