On the relationship between perception of usability and subjective mental workload of web interfaces

Luca Longo; Pierpaolo Dondio

doi:10.1109/WI-IAT.2015.157

On the relationship between perception of usability and subjective mental workload of web interfaces

Luca Longo, Pierpaolo Dondio

School of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Inspection methods and cheap self-reporting procedures have been significantly employed in the field of Human- Computer Interaction for assessing the usability of interfaces, systems and technologies. However, there is a tendency to overlook aspects related to the context and features of the users during the usability assessment process. This research introduces the concept of mental workload as an aid to enhance usability measurement. A user-study has been designed and executed in the context of human-web interaction. The aim was to investigate the relationship between the perception of usability of three popular web-sites, and the mental workload imposed by a set of typical tasks executed over them. Scores obtained with the System Usability Scale were compared to the mental workload scores obtained from the NASA Task Load Index and the Workload Profile assessment procedures. Findings suggest that perception of usability and mental workload are likely to be two nonoverlapping constructs, and there is no clear evidence of their interaction. They measure two different aspects of human-system interaction and therefore they could be jointly employed to better describe user experience.

Original language	English
Title of host publication	Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	345-352
Number of pages	8
ISBN (Electronic)	9781467396172
DOIs	https://doi.org/10.1109/WI-IAT.2015.157
Publication status	Published - 2 Feb 2016
Event	2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology Workshops, WI-IAT Workshops 2015 - Singapore, Singapore Duration: 6 Dec 2015 → 9 Dec 2015

Publication series

Name	Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015
Volume	1

Conference

Conference	2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology Workshops, WI-IAT Workshops 2015
Country/Territory	Singapore
City	Singapore
Period	6/12/15 → 9/12/15

Keywords

A/B testing
Mental Workload
Usability
Web-design

Access to Document

10.1109/WI-IAT.2015.157

https://arrow.tudublin.ie/scschcomcon/187Licence: CC BY-NC-SA

Cite this

Longo, L., & Dondio, P. (2016). On the relationship between perception of usability and subjective mental workload of web interfaces. In Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015 (pp. 345-352). Article 7396828 (Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015; Vol. 1). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/WI-IAT.2015.157

Longo, Luca ; Dondio, Pierpaolo. / On the relationship between perception of usability and subjective mental workload of web interfaces. Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 345-352 (Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015).

@inproceedings{b6e6ad1c445045a0a8313ae30ca2985c,

title = "On the relationship between perception of usability and subjective mental workload of web interfaces",

abstract = "Inspection methods and cheap self-reporting procedures have been significantly employed in the field of Human- Computer Interaction for assessing the usability of interfaces, systems and technologies. However, there is a tendency to overlook aspects related to the context and features of the users during the usability assessment process. This research introduces the concept of mental workload as an aid to enhance usability measurement. A user-study has been designed and executed in the context of human-web interaction. The aim was to investigate the relationship between the perception of usability of three popular web-sites, and the mental workload imposed by a set of typical tasks executed over them. Scores obtained with the System Usability Scale were compared to the mental workload scores obtained from the NASA Task Load Index and the Workload Profile assessment procedures. Findings suggest that perception of usability and mental workload are likely to be two nonoverlapping constructs, and there is no clear evidence of their interaction. They measure two different aspects of human-system interaction and therefore they could be jointly employed to better describe user experience.",

keywords = "A/B testing, Mental Workload, Usability, Web-design",

author = "Luca Longo and Pierpaolo Dondio",

note = "Publisher Copyright: {\textcopyright} 2015 IEEE.; 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology Workshops, WI-IAT Workshops 2015 ; Conference date: 06-12-2015 Through 09-12-2015",

year = "2016",

month = feb,

day = "2",

doi = "10.1109/WI-IAT.2015.157",

language = "English",

series = "Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "345--352",

booktitle = "Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015",

address = "United States",

}

Longo, L & Dondio, P 2016, On the relationship between perception of usability and subjective mental workload of web interfaces. in Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015., 7396828, Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015, vol. 1, Institute of Electrical and Electronics Engineers Inc., pp. 345-352, 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology Workshops, WI-IAT Workshops 2015, Singapore, Singapore, 6/12/15. https://doi.org/10.1109/WI-IAT.2015.157

On the relationship between perception of usability and subjective mental workload of web interfaces. / Longo, Luca; Dondio, Pierpaolo.
Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015. Institute of Electrical and Electronics Engineers Inc., 2016. p. 345-352 7396828 (Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015; Vol. 1).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - On the relationship between perception of usability and subjective mental workload of web interfaces

AU - Longo, Luca

AU - Dondio, Pierpaolo

PY - 2016/2/2

Y1 - 2016/2/2

N2 - Inspection methods and cheap self-reporting procedures have been significantly employed in the field of Human- Computer Interaction for assessing the usability of interfaces, systems and technologies. However, there is a tendency to overlook aspects related to the context and features of the users during the usability assessment process. This research introduces the concept of mental workload as an aid to enhance usability measurement. A user-study has been designed and executed in the context of human-web interaction. The aim was to investigate the relationship between the perception of usability of three popular web-sites, and the mental workload imposed by a set of typical tasks executed over them. Scores obtained with the System Usability Scale were compared to the mental workload scores obtained from the NASA Task Load Index and the Workload Profile assessment procedures. Findings suggest that perception of usability and mental workload are likely to be two nonoverlapping constructs, and there is no clear evidence of their interaction. They measure two different aspects of human-system interaction and therefore they could be jointly employed to better describe user experience.

AB - Inspection methods and cheap self-reporting procedures have been significantly employed in the field of Human- Computer Interaction for assessing the usability of interfaces, systems and technologies. However, there is a tendency to overlook aspects related to the context and features of the users during the usability assessment process. This research introduces the concept of mental workload as an aid to enhance usability measurement. A user-study has been designed and executed in the context of human-web interaction. The aim was to investigate the relationship between the perception of usability of three popular web-sites, and the mental workload imposed by a set of typical tasks executed over them. Scores obtained with the System Usability Scale were compared to the mental workload scores obtained from the NASA Task Load Index and the Workload Profile assessment procedures. Findings suggest that perception of usability and mental workload are likely to be two nonoverlapping constructs, and there is no clear evidence of their interaction. They measure two different aspects of human-system interaction and therefore they could be jointly employed to better describe user experience.

KW - A/B testing

KW - Mental Workload

KW - Usability

KW - Web-design

UR - https://www.scopus.com/pages/publications/84988502049

U2 - 10.1109/WI-IAT.2015.157

DO - 10.1109/WI-IAT.2015.157

M3 - Conference contribution

AN - SCOPUS:84988502049

T3 - Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015

SP - 345

EP - 352

BT - Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology Workshops, WI-IAT Workshops 2015

Y2 - 6 December 2015 through 9 December 2015

ER -

Longo L, Dondio P. On the relationship between perception of usability and subjective mental workload of web interfaces. In Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015. Institute of Electrical and Electronics Engineers Inc. 2016. p. 345-352. 7396828. (Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015). doi: 10.1109/WI-IAT.2015.157

On the relationship between perception of usability and subjective mental workload of web interfaces

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Cite this