TY - GEN
T1 - Discovering the preferences of physicians with regards to rank-ordered medical documents
AU - O'Sullivan, Dympna
AU - Wilk, Szymon
AU - Michalowski, Wojtek
AU - Słowiński, Roman
AU - Thomas, Roland
AU - Farion, Ken
PY - 2012
Y1 - 2012
N2 - The practice of evidence-based medicine involves consulting documents from repositories such as Scopus, PubMed, or the Cochrane Library. The most common approach for presenting retrieved documents is in the form of a list, with the assumption that the higher a document is on a list, the more relevant it is. Despite this list-based presentation, it is seldom studied how physicians perceive the importance of the order of documents presented in a list. This paper describes an empirical study that elicited and modeled physicians' preferences with regard to list-based results. Preferences were analyzed using a GRIP method that relies on pairwise comparisons of selected subsets of possible rank-ordered lists composed of 3 documents. The results allow us to draw conclusions regarding physicians' attitudes towards the importance of having documents ranked correctly on a result list, versus the importance of retrieving relevant but misplaced documents. Our findings should help developers of clinical information retrieval applications when deciding how retrieved documents should be presented and how performance of the application should be assessed.
AB - The practice of evidence-based medicine involves consulting documents from repositories such as Scopus, PubMed, or the Cochrane Library. The most common approach for presenting retrieved documents is in the form of a list, with the assumption that the higher a document is on a list, the more relevant it is. Despite this list-based presentation, it is seldom studied how physicians perceive the importance of the order of documents presented in a list. This paper describes an empirical study that elicited and modeled physicians' preferences with regard to list-based results. Preferences were analyzed using a GRIP method that relies on pairwise comparisons of selected subsets of possible rank-ordered lists composed of 3 documents. The results allow us to draw conclusions regarding physicians' attitudes towards the importance of having documents ranked correctly on a result list, versus the importance of retrieving relevant but misplaced documents. Our findings should help developers of clinical information retrieval applications when deciding how retrieved documents should be presented and how performance of the application should be assessed.
KW - Document Retrieval
KW - Evidence-Based Medicine
KW - Information Retrieval
KW - Physician preferences
KW - Rank-ordered Lists
UR - https://www.scopus.com/pages/publications/84868109755
U2 - 10.1007/978-3-642-31718-7_15
DO - 10.1007/978-3-642-31718-7_15
M3 - Conference contribution
AN - SCOPUS:84868109755
SN - 9783642317170
T3 - Communications in Computer and Information Science
SP - 142
EP - 150
BT - Advances in Computational Intelligence - 14th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, IPMU 2012, Proceedings
T2 - 14th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, IPMU 2012
Y2 - 9 July 2012 through 13 July 2012
ER -