Learning from the Evidence: Impact Evaluations, Ontology and Policy

Matt Murtagh-White; P. J. Wall; Declan O'Sullivan

doi:10.1109/ICSC56153.2023.00023

Learning from the Evidence: Impact Evaluations, Ontology and Policy

Matt Murtagh-White, P. J. Wall, Declan O'Sullivan

School of Business Technology, Retail and Supply Chain

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

In the past two decades, the use of Randomised Controlled Trials (RCTs) in economics and international development has grown, providing policymakers and researchers with new insight into what interventions work in improving people's welfare. This paper proposes a novel ontology based on the OWL framework that describes the results, methods and themes of RCTs in social science and policy. The ontology was evaluated using data from the American Economic Association Registry of RCTs, the International Initiative for Impact Evaluation's evidence hub and the World Bank; it was found to be effective at filtering relevant studies but less useful in pooling treatment results due to a lack of source data.

Original language	English
Title of host publication	Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	104-106
Number of pages	3
ISBN (Electronic)	9781665482639
DOIs	https://doi.org/10.1109/ICSC56153.2023.00023
Publication status	Published - 2023
Event	17th IEEE International Conference on Semantic Computing, ICSC 2023 - Virtual, Online, United States Duration: 1 Feb 2023 → 3 Feb 2023

Publication series

Name	Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023

Conference

Conference	17th IEEE International Conference on Semantic Computing, ICSC 2023
Country/Territory	United States
City	Virtual, Online
Period	1/02/23 → 3/02/23

Keywords

International Development
Knowledge Graphs
Meta-Science
Ontologies

Access to Document

10.1109/ICSC56153.2023.00023

Cite this

Murtagh-White, M., Wall, P. J., & O'Sullivan, D. (2023). Learning from the Evidence: Impact Evaluations, Ontology and Policy. In Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023 (pp. 104-106). (Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICSC56153.2023.00023

Murtagh-White, Matt ; Wall, P. J. ; O'Sullivan, Declan. / Learning from the Evidence : Impact Evaluations, Ontology and Policy. Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023. Institute of Electrical and Electronics Engineers Inc., 2023. pp. 104-106 (Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023).

@inproceedings{a59da7c4f210469cb637f45ea51b2ff1,

title = "Learning from the Evidence: Impact Evaluations, Ontology and Policy",

abstract = "In the past two decades, the use of Randomised Controlled Trials (RCTs) in economics and international development has grown, providing policymakers and researchers with new insight into what interventions work in improving people's welfare. This paper proposes a novel ontology based on the OWL framework that describes the results, methods and themes of RCTs in social science and policy. The ontology was evaluated using data from the American Economic Association Registry of RCTs, the International Initiative for Impact Evaluation's evidence hub and the World Bank; it was found to be effective at filtering relevant studies but less useful in pooling treatment results due to a lack of source data.",

keywords = "International Development, Knowledge Graphs, Meta-Science, Ontologies",

author = "Matt Murtagh-White and Wall, \{P. J.\} and Declan O'Sullivan",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 17th IEEE International Conference on Semantic Computing, ICSC 2023 ; Conference date: 01-02-2023 Through 03-02-2023",

year = "2023",

doi = "10.1109/ICSC56153.2023.00023",

language = "English",

series = "Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "104--106",

booktitle = "Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023",

address = "United States",

}

Murtagh-White, M, Wall, PJ & O'Sullivan, D 2023, Learning from the Evidence: Impact Evaluations, Ontology and Policy. in Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023. Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023, Institute of Electrical and Electronics Engineers Inc., pp. 104-106, 17th IEEE International Conference on Semantic Computing, ICSC 2023, Virtual, Online, United States, 1/02/23. https://doi.org/10.1109/ICSC56153.2023.00023

Learning from the Evidence: Impact Evaluations, Ontology and Policy. / Murtagh-White, Matt; Wall, P. J.; O'Sullivan, Declan.
Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023. Institute of Electrical and Electronics Engineers Inc., 2023. p. 104-106 (Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Learning from the Evidence

T2 - 17th IEEE International Conference on Semantic Computing, ICSC 2023

AU - Murtagh-White, Matt

AU - Wall, P. J.

AU - O'Sullivan, Declan

PY - 2023

Y1 - 2023

N2 - In the past two decades, the use of Randomised Controlled Trials (RCTs) in economics and international development has grown, providing policymakers and researchers with new insight into what interventions work in improving people's welfare. This paper proposes a novel ontology based on the OWL framework that describes the results, methods and themes of RCTs in social science and policy. The ontology was evaluated using data from the American Economic Association Registry of RCTs, the International Initiative for Impact Evaluation's evidence hub and the World Bank; it was found to be effective at filtering relevant studies but less useful in pooling treatment results due to a lack of source data.

AB - In the past two decades, the use of Randomised Controlled Trials (RCTs) in economics and international development has grown, providing policymakers and researchers with new insight into what interventions work in improving people's welfare. This paper proposes a novel ontology based on the OWL framework that describes the results, methods and themes of RCTs in social science and policy. The ontology was evaluated using data from the American Economic Association Registry of RCTs, the International Initiative for Impact Evaluation's evidence hub and the World Bank; it was found to be effective at filtering relevant studies but less useful in pooling treatment results due to a lack of source data.

KW - International Development

KW - Knowledge Graphs

KW - Meta-Science

KW - Ontologies

UR - https://www.scopus.com/pages/publications/85151512072

U2 - 10.1109/ICSC56153.2023.00023

DO - 10.1109/ICSC56153.2023.00023

M3 - Conference contribution

AN - SCOPUS:85151512072

T3 - Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023

SP - 104

EP - 106

BT - Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 1 February 2023 through 3 February 2023

ER -

Murtagh-White M, Wall PJ, O'Sullivan D. Learning from the Evidence: Impact Evaluations, Ontology and Policy. In Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023. Institute of Electrical and Electronics Engineers Inc. 2023. p. 104-106. (Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023). doi: 10.1109/ICSC56153.2023.00023

Learning from the Evidence: Impact Evaluations, Ontology and Policy

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Cite this