MLDG - Machine Learning Dataset Generator (Pilot Findings) - For Final Year Open-Book Machine Learning Summative Assessment

Keith Quille, Keith Nolan, Lidia Vidal-Meliá, Brett A. Becker

Research output: Contribution to conferencePaperpeer-review

Abstract

Following the COVID-19 pandemic, many institutions are considering the continuation of open-book assessments. Students cite many reasons for preferences for open-book assessments, both held in proctored environments and assessments that can be held remotely. Despite the numerous benefits, open-book assessments impose a number of challenges for educators, which is compounded if the assessment has the option to be taken in class (proctored) and remotely simultaneously. The challenges not only exist around academic integrity but also exist from a student-centred viewpoint of fairness and the equality of the assessment. This paper first presents the development of a tool for generating student-centred datasets (using the MLDG - Machine Learning Dataset Generator) which are unique but fair to allow for both in-class and remote summative assessment for a final-year Machine Learning course, simultaneously. Second, a study was conducted over a two-year period to trail the tool and assessment environment, where it reported positive findings from a student’s viewpoint, academic integrity viewpoint and the workload from course instructors (as the tool also generates an information file to reduce grading time). The results are encouraging and provide evidence that MLDG and the assessment approach used to promote a fair assessment with academic integrity for Machine Learning students. This tool and assessment approach could also be applied in other subjects such as databases thus having value outside of Machine Learning courses for the Computing Education Research community
Original languageEnglish
DOIs
Publication statusPublished - 2023
EventHCAI Education and Practice Conference -
Duration: 1 Jan 2023 → …

Conference

ConferenceHCAI Education and Practice Conference
Period1/01/23 → …

Keywords

  • open-book assessments
  • academic integrity
  • student-centred viewpoint
  • fairness
  • equality
  • Machine Learning
  • datasets
  • Computing Education Research

Fingerprint

Dive into the research topics of 'MLDG - Machine Learning Dataset Generator (Pilot Findings) - For Final Year Open-Book Machine Learning Summative Assessment'. Together they form a unique fingerprint.

Cite this