Skip Nav Destination
Close Modal
Update search
NARROW
Format
TocHeadingTitle
Date
Availability
1-3 of 3
Robert T. Pennock
Close
Follow your search
Access your saved searches in your account
Would you like to receive an alert when new items match your search?
Sort by
Proceedings Papers
Comparing Human and Automated Evaluation of Open-Ended Student Responses to Questions of Evolution
Open Access
. alif2016, ALIFE 2016, the Fifteenth International Conference on the Synthesis and Simulation of Living Systems116-122, (July 4–6, 2016) 10.1162/978-0-262-33936-0-ch025
Abstract
View Papertitled, Comparing Human and Automated Evaluation of Open-Ended Student Responses to Questions of Evolution
View
PDF
for content titled, Comparing Human and Automated Evaluation of Open-Ended Student Responses to Questions of Evolution
Written responses can provide a wealth of data in understanding student reasoning on a topic. Yet they are time- and labor-intensive to score, requiring many instructors to forego them except as limited parts of summative assessments at the end of a unit or course. Recent developments in Machine Learning (ML) have produced computational methods of scoring written responses for the presence or absence of specific concepts. Here, we compare the scores from one particular ML program EvoGrader to human scoring of responses to structurally- and content- similar questions that are distinct from the ones the program was trained on. We find that there is substantial inter-rater reliability between the human and ML scoring. However, sufficient systematic differences remain between the human and ML scoring that we advise only using the ML scoring for formative, rather than summative, assessment of student reasoning.
Proceedings Papers
. ecal2011, ECAL 2011: The 11th European Conference on Artificial Life44, (August 8–12, 2011) 10.7551/978-0-262-29714-1-ch044
Proceedings Papers
. ecal2011, ECAL 2011: The 11th European Conference on Artificial Life25, (August 8–12, 2011) 10.7551/978-0-262-29714-1-ch025
View Papertitled, Selective pressures for accurate altruism targeting: evidence from digital evolution for difficult-to-test aspects of inclusive fitness theory (abstract)
View
PDF
for content titled, Selective pressures for accurate altruism targeting: evidence from digital evolution for difficult-to-test aspects of inclusive fitness theory (abstract)