
"Automated scoring engines [. . .] require a careful balancing of the contributions of technology, NLP, psychometrics, artificial intelligence, and the learning sciences. The present handbook is evidence that the theories, methodologies, and underlying technology that surround automated scoring have reached maturity, and that there is a growing acceptance of these technologies among experts and the public."
From the Foreword by Alina von Davier, ACTNext Senior Vice President
Handbook of Automated Scoring: Theory into Practice provides a scientifically grounded overview of the key research efforts required to move automated scoring systems into operational practice. It examines the field of automated scoring from the viewpoint of related scientific fields serving as its foundation, the latest developments of computational methodologies utilized in automated scoring, and several large-scale real-world applications of automated scoring for complex learning and assessment systems. The book is organized into three parts that cover (1) theoretical foundations, (2) operational methodologies, and (3) practical illustrations, each with a commentary. In addition, the handbook includes an introduction and synthesis chapter as well as a cross-chapter glossary.
Inhaltsverzeichnis
Contents
Foreword. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
1 The Past, Present, and Future of Automated Scoring. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Peter W. Foltz, Duanli Yan, and André A. Rupp
Part I: Theoretical Foundations
2 Cognitive Foundations of Automated Scoring. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
Malcolm I. Bauer and Diego Zapata-Rivera
3 Assessment Design with Automated Scoring in Mind. . . . . . . . . . . . . . . . . . . . . . . . . 29
Kristen DiCerbo, Emily Lai, and Matthew Ventura
4 Human Scoring with Automated Scoring in Mind. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Edward W. Wolfe
5 Natural Language Processing for Writing and Speaking. . . . . . . . . . . . . . . . . . . . . 69
Aoife Cahill and Keelan Evanini
6 Multimodal Analytics for Automated Assessment. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
Sidney K. D'Mello
7 International Applications of Automated Essay Scoring. . . . . . . . . . . . . . . . . . . . 113
Mark D. Shermis
8 Public Perception and Communication around Automated
Essay Scoring. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133
Scott W. Wood
9 An Evidentiary-Reasoning Perspective on Automated Scoring:
Commentary on Part I. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151
Robert J. Mislevy
Part II: Operational Methodologies
10 Operational Human Scoring at Scale. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171
Kathryn L. Ricker-Pedley, Susan Hines, and Carolyn Connelly
11 System Architecture Design for Scoring and Delivery. . . . . . . . . . . . . . . . . . . . . . . 195
Sue Lottridg
'the Handbook of Automated Scoring is an excellent resource for understanding the theoretical, methodological and practical components of automated scoring. It provides a good foundation for understanding the considerations behind how assessments are designed and detailed methodological information about how to best create these kinds of systems. Part 3 that contains different illustrations of how to best design these systems is especially useful for students who are learning more about how these systems should work when implemented correctly.'
- Magdalen Beiting-Parrish and Jay Verkuilen, International Statistical Review, 2021
Es wurden noch keine Bewertungen abgegeben. Schreiben Sie die erste Bewertung zu "Handbook of Automated Scoring" und helfen Sie damit anderen bei der Kaufentscheidung.