Machine Learning, Natural Language Processing, and Psychometrics

Hong Jiao,Robert W. Lissitz

• Publisher: Information Age Publishing
• Year: 2024
• ISBN:
  9798887306063
• Topic: Ciencia de la computación
• Subtopic: Procesamiento del lenguaje natural

With the exponential increase of digital assessment, different types of data in addition to item responses become available in the measurement process. One of the salient features in digital assessment is that process data can be easily collected. This non-conventional structured or unstructured data source may bring new perspectives to better understand the assessment products or accuracy and the process how an item product was attained. The analysis of the conventional and non-conventional assessment data calls for more methodology other than the latent trait modeling.Natural language processing (NLP) methods and machine learning algorithms have been successfully applied in automated scoring. It has been explored in providing diagnostic feedback to test-takers in writing assessment. Recently, machine learning algorithms have been explored for cheating detection and cognitive diagnosis. When the measurement field promote the use of assessment data to provide feedback to improve teaching and learning, it is the right time to explore new methodology and explore the value added from other data sources. This book presents the use cases of machine learning and NLP in improving the assessment theory and practices in high-stakes summative assessment, learning, and instruction. More specifically, experts from the field addressed the topics related to automated item generations, automated scoring, automated feedback in writing, explainability of automated scoring, equating, cheating and alarming response detection, adaptive testing, and applications in science assessment. This book demonstrates the utility of machine learning and NLP in assessment design and psychometric analysis.

Table of contents

• Cover
• Series page
• Machine Learning, Natural Language Processing, and Psychometrics
• Library of Congress Cataloging-in-Publication Data
• CONTENTS
• CHAPTER 1: The Item Factory
• CHAPTER 2: Applications of Transformer Neural Networks in Processing Examinee Responses
• CHAPTER 3: Integrating Natural Language Processing for Writing Assessment
• CHAPTER 4: Empirical Ensemble Equating Under the NEAT Design
• CHAPTER 5: Test Security in Remote Testing Age
• CHAPTER 6: Using Language Models to Detect Alarming Student Responses
• CHAPTER 7: Epic Analysis
• CHAPTER 8: Fully Data-Driven Computerized Adaptive Testing
• CHAPTER 9: From Adaptive Testing to Personalized Adaptive Testing
• CHAPTER 10: AI and Machine Learning for Next Generation Science Assessments
• CHAPTER 11: An AI-Based Platform for Real Time Assessment