A continuous-time dynamic choice measurement model for problem-solving process data

DOI10.1007/S11336-020-09734-1zbMATH Open1477.62330arXiv1912.11335OpenAlexW3114135898MaRDI QIDQ2065262FDOQ2065262

Authors: Yunxiao Chen 

Publication date: 7 January 2022

Published in: Psychometrika (Search for Journal in Brave)

Abstract: Problem solving has been recognized as a central skill that today's students need to thrive and shape their world. As a result, the measurement of problem-solving competency has received much attention in education in recent years. A popular tool for the measurement of problem solving is simulated interactive tasks, which require students to uncover some of the information needed to solve the problem through interactions with a computer-simulated environment. A computer log file records a student's problem-solving process in details, including his/her actions and the time stamps of these actions. It thus provides rich information for the measurement of students' problem-solving competency. On the other hand, extracting useful information from log files is a challenging task, due to its complex data structure. In this paper, we show how log file process data can be viewed as a marked point process, based on which we propose a continuous-time dynamic choice model. The proposed model can serve as a measurement model for scaling students along the latent traits of problem-solving competency and action speed, based on data from one or multiple tasks. A real data example is given based on data from Program for International Student Assessment 2012.

Full work available at URL: https://arxiv.org/abs/1912.11335

Recommendations

• Students' complex problem solving profiles
• Diagnostic classification analysis of problem-solving competence using process data: an item expansion method
• Markov decision process measurement model
• Accurate assessment via process data
• Markov solution processes: modeling human problem solving with procedural knowledge space theory

zbMATH Keywords

measurementmarked point processproblem solvingchoice modelprocess data

Mathematics Subject Classification ID

Applications of statistics to psychology (62P15) Measurement and performance in psychology (91E45)

Cites Work

• Title not available (Why is that?)
• Maximum likelihood estimates in exponential response models
• The statistical analysis of recurrent events.
• Title not available (Why is that?)
• Title not available (Why is that?)
• A taxonomy of item response models
• High-dimensional exploratory item factor analysis by a Metropolis-Hastings Robbins-Monro algorithm
• A hierarchical framework for modeling speed and accuracy on test items
• Title not available (Why is that?)
• Markov decision process measurement model
• Latent feature extraction for process data via multidimensional scaling
• Joint maximum likelihood estimation for high-dimensional exploratory item factor analysis
• An improved stochastic EM algorithm for large-scale full-information item factor analysis
• Structured latent factor analysis for large-scale data: identifiability, estimability, and their implications

Cited In (7)

• Diagnostic classification analysis of problem-solving competence using process data: an item expansion method
• Students' complex problem solving profiles
• A latent hidden Markov model for process data
• Markov decision process measurement model
• Polytomous effectiveness indicators in complex problem-solving tasks and their applications in developing measurement model
• A latent topic model with Markov transition for process data
• Modelling multiple problem‐solving strategies and strategy shift in cognitive diagnosis for growth

This page was built for publication: A continuous-time dynamic choice measurement model for problem-solving process data

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2065262)