Educational and Psychological Measurement, Volume 85, Issue 1, Page 114-133, February 2025.
Parallel analysis has been considered one of the most accurate methods for determining the number of factors in factor analysis. One major advantage of parallel analysis over traditional factor retention methods (e.g., Kaiser’s rule) is that it addresses ...

Educational and Psychological Measurement, Volume 85, Issue 1, Page 60-81, February 2025.
The problem of local item dependencies (LIDs) is very common in personality and attitude measures, particularly in those that measure narrow-bandwidth dimensions. At the structural level, these dependencies can be modeled by using extended factor analytic ...

Educational and Psychological Measurement, Volume 85, Issue 1, Page 156-177, February 2025.
This note is concerned with the study of temporal development in several indices reflecting clustering effects in multilevel designs that are frequently utilized in educational and behavioral research. A latent variable method-based approach is outlined, ...

Educational and Psychological Measurement, Volume 85, Issue 1, Page 134-155, February 2025.
To mitigate the potential damaging consequences of rapid guessing (RG), a form of noneffortful responding, researchers have proposed a number of scoring approaches. The present simulation study examines the robustness of the most popular of these ...

Educational and Psychological Measurement, Volume 85, Issue 1, Page 38-59, February 2025.
Test-takers, policymakers, teachers, and institutions are increasingly demanding that testing programs provide more detailed feedback regarding test performance. As a result, there has been a growing interest in the reporting of subscores that potentially ...

Educational and Psychological Measurement, Volume 85, Issue 1, Page 5-37, February 2025.
Psychologists are emphasizing the importance of predictive conclusions. Machine learning methods, such as supervised neural networks, have been used in psychological studies as they naturally fit prediction tasks. However, we are concerned about whether ...

Educational and Psychological Measurement, Volume 85, Issue 1, Page 178-214, February 2025.
The use of discrete categorical formats to assess psychological traits has a long-standing tradition that is deeply embedded in item response theory models. The increasing prevalence and endorsement of computer- or web-based testing has led to greater ...

Educational and Psychological Measurement, Volume 85, Issue 1, Page 82-113, February 2025.
The multiple imputation two-stage (MI2S) approach holds promise for evaluating the model fit of structural equation models for ordinal variables with multiply imputed data. However, previous studies only examined the performance of MI2S-based residual-...

Educational and Psychological Measurement, Ahead of Print.
Field-testing is an essential yet often resource-intensive step in the development of high-quality educational assessments. I introduce an innovative method for field-testing newly written exam items by substituting human examinees with artificially ...

Educational and Psychological Measurement, Ahead of Print.
The standardized mean difference (sometimes called Cohen’s d) is an effect size measure widely used to describe the outcomes of experiments. It is mathematically natural to describe differences between groups of data that are normally distributed with ...

Educational and Psychological Measurement, Ahead of Print.
A multiple-step procedure is outlined that can be used for examining the latent structure of behavior measurement instruments in complex empirical settings. The method permits one to study their latent structure after assessing the need to account for ...

Educational and Psychological Measurement, Ahead of Print.
A procedure is outlined for point and interval estimation of location parameters associated with polytomous items, or raters assessing studied subjects or cases, which follow the rating scale model. The method is developed within the framework of latent ...

Educational and Psychological Measurement, Ahead of Print.
A latent variable modeling procedure for studying factorial invariance and differential item functioning for multi-component measuring instruments with nominal items is discussed. The method is based on a multiple testing approach utilizing the false ...

Educational and Psychological Measurement, Ahead of Print.
We outline a procedure for examining collapsibility over site in multiple-location settings that are frequently utilized in contemporary educational and behavioral research. The method is based on a test of cross-site identity of the response ...

Educational and Psychological Measurement, Ahead of Print.
Educational and psychological tests with an ordered item structure enable efficient test administration procedures and allow for intuitive score interpretation and monitoring. The effectiveness of the measurement instrument relies to a large extent on the ...

Educational and Psychological Measurement, Ahead of Print.
In educational assessment, cut scores are often defined through standard setting by a group of subject matter experts. This study aims to investigate the impact of several factors on classification accuracy using the receiver operating characteristic (ROC)...

Educational and Psychological Measurement, Ahead of Print.
This study investigated uniform differential item functioning (DIF) detection in response times. We proposed a regression analysis approach with both the working speed and the group membership as independent variables, and logarithm transformed response ...

Educational and Psychological Measurement, Ahead of Print.
There has been an emphasis on effect sizes for differential item functioning (DIF) with the purpose to understand the magnitude of the differences that are detected through statistical significance testing. Several different effect sizes have been ...

Educational and Psychological Measurement, Ahead of Print.
In psychological research, respondents are usually asked to answer questions with a single response value. A useful alternative are interval response formats like the dual-range slider (DRS) where respondents provide an interval with a lower and an upper ...

Educational and Psychological Measurement, Ahead of Print.
The assessment of individual students is not only crucial in the school setting but also at the core of educational research. Although classical test theory focuses on maximizing insights from student responses, the Bayesian perspective incorporates the ...

Educational and Psychological Measurement, Ahead of Print.
This study investigates the treatment of rapid-guess (RG) responses as missing data within the context of the effort-moderated model. Through a series of illustrations, this study demonstrates that the effort-moderated model assumes missing at random (MAR)...

Educational and Psychological Measurement, Ahead of Print.
This study examines the performance of ChatGPT, developed by OpenAI and widely used as an AI-based conversational tool, as a data analysis tool through exploratory factor analysis (EFA). To this end, simulated data were generated under various data ...

Educational and Psychological Measurement, Ahead of Print.
Maintaining consistent item difficulty across test forms is crucial for accurately and fairly classifying examinees into pass or fail categories. This article presents a practical procedure for classifying items based on difficulty levels using functional ...

Educational and Psychological Measurement, Ahead of Print.
In computerized adaptive testing (CAT), examinees see items targeted to their ability level. Postoperational data have a high degree of missing information relative to designs where everyone answers all questions. Item responses are observed over a ...

Educational and Psychological Measurement, Ahead of Print.
Self-report personality tests used in high-stakes assessments hold the risk that test-takers engage in faking. In this article, we demonstrate an extension of the multidimensional nominal response model (MNRM) to account for the response bias of faking. ...

Educational and Psychological Measurement, Ahead of Print.
Social and behavioral science researchers who use survey data are vigilant about data quality, with an increasing emphasis on avoiding common method variance (CMV) and insufficient effort responding (IER). Each of these errors can inflate and deflate ...

Educational and Psychological Measurement, Ahead of Print.
Inferences about student learning from large-scale achievement test scores are fundamental in education. For achievement test scores to provide useful information about student learning progress, differences in the content of instruction (i.e., the ...

Educational and Psychological Measurement, Ahead of Print.
Coefficient Omega measuring internal consistency is investigated for its deviations from expected outcomes when applied to correlational patterns that produce variable-focused factor solutions in confirmatory factor analysis. In these solutions, the ...

Educational and Psychological Measurement, Ahead of Print.
In this study, we proposed a novel scale abbreviation method based on sentence embeddings and compared it to two established automatic scale abbreviation techniques. Scale abbreviation methods typically rely on administering the full scale to a large ...

Educational and Psychological Measurement, Ahead of Print.
Rapid-guessing behavior in data can compromise our ability to estimate item and person parameters accurately. Consequently, it is crucial to model data with rapid-guessing patterns in a way that can produce unbiased ability estimates. This study proposes ...

Educational and Psychological Measurement, Ahead of Print.
Measurement involves numerous theoretical and empirical steps—ensuring our measures are operating the same in different groups is one step. Measurement invariance occurs when the factor loadings and item intercepts or thresholds of a scale operate ...

Educational and Psychological Measurement, Ahead of Print.
The speed–accuracy tradeoff (SAT), where increased response speed often leads to decreased accuracy, is well established in experimental psychology. However, its implications for psychological assessments, especially in high-stakes settings, remain less ...

Educational and Psychological Measurement, Ahead of Print.
Despite numerous studies on the magnitude of differential item functioning (DIF), different DIF detection methods often define effect sizes inconsistently and fail to adequately account for testing conditions. To address these limitations, this study ...

Educational and Psychological Measurement, Ahead of Print.
Factor analysis is commonly used in behavioral sciences to measure latent constructs, and researchers routinely consider approximate fit indices to ensure adequate model fit and to provide important validity evidence. Due to a lack of generalizable fit ...

Educational and Psychological Measurement, Ahead of Print.
Evaluating differential item functioning (DIF) in assessments plays an important role in achieving measurement fairness across different subgroups, such as gender and native language. However, relying solely on the item response scores among traditional ...

Educational and Psychological Measurement, Ahead of Print.
This study explores the performance of the item response tree (IRTree) approach in modeling missing data, comparing its performance to the expectation–maximization (EM) algorithm and multiple imputation (MI) methods. Both simulation and empirical data ...

Educational and Psychological Measurement, Ahead of Print.
Multidimensional Item Response Theory (MIRT) is applied routinely in developing educational and psychological assessment tools, for instance, for exploring multidimensional structures of items using exploratory MIRT. A critical decision in exploratory ...

Educational and Psychological Measurement, Ahead of Print.
An index extending the widely used omega-hierarchical coefficient is discussed, which can be used for evaluating the influence of a second-order factor on the interrelationships among the components of a hierarchical measuring instrument. The index ...

Educational and Psychological Measurement, Ahead of Print.
A plethora of techniques exist to determine the number of factors to retain in exploratory factor analysis. A recent and promising technique is the Next Eigenvalue Sufficiency Test (NEST), but has not been systematically compared with well-established ...

Educational and Psychological Measurement, Ahead of Print.
A new alternative to obtain a Bayesian estimate of coefficient alpha through a posterior normal distribution is proposed and assessed through percentile, normal-theory-based, and highest probability density credible intervals in a simulation study. The ...