XI Conference – European Congress of Methodology

Session

Symposium : "Innovations in test development and validation"

23 Jul 2025, 15:00

340. Constructing, Improving, and Shortening Tests for Skill Assessment with Competence-based Test Development

23/07/2025, 15:00

Oral Presentation

An assessment conducted within competence-based knowledge structure theory (CbKST) aims to uncover the skills that an individual possesses based on their observed responses to test items. This process involves first deriving the set of items that the individual is capable of solving (the knowledge state) from the set of items they actually solved (the response pattern), and then inferring the...

341. Exploratory Structural Equation Modeling (ESEM) in Comparison with CFA Models

23/07/2025, 15:15

Oral Presentation

Psychometric evaluations of psychological assessment measures have shown that several instruments produce inconsistent factor structures across groups and contexts and provide questionable reliability and predictive validity. A key conceptual issue concerns how a theoretical construct is defined vs. how it is measured. Given that psychological constructs cannot be observed directly, but only...

342. Addressing Ordinal Variables through Integrated IRT and CTT Methods in Cultural Capital Measurement

23/07/2025, 15:30

Oral Presentation

In quantitative measurement, Likert scales are often treated as continuous variables, potentially distorting results due to their ordinal nature. This study addresses the issue of appropriately handling ordinal variables by integrating classical test theory (CTT) and item response theory (IRT) to validate a novel Scale of Cultural Capital (SCC). SCC consists of 14 items measuring three...

343. On the Way to State Specific Response Errors: A Generalized Local Independence Model

23/07/2025, 15:45

Oral Presentation

Knowledge structure theory is a psychometric approach for representing the knowledge of participants in a precise, non-numerical way. The most prominent probabilistic model in knowledge structure theory is the basic local independence model. One of its fundamental assumptions is the constancy of the response error probabilities (guessing and slipping) across all participants. However, it seems...

344. Probabilistic Information and Network Evaluation System (PINES): A Bayesian Framework for Advancing Psychometric Testing

23/07/2025, 16:00

Oral Presentation

As educational and cognitive assessments advance, there is a growing need for innovative, evidence based methodologies that offer deeper insights into students’ abilities, knowledge representation, and response reliability. Contemporary assessment systems face the challenge of capturing nuanced insights into student learning while ensuring measurement validity, going beyond traditional...

127. Innovations in test development and validation

Measurement

Symposium