XI Conference – European Congress of Methodology

Session

Symposium : "Innovative Approaches to Address Validity"

24 Jul 2025, 10:00

315. Building and Validating Culturally Responsive Assessments

24/07/2025, 10:00

Oral Presentation

An exciting development in educational and psychological testing is culturally responsive assessment, which is assessment that is “mindful of student differences and employs assessment methods appropriate for different student groups”(Montenegro & Jankowski, 2017, p. 9). Although the call for culturally responsive assessment is strong, there are few examples of good practices in this area and...

316. Mapping construct representations: Integrative approaches to Content Validity and Latent structures

24/07/2025, 10:20

Oral Presentation

This oral communication examines evidence of content validity in psychometrics, focusing on established procedures and potential complementary approaches. We review traditional validation methods, acknowledging their foundational importance. Our discussion emphasizes the need for isomorphic relationships between construct definitions and operational representations, a cornerstone of...

317. Collecting Validity Evidence Through the Measurement of Eye Movement

24/07/2025, 10:40

Oral Presentation

Item functioning is typically evaluated through pilot studies to identify problematic items and assess their performance. However, such analyses often fail to provide insights into the underlying causes of these problems. To address this gap, alternative strategies such as psychophysiological measures, including eye movements, may offer valuable insights into participants’ response processes....

318. Improving web probing method to obtain validity evidence of response processes by an AI generative app

24/07/2025, 11:00

Oral Presentation

Practitioners and researchers use open-ended questions when designing survey questions to obtain validity evidence of response processes to survey items and questions. Data cleaning and response coding pose significant challenges, particularly for “web probes,”given the self-administered nature of “web probes”and the large number of participants compared to the smaller number of people...

132. Innovative Approaches to Address Validity

Measurement

Symposium