Classification consistency and results reporting of a digital-first computer-adaptive language proficiency test
- UNCG Author/Contributor (non-UNCG co-authors, if there are any, appear on document)
- Ramsey Lee Cardwell (Creator)
- Institution
- The University of North Carolina at Greensboro (UNCG )
- Web Site: http://library.uncg.edu/
- Advisor
- Micheline Chalhoub-Deville
Abstract: The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such assessments. The first paper presents a simulation study investigating the use of CTT–based classification consistency methods in a computer-adaptive testing context. The second paper further investigates CTT–based classification consistency estimates by applying the methods from the first paper, as well as a bootstrapping-inspired approach, to operational test data from the DET. The third paper investigates the reporting of test-related information and test-taker results to results users through a focus group with North American postsecondary admissions professionals. Collectively, the studies address challenges in constructing validity arguments for digital-first high-stakes assessments.
Classification consistency and results reporting of a digital-first computer-adaptive language proficiency test
PDF (Portable Document Format)
2463 KB
Created on 5/1/2022
Views: 163
Additional Information
- Publication
- Dissertation
- Language: English
- Date: 2022
- Keywords
- Admissions testing, Classification consistency, Computer-adaptive testing, Language testing, Reliability, Results reporting
- Subjects
- Computer adaptive testing
- Educational tests and measurements
- English language $x Ability testing