Hide
Раскрыть

Daria Kravchenko 1
  • 1 National Research University Higher School of Economics, 20 Myasnitskaya Str., Moscow, 101000, Russian Federation

Classical Test Theory and Item Response Theory in Measuring Validity of Peer-Grading in Massive Open Online Courses

2018. No. 4. P. 99–115 [issue contents]

Daria Kravchenko — Analyst, Centre for Psychometrics in eLearning, National Research University Higher School of Economics. E-mail: dakravchenko@hse.ru

The article presents the results of research on validity of peer-review assignments in massive open online courses within the framework of classical test theory (CTT) and item response theory (IRT). CTT-based analysis yielded data on convergent validity of the peer-review assignment, the low level of its criterion validity, and rater disagreement. IRT-based analysis revealed rater bias and established that experts largely tend to be lenient and overrate their peers. The findings are used to discuss the advantages and disadvantages of the psychometric theories in question and the opportunities for combining the two.

Citation: (2018)

Klassicheskiy i sovremennyy podkhody k izmereniyu validnosti zadaniy na vzaimnoe otsenivanie v MOOK

[

Classical Test Theory and Item Response Theory in Measuring Validity of Peer-Grading in Massive Open Online Courses

]. Voprosy obrazovaniya / Educational Studies. Moscow, no4.
doi
BiBTeX
RIS