Валидизация Единого национального тестирования в Казахстане: доказательная основа справедливого оценивания
Аннотация
Во всем мире к вступительным экзаменам в вузы, как к экзаменам с высокими ставками, предъявляются серьезные требования: они должны быть максимально объективными, надежными и справедливыми. Это означает, что процесс их разработки, проведения и оценки должен быть тщательно контролируемым и стандартизированным, чтобы исключить любую возможность предвзятости. В Казахстане прием в вузы осуществляется по результатам государственного вступительного экзамена — Единого национального тестирования (ЕНТ).
Проведено исследование с целью оценки валидности результатов Единого национального тестирования в Казахстане на примере математики.Основное внимание уделено двум блокам свидетельств валидности: на основе внутренней структуры теста и на основе связи результатов тестирования с другими переменными, в частности с критериями последующей успешности студентов на этапе получения высшего образования. Теоретической рамкой исследования послужила теориявалидности С. Мессика. Серия валидизационных исследований проводилась согласно методологическим требованиям объединенных Стандартов образовательного и психологического тестирования American Educational Research Association, American Psychological Association и National Council on Measurement in Education с использованием подходов классической теории тестирования, современной теории тестирования, а также статистического анализа, включая иерархическое линейное моделирование. Полученные результаты свидетельствуют о том, что экзамен ЕНТ по математике обладает высоким психометрическим качеством. При этом общий балл ЕНТ по пяти предметам и отдельно балл ЕНТ по математике позволяют надежно прогнозировать будущую успешность обучения студентов в вузе. Установлено, что качество использованных статистических моделей и объясняемая ими дисперсияоценок студентов за первый семестр во многом согласуются с результатами исследований, проведенных в других странах, включая Россию и США.
Скачивания
Литература
Abdrasilov B., Altybaeva Sh., Shinetova L. (2025) Results of the Study of the UNT System Conducted within the World Bank Project. Pedagogical Measurements, vol. 1, no 1, pp. 6–20 (In Russian).
ACT (2024) ACT® Technical Manual. Available at: https://www.act.org/content/dam/act/unsecured/documents/ACT_Technical_Manual.pdf (accessed 6.11.2025).
Aguinis H., Culpepper S.A., Pierce C.A. (2016) Differential Prediction Generalization in College Admissions Testing. Journal of Educational Psychology, vol. 108, no 7, pp. 1045–1059. https://doi.org/10.1037/edu0000104
Algina J., Penfield R.D. (2009) Classical Test Theory. The SAGE Handbook of Quantitative Methods in Psychology (eds R.E. Millsap, A. Maydeu-Olivares), Los Angeles, London, New Delhi: SAGE, pp. 93–122. https://doi.org/10.4135/9780857020994.n5
Amangeldiyeva B. (2024) Unveiling Gender Disparities in Kazakhstani Education: A Comprehensive Analysis using Unified National Testing Results (Master's thesis). Vienna: Central European University.
American Educational Research Association et al. (2014) Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association.
Amrein-Beardsley A., Azizova Z.T., Gibbs N.P., Ikegwuonu C., Kim J., La Torre D.M. et al. (2025) A Validation Review of the SAT and ACT for College and University Admissions Decisions. Education Policy Analysis Archives, vol. 33, Article no 28. https://doi.org/10.14507/epaa.33.8734
Atkinson R.C., Geiser S. (2009) Reflections on a Century of College Admissions Tests. Educational Researcher, vol. 38, no 9, pp. 665–676. https://doi.org/10.3102/0013189X0935198
Bai C., Chi W., Qian X. (2014) Do College Entrance Examination Scores Predict Undergraduate GPAs? A Tale of Two Universities. China Economic Review, vol. 30, September, pp. 632–647. https://doi.org/10.1016/j.chieco.2013.08.005
Bethell G., Zabulionis A. (2012) The Evolution of High-Stakes Testing at the School–University Interface in the Former Republics of the USSR. High-Stakes Testing in Education. Value, Fairness and Consequences (eds T. Eggen, G. Stobart), London: Routledge, pp. 7–25. https://doi.org/10.1080/0969594X.2011.635591
Burton N.W., Ramist L. (2001) Predicting Success in College: SAT® Studies of Classes Graduating since 1980. College Board Research Report no 2001-2. Available at: https://files.eric.ed.gov/fulltext/ED562836.pdf (accessed 7.11.2025).
Clark M., Rothstein J., Schanzenbach D.W. (2008) Selection Bias in College Admissions Test Scores. National Bureau of Economic Research Working Paper no 14265. https://doi.org/10.3386/w14265
College Board (2025) Validity of the SAT Suite of Assessments. Available at: https://research.collegeboard.org/reports/sat-suite/validity (accessed 6.11.2025).
De Ayala R.J. (2018) Item Response Theory and Rasch Modeling. The Reviewer’s Guide to Quantitative Methods in the Social Sciences (eds G.R. Hancock, L.M. Stapleton, R.O. Mueller), New York, NY: Routledge, pp. 145–163. https://doi.org/10.4324/9780203861554
Dorans N.J. (1989) Two New Approaches to Assessing Differential Item Functioning: Standardization and the Mantel–Haenszel Method. Applied Measurement in Education, vol. 2, no 3, pp. 217–233. https://doi.org/10.1207/s15324818ame0203_3
Fishman J.A., Pasanella A.K. (1960) College Admission Selection Studies. Review of Educational Research, vol. 30, no 4, pp. 298–310.
Garg N., Li H., Monachou F. (2020) Dropping Standardized Testing for Admissions Trades Off Information and Access. arXiv preprint arXiv:2010.04396. https://doi.org/10.48550/arXiv.2010.04396
Geiser S., Santelices M.V. (2007) Validity of High-School Grades in Predicting Student Success beyond the Freshman Year: High-School Record vs. Standardized Tests as Indicators of Four-Year College Outcomes. Research & Occasional Paper Series: CSHE.6.07. Berkeley, CA: Center for Studies in Higher Education, University of California.
Hajar A., Abenova S. (2021) The Role of Private Tutoring in Admission to Higher Education: Evidence from a Highly Selective University in Kazakhstan. Hungarian Educational Research Journal, vol. 11, no 2, pp. 124–142. https://doi.org/10.1556/063.2021.00001
Karayev Z., Duisenova R. (2024) Transformation of the Education System Based on the STEM Approach as a Condition for Preparing Competitive Human Capital in the Modern World. Proceedings of the 8th International Scientific Conference “Scientific Results” (Rome, 2024, 7–8 November), pp. 142–152.
Khavenson T.E., Solovyova A.A. (2014) Studying the Relation between the Unified State Exam Points and Higher Education Performance. Voprosy obrazovaniya / Educational Studies Moscow, no 1, pp. 176–199 (In Russian). https://doi.org/10.17323/1814-9545-2014-1-176-199.
Kobrin J.L., Patterson B.F., Shaw E.J., Mattern K.D., Barbuti S.M. (2008) Validity of the SAT® for Predicting First-Year College Grade Point Average. College Board Research Report no 2008-5. Available at: https://files.eric.ed.gov/fulltext/ED563202.pdf (accessed 7.11.2025).
Lane S. (2014) Validity Evidence Based on Testing Consequences. Psicothema, vol. 26, no 1, pp. 127–135. https://doi.org/10.7334/psicothema2013.258
Linn R.L. (2009) Considerations for College Admissions Testing. Educational Researcher, vol. 38, no 9, pp. 677–679. https://doi.org/10.3102/0013189X09351982
Marini J.P., Westrick P.A., Young L., Shaw E.J. (2020) Validity of the SAT® for Enrollment-Related Decisions: Focus on International Students Attending College in the US. Available at: https://research.collegeboard.org/media/pdf/validity-sat-enrollment-related-decisions.pdf (accessed 6.11.2025).
Messick S. (1994) The Interplay of Evidence and Consequences in the Validation of Performance Assessments. Educational Researcher, vol. 23, no 2, pp. 13–23. https://doi.org/10.3102/0013189X023002013
Messick S., Jungeblut A. (1981) Time and Method in Coaching for the SAT. Psychological Bulletin, vol. 89, no 2, pp. 191–216. https://doi.org/10.1037/0033-2909.89.2.191
Michaelides M.P. (2014) Validity Considerations Ensuing from Examinees’ Perceptions about High-Stakes National Examinations in Cyprus. Assessment in Education: Principles, Policy & Practice, vol. 21, no 4, pp. 427–441. https://doi.org/10.1080/0969594X.2014.916655
Migliaretti G., Bozzaro S., Siliquini R., Stura I., Costa G., Cavallo F. (2017) Is the Admission Test for a Course in Medicine a Good Predictor of Academic Performance? A Case-Control Experience at the School of Medicine of Turin. BMJ Open, vol. 7, no 11, Article no e017417. https://doi.org/10.1136/bmjopen-2017-017417
Mingisheva N. (2023) Development and Challenges of Standardized Testing in Kazakhstan: Transition from National to International Standards. Pedagogikalyq Gylymdar Seriiasy, vol. 76, no 3, pp. 94–103. https://doi.org/10.26577/JES.2023.v76.i3.08
Morgan R. (1989) Analyses of the Predictive Validity of the SAT® and High School Grades from 1976 to 1985. ETS Research Report Series, no 1989(2), pp. i–16.
OECD (2020) Education at a Glance 2020: OECD Indicators. Paris: OECD. https://doi.org/10.1787/69096873-en
Rothstein J.M. (2004) College Performance Predictions and the SAT. Journal of Econometrics, vol. 121, no 1–2, pp. 297–317. https://doi.org/10.1016/j.jeconom.2003.10.003
Sanchez E.I. (2025) Predicting STEM Achievement: A Comparative Study of ACT® Scores and High School GPA. ACT Research Report no R2501. Available at: https://www.act.org/content/dam/act/unsecured/documents/R2501-Predicting-STEM-Achievement-ACT-Scores-HSGPA-02-2025.pdf (accessed 6.11.2025).
Shabdenova A., Satybayeva A. (2024) Analysis of the Results of the Unified National Testing in the Context of Various Characteristics of Graduates of Schools in Kazakhstan. The Journal of Psychology & Sociology, vol. 88, no 1, pp. 85–97. https://doi.org/10.26577/JPsS.2024.v88.i1.07
Sheng Y. (2019) CTT Package in R. Measurement: Interdisciplinary Research and Perspectives, vol. 17, no 4, pp. 211–219. https://doi.org/10.1080/15366367.2019.1600839
Sireci S.G. (2021) NCME Presidential Address 2020: Valuing Educational Measurement. Educational Measurement: Issues and Practice, vol. 40, no 1, pp. 7–16. https://doi.org/10.1111/emip.12415
Sireci S., Benítez I. (2023) Evidence for Test Validation: A Guide for Practitioners. Psicothema, vol. 35, no 3, pp. 217–226. https://doi.org/10.7334/psicothema2022.477
Smagulova A., Satanov A., Kadirova F. (2025) Analysis of the Unified National Testing within the Study of the Child Well-Being Index in Kazakhstan. Pedagogical Measurements, vol. 1, no 1, pp. 47–63 (In Russian).
Smith E.V., Jr. (2001) Evidence for the Reliability of Measures and Validity of Measure Interpretation: A Rasch Measurement Perspective. Journal of Applied Measurement, vol. 2, no 3, pp. 281–311.
Smith E.V., Jr. (2002) Detecting and Evaluating the Impact of Multidimensionality Using Item Fit Statistics and Principal Component Analysis of Residuals. Journal of Applied Measurement, vol. 3, no 2, pp. 205–231.
Smith R.M. (2000) Fit Analysis in Latent Trait Measurement Models. Journal of Applied Measurement, vol. 1, no 2, pp. 199–218.
Stemler S.E. (2012) What Should University Admissions Tests Predict? Educational Psychologist, vol. 47, no 1, pp. 5–17. https://doi.org/10.1080/00461520.2011.611444
Westrick P.A., Le H., Robbins S.B., Radunzel J.M., Schmidt F.L. (2015) College Performance and Retention: A Meta-Analysis of the Predictive Validities of ACT® Scores, High School Grades, and SES. Educational Assessment, vol. 20, no 1, pp. 23–45. https://doi.org/10.1080/10627197.2015.997614
Woodruff D., Wu Y.F. (2012) Statistical Considerations in Choosing a Test Reliability Coefficient. ACT Research Report no 2012-10. Available at: https://www.act.org/content/dam/act/unsecured/documents/ACT_RR2012-10.pdf (accessed 7.11.2025).
Wright B.D., Stone M.H. (1979) Best Test Design. Chicago, IL: Mesa Press.
Wright B.D., Masters G.N. (1982) Rating Scale Analysis. Chicago, IL: Mesa Press.
Zwick R. (2019) Assessment in American Higher Education: The Role of Admissions Tests. The Annals of the American Academy of Political and Social Science, vol. 683, no 1, pp. 130–148. https://doi.org/10.1177/0002716219843469
