Internal Education Quality Assurance Systems in the Documents of Russian Universities: Quality Assurance or its Appearance?
Abstract
The quality of education, despite the variety of approaches to its understanding, is usually ensured in two contours: external and internal. The external contour is most familiar to the Russian education system, where a control model of quality assurance is implemented in the form of state accreditation. Internal contour may be voluntarily implemented through internal education quality assessment systems. The purpose of this study was to determine how common such systems are among Russian universities, what they look like and whether they represent working systems of quality assurance. For this purpose, the websites of 697 universities were examined for the presence of references to internal quality assurance systems, and a content analysis of publicly available local acts on internal quality assurance of 365 universities was carried out. As a result, it was found that the majority of civil universities in the country have acts, describing such systems (66%), but they are isomorphic, and the procedures contained in them are incomplete. This allows us to conclude that acts on internal quality assurance systems are adopted by universities not to achieve quality, but to show an external controller that such system is present, as required in the control model for ensuring the quality of education.
Downloads
References
Agasisti T., Barbato G., Molin M.D., Turri M. (2019) Internal Quality Assurance in Universities: Does NPM Matter? Studies in Higher Education, vol. 44, no 6, pp. 960–977. https://doi.org/10.1080/03075079.2017.1405252
Aghion P., Algan Y., Cahuc P., Shleifer A. (2010) Regulation and Distrust. The Quarterly Journal of Economics, vol. 125, no 3, pp. 1015–1049. https://doi.org/10.1162/qjec.2010.125.3.1015
Barbato G., Bugaj J., Campbell D.F.J., Cerbino R., Ciesielski P., Feliks-Długosz A., Milani M., Pausits A. (2022) Performance Indicators in Higher Education Quality Management of Learning and Teaching: Lessons from a Benchlearning Exercise of Six European Universities. Quality in Higher Education, vol. 28, no 1, pp. 82–105. https://doi.org/10.1080/13538322.2021.1951456
Barmatina I.V., Varakuta A.A. (2020) Assessment of the Quality of Educational Activities of the University and the Training of Students. Journal of Pedagogical Innovations, no 4, pp. 15–22 (In Russian).
Bazargan A. (2001) From Internal Evaluation to Quality Assurance in Higher Education: The Case of Medical Education in Iran. Journal of Medical Education, vol. 1, no 1, pp. 23–27. https://doi.org/10.22037/jme.v1i1.973
Belash O.Ju., Chirkova A.A. (2018) Indicators of Education Quality in Internal Monitoring: Difference between Students and Lecturers in Assessing Indicators’ Importance. Engineering Education, no 24, pp. 166–173 (In Russian).
Bendermacher G.W.G., oude Egbrink M.G.A., Wolfhagen I.H.A.P., Dolmans D.H.J.M. (2017) Unravelling Quality Culture in Higher Education: A Realist Review. Higher Education, vol. 73, no 1, pp. 39–60. https://doi.org/10.1007/s10734-015-9979-2
Bernhard A. (2011) Quality Assurance on the Road: Finland and Austria in Comparison. European Educational Research Journal, vol. 10, no 4, pp. 583–594. https://doi.org/10.2304/eerj.2011.10.4.583
Bolotov V.A. (2019) Accreditation of Universities: Order and Disorder. Educational Policy, no 1–2, pp. 64–66 (In Russian).
Borch I., Sandvoll R., Risør T. (2022) Student Course Evaluation Documents: Constituting Evaluation Practice. Assessment & Evaluation in Higher Education, vol. 47, no 2, pp. 169–182. https://doi.org/10.1080/02602938.2021.1899130
Brennan J., Shah T. (2000) Quality Assessment and Institutional Change: Experiences from 14 Countries. Higher Education, vol. 40, no 3, pp. 331–349. https://doi.org/10.1023/A:1004159425182
Campatelli G., Citti P., Meneghin A. (2011) Development of a Simplified Approach Based on the EFQM Model and Six Sigma for the Implementation of TQM Principles in a University Administration. Total Quality Management & Business Excellence, vol. 22, no 7, pp. 691–704. https://doi.org/10.1080/14783363.2011.585755
Cardoso S., Rosa M.J., Videira P., Amaral A. (2019) Internal Quality Assurance: A New Culture or Added Bureaucracy? Assessment & Evaluation in Higher Education, vol. 44, no 2, pp. 249–262. https://doi.org/10.1080/02602938.2018.1494818
Chaffee E.E., Sherr L.A. (1992) Quality: Transforming Postsecondary Education. ASHE-ERIC Higher Education Report no 3. Available at: https://files.eric.ed.gov/fulltext/ED351922.pdf (accessed 2 April 2024).
Chileshe N., Watson P., Maslow D., Belokorovin E. (2005) The Deployment of Total Quality Management (TQM): The Russian Experience. Proceedings of the 21st Annual ARCOM Conference (London, 2005, 7–9 September 2005), pp. 201–214. Available at: https://www.arcom.ac.uk/-docs/proceedings/ar2005-0201-0214_Biggs_et_al.pdf (accessed 16 April 2024).
Ching G. (2018) A Literature Review on the Student Evaluation of Teaching: An Examination of the Search, Experience, and Credence Qualities of SET. Higher Education Evaluation and Development, vol. 12, no 2, pp. 63–84. https://doi.org/10.1108/HEED-04-2018-0009
Chistova I.A., Evseeva N.V. (2021) Internal System for Assessing the Quality of University Education. Molodye uchyonye – razvitiyu Natsionalʼnoy tekhnologicheskoy initsiativy (POISK), no 1, pp. 861–863 (In Russian).
Chu A., Westerheijden D.F. (2018) Between Quality and Control: What Can We Learn from Higher Education Quality Assurance Policy in the Netherlands. Quality in Higher Education, vol. 24, no 3, pp. 260–270. https://doi.org/10.1080/13538322.2018.1559513
DiMaggio P.J., Powell W.W. (1983) The Iron Cage Revisited: Institutional Isomorphism and Collective Rationality in Organizational Fields. American Sociological Review, vol. 48, no 2, pp. 147–160. https://doi.org/10.2307/2095101
El-Khawas E. (2007) Accountability and Quality Assurance: New Issues for Academic Inquiry. International Handbook of Higher Education (eds J.J.F. Forest, P.G. Altbach), Dordrecht: Springer Netherlands, pp. 23–37. https://doi.org/10.1007/978-1-4020-4012-2_3
EQUIP (2016) Comparative Analysis of the ESG 2005 and ESG 2015. Brussels: EQUIP. Available at https://www.eqar.eu/assets/uploads/2020/06/EQUIP_comparative-analysis-ESG-2015-ESG-2005.pdf (accessed 16 January 2024).
European Association for Quality Assurance in Higher Education et al. (2015) Standards and Guidelines for Quality Assurance in the European Higher Education Area (ESG). Available at: https://www.eqar.eu/assets/uploads/2018/04/ESG_2015.pdf (accessed 16 January 2024).
Ewell P. (2007) The ‘Quality Game’: External Review and Institutional Reaction over Three Decades in the United States. Quality Assurance in Higher Education: Trends in Regulation, Translation and Transformation (eds D.F. Westerheijden, B. Stensaker, M.J. Rosa), Dordrecht: Springer Netherlands, pp. 119–153. https://doi.org/10.1007/978-1-4020-6012-0_5
Forrat N.V. (2009) Problems of Higher Education Quality: World Challenges and Their Russian Transformations. Voprosy obrazovaniya / Educational Studies Moscow, no 2, pp. 121–138 (In Russian). https://vo.hse.ru/article/view/15257
Gevorkjan E.N. (2005) Quality of Higher Education: Scheduled and Non-Scheduled Inspections. Voprosy obrazovaniya / Educational Studies Moscow, no 1, pp. 226–234 (In Russian).
Gorbashko E.A., Bonyushko N.A., Semchenko A.A. (2019) Development of an Organization’s Quality Management System in the Context of Digitalization of the Economy. St. Petersburg: St. Petersburg State University of Economics Vinarik V.A., Dolgopyatova T.G. (2011) Certification of the Quality Management System in Companies in Countries with Economies in Transition: An Empirical Analysis. Russian Management Journal, vol. 9, no 1, pp. 29–56 (In Russian).
Gornitzka Å., Stensaker B. (2014) The Dynamics of European Regulatory Regimes in Higher Education – Challenged Prerogatives and Evolutionary Change. Policy and Society, vol. 33, no 3, pp. 177–188. https://doi.org/10.1016/j.polsoc.2014.08.002
Guba K.S. (2019) Quality of Higher Education: A Review of International Practice. University Management: Practice and Analysis, vol. 23, no 3, pp. 94–107 Vinarik V.A., Dolgopyatova T.G. (2011) Certification of the Quality Management System in Companies in Countries with Economies in Transition: An Empirical Analysis. Russian Management Journal, vol. 9, no 1, pp. 29–56 (In Russian). https://doi.org/10.15826/umpa.2019.03.022
Guba K., Makeeva A., Sokolov M., Tsivinskaya A. (2017) How Rosobrnadzor Works: Open Data Analysis about Control and Supervision Activities in the Field of Higher Education. St. Petersburg: European University at St. Petersburg (In Russian). Available at: https://eusp.org/sites/default/files/archive/news/2018/docs/RON_EUSP_210218.pdf (accessed 16 January 2024).
Gvaramadze I. (2008) From Quality Assurance to Quality Enhancement in the European Higher Education Area. European Journal of Education, vol. 43, no 4, pp. 443–455. https://doi.org/10.1111/j.1465-3435.2008.00376.x
Harvey L., Askling B. (2003) Quality in Higher Education. The Dialogue between Higher Education Research and Practice (ed. R. Begg), Dordrecht: Springer Netherlands, pp. 69–83. https://doi.org/10.1007/978-0-306-48368-4_6
Harvey L., Green D. (1993) Defining Quality. Assessment & Evaluation in Higher Education, vol. 18, no 1, pp. 9–34. https://doi.org/10.1080/0260293930180102
Harvey L., Williams J. (2010) Fifteen Years of Quality in Higher Education (Part Two). Quality in Higher Education, vol. 16, no 2, pp. 81–113. https://doi.org/10.1080/13538322.2010.485722
Jankiewicz S.V., Knyaginina N.V., Vorobʼev V.V. (2019) State Accreditation of Universities: Conflicts of Declared and Actual Goals. Educational Policy, no 1–2, pp. 76–86 (In Russian).
Kameneva E.A., Prikhodko L.V. (2018) Quality Assessment System for Higher Education: World and Russian Practice Analysis. Management and Business Administration, no 4, pp. 112–124 (In Russian).
Kis V. (2005) Quality Assurance in Tertiary Education: Current Practices in OECD Countries and a Literature Review on Potential Effects. Paris: OECD.
Klenk T., Seyfried M. (2016) Institutional Isomorphism and Quality Management: Comparing Hospitals and Universities. Towards a Comparative Institutionalism: Forms, Dynamics and Logics across the Organizational Fields of Health Care and Higher Education (eds R. Pinheiro, L. Geschwind, F.O. Ramirez, K. Vrangbæk). Leeds, UK: Emerald Publishing Limited, vol. 45, pp. 217–242. https://doi.org/10.1108/S0733-558X20150000045020
Knutov A.V., Plaksin S.M., Sinyatullin R.H., Chaplinsky A.V. (2022) “Regulatory Guillotine“ in Russia and its Quantitative Results. Law. Journal of the Higher School of Economics, no 2, pp. 4–27 (In Russian).
Knyaginina N.V. (2022) Internal Education Quality Assurance Systems in Russian Universities. Tomsk: Tomsk State University (In Russian). Available at: http://docs.io.tsu.ru/wordpress/wp-content/uploads/VSOKO.pdf (accessed 16 January 2024).
Kuchakov R.K., Skougarevskiy D.A. (2022) Control and Supervision in 2022. Beyond the Norm. St. Petersburg: European University at St. Petersburg (In Russian). Available at: https://inspections.enforce.spb.ru (accessed 16 April 2024).
Leiber T. (ed.) (2016) Impact Evaluation of Quality Assurance in Higher Education: A Manual. Mannheim: IMPALA Consortium Partners.
Lindsay A. (1994) Quality and Management in Universities. Journal of Tertiary Education Administration, vol. 16, no 1, pp. 55–68. https://doi.org/10.1080/1036970940160105
Loukkola T., Zhang T. (2010) Examining Quality Culture: Part 1. Quality Assurance Processes in Higher Education Institutions. Brussels: European University Association.
Magun A. (2011) Higher Education in Russia: Is There a Way out of a Neoliberal Impasse? Globalization and Inequality in Emerging Societies (ed. B. Rehbein), London: Palgrave Macmillan, pp. 148–171. https://doi.org/10.1057/9780230354531_9
Manatos M.J., Sarrico C.S., Rosa M.J. (2017) The European Standards and Guidelines for Internal Quality Assurance: An Integrative Approach to Quality Management in Higher Education? The TQM Journal, vol. 29, no 2, pp. 342–356. https://doi.org/10.1108/TQM-01-2016-0009
Martin M. (2018) Internal Quality Assurance: Enhancing Higher Education Quality and Graduate Employability. Paris: UNESCO International Institute for Educational Planning. Available at: https://unesdoc.unesco.org/ark:/48223/pf0000261356/PDF/261356eng.pdf.multi (accessed 20 April 2024).
Minina E. (2017) ‘Quality Revolution’ in Post-Soviet Education in Russia: From Control to Assurance? Journal of Education Policy, vol. 32, no 2, pp. 176–197. https://doi.org/10.1080/02680939.2016.1250165
Nasonkin V.V., Putilo N.V. (2022) “Regulatory guillotine” in Education: Issues of Legal Regulation and Implementation Practice. Vestnik of Saint Petersburg University. Law, vol. 13, no 2, pp. 309–326 (In Russian). https://doi.org/10.21638/spbu14.2022.202
Navodnov V.G., Motova G.N. (2015) Development of Accreditation in Russian Higher Education: History and Future. Vysshee obrazovanie v Rossii / Higher Education in Russia, no 5, pp. 12–20 (In Russian).
Newton J. (2002) Views from Below: Academics Coping with Quality. Quality in Higher Education, vol. 8, no 1, pp. 39–61. https://doi.org/10.1080/13538320220127434
Nguyen P.V., Pham H. (2022) Enablers and Barriers for Quality Assurance: A Comparative Study of Vietnamese Case and International Trends. European Journal of Contemporary Education, vol. 11, no 1, pp. 123–137. https://doi.org/10.13187/ejced.2022.1.123
Okae-Adjei D.S. (2016) Internal Quality Assurance in Higher Education Institutions: The Case of Some Selected Ghanaian Polytechnics. European Journal of Research in Social Sciences, vol. 4, no 8, pp. 58–73.
Orsingher C. (ed.) (2006) Assessing Quality in European Higher Education Institutions. Heidelberg: Physica-Verlag HD. https://doi.org/10.1007/3-7908-1688-4
Ponomareva E.A., Savina A.D., Antonenko N.S. (2023) Risk-Based Regulation of Russian Universities: Risk Indicators and Their Use for State Control Purposes. Vysshee obrazovanie v Rossii / Higher Education in Russia, vol. 32, no 2, pp. 43–60 (In Russian). https://doi.org/10.31992/0869-3617-2023-32-2-43-60
Pratasavitskaya H., Stensaker B. (2010) Quality Management in Higher Education: Towards a Better Understanding of an Emerging Field. Quality in Higher Education, vol. 16, no 1, pp. 37–50. https://doi.org/10.1080/13538321003679465
Razinkina E.M., Raev K.V., Kalinina O.V. (2019) Internal System for Assessing Quality of Education: Independent Assessment of Professional Competences of Teaching Staff. Terra Linguistica, vol. 10, no 2, pp. 112–122 (In Russian). https://doi.org/10.18721/JHSS.10210
Salmi J. (2010) The Growing Accountability Agenda: Progress or Mixed Blessing? Voprosy obrazovaniya / Educational Studies Moscow, no 2, pp. 66–86 (In Russian). https://vo.hse.ru/article/view/15241
Sarakinioti A., Philippou S. (2020) European Discourse on Higher Education Quality Assurance and Accreditation: Recontextualizations in Greece and Cyprus at Times of “Crisis.” European Education, vol. 52, no 2, pp. 132–145. https://doi.org/10.1080/10564934.2020.1765390
Schwarz S., Westerheijden D.F. (2004) Accreditation in the Framework of Evaluation Activities: A Comparative Study in the European Higher Education Area. Accreditation and Evaluation in the European Higher Education Area (eds S. Schwarz, D.F. Westerheijden), Dordrecht: Springer Netherlands, pp. 1–41. https://doi.org/10.1007/978-1-4020-2797-0_1
Selezneva A.V., Lobov N.V. (2020) Elements of the Internal System for Assessing the Quality of Educational Services of a University. Bulletin PNRPU. Mechanical Engineering, Materials Science, vol. 22, no 2, pp. 90–98 (In Russian). https://doi.org/10.15593/2224-9877/2020.2.11
Shah M., Nair S., Wilson M. (2011) Quality Assurance in Australian Higher Education: Historical and Future Development. Asia Pacific Education Review, vol. 12, no 3, pp. 475–483. https://doi.org/10.1007/s12564-011-9152-2
Smolentseva A. (2017) Where Soviet and Neoliberal Discourses Meet: The Transformation of the Purposes of Higher Education in Soviet and Post-Soviet Russia. Higher Education, vol. 74, no 6, pp. 1091–1108. https://doi.org/10.1007/s10734-017-0111-7
Stensaker B. (2007) Quality as Fashion: Exploring the Translation of a Management Idea into Higher Education. Quality Assurance in Higher Education: Trends in Regulation, Translation and Transformation (eds D.F. Westerheijden, B. Stensaker, M.J. Rosa), Dordrecht: Springer Netherlands, pp. 99–118. https://doi.org/10.1007/978-1-4020-6012-0_4
Sunder M.V., Antony J. (2018) A Conceptual Lean Six Sigma Framework for Quality Excellence in Higher Education Institutions. International Journal of Quality & Reliability Management, vol. 35, no 4, pp. 857–874. https://doi.org/10.1108/IJQRM-01-2017-0002
Sursock A. (2015) Trends 2015: Learning and Teaching in European Universities. Brussels: European University Association. http://dx.doi.org/10.13140/RG.2.1.1321.8408
Sursock A., Smidt H. (2010) Trends 2010: A Decade of Change in European Higher Education. Brussels: European University Association.
Tishkina K.O., Eliseeva O.V., Bagautdinova A.Sh., Shilova K.S., Efremova A.A. (2022) Data-Based Approach to Educational Programs Quality Management. University Management: Practice and Analysis, vol. 26, no 3, pp. 112–119 (In Russian). https://doi.org/10.15826/umpa.2022.03.025
Torgaeva I.N., Ukraintzev D.V. (2022) Internal System for Assessing the Quality of Education of a Military Educational Organization of Higher Education: Theory and Practice. Nauchno-metodicheskiy byulleten Voennogo universiteta Ministerstva oborony RF, no 1, pp. 23–29 (In Russian).
Van Vught F.A., Westerheijden D.F. (1994) Towards a General Model of Quality Assessment in Higher Education. Higher Education, vol. 28, no 3, pp. 355–371. https://doi.org/10.1007/BF01383722
Vandoninck S., Annaert N., Verslyppe A., de Vos C., Verhagen A., Stockmans J., Corten M. (2017) Implementing a New Method for Quality Assurance: The Case of COBRA at KU Leuven. Lessons Learned from a Trial Run. Paper presented at 12th European Quality Assurance Forum "Responsible QA – Committing to Impact" (Riga, Latvia, 2017, 23–25 November). Available at: https://eua.eu/resources/publications/475:implementing-a-new-method-for-quality-assurance-the-case-of-cobra-at-ku-leuven.html (accessed 16 January 2024).
Versan V.G. (2009) Crisis in Standardization of Management Systems: Causes, Solutions. Standards and Quality, no 3, pp. 78–83 (In Russian).
Vinarik V.A., Dolgopyatova T.G. (2011) Certification of the Quality Management System in Companies in Countries with Economies in Transition: An Empirical Analysis. Russian Management Journal, vol. 9, no 1, pp. 29–56 (In Russian).
Vorobieva A.A. (2019) Development of the Internal System of Quality Management in Educational Activities at the University: Process and Criteria-Based Technology. Higher Education Today, no 11, pp. 2–10 (In Russian). https://doi.org/10.25586/RNU.HET.19.11.P.02
Zhemerikina Ju.I., Raev K.V., Savka O.G. (2019) Independent Evaluation of Professional Competence as a Basic Component of the Internal System of Evaluation of the Quality of Higher Education. Chelovecheskiy kapital, no 7, pp. 81–88 (In Russian). https://doi.org/10.25629/HC.2019.07.09
.jpg){kind=small}
