Multidimensional Health Literacy Scale: Development and Psychometric Properties
Abstract
Health literacy (HL) is often discussed in the context of school curricula, however there is a lack of published and varified instruments for evaluating HL in schoolaged children in Russia. This article presents the step-by-step development of a multidimensional assessment method of health literacy (MMHL) for middle-school children. The conceptual model is based on a review of international experience of HL measurement and includes three functional sections — autonomy, motivation, and practice; and four themes — hygiene, daily routine, nutrition and physical activity. The final version of the instrument consists of 54 questions in 9 scales: access to information, beliefs, trust, amotivation, extrinsic motivation, intrinsic motivation, critical thinking, communication, and action. Work was carried out in five stages: 1) expert evaluation and verification of content validity; 2) small pilot study (N = 92) to test face validity; 3) large pilot study (N = 313) for the primary assessment of psychometric characteristics; 4) final study on a larger sample (N = 1095) to confirm the psychometric characteristics and to explore the factor structure of the instrument; 5) analysis of the distribution of test scores and the establishment of threshold values for interpreting the results. The developed instrument has good indicators of validity and reliability. The Confirmatory Factor Analysis shows that the data corresponds with the theoretical model. Threshold values allow using this instrument not only in theoretical studies but also for solving practical pedagogical tasks. Therefore this instrument can be recommended for use in educational institutions as a diagnostic tool for assessing the motivation and HL of students.
Downloads
References
Abdillah I.L., Lusmilasari L., Hartini S. (2021) Instruments to Measure Health Literacy among Children: A Scoping Review. Jurnal Promosi Kesehatan Indonesia, vol. 16, no 2, pp. 79–87. https://doi.org/10.14710/JPKI.16.2.79-87
Almoslem M.M., Alshehri T.A., Althumairi A.A., Aljassim M.T., Hassan M.E., Berekaa M.M. (2021) Handwashing Knowledge, Attitudes, and Practices among Students in Eastern Province Schools, Saudi Arabia. Journal of Environmental and Public Health, no 4, pp. 1–10. https://doi.org/10.1155/2021/6638443
Baker D.W. (2006) The Meaning and the Measure of Health Literacy. Journal of General Internal Medicine, vol. 21, iss. 8, pp. 878–883. https://doi.org/10.1111/j.1525-1497.2006.00540.x
Bradley-Klug K., Shaffer-Hudkins E., Lynn C., DeLoatche K.J., Montgomery J. (2017) Initial Development of the Health Literacy and Resiliency Scale: Youth Version. Journal of Communication in Healthcare, vol. 10, no 2, pp. 100–107. https://doi.org/10.1080/17538068.2017.1308689
Cha Y.E., Fu Y.Z., Yao W. (2021) Knowledge, Practice of Personal Hygiene, School Sanitation, and Risk Factors of Contracting Diarrhea among Rural Students from Five Western Provinces in China. International Journal of Environmental Research and Public Health, vol. 18, Article no 9505. https://doi.org/10.3390/IJERPH18189505
Chew L.D., Bradley K.A., Boyko E.J. (2004) Brief Questions to Identify Patients with Inadequate Health Literacy. Family Medicine, vol. 36, no 8, pp. 588–594.
Chisolm D.J., Buchanan L. (2007) Measuring Adolescent Functional Health Literacy: A Pilot Validation of the Test of Functional Health Literacy in Adults. Journal of Adolescent Health, vol. 41, no 3, pp. 312–314. https://doi.org/10.1016/j.jadohealth.2007.04.015
Davis T.C., Wolf M.S., Arnold C.L., Byrd R.S., Long S.W., Springer T., Kennen E., Bocchini J.A. (2006) Development and Validation of the Rapid Estimate of Adolescent Literacy in Medicine (REALM-Teen): A Tool to Screen Adolescents for Below-Grade Reading in Health Care Settings. Pediatrics, vol. 118, no 6, pp. e1707–e1714. https://doi.org/10.1542/PEDS.2006-1139
Denisov L.A., Nekhorosheva E.V., Avramenko V.G. (2020) Issledovanie sub’ektivnykh predposylok zdorovogo obraza zhizni u obuchayushchikhsya obshcheobrazovatel'nykh organizatsiy [The Study of the Subjective Prerequisites for a Healthy Lifestyle in Students of Educational Institutions. Sanitarny vrach, no 2, pp. 47–56. https://doi.org/10.33920/med-08-2002-06
Fadel Ch., Bialik M., Trilling B. (2018) Chetyrekhmernoe obrazovanie. Kompetentsii, neobkhodimye dlya uspekha [Four-Dimensional Education: The Competencies Learners Need to Succeed]. Moscow: Tochka.
Federiakin D.A., Larina G.S., Kardanova E.Yu. (2021) Izmerenie bazovoy matemat-icheskoy gramotnosti v nachal’noy shkole [Measuring Basic Mathematical Literacy in Elementary School]. Voprosy obrazovaniya / Educational Studies Moscow, no 2, pp. 199–226. https://doi.org/10.17323/1814-9545-2021-2-199-226
Ghanbari S., Ramezankhani A., Montazeri A., Mehrabi Y. (2016) Health Literacy Measure for Adolescents (HELMA): Development and Psychometric Properties. PLOS ONE, vol. 11, no 2, Article no e0149202. https://doi.org/10.1371/JOURNAL.PONE.0149202
Guo S., Armstrong R., Waters E., Sathish T., Alif S.M., Browne G.R., Yu X. (2018) Quality of Health Literacy Instruments Used in Children and Adolescents: A Systematic Review. BMJ Open, vol. 8, no 6, Article no e020080. https://doi.org/10.1136/BMJOPEN-2017-020080
Guttersrud Ø., Naigaga M.D.A.S., Pettersen K.S. (2015) Measuring Maternal Health Literacy in Adolescents Attending Antenatal Care in Uganda: Exploring the Dimensionality of the Health Literacy Concept Studying a Composite Scale. Journal of Nursing Measurement, vol. 23, no 2, pp. 50E – 66. https://doi.org/10.1891/1061-3749.23.2.E50
Hamzah S.R., Suandi T., Ismail M., Muda Z. (2019) Association of the Personal Factors of Culture, Attitude and Motivation with Health Behavior among Adolescents in Malaysia. International Journal of Adolescence and Youth, vol. 24, no 2, pp. 149–159. https://doi.org/10.1080/02673843.2018.1482772
Harper R. (2014) Development of a Health Literacy Assessment for Young Adult College Students: A Pilot Study. Journal of American College Health, vol. 62, no 2, pp. 125–134. https://doi.org/10.1080/07448481.2013.865625
Lee S.Y.D., Arozullah A.M., Cho Y.I. (2004) Health Literacy, Social Support, and Health: A Research Agenda. Social Science & Medicine, vol. 58, no 7, pp. 1309–1321. https://doi.org/10.1016/S0277-9536(03)00329-0
Levesque C.S., Williams G.C., Elliot D., Pickering M.A., Bodenhamer B., Finley P.J. (2007) Validating the Theoretical Structure of the Treatment Self-Regulation Questionnaire (TSRQ) across Three Different Health Behaviors. Health Education Research, vol. 22, no 5, pp. 691–702. https://doi.org/10.1093/HER/CYL148
Li C.H. (2016) Confirmatory Factor Analysis with Ordinal Data: Comparing Robust Maximum Likelihood and Diagonally Weighted Least Squares. Behavior Research Methods, vol. 48, no 3, pp. 936–949. https://doi.org/10.3758/S13428-015-0619-7
Lounis M. (2020) Promoting School Health Education: A Lesson from the COVID-19 Pandemic. Contemporary Mathematics and Science Education, vol. 1, no 2, Article no ep20009. https://doi.org/10.30935/conmaths/8579
Mancuso J.M. (2008) Health Literacy: A Concept/Dimensional Analysis. Nursing and Health Sciences, vol. 10, no 3, pp. 248–255. https://doi.org/10.1111/j.1442-2018.2008.00394.x
Manganello J.A. (2008) Health Literacy and Adolescents: A Framework and Agenda for Future Research. Health Education Research, vol. 23, no 5, pp. 840–847. https://doi.org/10.1093/her/cym069
Manganello J.A., Colvin K.F., Chisolm D.J., Arnold C., Hancock J., Davis T. (2017) Validation of the Rapid Estimate for Adolescent Literacy in Medicine Short Form (REALM-TeenS). Pediatrics, vol. 139, no 5 Article no e20163286 https://doi.org/10.1542/PEDS.2016-3286/38772
Manganello J.A., Devellis R.F., Davis T.C., Schottler-Thal C. (2015) Development of the Health Literacy Assessment Scale for Adolescents (HAS-A). Journal of Communication in Healthcare, vol. 8, no 3, pp. 172–184. https://doi.org/10.1179/1753807615Y.0000000016
Massey P., Prelip M., Calimlim B., Afifi A., Quiter E., Nessim S., Wongvipat-Kalev N., Glik D. (2013) Findings toward a Multidimensional Measure of Adolescent Health Literacy. American Journal of Health Behavior, vol. 37, no 3, pp. 342–350. https://doi.org/10.5993/AJHB.37.3.7
Morris N.S., MacLean C.D., Chew L.D., Littenberg B. (2006) The Single Item Literacy Screener: Evaluation of a Brief Instrument to Identify Limited Reading Ability. BMC Family Practice, vol. 7, no 1, Article 21. https://doi.org/10.1186/1471-2296-7-21
Neustroeva M.I. (2015) Diagnostika urovnya znaniy mladshikh shkol'nikov o tsennostnom otnoshenii k zdorov'yu [Diagnostics of the Level of Knowledge of Younger Schoolchildren about the Value Attitude to Health]. Nauka, tekhnika i obrazovanie, vol. 12, no 118, pp. 182–183.
Nielsen-Bohlman L., Panzer A.M., Kindig D.A. (eds) (2009) Health Literacy: A Prescription to End Confusion. Washington, DC: The National Academies Press. https://doi.org/10.17226/10883
Nippold M.A., Lafavre S., Shinham K. (2020) How Adolescents Interpret the Moral Messages of Fables: Examining the Development of Critical Thinking. Journal of Speech, Language, and Hearing Research, vol. 63, no 4, pp. 1212–1226. https://doi.org/10.1044/2019_JSLHR-19-00168
Norman C.D., Skinner H.A. (2006) eHealth Literacy: Essential Skills for Consumer Health in a Networked World. Journal of Medical Internet Research, vol. 8, no 2, Article no e9. https://doi.org/10.2196/jmir.8.2.e9
Nosov A.G. (2014) Diagnostika urovnya stanovleniya zdorovogo obraza zhizni u obuchayushchikhsya [Diagnostics of the Level of Formation of a Healthy Lifestyle among Students]. Fundamental'nye issledovaniya, vol. 12, no 12, pp. 2644–2648.
Nutbeam D. (2008) The Evolving Concept of Health Literacy. Social Science and Medicine, vol. 67, no 12, pp. 2072–2078. https://doi.org/10.1016/J.SOCSCIMED.2008.09.050
Nutbeam D. (2000) Health Literacy as a Public Health Goal: A Challenge for Contemporary Health Education and Communication Strategies into the 21st Century. Health Promotion International, vol. 15, no 3, pp. 259–267. https://doi.org/10.1093/HEAPRO/15.3.259
Nye C.D. (2022) Reviewer Resources: Confirmatory Factor Analysis. Organizational Research Methods. https://doi.org/10.1177/10944281221120541
OECD (2003) The PISA 2003 Assessment Framework. Paris: OECD.
Okan O., Lopes E., Bollweg T.M., Bröder J. et al. (2018) Generic Health Literacy Measurement Instruments for Children and Adolescents: A Systematic Review of the Literature. BMC Public Health, vol. 18, no 1, Article no 166. https://doi.org/10.1186/S12889-018-5054-0
Paakkari L., Inchley J., Schulz A., Weber M.W., Okan O. (2019) Addressing Health Literacy in Schools in the WHO European Region. Public Health Panorama, vol. 5, no 2–3, pp. 123–329.
Paakkari L., Okan O. (2020) COVID-19: Health Literacy Is an Underestimated Problem. The Lancet Public Health, vol. 5, iss. 5, pp. e249–e250. https://doi.org/10.1016/S2468-2667(20)30086-4
Paakkari O., Torppa M., Kannas L., Paakkari L. (2016) Subjective Health Literacy: Development of a Brief Instrument for School-Aged Children. Scandinavian Journal of Public Health, vol. 44, no 8, pp. 751–757. https://doi.org/10.1177/1403494816669639
Paasche-Orlow M.K., Wolf M.S. (2007) The Causal Pathways Linking Health Literacy to Health Outcomes. American Journal of Health Behavior, vol. 31, suppl. 1, no 1, pp. S19–26. https://doi.org/10.5993/ajhb.31.s1.4
Poureslami I., Nimmon L., Rootman I., Fitzgerald M.J. (2016) Health Literacy and Chronic Disease Management: Drawing from Expert Knowledge to Set an Agenda. Health Promotion International, vol. 32, no 4. http://dx.doi.org/10.1093/heapro/daw003
Rozhnov R.V. (ed.) (2006) Preemstvennost' formirovaniya kul'tury zdorov'ya uchashchikhsya v obrazovatel'noy srede regiona [Continuity of the Formation of a Culture of Health of Students in the Educational Environment of the Region]. Penza: Information and Publishing Center of PSU.
Ryan R.M., Deci E.L. (2000) Self-Determination Theory and the Facilitation of Intrinsic Motivation, Social Development, and Well-Being. American Psychologist, vol. 55, no 1, pp. 68–78. https://doi.org/10.1037/0003-066X.55.1.68
Said L., Gubbels J.S., Kremers S.P.J. (2020) Development of Dietary Knowledge and Adherence Questionnaires for Lebanese Adolescents and Their Parents. International Journal of Environmental Research and Public Health, vol. 17, no 1, Article no 147. https://doi.org/10.3390/ijerph17010147
Salwa M., Atiqul Haque M., Khalequzzaman M., Al Mamun M.A., Bhuiyan M.R., Choudhury S.R. (2019) Towards Reducing Behavioral Risk Factors of Non-Communicable Diseases among Adolescents: Protocol for a School-Based Health Education Program in Bangladesh. BMC Public Health, vol. 19, no 1. Article no 1002. https://doi.org/10.1186/S12889-019-7229-8
Schmidt J.M. (2010) The Concept of Health—in the History of Medicine and in the Writings of Hahnemann. Homeopathy, vol. 99, no 3, pp. 215–220. https://doi.org/10.1016/J.HOMP.2010.05.004
Schulenkorf T., Sørensen K., Okan O. (2022) International Understandings of Health Literacy in Childhood and Adolescence—A Qualitative-Explorative Analysis of Global Expert Interviews. International Journal of Environmental Research and Public Health, vol. 19, no 3, Article no 1591. https://doi.org/10.3390/IJERPH19031591
Silva D.F.O., Sena-Evangelista K.C.M., Lyra C.O., Pedrosa L.F.C., Arrais R.F., Lima S.C.V.C. (2018) Motivations for Weight Loss in Adolescents with Overweight and Obesity: A Systematic Review. BMC Pediatrics, vol. 18, no 1, Article no 364. https://doi.org/10.1186/S12887-018-1333-2
Sørensen K., van den Broucke S., Fullam J., Doyle G., Pelikan J., Slonska Z., Brand H. (2012) Health Literacy and Public Health: A Systematic Review and Integration of Definitions and Models. BMC Public Health, vol. 12, no 1, pp. 12–80. https://doi.org/10.1186/1471-2458-12-80
Speros C. (2005) Health Literacy: Concept Analysis. Journal of Advanced Nursing, vol. 50, no 6, pp. 633–640. https://doi.org/10.1111/j.1365-2648.2005.03448.x
Steckelberg A., Hülfenhaus C., Kasper J., Rost J., Mühlhauser I. (2009) How to Measure Critical Health Competences: Development and Validation of the Critical Health Competence Test (CHC Test). Advances in Health Sciences Education, vol. 14, no 1, pp. 11–22. https://doi.org/10.1007/s10459-007-9083-1
Sun R.C.F., Hui E.K.P. (2012) Cognitive Competence as a Positive Youth Development Construct: A Conceptual Review. The Scientific World Journal, vol. 2012, April, Article ID 210953. https://doi.org/10.1100/2012/210953
Taware S., Gawai P., Chatterjee A., Thakur H. (2018) Outcome of School-Based Intervention Program in Promoting Personal Hygiene in Primary School Children of Mumbai, India. International Quarterly of Community Health Education, vol. 39, no 1, pp. 31–38. https://doi.org/10.1177/0272684X18809487
Teufl L., Vrtis D., Felder-Puig R. (2019) QUIGK-K: Quiz zur Erhebung von Gesundheitskompetenz bei Kindern. Prävention und Gesundheitsförderung, vol.15, November, pp. 250–255. https://doi.org/10.1007/s11553-019-00749-w
Vamos S., Okan O., Sentell T., Rootman I. (2020) Making a Case for “Education for Health Literacy”: An International Perspective. International Journal of Environmental Research and Public Health, vol. 17, no 4, Article no 1436. https://doi.org/10.3390/ijerph17041436
Wagner von C., Steptoe A., Wolf M.S., Wardle J. (2009) Health Literacy and Health Actions: A Review and a Framework from Health Psychology. Health Education and Behavior, vol. 36, no 5, pp. 860–877. https://doi.org/10.1177/1090198108322819
World Health Organization (2013) Health Literacy: The Solid Facts. Available at: https://apps.who.int/iris/bitstream/handle/10665/128703/e96854.pdf (accessed 20 February 2023).
Wu A.D., Begoray D.L., Macdonald M., Higgins J.W., Frankish J., Kwan B., Fung W., Rootman I. (2010) Developing and Evaluating a Relevant and Feasible Instrument for Measuring Health Literacy of Canadian High School Students. Health Promotion International, vol. 25, no 4, pp. 444–452. https://doi.org/10.1093/heapro/daq032
Wu J., Zhang L., Zhu X., Jiang G. (2021) Mental Health Literacy from the Perspective of Multi-Field Experts in the Context of Сhinese Culture. International Journal of Environmental Research and Public Health, vol. 18, no 4, pp. 1–15. https://doi.org/10.3390/ijerph18041387
Zarcadoolas C, Pleasant A., Greer S.D. (2005) Understanding Health Literacy: An Expanded Model. Health Promotion International, vol. 20, no 2, pp.195–203. https://doi.org/10.1093/heapro/dah609
Copyright (c) 2023 Authors retain copyright and accept the terms of publication in the journal (https://vo.hse.ru/copyright)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
.jpg){kind=small}
