Development and validation of the Information Literacy Measurement Scale (ILMS-34) in Chinese public health practitioners

Abstract Background Public health professionals (PHPs) have increasing information needs to inform evidence-based public health decisions and practice, which requires good information literacy. A comprehensive and reliable assessment tool is necessary to assess PHPs' literacy and guide future p...

Full description

Saved in:
Bibliographic Details
Main Authors: Hui Li, Ke-Ying Li, Xia-Rong Hu, Xuan Hong, Yan-Ting He, Hua-Wei Xiong, Yi-Li Zhang
Format: Article
Language:English
Published: BMC 2025-01-01
Series:BMC Medical Education
Subjects:
Online Access:https://doi.org/10.1186/s12909-025-06693-y
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832594655587336192
author Hui Li
Ke-Ying Li
Xia-Rong Hu
Xuan Hong
Yan-Ting He
Hua-Wei Xiong
Yi-Li Zhang
author_facet Hui Li
Ke-Ying Li
Xia-Rong Hu
Xuan Hong
Yan-Ting He
Hua-Wei Xiong
Yi-Li Zhang
author_sort Hui Li
collection DOAJ
description Abstract Background Public health professionals (PHPs) have increasing information needs to inform evidence-based public health decisions and practice, which requires good information literacy. A comprehensive and reliable assessment tool is necessary to assess PHPs' literacy and guide future promotion programs. However, there is a lack of measurement tools specifically for the information literacy of PHPs. Objectives This study aimed to develop an information literacy assessment tool for PHPs and test its psychometric properties among PHPs. Methods A 34-item Information Literacy Measurement Scale (ILMS-34) for PHPs was developed based on an extensive literature review, the Delphi method, and pilot testing. The ILMS-34 was further validated among 526 PHPs recruited from four cities in Guangdong Province, China, using convenience sampling. The sample was randomly divided into two equal groups for exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), respectively. Other psychometric testing included item analysis, Cronbach's α coefficient, three-week test–retest reliability, and known-group validity. Results EFA yielded four dimensions for the ILMS-34: information consciousness, information knowledge, information ability, and information ethics. Subsequent CFA showed a good model fit of the four-factor structure (χ2/df = 1.485, RMSEA = 0.043, SRMR = 0.038, TLI = 0.977, CFI = 0.979). There were significant differences in each item between the high and low-scoring groups (p < 0.001), indicating good item discrimination. The ILMS-34 demonstrated good internal consistency with a Cronbach's α coefficient of 0.97 for the total scale (four subscales: 0.92, 0.92, 0.98, and 0.91, respectively). It also showed good test–retest reliability after three weeks with an ICC coefficient of 0.67. The DSE-MS scores varied by various sample characteristics, verifying the known-group validity. Conclusion The ILMS-34 is a multidimensional instrument with good psychometric properties and can be used as an effective tool to measure information literacy among PHPs. Further validation in other samples across various cultures is needed to test its broad application.
format Article
id doaj-art-d8a50eb49a3d4a40b7c39175a9e17344
institution Kabale University
issn 1472-6920
language English
publishDate 2025-01-01
publisher BMC
record_format Article
series BMC Medical Education
spelling doaj-art-d8a50eb49a3d4a40b7c39175a9e173442025-01-19T12:27:27ZengBMCBMC Medical Education1472-69202025-01-0125111510.1186/s12909-025-06693-yDevelopment and validation of the Information Literacy Measurement Scale (ILMS-34) in Chinese public health practitionersHui Li0Ke-Ying Li1Xia-Rong Hu2Xuan Hong3Yan-Ting He4Hua-Wei Xiong5Yi-Li Zhang6The Tenth Affiliated Hospital, Southern Medical University (Dongguan People’s Hospital)The Tenth Affiliated Hospital, Southern Medical University (Dongguan People’s Hospital)The Tenth Affiliated Hospital, Southern Medical University (Dongguan People’s Hospital)Dermatology Hospital of Southern Medical University GuangzhouDongguan Maternal and Child Health HospitalShenzhen Center for Disease Control and PreventionSchool of Health Management, Southern Medical UniversityAbstract Background Public health professionals (PHPs) have increasing information needs to inform evidence-based public health decisions and practice, which requires good information literacy. A comprehensive and reliable assessment tool is necessary to assess PHPs' literacy and guide future promotion programs. However, there is a lack of measurement tools specifically for the information literacy of PHPs. Objectives This study aimed to develop an information literacy assessment tool for PHPs and test its psychometric properties among PHPs. Methods A 34-item Information Literacy Measurement Scale (ILMS-34) for PHPs was developed based on an extensive literature review, the Delphi method, and pilot testing. The ILMS-34 was further validated among 526 PHPs recruited from four cities in Guangdong Province, China, using convenience sampling. The sample was randomly divided into two equal groups for exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), respectively. Other psychometric testing included item analysis, Cronbach's α coefficient, three-week test–retest reliability, and known-group validity. Results EFA yielded four dimensions for the ILMS-34: information consciousness, information knowledge, information ability, and information ethics. Subsequent CFA showed a good model fit of the four-factor structure (χ2/df = 1.485, RMSEA = 0.043, SRMR = 0.038, TLI = 0.977, CFI = 0.979). There were significant differences in each item between the high and low-scoring groups (p < 0.001), indicating good item discrimination. The ILMS-34 demonstrated good internal consistency with a Cronbach's α coefficient of 0.97 for the total scale (four subscales: 0.92, 0.92, 0.98, and 0.91, respectively). It also showed good test–retest reliability after three weeks with an ICC coefficient of 0.67. The DSE-MS scores varied by various sample characteristics, verifying the known-group validity. Conclusion The ILMS-34 is a multidimensional instrument with good psychometric properties and can be used as an effective tool to measure information literacy among PHPs. Further validation in other samples across various cultures is needed to test its broad application.https://doi.org/10.1186/s12909-025-06693-yPublic health personnelInformation literacyScaleDelphi methodReliabilityValidity
spellingShingle Hui Li
Ke-Ying Li
Xia-Rong Hu
Xuan Hong
Yan-Ting He
Hua-Wei Xiong
Yi-Li Zhang
Development and validation of the Information Literacy Measurement Scale (ILMS-34) in Chinese public health practitioners
BMC Medical Education
Public health personnel
Information literacy
Scale
Delphi method
Reliability
Validity
title Development and validation of the Information Literacy Measurement Scale (ILMS-34) in Chinese public health practitioners
title_full Development and validation of the Information Literacy Measurement Scale (ILMS-34) in Chinese public health practitioners
title_fullStr Development and validation of the Information Literacy Measurement Scale (ILMS-34) in Chinese public health practitioners
title_full_unstemmed Development and validation of the Information Literacy Measurement Scale (ILMS-34) in Chinese public health practitioners
title_short Development and validation of the Information Literacy Measurement Scale (ILMS-34) in Chinese public health practitioners
title_sort development and validation of the information literacy measurement scale ilms 34 in chinese public health practitioners
topic Public health personnel
Information literacy
Scale
Delphi method
Reliability
Validity
url https://doi.org/10.1186/s12909-025-06693-y
work_keys_str_mv AT huili developmentandvalidationoftheinformationliteracymeasurementscaleilms34inchinesepublichealthpractitioners
AT keyingli developmentandvalidationoftheinformationliteracymeasurementscaleilms34inchinesepublichealthpractitioners
AT xiaronghu developmentandvalidationoftheinformationliteracymeasurementscaleilms34inchinesepublichealthpractitioners
AT xuanhong developmentandvalidationoftheinformationliteracymeasurementscaleilms34inchinesepublichealthpractitioners
AT yantinghe developmentandvalidationoftheinformationliteracymeasurementscaleilms34inchinesepublichealthpractitioners
AT huaweixiong developmentandvalidationoftheinformationliteracymeasurementscaleilms34inchinesepublichealthpractitioners
AT yilizhang developmentandvalidationoftheinformationliteracymeasurementscaleilms34inchinesepublichealthpractitioners