Evaluating the Development, Reliability, and Validation of the Tele-Primary Care Oral Health Clinical Information System Questionnaire: Cross-Sectional Questionnaire Study
BackgroundEvaluating digital health service delivery in primary health care requires a validated questionnaire to comprehensively assess users’ ability to implement tasks customized to the program’s needs. ObjectiveThis study aimed to develop, test the reliability...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-01-01
|
| Series: | JMIR Human Factors |
| Online Access: | https://humanfactors.jmir.org/2025/1/e53630 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832582474202349568 |
|---|---|
| author | Rosnah Sutan Shahida Ismail Roszita Ibrahim |
| author_facet | Rosnah Sutan Shahida Ismail Roszita Ibrahim |
| author_sort | Rosnah Sutan |
| collection | DOAJ |
| description |
BackgroundEvaluating digital health service delivery in primary health care requires a validated questionnaire to comprehensively assess users’ ability to implement tasks customized to the program’s needs.
ObjectiveThis study aimed to develop, test the reliability of, and validate the Tele-Primary Care Oral Health Clinical Information System (TPC-OHCIS) questionnaire for evaluating the implementation of maternal and child digital health information systems.
MethodsA cross-sectional study was conducted in 2 phases. The first phase focused on content item development and was validated by a group of 10 experts using the content validity index. The second phase was to assess its psychometric testing for reliability and validity.
ResultsA structured questionnaire of 65 items was constructed to assess the TPC-OHCIS delivery for primary health care use based on literature and has been validated by 10 experts, and 319 respondents answered the 65-item TPC-OHCIS questionnaire, with mean item scores ranging from 1.99 (SD 0.67) to 2.85 (SD 1.019). The content validity, reliability, and face validity showed a scale-level content validity index of 0.90, scale-level content validation ratio of 0.90, and item-level face validity index of 0.76, respectively. The internal reliability was calculated as a Cronbach α value of 0.90, with an intraclass correlation coefficient of 0.91. Scales were determined by the scree plot with eigenvalues >1, and 13 subscales were identified based on principal component analysis. The Kaiser-Meyer-Olkin value was 0.90 (P<.049). The total variance explained was 76.07%, and factor loading scores for all variables were >0.7. The Bartlett test of sphericity, determining construct validity, was found to be significant (P<.049).
ConclusionsThe TPC-OHCIS questionnaire is valid to be used at the primary health care level to evaluate the TPC-OHCIS implementation. It can assess health care workers’ work performance and job acceptance and improve the quality of care. |
| format | Article |
| id | doaj-art-bd7f75db0325443088b967c94a086a31 |
| institution | Kabale University |
| issn | 2292-9495 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Human Factors |
| spelling | doaj-art-bd7f75db0325443088b967c94a086a312025-01-29T20:30:37ZengJMIR PublicationsJMIR Human Factors2292-94952025-01-0112e5363010.2196/53630Evaluating the Development, Reliability, and Validation of the Tele-Primary Care Oral Health Clinical Information System Questionnaire: Cross-Sectional Questionnaire StudyRosnah Sutanhttps://orcid.org/0000-0001-9956-4727Shahida Ismailhttps://orcid.org/0000-0003-2772-065XRoszita Ibrahimhttps://orcid.org/0000-0002-4741-5970 BackgroundEvaluating digital health service delivery in primary health care requires a validated questionnaire to comprehensively assess users’ ability to implement tasks customized to the program’s needs. ObjectiveThis study aimed to develop, test the reliability of, and validate the Tele-Primary Care Oral Health Clinical Information System (TPC-OHCIS) questionnaire for evaluating the implementation of maternal and child digital health information systems. MethodsA cross-sectional study was conducted in 2 phases. The first phase focused on content item development and was validated by a group of 10 experts using the content validity index. The second phase was to assess its psychometric testing for reliability and validity. ResultsA structured questionnaire of 65 items was constructed to assess the TPC-OHCIS delivery for primary health care use based on literature and has been validated by 10 experts, and 319 respondents answered the 65-item TPC-OHCIS questionnaire, with mean item scores ranging from 1.99 (SD 0.67) to 2.85 (SD 1.019). The content validity, reliability, and face validity showed a scale-level content validity index of 0.90, scale-level content validation ratio of 0.90, and item-level face validity index of 0.76, respectively. The internal reliability was calculated as a Cronbach α value of 0.90, with an intraclass correlation coefficient of 0.91. Scales were determined by the scree plot with eigenvalues >1, and 13 subscales were identified based on principal component analysis. The Kaiser-Meyer-Olkin value was 0.90 (P<.049). The total variance explained was 76.07%, and factor loading scores for all variables were >0.7. The Bartlett test of sphericity, determining construct validity, was found to be significant (P<.049). ConclusionsThe TPC-OHCIS questionnaire is valid to be used at the primary health care level to evaluate the TPC-OHCIS implementation. It can assess health care workers’ work performance and job acceptance and improve the quality of care.https://humanfactors.jmir.org/2025/1/e53630 |
| spellingShingle | Rosnah Sutan Shahida Ismail Roszita Ibrahim Evaluating the Development, Reliability, and Validation of the Tele-Primary Care Oral Health Clinical Information System Questionnaire: Cross-Sectional Questionnaire Study JMIR Human Factors |
| title | Evaluating the Development, Reliability, and Validation of the Tele-Primary Care Oral Health Clinical Information System Questionnaire: Cross-Sectional Questionnaire Study |
| title_full | Evaluating the Development, Reliability, and Validation of the Tele-Primary Care Oral Health Clinical Information System Questionnaire: Cross-Sectional Questionnaire Study |
| title_fullStr | Evaluating the Development, Reliability, and Validation of the Tele-Primary Care Oral Health Clinical Information System Questionnaire: Cross-Sectional Questionnaire Study |
| title_full_unstemmed | Evaluating the Development, Reliability, and Validation of the Tele-Primary Care Oral Health Clinical Information System Questionnaire: Cross-Sectional Questionnaire Study |
| title_short | Evaluating the Development, Reliability, and Validation of the Tele-Primary Care Oral Health Clinical Information System Questionnaire: Cross-Sectional Questionnaire Study |
| title_sort | evaluating the development reliability and validation of the tele primary care oral health clinical information system questionnaire cross sectional questionnaire study |
| url | https://humanfactors.jmir.org/2025/1/e53630 |
| work_keys_str_mv | AT rosnahsutan evaluatingthedevelopmentreliabilityandvalidationoftheteleprimarycareoralhealthclinicalinformationsystemquestionnairecrosssectionalquestionnairestudy AT shahidaismail evaluatingthedevelopmentreliabilityandvalidationoftheteleprimarycareoralhealthclinicalinformationsystemquestionnairecrosssectionalquestionnairestudy AT roszitaibrahim evaluatingthedevelopmentreliabilityandvalidationoftheteleprimarycareoralhealthclinicalinformationsystemquestionnairecrosssectionalquestionnairestudy |