Fit for purpose? Evaluating multiple-choice question quality in E-learning for emergency primary healthcare
Objective Emergency medicine healthcare professionals need to be continuously updated and trained in emergency medicine. Continuing professional development (CPD) courses are frequently offered but are seldom quality assured by other means than learner satisfaction evaluations or pre–post-test of kn...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2024-12-01
|
| Series: | Cogent Public Health |
| Subjects: | |
| Online Access: | https://www.tandfonline.com/doi/10.1080/27707571.2025.2458945 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832574383330164736 |
|---|---|
| author | Kate-Torunn Aas Vold Monika Kvernenes Une Elisabeth Stømer Erik Zakariassen |
| author_facet | Kate-Torunn Aas Vold Monika Kvernenes Une Elisabeth Stømer Erik Zakariassen |
| author_sort | Kate-Torunn Aas Vold |
| collection | DOAJ |
| description | Objective Emergency medicine healthcare professionals need to be continuously updated and trained in emergency medicine. Continuing professional development (CPD) courses are frequently offered but are seldom quality assured by other means than learner satisfaction evaluations or pre–post-test of knowledge retention. This study explores the quality of multiple choice questions (MCQs) used in a mandatory cross-disciplinary Norwegian CPD e-learning course in emergency medicine primary care.Design Cross-sectional study design.Setting We extracted MCQ assessment data from the e-learning platform ‘Oppvakt’ at National Centre for Emergency Primary Health Care (NKLM).Subjects Physicians and nurses working in the Out-of-Hour service in Norway.Main outcome measures Results from the MCQ exam and information about the participants’ professional role was extracted. Statistical analyses were performed to determine the level of difficulty of the MCQ items and their discriminatory power.Results A total of 2310 physicians and 1547 nurses completed the e-learning module, and 79% of the physicians and 67% of the nurses passed their first exam attempt. The physicians and nurses had an average of 85% and 81% correct answers, respectively. More than half of the MCQ items tested facts and knowledge retrieval, and not knowledge application. 70% of the items were found to be ‘easy’ or ‘too easy’. A third of the items had a low level of discrimination.Conclusions Our results indicate that there is room for improvement of the MCQ exam. Overall, the items were too easy and lacked the ability to discriminate between high and low-performance participants. |
| format | Article |
| id | doaj-art-8617dee6886e4f2ebc03dba5784822d0 |
| institution | Kabale University |
| issn | 2770-7571 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | Cogent Public Health |
| spelling | doaj-art-8617dee6886e4f2ebc03dba5784822d02025-02-01T13:34:57ZengTaylor & Francis GroupCogent Public Health2770-75712024-12-0111110.1080/27707571.2025.2458945Fit for purpose? Evaluating multiple-choice question quality in E-learning for emergency primary healthcareKate-Torunn Aas Vold0Monika Kvernenes1Une Elisabeth Stømer2Erik Zakariassen3SAFER Stavanger Acute Medicine Foundation for Education and Research, Stavanger, NorwayCenter for Medical Education and Department of Clinical Medicine, University of Bergen, Bergen, NorwayDepartment for Simulation-based Learning, Stavanger University Hospital, Stavanger, NorwayNational Centre for Emergency Primary Health Care Norce, Bergen, NorwayObjective Emergency medicine healthcare professionals need to be continuously updated and trained in emergency medicine. Continuing professional development (CPD) courses are frequently offered but are seldom quality assured by other means than learner satisfaction evaluations or pre–post-test of knowledge retention. This study explores the quality of multiple choice questions (MCQs) used in a mandatory cross-disciplinary Norwegian CPD e-learning course in emergency medicine primary care.Design Cross-sectional study design.Setting We extracted MCQ assessment data from the e-learning platform ‘Oppvakt’ at National Centre for Emergency Primary Health Care (NKLM).Subjects Physicians and nurses working in the Out-of-Hour service in Norway.Main outcome measures Results from the MCQ exam and information about the participants’ professional role was extracted. Statistical analyses were performed to determine the level of difficulty of the MCQ items and their discriminatory power.Results A total of 2310 physicians and 1547 nurses completed the e-learning module, and 79% of the physicians and 67% of the nurses passed their first exam attempt. The physicians and nurses had an average of 85% and 81% correct answers, respectively. More than half of the MCQ items tested facts and knowledge retrieval, and not knowledge application. 70% of the items were found to be ‘easy’ or ‘too easy’. A third of the items had a low level of discrimination.Conclusions Our results indicate that there is room for improvement of the MCQ exam. Overall, the items were too easy and lacked the ability to discriminate between high and low-performance participants.https://www.tandfonline.com/doi/10.1080/27707571.2025.2458945E-learningmedical educationmultiple choice question (MCQ)Continuing professional developmentemergency medicineAdult Education and Lifelong Learning |
| spellingShingle | Kate-Torunn Aas Vold Monika Kvernenes Une Elisabeth Stømer Erik Zakariassen Fit for purpose? Evaluating multiple-choice question quality in E-learning for emergency primary healthcare Cogent Public Health E-learning medical education multiple choice question (MCQ) Continuing professional development emergency medicine Adult Education and Lifelong Learning |
| title | Fit for purpose? Evaluating multiple-choice question quality in E-learning for emergency primary healthcare |
| title_full | Fit for purpose? Evaluating multiple-choice question quality in E-learning for emergency primary healthcare |
| title_fullStr | Fit for purpose? Evaluating multiple-choice question quality in E-learning for emergency primary healthcare |
| title_full_unstemmed | Fit for purpose? Evaluating multiple-choice question quality in E-learning for emergency primary healthcare |
| title_short | Fit for purpose? Evaluating multiple-choice question quality in E-learning for emergency primary healthcare |
| title_sort | fit for purpose evaluating multiple choice question quality in e learning for emergency primary healthcare |
| topic | E-learning medical education multiple choice question (MCQ) Continuing professional development emergency medicine Adult Education and Lifelong Learning |
| url | https://www.tandfonline.com/doi/10.1080/27707571.2025.2458945 |
| work_keys_str_mv | AT katetorunnaasvold fitforpurposeevaluatingmultiplechoicequestionqualityinelearningforemergencyprimaryhealthcare AT monikakvernenes fitforpurposeevaluatingmultiplechoicequestionqualityinelearningforemergencyprimaryhealthcare AT uneelisabethstømer fitforpurposeevaluatingmultiplechoicequestionqualityinelearningforemergencyprimaryhealthcare AT erikzakariassen fitforpurposeevaluatingmultiplechoicequestionqualityinelearningforemergencyprimaryhealthcare |