Design, implementation and evaluation of OSPE exam to evaluate the competence of occupational health and safety engineering students

Background and Aim: One of the concerns of occupational health engineering lecturers is acquisition an acceptable level of skill and ability by learners, which is also emphasized in the educational curriculum. Paying attention to abilities and practical skills in exams can answer these concerns to s...

Full description

Saved in:
Bibliographic Details
Main Authors: Samira Rahimnejad, Kamaladdin Abedi, Farough Mohammadian, Ebrahim Darvishi, Ebrahim Mohammadi, Farzaneh Zarei, Madjid Shafiiyan
Format: Article
Language:fas
Published: Kurdistan University of Medical Sciences 2024-11-01
Series:مجله علمی دانشگاه علوم پزشکی کردستان
Subjects:
Online Access:http://sjku.muk.ac.ir/article-1-7829-en.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832575398786891776
author Samira Rahimnejad
Kamaladdin Abedi
Farough Mohammadian
Ebrahim Darvishi
Ebrahim Mohammadi
Farzaneh Zarei
Madjid Shafiiyan
author_facet Samira Rahimnejad
Kamaladdin Abedi
Farough Mohammadian
Ebrahim Darvishi
Ebrahim Mohammadi
Farzaneh Zarei
Madjid Shafiiyan
author_sort Samira Rahimnejad
collection DOAJ
description Background and Aim: One of the concerns of occupational health engineering lecturers is acquisition an acceptable level of skill and ability by learners, which is also emphasized in the educational curriculum. Paying attention to abilities and practical skills in exams can answer these concerns to some extent. Therefore, this study was carried out with the aim of designing, implementing and evaluating the OSPE exam at the end of the undergraduate course. Materials and Methods: This descriptive-analytical study was conducted cross-sectionally on the students of occupational health engineering after the end of their internship. First, the exam committee was formed and then focused group discussion meetings (FGD) were held and the study was conducted in three phases: design, implementation and evaluation. The scenarios of the stations (12 stations) were designed according to the competences and practical skills of the educational curriculum. The evaluation of the exam included the determination of formal and content validity, student satisfaction, reliability, and the determination of the internal correlation of the exam scores. Results: The content validity of the exam was around average from the point of view of the students and professors in all stations with a significance level of 0.05. The results of Cronbach's alpha coefficient showed that there was a high correlation between the scores of the stations (ɑ=0.7) and between the scores of the stations and the overall score of OSPE (ɑ=0.8). Students' satisfaction with the exam was average. In addition, by examining the results of qualitative data, two classes and several subclasses were obtained. The mentioned two classes were identified as strengths and weaknesses of the exam. Conclusion: Although the OSPE exam has weaknesses, it can be used as a standard and suitable method to show the competence and practical skills of learners. It seems that much more studies should be carried out in the field of health sciences especially regarding exam design and standard scenario writing methods, in order to judge its validity and reliability as an evaluation tool. At the same time, using OSPE as a supplement to traditional exams is very valuable.
format Article
id doaj-art-cf511abc1afa48558627aad6ce9093e8
institution Kabale University
issn 1560-652X
2345-4040
language fas
publishDate 2024-11-01
publisher Kurdistan University of Medical Sciences
record_format Article
series مجله علمی دانشگاه علوم پزشکی کردستان
spelling doaj-art-cf511abc1afa48558627aad6ce9093e82025-02-01T09:41:40ZfasKurdistan University of Medical Sciencesمجله علمی دانشگاه علوم پزشکی کردستان1560-652X2345-40402024-11-01295108124Design, implementation and evaluation of OSPE exam to evaluate the competence of occupational health and safety engineering studentsSamira Rahimnejad0Kamaladdin Abedi1Farough Mohammadian2Ebrahim Darvishi3Ebrahim Mohammadi4Farzaneh Zarei5Madjid Shafiiyan6 .Instructor, Environmental Health Research Center, Research Institute for Health Development, Kurdistan University of Medical Sciences, Sanandaj, Iran Assistant Professor, Environmental Health Research Center, Research Institute for Health Development, Kurdistan University of Medical Sciences, Sanandaj, Iran Assistant Professor, Environmental Health Research Center, Research Institute for Health Development, Kurdistan University of Medical Sciences, Sanandaj, Iran Assistant Professor, Environmental Health Research Center, Research Institute for Health Development, Kurdistan University of Medical Sciences, Sanandaj, Iran Assistant Professor, Environmental Health Research Center, Research Institute for Health Development, Kurdistan University of Medical Sciences, Sanandaj, Iran Instructor, Center for Studies and Development of Medical Education, Vice-Chancellor of Education, Kurdistan University of Medical Sciences, Sanandaj, Iran Assistant Professor, Center for Studies and Development of Medical Education, Vice-Chancellor of Education, Kurdistan University of Medical Sciences, Sanandaj, Iran Background and Aim: One of the concerns of occupational health engineering lecturers is acquisition an acceptable level of skill and ability by learners, which is also emphasized in the educational curriculum. Paying attention to abilities and practical skills in exams can answer these concerns to some extent. Therefore, this study was carried out with the aim of designing, implementing and evaluating the OSPE exam at the end of the undergraduate course. Materials and Methods: This descriptive-analytical study was conducted cross-sectionally on the students of occupational health engineering after the end of their internship. First, the exam committee was formed and then focused group discussion meetings (FGD) were held and the study was conducted in three phases: design, implementation and evaluation. The scenarios of the stations (12 stations) were designed according to the competences and practical skills of the educational curriculum. The evaluation of the exam included the determination of formal and content validity, student satisfaction, reliability, and the determination of the internal correlation of the exam scores. Results: The content validity of the exam was around average from the point of view of the students and professors in all stations with a significance level of 0.05. The results of Cronbach's alpha coefficient showed that there was a high correlation between the scores of the stations (ɑ=0.7) and between the scores of the stations and the overall score of OSPE (ɑ=0.8). Students' satisfaction with the exam was average. In addition, by examining the results of qualitative data, two classes and several subclasses were obtained. The mentioned two classes were identified as strengths and weaknesses of the exam. Conclusion: Although the OSPE exam has weaknesses, it can be used as a standard and suitable method to show the competence and practical skills of learners. It seems that much more studies should be carried out in the field of health sciences especially regarding exam design and standard scenario writing methods, in order to judge its validity and reliability as an evaluation tool. At the same time, using OSPE as a supplement to traditional exams is very valuable.http://sjku.muk.ac.ir/article-1-7829-en.pdfobjective structured practical examination (ospe)occupational health and safety engineeringundergraduate students
spellingShingle Samira Rahimnejad
Kamaladdin Abedi
Farough Mohammadian
Ebrahim Darvishi
Ebrahim Mohammadi
Farzaneh Zarei
Madjid Shafiiyan
Design, implementation and evaluation of OSPE exam to evaluate the competence of occupational health and safety engineering students
مجله علمی دانشگاه علوم پزشکی کردستان
objective structured practical examination (ospe)
occupational health and safety engineering
undergraduate students
title Design, implementation and evaluation of OSPE exam to evaluate the competence of occupational health and safety engineering students
title_full Design, implementation and evaluation of OSPE exam to evaluate the competence of occupational health and safety engineering students
title_fullStr Design, implementation and evaluation of OSPE exam to evaluate the competence of occupational health and safety engineering students
title_full_unstemmed Design, implementation and evaluation of OSPE exam to evaluate the competence of occupational health and safety engineering students
title_short Design, implementation and evaluation of OSPE exam to evaluate the competence of occupational health and safety engineering students
title_sort design implementation and evaluation of ospe exam to evaluate the competence of occupational health and safety engineering students
topic objective structured practical examination (ospe)
occupational health and safety engineering
undergraduate students
url http://sjku.muk.ac.ir/article-1-7829-en.pdf
work_keys_str_mv AT samirarahimnejad designimplementationandevaluationofospeexamtoevaluatethecompetenceofoccupationalhealthandsafetyengineeringstudents
AT kamaladdinabedi designimplementationandevaluationofospeexamtoevaluatethecompetenceofoccupationalhealthandsafetyengineeringstudents
AT faroughmohammadian designimplementationandevaluationofospeexamtoevaluatethecompetenceofoccupationalhealthandsafetyengineeringstudents
AT ebrahimdarvishi designimplementationandevaluationofospeexamtoevaluatethecompetenceofoccupationalhealthandsafetyengineeringstudents
AT ebrahimmohammadi designimplementationandevaluationofospeexamtoevaluatethecompetenceofoccupationalhealthandsafetyengineeringstudents
AT farzanehzarei designimplementationandevaluationofospeexamtoevaluatethecompetenceofoccupationalhealthandsafetyengineeringstudents
AT madjidshafiiyan designimplementationandevaluationofospeexamtoevaluatethecompetenceofoccupationalhealthandsafetyengineeringstudents