Evidence-Based Design Approach for Assessing Universal Competencies in Higher Education: Advantages and Features
The article addresses the issue of assessing universal competencies, which are becoming increasingly important given modern demands on university graduates. It emphasizes the need for valid and reliable tools to measure skills such as critical thinking, creativity, communication, and complex problem...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Moscow Polytechnic University
2025-02-01
|
| Series: | Высшее образование в России |
| Subjects: | |
| Online Access: | https://vovr.elpub.ru/jour/article/view/5321 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832574368344965120 |
|---|---|
| author | S. M. Avdeeva K. V. Tarasova |
| author_facet | S. M. Avdeeva K. V. Tarasova |
| author_sort | S. M. Avdeeva |
| collection | DOAJ |
| description | The article addresses the issue of assessing universal competencies, which are becoming increasingly important given modern demands on university graduates. It emphasizes the need for valid and reliable tools to measure skills such as critical thinking, creativity, communication, and complex problem-solving. The paper presents an analysis of an evidence-based design approach, which integrates cognitive theories, innovative educational technologies, and psychometric models to achieve objective assessments of these competencies.Particular attention is given to the evidence-centered design methodology, which relies on scenario-based tasks closely reflecting real-life and professional situations. This method emphasizes constructing valid argument that link students’ observable behaviors to claims about their competence levels. The approach not only captures demonstrations of knowledge and skills in realistic contexts but also structures the instrument development process to ensure that empirical results are theoretically sound. A distinctive feature of this approach is the process of building arguments from collected evidence, differentiating it from traditional methods, which focus primarily on the statistical and psychometric properties of tests.The principles of this method are illustrated using the CT Test for assessing university students’ critical thinking, a tool with established psychometric quality, which has been piloted with over 10,000 students in Russian universities. The article argues that implementing evidence-based tools will substantially enhance the validity and reliability of competency assessments among students, making this approach a promising candidate for integration into educational practice. |
| format | Article |
| id | doaj-art-55ce313eaf614adbbdce2915025b38fc |
| institution | Kabale University |
| issn | 0869-3617 2072-0459 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Moscow Polytechnic University |
| record_format | Article |
| series | Высшее образование в России |
| spelling | doaj-art-55ce313eaf614adbbdce2915025b38fc2025-02-01T13:14:33ZengMoscow Polytechnic UniversityВысшее образование в России0869-36172072-04592025-02-013418210510.31992/0869-3617-2025-34-1-82-1052530Evidence-Based Design Approach for Assessing Universal Competencies in Higher Education: Advantages and FeaturesS. M. Avdeeva0K. V. Tarasova1National Research University Higher School of EconomicsNational Research University Higher School of EconomicsThe article addresses the issue of assessing universal competencies, which are becoming increasingly important given modern demands on university graduates. It emphasizes the need for valid and reliable tools to measure skills such as critical thinking, creativity, communication, and complex problem-solving. The paper presents an analysis of an evidence-based design approach, which integrates cognitive theories, innovative educational technologies, and psychometric models to achieve objective assessments of these competencies.Particular attention is given to the evidence-centered design methodology, which relies on scenario-based tasks closely reflecting real-life and professional situations. This method emphasizes constructing valid argument that link students’ observable behaviors to claims about their competence levels. The approach not only captures demonstrations of knowledge and skills in realistic contexts but also structures the instrument development process to ensure that empirical results are theoretically sound. A distinctive feature of this approach is the process of building arguments from collected evidence, differentiating it from traditional methods, which focus primarily on the statistical and psychometric properties of tests.The principles of this method are illustrated using the CT Test for assessing university students’ critical thinking, a tool with established psychometric quality, which has been piloted with over 10,000 students in Russian universities. The article argues that implementing evidence-based tools will substantially enhance the validity and reliability of competency assessments among students, making this approach a promising candidate for integration into educational practice.https://vovr.elpub.ru/jour/article/view/5321evidence-based design approachevidence-centered designuniversal competenciescomplex latent constructmeasurement modelvalidity argument |
| spellingShingle | S. M. Avdeeva K. V. Tarasova Evidence-Based Design Approach for Assessing Universal Competencies in Higher Education: Advantages and Features Высшее образование в России evidence-based design approach evidence-centered design universal competencies complex latent construct measurement model validity argument |
| title | Evidence-Based Design Approach for Assessing Universal Competencies in Higher Education: Advantages and Features |
| title_full | Evidence-Based Design Approach for Assessing Universal Competencies in Higher Education: Advantages and Features |
| title_fullStr | Evidence-Based Design Approach for Assessing Universal Competencies in Higher Education: Advantages and Features |
| title_full_unstemmed | Evidence-Based Design Approach for Assessing Universal Competencies in Higher Education: Advantages and Features |
| title_short | Evidence-Based Design Approach for Assessing Universal Competencies in Higher Education: Advantages and Features |
| title_sort | evidence based design approach for assessing universal competencies in higher education advantages and features |
| topic | evidence-based design approach evidence-centered design universal competencies complex latent construct measurement model validity argument |
| url | https://vovr.elpub.ru/jour/article/view/5321 |
| work_keys_str_mv | AT smavdeeva evidencebaseddesignapproachforassessinguniversalcompetenciesinhighereducationadvantagesandfeatures AT kvtarasova evidencebaseddesignapproachforassessinguniversalcompetenciesinhighereducationadvantagesandfeatures |