The influence of rater empathy, age and experience on writing performance assessment
Assessment reliability is vital in language testing. We have studied the influence of empathy, age and experience on the assessment of the writing component in Estonian Language proficiency examinations at levels A2–C1, and the effect of the rater properties on rater performance at different langua...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The John Paul II Catholic University of Lublin
2017-12-01
|
| Series: | LingBaW |
| Subjects: | |
| Online Access: | https://czasopisma.kul.pl/index.php/LingBaW/article/view/5647 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832592698778845184 |
|---|---|
| author | Pilvi Alp Anu Epner Hille Pajupuu |
| author_facet | Pilvi Alp Anu Epner Hille Pajupuu |
| author_sort | Pilvi Alp |
| collection | DOAJ |
| description |
Assessment reliability is vital in language testing. We have studied the influence of empathy, age and experience on the assessment of the writing component in Estonian Language proficiency examinations at levels A2–C1, and the effect of the rater properties on rater performance at different language levels. The study included 5,270 examination papers, each assessed by two raters. Raters were aged 34–73 and had a rating experience of 3–15 years. The empathy level (EQ) of all 26 A2–C1 raters had previously been measured by Baron-Cohen and Wheelwright’s self-report questionnaire. The results of the correlation analysis indicated that in case of regular training (and with three or more years of experience), the rater’s level of empathy, age and experience did not have a significant effect on the score.
|
| format | Article |
| id | doaj-art-2ef814d6267440578c93716747a90ae2 |
| institution | Kabale University |
| issn | 2450-5188 |
| language | English |
| publishDate | 2017-12-01 |
| publisher | The John Paul II Catholic University of Lublin |
| record_format | Article |
| series | LingBaW |
| spelling | doaj-art-2ef814d6267440578c93716747a90ae22025-01-21T05:14:00ZengThe John Paul II Catholic University of LublinLingBaW2450-51882017-12-013110.31743/lingbaw.5647The influence of rater empathy, age and experience on writing performance assessmentPilvi Alp0Anu Epner1Hille Pajupuu2Foundation InnoveFoundation InnoveInstitute of the Estonian Language Assessment reliability is vital in language testing. We have studied the influence of empathy, age and experience on the assessment of the writing component in Estonian Language proficiency examinations at levels A2–C1, and the effect of the rater properties on rater performance at different language levels. The study included 5,270 examination papers, each assessed by two raters. Raters were aged 34–73 and had a rating experience of 3–15 years. The empathy level (EQ) of all 26 A2–C1 raters had previously been measured by Baron-Cohen and Wheelwright’s self-report questionnaire. The results of the correlation analysis indicated that in case of regular training (and with three or more years of experience), the rater’s level of empathy, age and experience did not have a significant effect on the score. https://czasopisma.kul.pl/index.php/LingBaW/article/view/5647rater effectsrater reliabilityempathyL2 writingassessment |
| spellingShingle | Pilvi Alp Anu Epner Hille Pajupuu The influence of rater empathy, age and experience on writing performance assessment LingBaW rater effects rater reliability empathy L2 writing assessment |
| title | The influence of rater empathy, age and experience on writing performance assessment |
| title_full | The influence of rater empathy, age and experience on writing performance assessment |
| title_fullStr | The influence of rater empathy, age and experience on writing performance assessment |
| title_full_unstemmed | The influence of rater empathy, age and experience on writing performance assessment |
| title_short | The influence of rater empathy, age and experience on writing performance assessment |
| title_sort | influence of rater empathy age and experience on writing performance assessment |
| topic | rater effects rater reliability empathy L2 writing assessment |
| url | https://czasopisma.kul.pl/index.php/LingBaW/article/view/5647 |
| work_keys_str_mv | AT pilvialp theinfluenceofraterempathyageandexperienceonwritingperformanceassessment AT anuepner theinfluenceofraterempathyageandexperienceonwritingperformanceassessment AT hillepajupuu theinfluenceofraterempathyageandexperienceonwritingperformanceassessment AT pilvialp influenceofraterempathyageandexperienceonwritingperformanceassessment AT anuepner influenceofraterempathyageandexperienceonwritingperformanceassessment AT hillepajupuu influenceofraterempathyageandexperienceonwritingperformanceassessment |