Assessing quality and biases in ethnomathematics-based numeracy worksheets: A Many-Facet Rasch Model analysis

Numeracy is a vital 21st-century skill, enabling students to solve problems relevant to socio-cultural contexts, a significance emphasized by international assessments such as PISA. Teachers can improve students' numeracy abilities by creating teaching materials that incorporate diverse activit...

Full description

Saved in:
Bibliographic Details
Main Authors: Rahmi Ramadhani, Soeharto Soeharto, Fitria Arifiyanti, Rully Charitas Indra Prahmana, Alfa Saleh, Zsolt Lavicza
Format: Article
Language:English
Published: Elsevier 2025-01-01
Series:Social Sciences and Humanities Open
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2590291125004644
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849417484263751680
author Rahmi Ramadhani
Soeharto Soeharto
Fitria Arifiyanti
Rully Charitas Indra Prahmana
Alfa Saleh
Zsolt Lavicza
author_facet Rahmi Ramadhani
Soeharto Soeharto
Fitria Arifiyanti
Rully Charitas Indra Prahmana
Alfa Saleh
Zsolt Lavicza
author_sort Rahmi Ramadhani
collection DOAJ
description Numeracy is a vital 21st-century skill, enabling students to solve problems relevant to socio-cultural contexts, a significance emphasized by international assessments such as PISA. Teachers can improve students' numeracy abilities by creating teaching materials that incorporate diverse activities to address daily problems through cultural lens (ethnomathematics) within a sociocultural framework. Students’ worksheets are considered effective tools for this purpose. Therefore, this study aimed to investigate numeracy learning activities in ethnomathematics-based worksheets within socio-cultural contexts using Many-Facet Rasch Model analysis. To achieve this objective, ten raters evaluated four learning activities based on five criteria: relevance, feasibility, construction and systematics, appearance, and language appropriateness. A total of 200 data points were coded in the FACETS software and subsequently analyzed. The results confirm that the worksheets meet educational quality standards in terms of both validity and reliability. Language appropriateness was the most challenging criterion for raters, whereas construction and systematics were the easiest. In addition, Rater A was the strictest, while Rater J was the most lenient. The evaluation also confirmed gender bias in Learning Activity 2 and educational background bias in Learning Activity 3.
format Article
id doaj-art-7410b2ea0a064ab9b14de3361ba8196c
institution Kabale University
issn 2590-2911
language English
publishDate 2025-01-01
publisher Elsevier
record_format Article
series Social Sciences and Humanities Open
spelling doaj-art-7410b2ea0a064ab9b14de3361ba8196c2025-08-20T03:32:50ZengElsevierSocial Sciences and Humanities Open2590-29112025-01-011210173610.1016/j.ssaho.2025.101736Assessing quality and biases in ethnomathematics-based numeracy worksheets: A Many-Facet Rasch Model analysisRahmi Ramadhani0Soeharto Soeharto1Fitria Arifiyanti2Rully Charitas Indra Prahmana3Alfa Saleh4Zsolt Lavicza5Universitas Potensi Utama, Medan, Indonesia; Ethno-Realistic Mathematics Education Research Center, Universitas Ahmad Dahlan, Yogyakarta, IndonesiaLinz School of Education, Johannes Kepler University, Department of STEM Education, Linz, Austria; Research Center for Education, National Research and Innovation Agency (BRIN), Jakarta, Indonesia; Research Center of Educational Technologies, Azerbaijan State University of Economics, Baku, Azerbaijan; Corresponding author. Soeharto Soeharto, Visiting Researcher at Linz School of Education, Johannes Kepler University, Department of STEM Education, AustriaDepartment of Mathematics and Science Education, Universitas Pendidikan Indonesia, Bandung, IndonesiaAhmad Dahlan University, Yogyakarta, Indonesia; Ethno-Realistic Mathematics Education Research Center, Universitas Ahmad Dahlan, Yogyakarta, IndonesiaUniversitas Samudra, Langsa, IndonesiaLinz School of Education, Johannes Kepler University, Department of STEM Education, Linz, AustriaNumeracy is a vital 21st-century skill, enabling students to solve problems relevant to socio-cultural contexts, a significance emphasized by international assessments such as PISA. Teachers can improve students' numeracy abilities by creating teaching materials that incorporate diverse activities to address daily problems through cultural lens (ethnomathematics) within a sociocultural framework. Students’ worksheets are considered effective tools for this purpose. Therefore, this study aimed to investigate numeracy learning activities in ethnomathematics-based worksheets within socio-cultural contexts using Many-Facet Rasch Model analysis. To achieve this objective, ten raters evaluated four learning activities based on five criteria: relevance, feasibility, construction and systematics, appearance, and language appropriateness. A total of 200 data points were coded in the FACETS software and subsequently analyzed. The results confirm that the worksheets meet educational quality standards in terms of both validity and reliability. Language appropriateness was the most challenging criterion for raters, whereas construction and systematics were the easiest. In addition, Rater A was the strictest, while Rater J was the most lenient. The evaluation also confirmed gender bias in Learning Activity 2 and educational background bias in Learning Activity 3.http://www.sciencedirect.com/science/article/pii/S2590291125004644EthnomathematicsExpert judgementMany-facet rasch modelNumeracy worksheet
spellingShingle Rahmi Ramadhani
Soeharto Soeharto
Fitria Arifiyanti
Rully Charitas Indra Prahmana
Alfa Saleh
Zsolt Lavicza
Assessing quality and biases in ethnomathematics-based numeracy worksheets: A Many-Facet Rasch Model analysis
Social Sciences and Humanities Open
Ethnomathematics
Expert judgement
Many-facet rasch model
Numeracy worksheet
title Assessing quality and biases in ethnomathematics-based numeracy worksheets: A Many-Facet Rasch Model analysis
title_full Assessing quality and biases in ethnomathematics-based numeracy worksheets: A Many-Facet Rasch Model analysis
title_fullStr Assessing quality and biases in ethnomathematics-based numeracy worksheets: A Many-Facet Rasch Model analysis
title_full_unstemmed Assessing quality and biases in ethnomathematics-based numeracy worksheets: A Many-Facet Rasch Model analysis
title_short Assessing quality and biases in ethnomathematics-based numeracy worksheets: A Many-Facet Rasch Model analysis
title_sort assessing quality and biases in ethnomathematics based numeracy worksheets a many facet rasch model analysis
topic Ethnomathematics
Expert judgement
Many-facet rasch model
Numeracy worksheet
url http://www.sciencedirect.com/science/article/pii/S2590291125004644
work_keys_str_mv AT rahmiramadhani assessingqualityandbiasesinethnomathematicsbasednumeracyworksheetsamanyfacetraschmodelanalysis
AT soehartosoeharto assessingqualityandbiasesinethnomathematicsbasednumeracyworksheetsamanyfacetraschmodelanalysis
AT fitriaarifiyanti assessingqualityandbiasesinethnomathematicsbasednumeracyworksheetsamanyfacetraschmodelanalysis
AT rullycharitasindraprahmana assessingqualityandbiasesinethnomathematicsbasednumeracyworksheetsamanyfacetraschmodelanalysis
AT alfasaleh assessingqualityandbiasesinethnomathematicsbasednumeracyworksheetsamanyfacetraschmodelanalysis
AT zsoltlavicza assessingqualityandbiasesinethnomathematicsbasednumeracyworksheetsamanyfacetraschmodelanalysis