Visuals versus textual scales: Optimizing reliability and user experience in observational assessment of parent-child interaction
Objective: Assessment of parent-child interaction by practitioners is of great importance but hindered by a lack of instruments that withstand the constraints daily practice places on usage. Visuals may offer an alternative format. Visualizations were tested on reliability, accuracy, and feasibility...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-06-01
|
| Series: | PEC Innovation |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2772628225000056 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832087408421634048 |
|---|---|
| author | Mirte L. Forrer Carlo Schuengel Mirjam Oosterman |
| author_facet | Mirte L. Forrer Carlo Schuengel Mirjam Oosterman |
| author_sort | Mirte L. Forrer |
| collection | DOAJ |
| description | Objective: Assessment of parent-child interaction by practitioners is of great importance but hindered by a lack of instruments that withstand the constraints daily practice places on usage. Visuals may offer an alternative format. Visualizations were tested on reliability, accuracy, and feasibility in observational assessment of parent-child interaction, as alternatives for textual rating scales. Methods: In Study 1, 95 students rated parent-child interactions with a video or text anchor scale, and in Study 2, 217 professionals rated the same interactions with a decision tree including visual components or a text anchor scale. Results: Students using the video anchor scale were less reliable and accurate, slower, and had a less positive user experience than students using the text anchor scale. Professionals using the decision tree did not differ in reliability and were comparable in user experience with professionals using the text anchor scale. Rater accuracy showed similar dependency on quality of parental behavior for both scales: ratings were less accurate when the quality of the parent-child interaction was low, and more accurate when the quality was high. However, professionals were less accurate and slower in using the decision tree than the text anchor scale. Conclusion: With a first iteration of a decision tree performing the same to or only slightly worse, efforts to further develop decision trees might be worthwhile. Innovation: These nonintuitive findings underscore the value of experimental testing in assessment design in daily practice. |
| format | Article |
| id | doaj-art-a29f67c3dd0943a7a6a1ee6aacc947e5 |
| institution | Kabale University |
| issn | 2772-6282 |
| language | English |
| publishDate | 2025-06-01 |
| publisher | Elsevier |
| record_format | Article |
| series | PEC Innovation |
| spelling | doaj-art-a29f67c3dd0943a7a6a1ee6aacc947e52025-02-06T05:13:06ZengElsevierPEC Innovation2772-62822025-06-016100376Visuals versus textual scales: Optimizing reliability and user experience in observational assessment of parent-child interactionMirte L. Forrer0Carlo Schuengel1Mirjam Oosterman2Vrije Universiteit Amsterdam, Section of Clinical Child and Family Studies, Van der Boechorststraat 7, 1081 BT Amsterdam, the Netherlands; Amsterdam Public Health Research Institute, Amsterdam, the Netherlands; Jeugdbescherming Regio Amsterdam, Overschiestraat 57, 1062 HN Amsterdam, the Netherlands; Corresponding author at: Vrije Universiteit Amsterdam, Section of Clinical Child and Family Studies, Van der Boechorststraat 7, 1081 BT Amsterdam, the Netherlands.Vrije Universiteit Amsterdam, Section of Clinical Child and Family Studies, Van der Boechorststraat 7, 1081 BT Amsterdam, the Netherlands; Amsterdam Public Health Research Institute, Amsterdam, the NetherlandsVrije Universiteit Amsterdam, Section of Clinical Child and Family Studies, Van der Boechorststraat 7, 1081 BT Amsterdam, the Netherlands; Amsterdam Public Health Research Institute, Amsterdam, the NetherlandsObjective: Assessment of parent-child interaction by practitioners is of great importance but hindered by a lack of instruments that withstand the constraints daily practice places on usage. Visuals may offer an alternative format. Visualizations were tested on reliability, accuracy, and feasibility in observational assessment of parent-child interaction, as alternatives for textual rating scales. Methods: In Study 1, 95 students rated parent-child interactions with a video or text anchor scale, and in Study 2, 217 professionals rated the same interactions with a decision tree including visual components or a text anchor scale. Results: Students using the video anchor scale were less reliable and accurate, slower, and had a less positive user experience than students using the text anchor scale. Professionals using the decision tree did not differ in reliability and were comparable in user experience with professionals using the text anchor scale. Rater accuracy showed similar dependency on quality of parental behavior for both scales: ratings were less accurate when the quality of the parent-child interaction was low, and more accurate when the quality was high. However, professionals were less accurate and slower in using the decision tree than the text anchor scale. Conclusion: With a first iteration of a decision tree performing the same to or only slightly worse, efforts to further develop decision trees might be worthwhile. Innovation: These nonintuitive findings underscore the value of experimental testing in assessment design in daily practice.http://www.sciencedirect.com/science/article/pii/S2772628225000056Decision treesFeasibilityObservational assessmentChild welfareParent-child interactionVisualization |
| spellingShingle | Mirte L. Forrer Carlo Schuengel Mirjam Oosterman Visuals versus textual scales: Optimizing reliability and user experience in observational assessment of parent-child interaction PEC Innovation Decision trees Feasibility Observational assessment Child welfare Parent-child interaction Visualization |
| title | Visuals versus textual scales: Optimizing reliability and user experience in observational assessment of parent-child interaction |
| title_full | Visuals versus textual scales: Optimizing reliability and user experience in observational assessment of parent-child interaction |
| title_fullStr | Visuals versus textual scales: Optimizing reliability and user experience in observational assessment of parent-child interaction |
| title_full_unstemmed | Visuals versus textual scales: Optimizing reliability and user experience in observational assessment of parent-child interaction |
| title_short | Visuals versus textual scales: Optimizing reliability and user experience in observational assessment of parent-child interaction |
| title_sort | visuals versus textual scales optimizing reliability and user experience in observational assessment of parent child interaction |
| topic | Decision trees Feasibility Observational assessment Child welfare Parent-child interaction Visualization |
| url | http://www.sciencedirect.com/science/article/pii/S2772628225000056 |
| work_keys_str_mv | AT mirtelforrer visualsversustextualscalesoptimizingreliabilityanduserexperienceinobservationalassessmentofparentchildinteraction AT carloschuengel visualsversustextualscalesoptimizingreliabilityanduserexperienceinobservationalassessmentofparentchildinteraction AT mirjamoosterman visualsversustextualscalesoptimizingreliabilityanduserexperienceinobservationalassessmentofparentchildinteraction |