Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review.
<h4>Introduction</h4>Systems modelling and simulation can improve understanding of complex systems to support decision making, better managing system challenges. Advances in technology have facilitated accessibility of modelling by diverse stakeholders, allowing them to engage with and c...
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2022-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0266125&type=printable |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832540082042568704 |
|---|---|
| author | Grace Yeeun Lee Ian Bernard Hickie Jo-An Occhipinti Yun Ju Christine Song Adam Skinner Salvador Camacho Kenny Lawson Adriane Martin Hilber Louise Freebairn |
| author_facet | Grace Yeeun Lee Ian Bernard Hickie Jo-An Occhipinti Yun Ju Christine Song Adam Skinner Salvador Camacho Kenny Lawson Adriane Martin Hilber Louise Freebairn |
| author_sort | Grace Yeeun Lee |
| collection | DOAJ |
| description | <h4>Introduction</h4>Systems modelling and simulation can improve understanding of complex systems to support decision making, better managing system challenges. Advances in technology have facilitated accessibility of modelling by diverse stakeholders, allowing them to engage with and contribute to the development of systems models (participatory modelling). However, despite its increasing applications across a range of disciplines, there is a growing need to improve evaluation efforts to effectively report on the quality, importance, and value of participatory modelling. This paper aims to identify and assess evaluation frameworks, criteria, and/or processes, as well as to synthesize the findings into a comprehensive multi-scale framework for participatory modelling programs.<h4>Materials and methods</h4>A scoping review approach was utilized, which involved a systematic literature search via Scopus in consultation with experts to identify and appraise records that described an evaluation framework, criteria, and/or process in the context of participatory modelling. This scoping review is registered with the Open Science Framework.<h4>Results</h4>The review identified 11 studies, which varied in evaluation purposes, terminologies, levels of examination, and time points. The review of studies highlighted areas of overlap and opportunities for further development, which prompted the development of a comprehensive multi-scale evaluation framework to assess participatory modelling programs across disciplines and systems modelling methods. The framework consists of four categories (Feasibility, Value, Change/Action, Sustainability) with 30 evaluation criteria, broken down across project-, individual-, group- and system-level impacts.<h4>Discussion & conclusion</h4>The presented novel framework brings together a significant knowledge base into a flexible, cross-sectoral evaluation effort that considers the whole participatory modelling process. Developed through the rigorous synthesis of multidisciplinary expertise from existing studies, the application of the framework can provide the opportunity to understand practical future implications such as which aspects are particularly important for policy decisions, community learning, and the ongoing improvement of participatory modelling methods. |
| format | Article |
| id | doaj-art-f5890932ff434573b552f1343671932f |
| institution | Kabale University |
| issn | 1932-6203 |
| language | English |
| publishDate | 2022-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-f5890932ff434573b552f1343671932f2025-02-05T05:32:53ZengPublic Library of Science (PLoS)PLoS ONE1932-62032022-01-01174e026612510.1371/journal.pone.0266125Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review.Grace Yeeun LeeIan Bernard HickieJo-An OcchipintiYun Ju Christine SongAdam SkinnerSalvador CamachoKenny LawsonAdriane Martin HilberLouise Freebairn<h4>Introduction</h4>Systems modelling and simulation can improve understanding of complex systems to support decision making, better managing system challenges. Advances in technology have facilitated accessibility of modelling by diverse stakeholders, allowing them to engage with and contribute to the development of systems models (participatory modelling). However, despite its increasing applications across a range of disciplines, there is a growing need to improve evaluation efforts to effectively report on the quality, importance, and value of participatory modelling. This paper aims to identify and assess evaluation frameworks, criteria, and/or processes, as well as to synthesize the findings into a comprehensive multi-scale framework for participatory modelling programs.<h4>Materials and methods</h4>A scoping review approach was utilized, which involved a systematic literature search via Scopus in consultation with experts to identify and appraise records that described an evaluation framework, criteria, and/or process in the context of participatory modelling. This scoping review is registered with the Open Science Framework.<h4>Results</h4>The review identified 11 studies, which varied in evaluation purposes, terminologies, levels of examination, and time points. The review of studies highlighted areas of overlap and opportunities for further development, which prompted the development of a comprehensive multi-scale evaluation framework to assess participatory modelling programs across disciplines and systems modelling methods. The framework consists of four categories (Feasibility, Value, Change/Action, Sustainability) with 30 evaluation criteria, broken down across project-, individual-, group- and system-level impacts.<h4>Discussion & conclusion</h4>The presented novel framework brings together a significant knowledge base into a flexible, cross-sectoral evaluation effort that considers the whole participatory modelling process. Developed through the rigorous synthesis of multidisciplinary expertise from existing studies, the application of the framework can provide the opportunity to understand practical future implications such as which aspects are particularly important for policy decisions, community learning, and the ongoing improvement of participatory modelling methods.https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0266125&type=printable |
| spellingShingle | Grace Yeeun Lee Ian Bernard Hickie Jo-An Occhipinti Yun Ju Christine Song Adam Skinner Salvador Camacho Kenny Lawson Adriane Martin Hilber Louise Freebairn Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review. PLoS ONE |
| title | Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review. |
| title_full | Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review. |
| title_fullStr | Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review. |
| title_full_unstemmed | Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review. |
| title_short | Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review. |
| title_sort | presenting a comprehensive multi scale evaluation framework for participatory modelling programs a scoping review |
| url | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0266125&type=printable |
| work_keys_str_mv | AT graceyeeunlee presentingacomprehensivemultiscaleevaluationframeworkforparticipatorymodellingprogramsascopingreview AT ianbernardhickie presentingacomprehensivemultiscaleevaluationframeworkforparticipatorymodellingprogramsascopingreview AT joanocchipinti presentingacomprehensivemultiscaleevaluationframeworkforparticipatorymodellingprogramsascopingreview AT yunjuchristinesong presentingacomprehensivemultiscaleevaluationframeworkforparticipatorymodellingprogramsascopingreview AT adamskinner presentingacomprehensivemultiscaleevaluationframeworkforparticipatorymodellingprogramsascopingreview AT salvadorcamacho presentingacomprehensivemultiscaleevaluationframeworkforparticipatorymodellingprogramsascopingreview AT kennylawson presentingacomprehensivemultiscaleevaluationframeworkforparticipatorymodellingprogramsascopingreview AT adrianemartinhilber presentingacomprehensivemultiscaleevaluationframeworkforparticipatorymodellingprogramsascopingreview AT louisefreebairn presentingacomprehensivemultiscaleevaluationframeworkforparticipatorymodellingprogramsascopingreview |