Development and design validation of a novel network meta-analysis presentation tool for multiple outcomes: a qualitative descriptive study
Objective The Grades of Recommendations, Assessment, Development and Evaluation working group recently developed an innovative approach to interpreting results from network meta-analyses (NMA) through minimally and partially contextualised methods; however, the optimal method for presenting results...
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMJ Publishing Group
2022-06-01
|
| Series: | BMJ Open |
| Online Access: | https://bmjopen.bmj.com/content/12/6/e056400.full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832583871633293312 |
|---|---|
| author | Lehana Thabane Jason W Busse Behnam Sadeghirad Gordon H Guyatt Mohit Bhandari Romina Brignardello-Petersen Fernando Kenji Nampo Carlos A Cuello-Garcia Raveendhara R Bannuru Mark R Phillips Yu Jia Guo Sofia Bzovsky |
| author_facet | Lehana Thabane Jason W Busse Behnam Sadeghirad Gordon H Guyatt Mohit Bhandari Romina Brignardello-Petersen Fernando Kenji Nampo Carlos A Cuello-Garcia Raveendhara R Bannuru Mark R Phillips Yu Jia Guo Sofia Bzovsky |
| author_sort | Lehana Thabane |
| collection | DOAJ |
| description | Objective The Grades of Recommendations, Assessment, Development and Evaluation working group recently developed an innovative approach to interpreting results from network meta-analyses (NMA) through minimally and partially contextualised methods; however, the optimal method for presenting results for multiple outcomes using this approach remains uncertain. We; therefore, developed and iteratively modified a presentation method that effectively summarises NMA results of multiple outcomes for clinicians using this new interpretation approach.Design Qualitative descriptive study.Setting A steering group of seven individuals with experience in NMA and design validation studies developed two colour-coded presentation formats for evaluation. Through an iterative process, we assessed the validity of both formats to maximise their clarity and ease of interpretation.Participants 26 participants including 20 clinicians who routinely provide patient care, 3 research staff/research methodologists and 3 residents.Main outcome measures Two team members used qualitative content analysis to independently analyse transcripts of all interviews. The steering group reviewed the analyses and responded with serial modifications of the presentation format.Results To ensure that readers could easily discern the benefits and safety of each included treatment across all assessed outcomes, participants primarily focused on simple information presentations, with intuitive organisational decisions and colour coding. Feedback ultimately resulted in two presentation versions, each preferred by a substantial group of participants, and development of a legend to facilitate interpretation.Conclusion Iterative design validation facilitated the development of two novel formats for presenting minimally or partially contextualised NMA results for multiple outcomes. These presentation approaches appeal to audiences that include clinicians with limited familiarity with NMAs. |
| format | Article |
| id | doaj-art-ea517690c7f3421586909efb3689b614 |
| institution | Kabale University |
| issn | 2044-6055 |
| language | English |
| publishDate | 2022-06-01 |
| publisher | BMJ Publishing Group |
| record_format | Article |
| series | BMJ Open |
| spelling | doaj-art-ea517690c7f3421586909efb3689b6142025-01-28T04:15:09ZengBMJ Publishing GroupBMJ Open2044-60552022-06-0112610.1136/bmjopen-2021-056400Development and design validation of a novel network meta-analysis presentation tool for multiple outcomes: a qualitative descriptive studyLehana Thabane0Jason W Busse1Behnam Sadeghirad2Gordon H Guyatt3Mohit Bhandari4Romina Brignardello-Petersen5Fernando Kenji Nampo6Carlos A Cuello-Garcia7Raveendhara R Bannuru8Mark R Phillips9Yu Jia Guo10Sofia Bzovsky11Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, CanadaprofessorDepartment of Health Research Methods, Evidence and Impact, Mcmaster University, Hamilton, Ontario, CanadaHealth Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, CanadaHealth Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, CanadamethodologistDepartment of Latin-American Institute of Life and Nature science, Federal University of Latin-American Integration, Foz do Iguacu, BrazilHealth Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, CanadaCenter for Treatment Comparison and Integrative Analysis, Tufts Medical Center, Boston, Massachusetts, USAHealth Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, CanadaHealth Sciences, McMaster University, Hamilton, Ontario, CanadaDepartment of Surgery - Division of Orthopaedics, McMaster University, Hamilton, Ontario, CanadaObjective The Grades of Recommendations, Assessment, Development and Evaluation working group recently developed an innovative approach to interpreting results from network meta-analyses (NMA) through minimally and partially contextualised methods; however, the optimal method for presenting results for multiple outcomes using this approach remains uncertain. We; therefore, developed and iteratively modified a presentation method that effectively summarises NMA results of multiple outcomes for clinicians using this new interpretation approach.Design Qualitative descriptive study.Setting A steering group of seven individuals with experience in NMA and design validation studies developed two colour-coded presentation formats for evaluation. Through an iterative process, we assessed the validity of both formats to maximise their clarity and ease of interpretation.Participants 26 participants including 20 clinicians who routinely provide patient care, 3 research staff/research methodologists and 3 residents.Main outcome measures Two team members used qualitative content analysis to independently analyse transcripts of all interviews. The steering group reviewed the analyses and responded with serial modifications of the presentation format.Results To ensure that readers could easily discern the benefits and safety of each included treatment across all assessed outcomes, participants primarily focused on simple information presentations, with intuitive organisational decisions and colour coding. Feedback ultimately resulted in two presentation versions, each preferred by a substantial group of participants, and development of a legend to facilitate interpretation.Conclusion Iterative design validation facilitated the development of two novel formats for presenting minimally or partially contextualised NMA results for multiple outcomes. These presentation approaches appeal to audiences that include clinicians with limited familiarity with NMAs.https://bmjopen.bmj.com/content/12/6/e056400.full |
| spellingShingle | Lehana Thabane Jason W Busse Behnam Sadeghirad Gordon H Guyatt Mohit Bhandari Romina Brignardello-Petersen Fernando Kenji Nampo Carlos A Cuello-Garcia Raveendhara R Bannuru Mark R Phillips Yu Jia Guo Sofia Bzovsky Development and design validation of a novel network meta-analysis presentation tool for multiple outcomes: a qualitative descriptive study BMJ Open |
| title | Development and design validation of a novel network meta-analysis presentation tool for multiple outcomes: a qualitative descriptive study |
| title_full | Development and design validation of a novel network meta-analysis presentation tool for multiple outcomes: a qualitative descriptive study |
| title_fullStr | Development and design validation of a novel network meta-analysis presentation tool for multiple outcomes: a qualitative descriptive study |
| title_full_unstemmed | Development and design validation of a novel network meta-analysis presentation tool for multiple outcomes: a qualitative descriptive study |
| title_short | Development and design validation of a novel network meta-analysis presentation tool for multiple outcomes: a qualitative descriptive study |
| title_sort | development and design validation of a novel network meta analysis presentation tool for multiple outcomes a qualitative descriptive study |
| url | https://bmjopen.bmj.com/content/12/6/e056400.full |
| work_keys_str_mv | AT lehanathabane developmentanddesignvalidationofanovelnetworkmetaanalysispresentationtoolformultipleoutcomesaqualitativedescriptivestudy AT jasonwbusse developmentanddesignvalidationofanovelnetworkmetaanalysispresentationtoolformultipleoutcomesaqualitativedescriptivestudy AT behnamsadeghirad developmentanddesignvalidationofanovelnetworkmetaanalysispresentationtoolformultipleoutcomesaqualitativedescriptivestudy AT gordonhguyatt developmentanddesignvalidationofanovelnetworkmetaanalysispresentationtoolformultipleoutcomesaqualitativedescriptivestudy AT mohitbhandari developmentanddesignvalidationofanovelnetworkmetaanalysispresentationtoolformultipleoutcomesaqualitativedescriptivestudy AT rominabrignardellopetersen developmentanddesignvalidationofanovelnetworkmetaanalysispresentationtoolformultipleoutcomesaqualitativedescriptivestudy AT fernandokenjinampo developmentanddesignvalidationofanovelnetworkmetaanalysispresentationtoolformultipleoutcomesaqualitativedescriptivestudy AT carlosacuellogarcia developmentanddesignvalidationofanovelnetworkmetaanalysispresentationtoolformultipleoutcomesaqualitativedescriptivestudy AT raveendhararbannuru developmentanddesignvalidationofanovelnetworkmetaanalysispresentationtoolformultipleoutcomesaqualitativedescriptivestudy AT markrphillips developmentanddesignvalidationofanovelnetworkmetaanalysispresentationtoolformultipleoutcomesaqualitativedescriptivestudy AT yujiaguo developmentanddesignvalidationofanovelnetworkmetaanalysispresentationtoolformultipleoutcomesaqualitativedescriptivestudy AT sofiabzovsky developmentanddesignvalidationofanovelnetworkmetaanalysispresentationtoolformultipleoutcomesaqualitativedescriptivestudy |