Synthesis when meta-analysis is not possible (Part II): implementing good practice in reviews of complex interventions

Workshop category: 

  • Qualitative evidence synthesis methodology
Date and Location

Date: 

Monday 17 September 2018 - 11:00 to 12:30

Location: 

Contact persons and facilitators

Contact person:

Facilitators:

Thomson H1, Brennan S2, McKenzie J3
1 Cochrane Public Health, University of Glasgow, United Kingdom
2 Cochrane Australia, Australia
3 Monash University, Australia

Acknowledgements:

Target audience

Target audience: 

Review authors and editors

Level of difficulty: 

Intermediate
Type of workshop

Type of workshop : 

Training
Abstract

Abstract:

Background:
Narrative synthesis is a common synthesis method used to synthesise data when meta-analysis is not possible or appropriate. Around 50% of Cochrane Reviews use narrative synthesis for some or all of the data. In public health reviews, where there are often multiple sources of heterogeneity, narrative synthesis is frequently the main synthesis method. Despite this, narrative synthesis is often poorly reported, and the links between the data and the conclusions of the synthesis are often not transparent, and ultimately threatens the reliability and utility of reviews using narrative synthesis. The persistence of these problems may be partly explained by a lack of support or clear guidance to promote rigour in narrative synthesis, as well as a lack of familiarity with good practice in narrative synthesis, even among experienced review authors.

Objectives:
- To facilitate learning through experience about how to conduct a narrative synthesis for reviews where there are multiple sources of heterogeneity.
- To facilitate learning about the challenge of ensuring transparency and consistency in narrative synthesis for reviews where there are multiple sources of heterogeneity.

Description:
This workshop aims to complement the workshop 'Synthesis when meta-analysis is not possible (Part 1)', by providing an opportunity to work on an example with additional sources of heterogeneity. The workshop will start with a presentation on the principles and challenges of narrative synthesis for reviews of complex interventions where there are multiple sources of heterogeneity, and provide a summary of tools to promote transparency in narrative synthesis. Participants will then have the opportunity to trial the knowledge gained in the presentation. Participants will be provided with extracted and tabulated data from a published Cochrane Review of a public health intervention, and will be asked to prepare a brief narrative synthesis of one or more outcomes. Small group discussion will feed into a final discussion with the whole group about the issues in preparing a narrative, including promoting transparency and replicability.

Relevance to patients and consumers: 

The target audience of this workshop is systematic review authors. The relevance to patients and consumers is that the improved reporting and conduct of narrative synthesis aims to improve the usefulness of systematic reviews for patients and consumers by producing reviews which better represent the evidence. It aims to do this by facilitating the application of rigorous methods for reviews which incorporate diverse sources of evidence. This should help make use of best available evidence and reduce the number of reviews which draw conclusions indicating that nothing is known on a topic because a meta-analysis was not possible.