Scoping Reviews

  • What is a Scoping Review?
  • Best Practices
  • Review Protocol

Eligibility Criteria

Inclusion criteria, exclusion criteria.

  • Database Search Strategies
  • Study Selection (Screening)
  • Data Extraction
  • Reference Management

Specify study characteristics (e.g., PICOS, length of follow-up) and report characteristics (e.g., years considered, language, publication status) used as criteria for eligibility, giving rationale. 

Think about criteria that will be used to select articles for your literature review based on your research question.  These are commonly known as  inclusion criteria  and  exclusion criteria .  You may introduce bias into the final review if these are not used thoughtfully. 

According to the PRISMA-SCcR Checklist , item 6 , authors should "specify characteristics of the sources of evidence used as eligibility criteria (e.g., years considered, language, and publication status), and provide a rationale."

Inclusion criteria are the elements of an article that must be present in order for it to be eligible for inclusion in a literature review.  

For example, included studies must:

  • have compared certain treatments
  • be experimental or observational or both
  • have been published in a certain timeframe (must have compelling reason)
  • be certain publication type(s)
  • have recruited a certain population

Exclusion criteria are the elements of an article that disqualify the study from inclusion in a literature review.  

For example, excluded studies: 

  • used qualitative methodology
  • used a certain study design (e.g, observational)
  • are a certain publication type (e.g., systematic reviews)
  • were published before a certain year (must have compelling reason)
  • used animal models
  • was published in a language other than English
  • << Previous: Review Protocol
  • Next: Database Search Strategies >>
  • Last Updated: Sep 12, 2024 4:02 PM
  • URL: https://musc.libguides.com/scopingreviews

Jump to navigation

Home

Cochrane Training

Chapter 3: defining the criteria for including studies and how they will be grouped for the synthesis.

Joanne E McKenzie, Sue E Brennan, Rebecca E Ryan, Hilary J Thomson, Renea V Johnston, James Thomas

Key Points:

  • The scope of a review is defined by the types of population (participants), types of interventions (and comparisons), and the types of outcomes that are of interest. The acronym PICO (population, interventions, comparators and outcomes) helps to serve as a reminder of these.
  • The population, intervention and comparison components of the question, with the additional specification of types of study that will be included, form the basis of the pre-specified eligibility criteria for the review. It is rare to use outcomes as eligibility criteria: studies should be included irrespective of whether they report outcome data, but may legitimately be excluded if they do not measure outcomes of interest, or if they explicitly aim to prevent a particular outcome.
  • Cochrane Reviews should include all outcomes that are likely to be meaningful and not include trivial outcomes. Critical and important outcomes should be limited in number and include adverse as well as beneficial outcomes.
  • Review authors should plan at the protocol stage how the different populations, interventions, outcomes and study designs within the scope of the review will be grouped for analysis.

Cite this chapter as: McKenzie JE, Brennan SE, Ryan RE, Thomson HJ, Johnston RV, Thomas J. Chapter 3: Defining the criteria for including studies and how they will be grouped for the synthesis [last updated August 2023]. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane Handbook for Systematic Reviews of Interventions version 6.5. Cochrane, 2024. Available from www.training.cochrane.org/handbook .

3.1 Introduction

One of the features that distinguishes a systematic review from a narrative review is that systematic review authors should pre-specify criteria for including and excluding studies in the review (eligibility criteria, see MECIR Box 3.2.a ).

When developing the protocol, one of the first steps is to determine the elements of the review question (including the population, intervention(s), comparator(s) and outcomes, or PICO elements) and how the intervention, in the specified population, produces the expected outcomes (see Chapter 2, Section 2.5.1 and Chapter 17, Section 17.2.1 ). Eligibility criteria are based on the PICO elements of the review question plus a specification of the types of studies that have addressed these questions. The population, interventions and comparators in the review question usually translate directly into eligibility criteria for the review, though this is not always a straightforward process and requires a thoughtful approach, as this chapter shows. Outcomes usually are not part of the criteria for including studies, and a Cochrane Review would typically seek all sufficiently rigorous studies (most commonly randomized trials) of a particular comparison of interventions in a particular population of participants, irrespective of the outcomes measured or reported. It should be noted that some reviews do legitimately restrict eligibility to specific outcomes. For example, the same intervention may be studied in the same population for different purposes; or a review may specifically address the adverse effects of an intervention used for several conditions (see Chapter 19 ).

Eligibility criteria do not exist in isolation, but should be specified with the synthesis of the studies they describe in mind. This will involve making plans for how to group variants of the PICO elements for synthesis. This chapter describes the processes by which the structure of the synthesis can be mapped out at the beginning of the review, and the interplay between the review question, considerations for the analysis and their operationalization in terms of eligibility criteria. Decisions about which studies to include (and exclude), and how they will be combined in the review’s synthesis, should be documented and justified in the review protocol.

A distinction between three different stages in the review at which the PICO construct might be used is helpful for understanding the decisions that need to be made. In Chapter 2, Section 2.3 , we introduced the ideas of a review PICO (on which eligibility of studies is based), the PICO for each synthesis (defining the question that each specific synthesis aims to answer) and the PICO of the included studies (what was actually investigated in the included studies). In this chapter, we focus on the review PICO and the PICO for each synthesis as a basis for specifying which studies should be included in the review and planning its syntheses. These PICOs should relate clearly and directly to the questions or hypotheses that are posed when the review is formulated (see Chapter 2 ) and will involve specifying the population in question, and a set of comparisons between the intervention groups.

An integral part of the process of setting up the review is to specify which characteristics of the interventions (e.g. individual compounds of a drug), populations (e.g. acute and chronic conditions), outcomes (e.g. different depression measurement scales) and study designs, will be grouped together. Such decisions should be made independent of knowing which studies will be included and the methods of synthesis that will be used (e.g. meta-analysis). There may be a need to modify the comparisons and even add new ones at the review stage in light of the data that are collected. For example, important variations in the intervention may be discovered only after data are collected, or modifying the comparison may facilitate the possibility of synthesis when only one or few studies meet the comparison PICO. Planning for the latter scenario at the protocol stage may lead to less post-hoc decision making ( Chapter 2, Section 2.5.3 ) and, of course, any changes made during the conduct of the review should be recorded and documented in the final report.

3.2 Articulating the review and comparison PICO

3.2.1 defining types of participants: which people and populations.

The criteria for considering types of people included in studies in a review should be sufficiently broad to encompass the likely diversity of studies and the likely scenarios in which the interventions will be used, but sufficiently narrow to ensure that a meaningful answer can be obtained when studies are considered together; they should be specified in advance (see MECIR Box 3.2.a ). As discussed in Chapter 2, Section 2.3.1 , the degree of breadth will vary, depending on the question being asked and the analytical approach to be employed. A range of evidence may inform the choice of population characteristics to examine, including theoretical considerations, evidence from other interventions that have a similar mechanism of action, and in vitro or animal studies. Consideration should be given to whether the population characteristic is at the level of the participant (e.g. age, severity of disease) or the study (e.g. care setting, geographical location), since this has implications for grouping studies and for the method of synthesis ( Chapter 10, Section 10.11.5 ). It is often helpful to consider the types of people that are of interest in three steps.

MECIR Box 3.2.a Relevant expectations for conduct of intervention reviews

Predefining unambiguous criteria for participants ( )

Predefined, unambiguous eligibility criteria are a fundamental prerequisite for a systematic review. The criteria for considering types of people included in studies in a review should be sufficiently broad to encompass the likely diversity of studies, but sufficiently narrow to ensure that a meaningful answer can be obtained when studies are considered in aggregate. Considerations when specifying participants include setting, diagnosis or definition of condition and demographic factors. Any restrictions to study populations must be based on a sound rationale, since it is important that Cochrane Reviews are widely relevant.

Predefining a strategy for studies with a subset of eligible participants ( )

Sometimes a study includes some ‘eligible’ participants and some ‘ineligible’ participants, for example when an age cut-off is used in the review’s eligibility criteria. If data from the eligible participants cannot be retrieved, a mechanism for dealing with this situation should be pre-specified.

First, the diseases or conditions of interest should be defined using explicit criteria for establishing their presence (or absence). Criteria that will force the unnecessary exclusion of studies should be avoided. For example, diagnostic criteria that were developed more recently – which may be viewed as the current gold standard for diagnosing the condition of interest – will not have been used in earlier studies. Expensive or recent diagnostic tests may not be available in many countries or settings, and time-consuming tests may not be practical in routine healthcare settings.

Second, the broad population and setting of interest should be defined . This involves deciding whether a specific population group is within scope, determined by factors such as age, sex, race, educational status or the presence of a particular condition such as angina or shortness of breath. Interest may focus on a particular setting such as a community, hospital, nursing home, chronic care institution, or outpatient setting. Box 3.2.a outlines some factors to consider when developing population criteria.

Whichever criteria are used for defining the population and setting of interest, it is common to encounter studies that only partially overlap with the review’s population. For example, in a review focusing on children, a cut-point of less than 16 years might be desirable, but studies may be identified with participants aged from 12 to 18. Unless the study reports separate data from the eligible section of the population (in which case data from the eligible participants can be included in the review), review authors will need a strategy for dealing with these studies (see MECIR Box 3.2.a ). This will involve balancing concerns about reduced applicability by including participants who do not meet the eligibility criteria, against the loss of data when studies are excluded. Arbitrary rules (such as including a study if more than 80% of the participants are under 16) will not be practical if detailed information is not available from the study. A less stringent rule, such as ‘the majority of participants are under 16’ may be sufficient. Although there is a risk of review authors’ biases affecting post-hoc inclusion decisions (which is why many authors endeavour to pre-specify these rules), this may be outweighed by a common-sense strategy in which eligibility decisions keep faith with the objectives of the review rather than with arbitrary rules. Difficult decisions should be documented in the review, checked with the advisory group (if available, see Chapter 1 ), and sensitivity analyses can assess the impact of these decisions on the review’s findings (see Chapter 10, Section 10.14 and MECIR Box 3.2.b ).

Box 3.2.a Factors to consider when developing criteria for ‘Types of participants’

MECIR Box 3.2.b Relevant expectations for conduct of intervention reviews

Changing eligibility criteria ( )

Following pre-specified eligibility criteria is a fundamental attribute of a systematic review. However, unanticipated issues may arise. Review authors should make sensible post-hoc decisions about exclusion of studies, and these should be documented in the review, possibly accompanied by sensitivity analyses. Changes to the protocol must not be made on the basis of the findings of the studies or the synthesis, as this can introduce bias.

Third, there should be consideration of whether there are population characteristics that might be expected to modify the size of the intervention effects (e.g. different severities of heart failure). Identifying subpopulations may be important for implementation of the intervention. If relevant subpopulations are identified, two courses of action are possible: limiting the scope of the review to exclude certain subpopulations; or maintaining the breadth of the review and addressing subpopulations in the analysis.

Restricting the review with respect to specific population characteristics or settings should be based on a sound rationale. It is important that Cochrane Reviews are globally relevant, so the rationale for the exclusion of studies based on population characteristics should be justified. For example, focusing a review of the effectiveness of mammographic screening on women between 40 and 50 years old may be justified based on biological plausibility, previously published systematic reviews and existing controversy. On the other hand, focusing a review on a particular subgroup of people on the basis of their age, sex or ethnicity simply because of personal interests, when there is no underlying biologic or sociological justification for doing so, should be avoided, as these reviews will be less useful to decision makers and readers of the review.

Maintaining the breadth of the review may be best when it is uncertain whether there are important differences in effects among various subgroups of people, since this allows investigation of these differences (see Chapter 10, Section 10.11.5 ). Review authors may combine the results from different subpopulations in the same synthesis, examining whether a given subdivision explains variation (heterogeneity) among the intervention effects. Alternatively, the results may be synthesized in separate comparisons representing different subpopulations. Splitting by subpopulation risks there being too few studies to yield a useful synthesis (see Table 3.2.a and Chapter 2, Section 2.3.2 ). Consideration needs to be given to the subgroup analysis method, particularly for population characteristics measured at the participant level (see Chapter 10 and Chapter 26 , Fisher et al 2017). All subgroup analyses should ideally be planned a priori and stated as a secondary objective in the protocol, and not driven by the availability of data.

In practice, it may be difficult to assign included studies to defined subpopulations because of missing information about the population characteristic, variability in how the population characteristic is measured across studies (e.g. variation in the method used to define the severity of heart failure), or because the study does not wholly fall within (or report the results separately by) the defined subpopulation. The latter issue mainly applies for participant characteristics but can also arise for settings or geographic locations where these vary within studies. Review authors should consider planning for these scenarios (see example reviews Hetrick et al 2012, Safi et al 2017; Table 3.2.b , column 3).

Table 3.2.a Examples of population attributes and characteristics

Intended recipient of intervention

Patient, carer, healthcare provider (general practitioners, nurses, allied health professionals), health system, policy maker, community

In a review of e-learning programmes for health professionals, a subgroup analysis was planned to examine if the effects were modified by the (doctors, nurses or physiotherapists). The authors hypothesized that e-learning programmes for doctors would be more effective than for other health professionals, but did not provide a rationale (Vaona et al 2018).

Disease/condition (to be treated or prevented)

Type and severity of a condition

In a review of platelet-rich therapies for musculoskeletal soft tissue injuries, a subgroup analysis was undertaken to examine if the effects of platelet-rich therapies were modified by the (e.g. rotator cuff tear, anterior cruciate ligament reconstruction, chronic Achilles tendinopathy) (Moraes et al 2014).

In planning a review of beta-blockers for heart failure, subgroup analyses were specified to examine if the effects of beta-blockers are modified by the (e.g. idiopathic dilated cardiomyopathy, ischaemic heart disease, valvular heart disease, hypertension) and the (‘reduced left ventricular ejection fraction (LVEF)’ ≤ 40%, ‘mid-range LVEF’ > 40% and < 50%, ‘preserved LVEF’ ≥ 50%, mixed, not specified). Studies have shown that patient characteristics and comorbidities differ by heart failure severity, and that therapies have been shown to reduce morbidity in ‘reduced LVEF’ patients, but the benefits in the other groups are uncertain (Safi et al 2017).

Participant characteristics

Age (neonate, child, adolescent, adult, older adult)

Race/ethnicity

Sex/gender

PROGRESS-Plus equity characteristics (e.g. place of residence, socio-economic status, education) (O’Neill et al 2014)

In a review of newer-generation antidepressants for depressive disorders in children and adolescents, a subgroup analysis was undertaken to examine if the effects of the antidepressants were modified by . The rationale was based on the findings of another review that suggested that children and adolescents may respond differently to antidepressants. The age groups were defined as ‘children’ (aged approximately 6 to 12 years), ‘adolescents’ (aged approximately 13 to 18 years), and ‘children and adolescents’ (when the study included both children and adolescents, and results could not be obtained separately by these subpopulations) (Hetrick et al 2012).

Setting

Setting of care (primary care, hospital, community)

Rurality (urban, rural, remote)

Socio-economic setting (low and middle-income countries, high-income countries)

Hospital ward (e.g. intensive care unit, general medical ward, outpatient)

In a review of hip protectors for preventing hip fractures in older people, separate comparisons were specified based on (institutional care or community-dwelling) for the critical outcome of hip fracture (Santesso et al 2014).

3.2.2 Defining interventions and how they will be grouped

In some reviews, predefining the intervention ( MECIR Box 3.2.c ) may be straightforward. For example, in a review of the effect of a given anticoagulant on deep vein thrombosis, the intervention can be defined precisely. A more complicated definition might be required for a multi-component intervention composed of dietary advice, training and support groups to reduce rates of obesity in a given population.

The inherent complexity present when defining an intervention often comes to light when considering how it is thought to achieve its intended effect and whether the effect is likely to differ when variants of the intervention are used. In the first example, the anticoagulant warfarin is thought to reduce blood clots by blocking an enzyme that depends on vitamin K to generate clotting factors. In the second, the behavioural intervention is thought to increase individuals’ self-efficacy in their ability to prepare healthy food. In both examples, we cannot assume that all forms of the intervention will work in the same way. When defining drug interventions, such as anticoagulants, factors such as the drug preparation, route of administration, dose, duration, and frequency should be considered. For multi-component interventions (such as interventions to reduce rates of obesity), the common or core features of the interventions must be defined, so that the review authors can clearly differentiate them from other interventions not included in the review.

MECIR Box 3.2.c Relevant expectations for conduct of intervention reviews

Predefining unambiguous criteria for interventions and comparators ( )

Predefined, unambiguous eligibility criteria are a fundamental prerequisite for a systematic review. Specification of comparator interventions requires particular clarity: are the experimental interventions to be compared with an inactive control intervention (e.g. placebo, no treatment, standard care, or a waiting list control), or with an active control intervention (e.g. a different variant of the same intervention, a different drug, a different kind of therapy)? Any restrictions on interventions and comparators, for example, regarding delivery, dose, duration, intensity, co-interventions and features of complex interventions should also be predefined and explained.

In general, it is useful to consider exactly what is delivered, who delivers it, how it is delivered, where it is delivered, when and how much is delivered, and whether the intervention can be adapted or tailored , and to consider this for each type of intervention included in the review (see the TIDieR checklist (Hoffmann et al 2014)). As argued in Chapter 17 , separating interventions into ‘simple’ and ‘complex’ is a false dichotomy; all interventions can be complex in some ways. The critical issue for review authors is to identify the most important factors to be considered in a specific review. Box 3.2.b outlines some factors to consider when developing broad criteria for the ‘Types of interventions’ (and comparisons).

Box 3.2.b Factors to consider when developing criteria for ‘Types of interventions’

Once interventions eligible for the review have been broadly defined, decisions should be made about how variants of the intervention will be handled in the synthesis. Differences in intervention characteristics across studies occur in all reviews. If these reflect minor differences in the form of the intervention used in practice (such as small differences in the duration or content of brief alcohol counselling interventions), then an overall synthesis can provide useful information for decision makers. Where differences in intervention characteristics are more substantial (such as delivery of brief alcohol counselling by nurses versus doctors), and are expected to have a substantial impact on the size of intervention effects, these differences should be examined in the synthesis. What constitutes an important difference requires judgement, but in general differences that alter decisions about how an intervention is implemented or whether the intervention is used or not are likely to be important. In such circumstances, review authors should consider specifying separate groups (or subgroups) to examine in their synthesis.

Clearly defined intervention groups serve two main purposes in the synthesis. First, the way in which interventions are grouped for synthesis (meta-analysis or other synthesis) is likely to influence review findings. Careful planning of intervention groups makes best use of the available data, avoids decisions that are influenced by study findings (which may introduce bias), and produces a review focused on questions relevant to decision makers. Second, the intervention groups specified in a protocol provide a standardized terminology for describing the interventions throughout the review, overcoming the varied descriptions used by study authors (e.g. where different labels are used for the same intervention, or similar labels used for different techniques) (Michie et al 2013). This standardization enables comparison and synthesis of information about intervention characteristics across studies (common characteristics and differences) and provides a consistent language for reporting that supports interpretation of review findings.

Table 3.2.b   outlines a process for planning intervention groups as a basis for/precursor to synthesis, and the decision points and considerations at each step. The table is intended to guide, rather than to be prescriptive and, although it is presented as a sequence of steps, the process is likely to be iterative, and some steps may be done concurrently or in a different sequence. The process aims to minimize data-driven approaches that can arise once review authors have knowledge of the findings of the included studies. It also includes principles for developing a flexible plan that maximizes the potential to synthesize in circumstances where there are few studies, many variants of an intervention, or where the variants are difficult to anticipate. In all stages, review authors should consider how to categorize studies whose reports contain insufficient detail.

Table 3.2.b A process for planning intervention groups for synthesis

1. Identify intervention characteristics that may modify the effect of the intervention.

Consider whether differences in interventions characteristics might modify the size of the intervention effect importantly. Content-specific research literature and expertise should inform this step.

The TIDieR checklist – a tool for describing interventions – outlines the characteristics across which an intervention might differ (Hoffmann et al 2014). These include ‘what’ materials and procedures are used, ‘who’ provides the intervention, ‘when and how much’ intervention is delivered. The iCAT-SR tool provides equivalent guidance for complex interventions (Lewin et al 2017).

differ across multiple characteristics, which vary in importance depending on the review.

In a review of exercise for osteoporosis, whether the exercise is weight-bearing or non-weight-bearing may be a key characteristic, since the mechanism by which exercise is thought to work is by placing stress or mechanical load on bones (Howe et al 2011).

Different mechanisms apply in reviews of exercise for knee osteoarthritis (muscle strengthening), falls prevention (gait and balance), cognitive function (cardiovascular fitness).

The differing mechanisms might suggest different ways of grouping interventions (e.g. by intensity, mode of delivery) according to potential modifiers of the intervention effects.

2a. Label and define intervention groups to be considered in the synthesis.

 

For each intervention group, provide a short label (e.g. supportive psychotherapy) and describe the core characteristics (criteria) that will be used to assign each intervention from an included study to a group.

Groups are often defined by intervention content (especially the active components), such as materials, procedures or techniques (e.g. a specific drug, an information leaflet, a behaviour change technique). Other characteristics may also be used, although some are more commonly used to define subgroups (see ): the purpose or theoretical underpinning, mode of delivery, provider, dose or intensity, duration or timing of the intervention (Hoffmann et al 2014).

In specifying groups:

Logic models may help structure the synthesis (see and ).

In a review of psychological therapies for coronary heart disease, a single group was specified for meta-analysis that included all types of therapy. Subgroups were defined to examine whether intervention effects were modified by intervention components (e.g. cognitive techniques, stress management) or mode of delivery (e.g. individual, group) (Richards et al 2017).

In a review of psychological therapies for panic disorder (Pompoli et al 2016), eight types of therapy were specified:

1. psychoeducation;

2. supportive psychotherapy (with or without a psychoeducational component);

3. physiological therapies;

4. behaviour therapy;

5. cognitive therapy;

6. cognitive behaviour therapy (CBT);

7. third-wave CBT; and

8. psychodynamic therapies.

Groups were defined by the theoretical basis of each therapy (e.g. CBT aims to modify maladaptive thoughts through cognitive restructuring) and the component techniques used.

2b. Define levels for groups based on dose or intensity.

For groups based on ‘how much’ of an intervention is used (e.g. dose or intensity), criteria are needed to quantify each group. This may be straightforward for easy-to-quantify characteristics, but more complex for characteristics that are hard to quantify (e.g. duration or intensity of rehabilitation or psychological therapy).

The levels should be based on how the intervention is used in practice (e.g. cut-offs for low and high doses of a supplement based on recommended nutrient intake), or on a rationale for how the intervention might work.

In reviews of exercise, intensity may be defined by training time (session length, frequency, program duration), amount of work (e.g. repetitions), and effort/energy expenditure (exertion, heart rate) (Regnaux et al 2015).

In a review of organized inpatient care for stroke, acute stroke units were categorized as ‘intensive’, ‘semi-intensive’ or ‘non-intensive’ based on whether the unit had continuous monitoring, high nurse staffing, and life support facilities (Stroke Unit Trialists Collaboration 2013).

3. Determine whether there is an existing system for grouping interventions.

 

In some fields, intervention taxonomies and frameworks have been developed for labelling and describing interventions, and these can make it easier for those using a review to interpret and apply findings.

Using an agreed system is preferable to developing new groupings. Existing systems should be assessed for relevance and usefulness. The most useful systems:

Systems for grouping interventions may be generic, widely applicable across clinical areas, or specific to a condition or intervention type. Some Cochrane Groups recommend specific taxonomies.

The (BCT) (Michie et al 2013) categorizes intervention elements such as goal setting, self-monitoring and social support. A protocol for a review of social media interventions used this taxonomy to describe interventions and examine different BCTs as potential effect modifiers (Welch et al 2018).

The has been used to group interventions (or components) by function (e.g. to educate, persuade, enable) (Michie et al 2011). This system was used to describe the components of dietary advice interventions (Desroches et al 2013).

 

Multiple reviews have used the consensus-based taxonomy developed by the Prevention of Falls Network Europe (ProFaNE) (e.g. Verheyden et al 2013, Kendrick et al 2014). The taxonomy specifies broad groups (e.g. exercise, medication, environment/assistive technology) within which are more specific groups (e.g. exercise: gait, balance and functional training; flexibility; strength and resistance) (Lamb et al 2011).

4. Plan how the specified groups will be used in synthesis and reporting.

Decide whether it is useful to pool all interventions in a single meta-analysis (‘lumping’), within which specific characteristics can be explored as effect modifiers (e.g. in subgroups). Alternatively, if pooling all interventions is unlikely to address a useful question, separate synthesis of specific interventions may be more appropriate (‘splitting’).

Determining the right analytic approach is discussed further in .

In a review of exercise for knee osteoarthritis, the different categories of exercise were combined in a single meta-analysis, addressing the question ‘what is the effect of exercise on knee osteoarthritis?’. The categories were also analysed as subgroups within the meta-analysis to explore whether the effect size varied by type of exercise (Fransen et al 2015). Other subgroup analyses examined mode of delivery and dose.

5. Decide how to group interventions with multiple components or co-interventions.

Some interventions, especially those considered ‘complex’, include multiple components that could also be implemented independently (Guise et al 2014, Lewin et al 2017). These components might be eligible for inclusion in the review alone, or eligible only if used alongside an eligible intervention.

Options for considering multi-component interventions may include the following.

and Welton et al 2009, Caldwell and Welton 2016, Higgins et al 2019).

The first two approaches may be challenging but are likely to be most useful (Caldwell and Welton 2016).

See Section . for the special case of when a co-intervention is administered in both treatment arms.

In a review of psychological therapies for panic disorder, two of the eight eligible therapies (psychoeducation and supportive psychotherapy) could be used alone or as part of a multi-component therapy. When accompanied by another eligible therapy, the intervention was categorized as the other therapy (i.e. psychoeducation + cognitive behavioural therapy was categorized as cognitive behavioural therapy) (Pompoli et al 2016).

 

In a review of psychosocial interventions for smoking cessation in pregnancy, two approaches were used. All intervention types were included in a single meta-analysis with subgroups for multi-component, single and tailored interventions. Separate meta-analyses were also performed for each intervention type, with categorization of multi-component interventions based on the ‘main’ component (Chamberlain et al 2017).

6. Build in contingencies by specifying both specific and broader intervention groups.

Consider grouping interventions at more than one level, so that studies of a broader group of interventions can be synthesized if too few studies are identified for synthesis in more specific groups. This will provide flexibility where review authors anticipate few studies contributing to specific groups (e.g. in reviews with diverse interventions, additional diversity in other PICO elements, or few studies overall, see also ).

In a review of psychosocial interventions for smoking cessation, the authors planned to group any psychosocial intervention in a single comparison (addressing the higher level question of whether, on average, psychosocial interventions are effective). Given that sufficient data were available, they also presented separate meta-analyses to examine the effects of specific types of psychosocial interventions (e.g. counselling, health education, incentives, social support) (Chamberlain et al 2017).

3.2.3 Defining which comparisons will be made

When articulating the PICO for each synthesis, defining the intervention groups alone is not sufficient for complete specification of the planned syntheses. The next step is to define the comparisons that will be made between the intervention groups. Setting aside for a moment more complex analyses such as network meta-analyses, which can simultaneously compare many groups ( Chapter 11 ), standard meta-analysis ( Chapter 10 ) aims to draw conclusions about the comparative effects of two groups at a time (i.e. which of two intervention groups is more effective?). These comparisons form the basis for the syntheses that will be undertaken if data are available. Cochrane Reviews sometimes include one comparison, but most often include multiple comparisons. Three commonly identified types of comparisons include the following (Davey et al 2011).

  • newer generation antidepressants versus placebo (Hetrick et al 2012); and
  • vertebroplasty for osteoporotic vertebral compression fractures versus placebo (sham procedure) (Buchbinder et al 2018).
  • chemotherapy or targeted therapy plus best supportive care (BSC) versus BSC for palliative treatment of esophageal and gastroesophageal-junction carcinoma (Janmaat et al 2017); and
  • personalized care planning versus usual care for people with long-term conditions (Coulter et al 2015).
  • early (commenced at less than two weeks of age) versus late (two weeks of age or more) parenteral zinc supplementation in term and preterm infants (Taylor et al 2017);
  • high intensity versus low intensity physical activity or exercise in people with hip or knee osteoarthritis (Regnaux et al 2015);
  • multimedia education versus other education for consumers about prescribed and over the counter medications (Ciciriello et al 2013).

The first two types of comparisons aim to establish the effectiveness of an intervention, while the last aims to compare the effectiveness of two interventions. However, the distinction between the placebo and control is often arbitrary, since any differences in the care provided between trials with a control arm and those with a placebo arm may be unimportant , especially where ‘usual care’ is provided to both. Therefore, placebo and control groups may be determined to be similar enough to be combined for synthesis.

In reviews including multiple intervention groups, many comparisons are possible. In some of these reviews, authors seek to synthesize evidence on the comparative effectiveness of all their included interventions, including where there may be only indirect comparison of some interventions across the included studies ( Chapter 11, Section 11.2.1 ). However, in many reviews including multiple intervention groups, a limited subset of the possible comparisons will be selected. The chosen subset of comparisons should address the most important clinical and research questions. For example, if an established intervention (or dose of an intervention) is used in practice, then the synthesis would ideally compare novel or alternative interventions to this established intervention, and not, for example, to no intervention.

3.2.3.1 Dealing with co-interventions

Planning is needed for the special case where the same supplementary intervention is delivered to both the intervention and comparator groups. A supplementary intervention is an additional intervention delivered alongside the intervention of interest, such as massage in a review examining the effects of aromatherapy (i.e. aromatherapy plus massage versus massage alone). In many cases, the supplementary intervention will be unimportant and can be ignored. In other situations, the effect of the intervention of interest may differ according to whether participants receive the supplementary therapy. For example, the effect of aromatherapy among people who receive a massage may differ from the effect of the aromatherapy given alone. This will be the case if the intervention of interest interacts with the supplementary intervention leading to larger (synergistic) or smaller (dysynergistic/antagonistic) effects than the intervention of interest alone (Squires et al 2013). While qualitative interactions are rare (where the effect of the intervention is in the opposite direction when combined with the supplementary intervention), it is possible that there will be more variation in the intervention effects (heterogeneity) when supplementary interventions are involved, and it is important to plan for this. Approaches for dealing with this in the statistical synthesis may include fitting a random-effects meta-analysis model that encompasses heterogeneity ( Chapter 10, Section 10.10.4 ), or investigating whether the intervention effect is modified by the addition of the supplementary intervention through subgroup analysis ( Chapter 10, Section 10.11.2 ).

3.2.4 Selecting, prioritizing and grouping review outcomes

3.2.4.1 selecting review outcomes.

Broad outcome domains are decided at the time of setting up the review PICO (see Chapter 2 ). Once the broad domains are agreed, further specification is required to define the domains to facilitate reporting and synthesis (i.e. the PICO for comparison) (see Chapter 2, Section 2.3 ). The process for specifying and grouping outcomes largely parallels that used for specifying intervention groups.

Reporting of outcomes should rarely determine study eligibility for a review. In particular, studies should not be excluded because they do not report results of an outcome they may have measured, or provide ‘no usable data’ ( MECIR Box 3.2.d ). This is essential to avoid bias arising from selective reporting of findings by the study authors (see Chapter 13 ). However, in some circumstances, the measurement of certain outcomes may be a study eligibility criterion. This may be the case, for example, when the review addresses the potential for an intervention to prevent a particular outcome, or when the review addresses a specific purpose of an intervention that can be used in the same population for different purposes (such as hormone replacement therapy, or aspirin).

MECIR Box 3.2.d Relevant expectations for conduct of intervention reviews

Clarifying role of outcomes ( )

Outcome measures should not always form part of the criteria for including studies in a review. However, some reviews do legitimately restrict eligibility to specific outcomes. For example, the same intervention may be studied in the same population for different purposes (e.g. hormone replacement therapy, or aspirin); or a review may address specifically the adverse effects of an intervention used for several conditions. If authors do exclude studies on the basis of outcomes, care should be taken to ascertain that relevant outcomes are not available because they have not been measured rather than simply not reported.

Predefining outcome domains ( )

Full specification of the outcomes includes consideration of outcome domains (e.g. quality of life) and outcome measures (e.g. SF-36). Predefinition of outcome reduces the risk of selective outcome reporting. The should be as few as possible and should normally reflect at least one potential benefit and at least one potential area of harm. It is expected that the review should be able to synthesize these outcomes if eligible studies are identified, and that the conclusions of the review will be based largely on the effects of the interventions on these outcomes. Additional important outcomes may also be specified. Up to seven critical and important outcomes will form the basis of the GRADE assessment and summarized in the review’s abstract and other summary formats, although the review may measure more than seven outcomes.

Choosing outcomes ( )

Cochrane Reviews are intended to support clinical practice and policy, and should address outcomes that are critical or important to consumers. These should be specified at protocol stage. Where available, established sets of core outcomes should be used. Patient-reported outcomes should be included where possible. It is also important to judge whether evidence of resource use and costs might be an important component of decisions to adopt the intervention or alternative management strategies around the world. Large numbers of outcomes, while sometimes necessary, can make reviews unfocused, unmanageable for the user, and prone to selective outcome reporting bias. Biochemical, interim and process outcomes should be considered where they are important to decision makers. Any outcomes that would not be described as critical or important can be left out of the review.

Predefining outcome measures ( )

Having decided what outcomes are of interest to the review, authors should clarify acceptable ways in which these outcomes can be measured. It may be difficult, however, to predefine adverse effects.

C17: Predefining choices from multiple outcome measures ( )

Prespecification guards against selective outcome reporting, and allows users to confirm that choices were not overly influenced by the results. A predefined hierarchy of outcomes measures may be helpful. It may be difficult, however, to predefine adverse effects. A rationale should be provided for the choice of outcome measure

C18: Predefining time points of interest ( )

Prespecification guards against selective outcome reporting, and allows users to confirm that choices were not overly influenced by the results. Authors may consider whether all time frames or only selected time points will be included in the review. These decisions should be based on outcomes important for making healthcare decisions. One strategy to make use of the available data could be to group time points into prespecified intervals to represent ‘short-term’, ‘medium-term’ and ‘long-term’ outcomes and to take no more than one from each interval from each study for any particular outcome.

In general, systematic reviews should aim to include outcomes that are likely to be meaningful to the intended users and recipients of the reviewed evidence. This may include clinicians, patients (consumers), the general public, administrators and policy makers. Outcomes may include survival (mortality), clinical events (e.g. strokes or myocardial infarction), behavioural outcomes (e.g. changes in diet, use of services), patient-reported outcomes (e.g. symptoms, quality of life), adverse events, burdens (e.g. demands on caregivers, frequency of tests, restrictions on lifestyle) and economic outcomes (e.g. cost and resource use). It is critical that outcomes used to assess adverse effects as well as outcomes used to assess beneficial effects are among those addressed by a review (see Chapter 19 ).

Outcomes that are trivial or meaningless to decision makers should not be included in Cochrane Reviews. Inclusion of outcomes that are of little or no importance risks overwhelming and potentially misleading readers. Interim or surrogate outcomes measures, such as laboratory results or radiologic results (e.g. loss of bone mineral content as a surrogate for fractures in hormone replacement therapy), while potentially helpful in explaining effects or determining intervention integrity (see Chapter 5, Section 5.3.4.1 ), can also be misleading since they may not predict clinically important outcomes accurately. Many interventions reduce the risk for a surrogate outcome but have no effect or have harmful effects on clinically relevant outcomes, and some interventions have no effect on surrogate measures but improve clinical outcomes.

Various sources can be used to develop a list of relevant outcomes, including input from consumers and advisory groups (see Chapter 2 ), the clinical experiences of the review authors, and evidence from the literature (including qualitative research about outcomes important to those affected (see Chapter 21 )). A further driver of outcome selection is consideration of outcomes used in related reviews. Harmonization of outcomes across reviews addressing related questions facilitates broader evidence synthesis questions being addressed through the use of Overviews of reviews (see Chapter V ).

Outcomes considered to be meaningful, and therefore addressed in a review, may not have been reported in the primary studies. For example, quality of life is an important outcome, perhaps the most important outcome, for people considering whether or not to use chemotherapy for advanced cancer, even if the available studies are found to report only survival (see Chapter 18 ). A further example arises with timing of the outcome measurement, where time points determined as clinically meaningful in a review are not measured in the primary studies. Including and discussing all important outcomes in a review will highlight gaps in the primary research and encourage researchers to address these gaps in future studies.

3.2.4.2 Prioritizing review outcomes

Once a full list of relevant outcomes has been compiled for the review, authors should prioritize the outcomes and select the outcomes of most relevance to the review question. The GRADE approach to assessing the certainty of evidence (see Chapter 14 ) suggests that review authors separate outcomes into those that are ‘critical’, ‘important’ and ‘not important’ for decision making.

The critical outcomes are the essential outcomes for decision making, and are those that would form the basis of a ‘Summary of findings’ table or other summary versions of the review, such as the Abstract or Plain Language Summary. ‘Summary of findings’ tables provide key information about the amount of evidence for important comparisons and outcomes, the quality of the evidence and the magnitude of effect (see Chapter 14, Section 14.1 ). There should be no more than seven outcomes included in a ‘Summary of findings’ table, and those outcomes that will be included in summaries should be specified at the protocol stage. They should generally not include surrogate or interim outcomes. They should not be chosen on the basis of any anticipated or observed magnitude of effect, or because they are likely to have been addressed in the studies to be reviewed. Box 3.2.c summarizes the principal factors to consider when selecting and prioritizing review outcomes.

Box 3.2.c Factors to consider when selecting and prioritizing review outcomes

3.2.4.3 Defining and grouping outcomes for synthesis

Table 3.2.c outlines a process for planning for the diversity in outcome measurement that may be encountered in the studies included in a review and which can complicate, and sometimes prevent, synthesis. Research has repeatedly documented inconsistency in the outcomes measured across trials in the same clinical areas (Harrison et al 2016, Williamson et al 2017). This inconsistency occurs across all aspects of outcome measurement, including the broad domains considered, the outcomes measured, the way these outcomes are labelled and defined, and the methods and timing of measurement. For example, a review of outcome measures used in 563 studies of interventions for dementia and mild cognitive impairment found that 321 unique measurement methods were used for 1278 assessments of cognitive outcomes (Harrison et al 2016). Initiatives like COMET ( Core Outcome Measures in Effectiveness Trials ) aim to encourage standardization of outcome measurement across trials (Williamson et al 2017), but these initiatives are comparatively new and review authors will inevitably encounter diversity in outcomes across studies.

The process begins by describing the scope of each outcome domain in sufficient detail to enable outcomes from included studies to be categorized ( Table 3.2.c Step 1). This step may be straightforward in areas for which core outcome sets (or equivalent systems) exist ( Table 3.2.c Step 2). The methods and timing of outcome measurement also need to be specified, giving consideration to how differences across studies will be handled ( Table 3.2.c Steps 3 and 4). Subsequent steps consider options for dealing with studies that report multiple measures within an outcome domain ( Table 3.2.c Step 5), planning how outcome domains will be used in synthesis ( Table 3.2.c Step 6), and building in contingencies to maximize potential to synthesize ( Table 3.2.c Step 7).

Table 3.2.c A process for planning outcome groups for synthesis

1. Fully specify outcome domains.

For each outcome domain, provide a short label (e.g. cognition, consumer evaluation of care) and describe the domain in sufficient detail to enable eligible outcomes from each included study to be categorized. The definition should be based on the concept (or construct) measured, that is ‘what’ is measured. ‘When’ and ‘how’ the outcome is measured will be considered in subsequent steps.

Outcomes can be defined hierarchically, starting with very broad groups (e.g. physiological/clinical outcomes, life impact, adverse events), then outcome domains (e.g. functioning and perceived health status are domains within ‘life impact’). Within these may be narrower domains (e.g. physical function, cognitive function), and then specific outcome measures (Dodd et al 2018). The level at which outcomes are grouped for synthesis alters the question addressed, and so decisions should be guided by the review objectives.

In specifying outcome domains:

In a review of computer-based interventions for sexual health promotion, three broad outcome domains were defined (cognitions, behaviours, biological) based on a conceptual model of how the intervention might work. Each domain comprised more specific domains and outcomes (e.g. condom use, seeking health services such as STI testing); listing these helped define the broad domains and guided categorization of the diverse outcomes reported in included studies (Bailey et al 2010).

In a protocol for a review of social media interventions for improving health, the rationale for synthesizing broad groupings of outcomes (e.g. health behaviours, physical health) was based on prediction of a common underlying mechanism by which the intervention would work, and the review objective, which focused on overall health rather than specific outcomes (Welch et al 2018).

2. Determine whether there is an existing system for identifying and grouping important outcomes.

Systems for categorizing outcomes include core outcome sets including the and initiatives, and outcome taxonomies (Dodd et al 2018). These systems define agreed outcomes that should be measured for specific conditions (Williamson et al 2017).These systems can be used to standardize the varied outcome labels used across studies and enable grouping and comparison (Kirkham et al 2013). Agreed terminology may help decision makers interpret review findings.

The COMET website provides a database of core outcome sets agreed or in development. Some Cochrane Groups have developed their own outcome sets. While the availability of outcome sets and taxonomies varies across clinical areas, several taxonomies exist for specifying broad outcome domains (e.g. Dodd et al 2018, ICHOM 2018).

In a review of combined diet and exercise for preventing gestational diabetes mellitus, a core outcome set agreed by the Cochrane Pregnancy and Childbirth group was used (Shepherd et al 2017).

In a review of decision aids for people facing health treatment or screening decisions (Stacey et al 2017), outcome domains were based on criteria for evaluating decision aids agreed in the (IPDAS). Doing so helped to assess the use of aids across diverse clinical decisions.

The Cochrane Consumers and Communication Group has an agreed taxonomy to guide specification of outcomes of importance in evaluating communication interventions (Cochrane Consumers & Communication Group).

3. Define the outcome time points.

A key attribute of defining an outcome is specifying the time of measurement. In reviews, time frames, and not specific time points, are often specified to handle the likely diversity in timing of outcome measurement across studies (e.g. a ‘medium-term’ time frame might be defined as including outcomes measured between 6 and 12 months).

In specifying outcome timing:

In a review of psychological therapies for panic disorder, the main outcomes were ‘short-term’ (≤6 months from treatment commencement). ‘Long-term’ outcomes (>6 months from treatment commencement) were considered important, but not specified as critical because of concerns of participant attrition (Pompoli et al 2018).

In contrast, in a review of antidepressants, a clinically meaningful time frame of 6 to 12 months might be specified for the critical outcome ‘depression’, since this is the recommended treatment duration. However, it may be anticipated that many studies will be of shorter duration with short-term follow-up, so an additional important outcome of ‘depression (<3 months)’ might also be specified.

4. Specify the measurement tool or measurement method.

For each outcome domain, specify:

Minimum criteria for inclusion of a measure may include:

(e.g. consistent scores across time and raters when the outcome is unchanged), and (e.g. comparable results to similar measures, including a gold standard if available); and

Measures may be identified from core outcome sets (e.g. Williamson et al 2017, ICHOM 2018) or systematic reviews of instruments (see COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) initiative for a database of examples).

In a review of interventions to support women to stop smoking, objective (biochemically validated) and subjective (self-report) measures of smoking cessation were specified separately to examine bias due to the method used to measure the outcome (Step 6) (Chamberlain et al 2017).

In a review of high-intensity versus low-intensity exercise for osteoarthritis, measures of pain were selected based on relevance of the content and properties of the measurement tool (i.e. evidence of validity and reliability) (Regnaux et al 2015).

5. Specify how multiplicity of outcomes will be handled.

For a particular domain, multiple outcomes within a study may be available for inclusion. This may arise from:

Effects of the intervention calculated from these different sources of multiplicity are statistically dependent, since they have been calculated using the same participants. To deal with this dependency, select only one outcome per study for a particular comparison, or use a meta-analysis method that accounts for the dependency (see Step 6).

Pre-specify the method of selection from multiple outcomes or measures in the protocol, using an approach that is independent of the result (see ) (López-López et al 2018). Document all eligible outcomes or measures in the ‘Characteristics of included studies’ table, noting which was selected and why.

Multiplicity can arise from the reporting of multiple analyses of the same outcome (e.g. analyses that do and do not adjust for prognostic factors; intention-to-treat and per-protocol analyses) and multiple reports of the same study (e.g. journal articles, conference abstracts). Approaches for dealing with this type of multiplicity should also be specified in the protocol (López-López et al 2018).

It may be difficult to anticipate all forms of multiplicity when developing a protocol. Any post-hoc approaches used to select outcomes or results should be noted at the beginning of the Methods section, or if extensive, within an additional supplementary material.

The following hierarchy was specified to select one outcome per domain in a review examining the effects of portion, package or tableware size (Hollands et al 2015):

Selection of the outcome was made blinded to the results. All available outcome measures were documented in the ‘Characteristics of included studies’ table.

In a review of audit and feedback for healthcare providers, the outcome domains were ‘provider performance’ (e.g. compliance with recommended use of a laboratory test) and ‘patient health outcomes’ (e.g. smoking status, blood pressure) (Ivers et al 2012). For each domain, outcomes were selected using the following hierarchy:

6. Plan how the specified outcome domains will be used in the synthesis.

When different measurement methods or tools have been used across studies, consideration must be given to how these will be synthesized. Options include the following.

and ). There may be increased heterogeneity, warranting use of a random-effects model ( ).

In a review of interventions to support women to stop smoking, separate outcome domains were specified for biochemically validated measures of smoking and self-report measures. The two domains were meta-analysed together, but sensitivity analyses were undertaken restricting the meta-analyses to studies with only biochemically validated outcomes, to examine if the results were robust to the method of measurement (Chamberlain et al 2017).

In a review of psychological therapies for youth internalizing and externalizing disorders, most studies contributed multiple effects (e.g. in one meta-analysis of 443 studies, there were 5139 included measures). The authors used multilevel modelling to address the dependency among multiple effects contributed from each study (Weisz et al 2017).

7. Where possible, build in contingencies by specifying both specific and broader outcome domains.

Consider building in flexibility to group outcomes at different levels or time intervals. Inflexible approaches can undermine the potential to synthesize, especially when few studies are anticipated, or there is likely to be diversity in the way outcomes are defined and measured and the timing of measurement. If insufficient studies report data for meaningful synthesis using the narrower domains, the broader domains can be used (see also ).

Consider a hypothetical review aiming to examine the effects of behavioural psychological interventions for the treatment of overweight and obese adults. A specific outcome is body mass index (BMI). However, also specifying a broader outcome domain ‘indicator of body mass’ will facilitate synthesis in the circumstance where few studies report BMI, but most report an indicator of body mass (such as weight or waist circumference). This is particularly important when few studies may be anticipated or there is expected diversity in the measurement methods or tools.

3.3 Determining which study designs to include

Some study designs are more appropriate than others for answering particular questions. Authors need to consider a priori what study designs are likely to provide reliable data with which to address the objectives of their review ( MECIR Box 3.3.a ). Sections 3.3.1 and 3.3.2 cover randomized and non-randomized designs for assessing treatment effects; Chapter 17, Section 17.2.5  discusses other study designs in the context of addressing intervention complexity.

MECIR Box 3.3.a Relevant expectations for conduct of intervention reviews

Predefining study designs ( )

Predefined, unambiguous eligibility criteria are a fundamental prerequisite for a systematic review. This is particularly important when non-randomized studies are considered. Some labels commonly used to define study designs can be ambiguous. For example a ‘double blind’ study may not make it clear who was blinded; a ‘case-control’ study may be nested within a cohort, or be undertaken in a cross-sectional manner; or a ‘prospective’ study may have only some features defined or undertaken prospectively.

Justifying choice of study designs ( )

It might be difficult to address some interventions or some outcomes in randomized trials. Authors should be able to justify why they have chosen either to restrict the review to randomized trials or to include non-randomized studies. The particular study designs included should be justified with regard to appropriateness to the review question and with regard to potential for bias.

3.3.1 Including randomized trials

Because Cochrane Reviews address questions about the effects of health care, they focus primarily on randomized trials and randomized trials should be included if they are feasible for the interventions of interest ( MECIR Box 3.3.b ). Randomization is the only way to prevent systematic differences between baseline characteristics of participants in different intervention groups in terms of both known and unknown (or unmeasured) confounders (see Chapter 8 ), and claims about cause and effect can be based on their findings with far more confidence than almost any other type of study. For clinical interventions, deciding who receives an intervention and who does not is influenced by many factors, including prognostic factors. Empirical evidence suggests that, on average, non-randomized studies produce effect estimates that indicate more extreme benefits of the effects of health care than randomized trials. However, the extent, and even the direction, of the bias is difficult to predict. These issues are discussed at length in Chapter 24 , which provides guidance on when it might be appropriate to include non-randomized studies in a Cochrane Review.

Practical considerations also motivate the restriction of many Cochrane Reviews to randomized trials. In recent decades there has been considerable investment internationally in establishing infrastructure to index and identify randomized trials. Cochrane has contributed to these efforts, including building up and maintaining a database of randomized trials, developing search filters to aid their identification, working with MEDLINE to improve tagging and identification of randomized trials, and using machine learning and crowdsourcing to reduce author workload in identifying randomized trials ( Chapter 4, Section 4.6.6.2 ). The same scale of organizational investment has not (yet) been matched for the identification of other types of studies. Consequently, identifying and including other types of studies may require additional efforts to identify studies and to keep the review up to date, and might increase the risk that the result of the review will be influenced by publication bias. This issue and other bias-related issues that are important to consider when defining types of studies are discussed in detail in Chapter 7 and Chapter 13 .

Specific aspects of study design and conduct should be considered when defining eligibility criteria, even if the review is restricted to randomized trials. For example, whether cluster-randomized trials ( Chapter 23, Section 23.1 ) and crossover trials ( Chapter 23, Section 23.2 ) are eligible, as well as other criteria for eligibility such as use of a placebo comparison group, evaluation of outcomes blinded to allocation sequence, or a minimum period of follow-up. There will always be a trade-off between restrictive study design criteria (which might result in the inclusion of studies that are at low risk of bias, but very few in number) and more liberal design criteria (which might result in the inclusion of more studies, but at a higher risk of bias). Furthermore, excessively broad criteria might result in the inclusion of misleading evidence. If, for example, interest focuses on whether a therapy improves survival in patients with a chronic condition, it might be inappropriate to look at studies of very short duration, except to make explicit the point that they cannot address the question of interest.

MECIR Box 3.3.b Relevant expectations for conduct of intervention reviews

Including randomized trials ( )

if it is feasible to conduct them to evaluate the interventions and outcomes of interest.

Randomized trials are the best study design for evaluating the efficacy of interventions. If it is feasible to conduct them to evaluate questions that are being addressed by the review, they must be considered eligible for the review. However, appropriate exclusion criteria may be put in place, for example regarding length of follow-up.

3.3.2 Including non-randomized studies

The decision of whether non-randomized studies (and what type) will be included is decided alongside the formulation of the review PICO. The main drivers that may lead to the inclusion of non-randomized studies include: (i) when randomized trials are unable to address the effects of the intervention on harm and long-term outcomes or in specific populations or settings; or (ii) for interventions that cannot be randomized (e.g. policy change introduced in a single or small number of jurisdictions) (see Chapter 24 ). Cochrane, in collaboration with others, has developed guidance for review authors to support their decision about when to look for and include non-randomized studies (Schünemann et al 2013).

Non-randomized designs have the commonality of not using randomization to allocate units to comparison groups, but their different design features mean that they are variable in their susceptibility to bias. Eligibility criteria should be based on explicit study design features, and not the study labels applied by the primary researchers (e.g. case-control, cohort), which are often used inconsistently (Reeves et al 2017; see Chapter 24 ).

When non-randomized studies are included, review authors should consider how the studies will be grouped and used in the synthesis. The Cochrane Non-randomized Studies Methods Group taxonomy of design features (see Chapter 24 ) may provide a basis for grouping together studies that are expected to have similar inferential strength and for providing a consistent language for describing the study design.

Once decisions have been made about grouping study designs, planning of how these will be used in the synthesis is required. Review authors need to decide whether it is useful to synthesize results from non-randomized studies and, if so, whether results from randomized trials and non-randomized studies should be included in the same synthesis (for the purpose of examining whether study design explains heterogeneity among the intervention effects), or whether the effects should be synthesized in separate comparisons (Valentine and Thompson 2013). Decisions should be made for each of the different types of non-randomized studies under consideration. Review authors might anticipate increased heterogeneity when non-randomized studies are synthesized, and adoption of a meta-analysis model that encompasses heterogeneity is wise (Valentine and Thompson 2013) (such as a random effects model, see Chapter 10, Section 10.10.4 ). For further discussion of non-randomized studies, see Chapter 24 .

3.4 Eligibility based on publication status and language

Chapter 4 contains detailed guidance on how to identify studies from a range of sources including, but not limited to, those in peer-reviewed journals. In general, a strategy to include studies reported in all types of publication will reduce bias ( Chapter 7 ). There would need to be a compelling argument for the exclusion of studies on the basis of their publication status ( MECIR Box 3.4.a ), including unpublished studies, partially published studies, and studies published in ‘grey’ literature sources. Given the additional challenge in obtaining unpublished studies, it is possible that any unpublished studies identified in a given review may be an unrepresentative subset of all the unpublished studies in existence. However, the bias this introduces is of less concern than the bias introduced by excluding all unpublished studies, given what is known about the impact of reporting biases (see Chapter 13 on bias due to missing studies, and Chapter 4, Section 4.3 for a more detailed discussion of searching for unpublished and grey literature).

Likewise, while searching for, and analysing, studies in any language can be extremely resource-intensive, review authors should consider carefully the implications for bias (and equity, see Chapter 16 ) if they restrict eligible studies to those published in one specific language (usually English). See Chapter 4, Section 4.4.5 , for further discussion of language and other restrictions while searching.

MECIR Box 3.4.a Relevant expectations for conduct of intervention reviews

Excluding studies based on publication status ( )

Obtaining and including data from unpublished studies (including grey literature) can reduce the effects of publication bias. However, the unpublished studies that can be located may be an unrepresentative sample of all unpublished studies.

3.5 Chapter information

Authors: Joanne E McKenzie, Sue E Brennan, Rebecca E Ryan, Hilary J Thomson, Renea V Johnston, James Thomas

Acknowledgements: This chapter builds on earlier versions of the Handbook . In particular, Version 5, Chapter 5 , edited by Denise O’Connor, Sally Green and Julian Higgins.

Funding: JEM is supported by an Australian National Health and Medical Research Council (NHMRC) Career Development Fellowship (1143429). SEB and RER’s positions are supported by the NHMRC Cochrane Collaboration Funding Program. HJT is funded by the UK Medical Research Council (MC_UU_12017-13 and MC_UU_12017-15) and Scottish Government Chief Scientist Office (SPHSU13 and SPHSU15). RVJ’s position is supported by the NHMRC Cochrane Collaboration Funding Program and Cabrini Institute. JT is supported by the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care North Thames at Barts Health NHS Trust. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.

3.6 References

Bailey JV, Murray E, Rait G, Mercer CH, Morris RW, Peacock R, Cassell J, Nazareth I. Interactive computer-based interventions for sexual health promotion. Cochrane Database of Systematic Reviews 2010; 9 : CD006483.

Bender R, Bunce C, Clarke M, Gates S, Lange S, Pace NL, Thorlund K. Attention should be given to multiplicity issues in systematic reviews. Journal of Clinical Epidemiology 2008; 61 : 857–865.

Buchbinder R, Johnston RV, Rischin KJ, Homik J, Jones CA, Golmohammadi K, Kallmes DF. Percutaneous vertebroplasty for osteoporotic vertebral compression fracture. Cochrane Database of Systematic Reviews 2018; 4 : CD006349.

Caldwell DM, Welton NJ. Approaches for synthesising complex mental health interventions in meta-analysis. Evidence-Based Mental Health 2016; 19 : 16–21.

Chamberlain C, O’Mara-Eves A, Porter J, Coleman T, Perlen S, Thomas J, McKenzie J. Psychosocial interventions for supporting women to stop smoking in pregnancy. Cochrane Database of Systematic Reviews 2017; 2 : CD001055.

Ciciriello S, Johnston RV, Osborne RH, Wicks I, deKroo T, Clerehan R, O’Neill C, Buchbinder R. Multimedia educational interventions for consumers about prescribed and over-the-counter medications. Cochrane Database of Systematic Reviews 2013; 4 : CD008416.

Cochrane Consumers & Communication Group. Outcomes of Interest to the Cochrane Consumers & Communication Group: taxonomy. http://cccrg.cochrane.org/ .

COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) initiative. COSMIN database of systematic reviews of outcome measurement instruments. https://database.cosmin.nl/ .

Coulter A, Entwistle VA, Eccles A, Ryan S, Shepperd S, Perera R. Personalised care planning for adults with chronic or long-term health conditions. Cochrane Database of Systematic Reviews 2015; 3 : CD010523.

Davey J, Turner RM, Clarke MJ, Higgins JPT. Characteristics of meta-analyses and their component studies in the Cochrane Database of Systematic Reviews: a cross-sectional, descriptive analysis. BMC Medical Research Methodology 2011; 11 : 160.

Desroches S, Lapointe A, Ratte S, Gravel K, Legare F, Turcotte S. Interventions to enhance adherence to dietary advice for preventing and managing chronic diseases in adults. Cochrane Database of Systematic Reviews 2013; 2 : CD008722.

Deyo RA, Dworkin SF, Amtmann D, Andersson G, Borenstein D, Carragee E, Carrino J, Chou R, Cook K, DeLitto A, Goertz C, Khalsa P, Loeser J, Mackey S, Panagis J, Rainville J, Tosteson T, Turk D, Von Korff M, Weiner DK. Report of the NIH Task Force on research standards for chronic low back pain. Journal of Pain 2014; 15 : 569–585.

Dodd S, Clarke M, Becker L, Mavergames C, Fish R, Williamson PR. A taxonomy has been developed for outcomes in medical research to help improve knowledge discovery. Journal of Clinical Epidemiology 2018; 96 : 84–92.

Fisher DJ, Carpenter JR, Morris TP, Freeman SC, Tierney JF. Meta-analytical methods to identify who benefits most from treatments: daft, deluded, or deft approach? BMJ 2017; 356 : j573.

Fransen M, McConnell S, Harmer AR, Van der Esch M, Simic M, Bennell KL. Exercise for osteoarthritis of the knee. Cochrane Database of Systematic Reviews 2015; 1 : CD004376.

Guise JM, Chang C, Viswanathan M, Glick S, Treadwell J, Umscheid CA. Systematic reviews of complex multicomponent health care interventions. Report No. 14-EHC003-EF . Rockville, MD: Agency for Healthcare Research and Quality; 2014.

Harrison JK, Noel-Storr AH, Demeyere N, Reynish EL, Quinn TJ. Outcomes measures in a decade of dementia and mild cognitive impairment trials. Alzheimer’s Research and Therapy 2016; 8 : 48.

Hedges LV, Tipton E, Johnson M, C. Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods 2010; 1 : 39–65.

Hetrick SE, McKenzie JE, Cox GR, Simmons MB, Merry SN. Newer generation antidepressants for depressive disorders in children and adolescents. Cochrane Database of Systematic Reviews 2012; 11 : CD004851.

Higgins JPT, López-López JA, Becker BJ, Davies SR, Dawson S, Grimshaw JM, McGuinness LA, Moore THM, Rehfuess E, Thomas J, Caldwell DM. Synthesizing quantitative evidence in systematic reviews of complex health interventions. BMJ Global Health 2019; 4 : e000858.

Hoffmann T, Glasziou P, Barbour V, Macdonald H. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ 2014; 1687 : 1-13.

Hollands GJ, Shemilt I, Marteau TM, Jebb SA, Lewis HB, Wei Y, Higgins JPT, Ogilvie D. Portion, package or tableware size for changing selection and consumption of food, alcohol and tobacco. Cochrane Database of Systematic Reviews 2015; 9 : CD011045.

Howe TE, Shea B, Dawson LJ, Downie F, Murray A, Ross C, Harbour RT, Caldwell LM, Creed G. Exercise for preventing and treating osteoporosis in postmenopausal women. Cochrane Database of Systematic Reviews 2011; 7 : CD000333.

ICHOM. The International Consortium for Health Outcomes Measurement 2018. http://www.ichom.org/ .

IPDAS. International Patient Decision Aid Standards Collaboration (IPDAS) standards. www.ipdas.ohri.ca .

Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O’Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database of Systematic Reviews 2012; 6 : CD000259.

Janmaat VT, Steyerberg EW, van der Gaast A, Mathijssen RH, Bruno MJ, Peppelenbosch MP, Kuipers EJ, Spaander MC. Palliative chemotherapy and targeted therapies for esophageal and gastroesophageal junction cancer. Cochrane Database of Systematic Reviews 2017; 11 : CD004063.

Kendrick D, Kumar A, Carpenter H, Zijlstra GAR, Skelton DA, Cook JR, Stevens Z, Belcher CM, Haworth D, Gawler SJ, Gage H, Masud T, Bowling A, Pearl M, Morris RW, Iliffe S, Delbaere K. Exercise for reducing fear of falling in older people living in the community. Cochrane Database of Systematic Reviews 2014; 11 : CD009848.

Kirkham JJ, Gargon E, Clarke M, Williamson PR. Can a core outcome set improve the quality of systematic reviews? A survey of the Co-ordinating Editors of Cochrane Review Groups. Trials 2013; 14 : 21.

Konstantopoulos S. Fixed effects and variance components estimation in three-level meta-analysis. Research Synthesis Methods 2011; 2 : 61–76.

Lamb SE, Becker C, Gillespie LD, Smith JL, Finnegan S, Potter R, Pfeiffer K. Reporting of complex interventions in clinical trials: development of a taxonomy to classify and describe fall-prevention interventions. Trials 2011; 12 : 125.

Lewin S, Hendry M, Chandler J, Oxman AD, Michie S, Shepperd S, Reeves BC, Tugwell P, Hannes K, Rehfuess EA, Welch V, Mckenzie JE, Burford B, Petkovic J, Anderson LM, Harris J, Noyes J. Assessing the complexity of interventions within systematic reviews: development, content and use of a new tool (iCAT_SR). BMC Medical Research Methodology 2017; 17 : 76.

López-López JA, Page MJ, Lipsey MW, Higgins JPT. Dealing with multiplicity of effect sizes in systematic reviews and meta-analyses. Research Synthesis Methods 2018; 9 : 336–351.

Mavridis D, Salanti G. A practical introduction to multivariate meta-analysis. Statistical Methods in Medical Research 2013; 22 : 133–158.

Michie S, van Stralen M, West R. The Behaviour Change Wheel: a new method for characterising and designing behaviour change interventions. Implementation Science 2011; 6 : 42.

Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Annals of Behavioral Medicine 2013; 46 : 81–95.

Moraes VY, Lenza M, Tamaoki MJ, Faloppa F, Belloti JC. Platelet-rich therapies for musculoskeletal soft tissue injuries. Cochrane Database of Systematic Reviews 2014; 4 : CD010071.

O'Neill J, Tabish H, Welch V, Petticrew M, Pottie K, Clarke M, Evans T, Pardo Pardo J, Waters E, White H, Tugwell P. Applying an equity lens to interventions: using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. Journal of Clinical Epidemiology 2014; 67 : 56–64.

Pompoli A, Furukawa TA, Imai H, Tajika A, Efthimiou O, Salanti G. Psychological therapies for panic disorder with or without agoraphobia in adults: a network meta-analysis. Cochrane Database of Systematic Reviews 2016; 4 : CD011004.

Pompoli A, Furukawa TA, Efthimiou O, Imai H, Tajika A, Salanti G. Dismantling cognitive-behaviour therapy for panic disorder: a systematic review and component network meta-analysis. Psychological Medicine 2018; 48 : 1–9.

Reeves BC, Wells GA, Waddington H. Quasi-experimental study designs series-paper 5: a checklist for classifying studies evaluating the effects on health interventions – a taxonomy without labels. Journal of Clinical Epidemiology 2017; 89 : 30–42.

Regnaux J-P, Lefevre-Colau M-M, Trinquart L, Nguyen C, Boutron I, Brosseau L, Ravaud P. High-intensity versus low-intensity physical activity or exercise in people with hip or knee osteoarthritis. Cochrane Database of Systematic Reviews 2015; 10 : CD010203.

Richards SH, Anderson L, Jenkinson CE, Whalley B, Rees K, Davies P, Bennett P, Liu Z, West R, Thompson DR, Taylor RS. Psychological interventions for coronary heart disease. Cochrane Database of Systematic Reviews 2017; 4 : CD002902.

Safi S, Korang SK, Nielsen EE, Sethi NJ, Feinberg J, Gluud C, Jakobsen JC. Beta-blockers for heart failure. Cochrane Database of Systematic Reviews 2017; 12 : CD012897.

Santesso N, Carrasco-Labra A, Brignardello-Petersen R. Hip protectors for preventing hip fractures in older people. Cochrane Database of Systematic Reviews 2014; 3 : CD001255.

Shepherd E, Gomersall JC, Tieu J, Han S, Crowther CA, Middleton P. Combined diet and exercise interventions for preventing gestational diabetes mellitus. Cochrane Database of Systematic Reviews 2017; 11 : CD010443.

Squires J, Valentine J, Grimshaw J. Systematic reviews of complex interventions: framing the review question. Journal of Clinical Epidemiology 2013; 66 : 1215–1222.

Stacey D, Légaré F, Lewis K, Barry MJ, Bennett CL, Eden KB, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Thomson R, Trevena L. Decision aids for people facing health treatment or screening decisions. Cochrane Database of Systematic Reviews 2017; 4 : CD001431.

Stroke Unit Trialists Collaboration. Organised inpatient (stroke unit) care for stroke. Cochrane Database of Systematic Reviews 2013; 9 : CD000197.

Taylor AJ, Jones LJ, Osborn DA. Zinc supplementation of parenteral nutrition in newborn infants. Cochrane Database of Systematic Reviews 2017; 2 : CD012561.

Valentine JC, Thompson SG. Issues relating to confounding and meta-analysis when including non-randomized studies in systematic reviews on the effects of interventions. Research Synthesis Methods 2013; 4 : 26–35.

Vaona A, Banzi R, Kwag KH, Rigon G, Cereda D, Pecoraro V, Tramacere I, Moja L. E-learning for health professionals. Cochrane Database of Systematic Reviews 2018; 1 : CD011736.

Verheyden GSAF, Weerdesteyn V, Pickering RM, Kunkel D, Lennon S, Geurts ACH, Ashburn A. Interventions for preventing falls in people after stroke. Cochrane Database of Systematic Reviews 2013; 5 : CD008728.

Weisz JR, Kuppens S, Ng MY, Eckshtain D, Ugueto AM, Vaughn-Coaxum R, Jensen-Doss A, Hawley KM, Krumholz Marchette LS, Chu BC, Weersing VR, Fordwood SR. What five decades of research tells us about the effects of youth psychological therapy: a multilevel meta-analysis and implications for science and practice. American Psychologist 2017; 72 : 79–117.

Welch V, Petkovic J, Simeon R, Presseau J, Gagnon D, Hossain A, Pardo Pardo J, Pottie K, Rader T, Sokolovski A, Yoganathan M, Tugwell P, DesMeules M. Interactive social media interventions for health behaviour change, health outcomes, and health equity in the adult population. Cochrane Database of Systematic Reviews 2018; 2 : CD012932.

Welton NJ, Caldwell DM, Adamopoulos E, Vedhara K. Mixed treatment comparison meta-analysis of complex interventions: psychological interventions in coronary heart disease. American Journal of Epidemiology 2009; 169 : 1158–1165.

Williamson PR, Altman DG, Bagley H, Barnes KL, Blazeby JM, Brookes ST, Clarke M, Gargon E, Gorst S, Harman N, Kirkham JJ, McNair A, Prinsen CAC, Schmitt J, Terwee CB, Young B. The COMET Handbook: version 1.0. Trials 2017; 18 : 280.

For permission to re-use material from the Handbook (either academic or commercial), please see here for full details.

exclusion and inclusion criteria in a literature review

Systematic Reviews for Health Sciences and Medicine

  • Systematic Reviews
  • The research question
  • Common search errors
  • Search translation
  • Managing results
  • Inclusion and exclusion criteria
  • Critical appraisal
  • Updating a Review
  • Resources by Review Stage

Inclusion and Exclusion Criteria

Inclusion and exclusion criteria set the boundaries for the systematic review.  They are determined after setting the research question usually before the search is conducted, however scoping searches may need to be undertaken to determine appropriate criteria.  Many different factors can be used as inclusion or exclusion criteria. Information about the inclusion and exclusion criteria is usually recorded as a paragraph or table within the methods section of the systematic review.   It may also be necessary to give the definitions, and source of the definition, used for particular concepts in the research question (e.g. adolescence, depression).  

exclusion and inclusion criteria in a literature review

Other inclusion/exclusion criteria can include the sample size, method of sampling or availability of a relevant comparison group in the study.  Where a single study is reported across multiple papers the findings from the papers may be merged or only the latest data may be included.

  • << Previous: Managing results
  • Next: Critical appraisal >>
  • Last Updated: Aug 27, 2024 2:17 PM
  • URL: https://unimelb.libguides.com/sysrev

Systematic Reviews: Inclusion and Exclusion Criteria

  • What Type of Review is Right for You?
  • What is in a Systematic Review
  • Finding and Appraising Systematic Reviews
  • Formulating Your Research Question
  • Inclusion and Exclusion Criteria
  • Creating a Protocol
  • Results and PRISMA Flow Diagram
  • Searching the Published Literature
  • Searching the Gray Literature
  • Methodology and Documentation
  • Managing the Process
  • Scoping Reviews

Defining Inclusion/Exclusion Criteria

An important part of the SR process is defining what will and will not be included in your review. 

Inclusion and exclusion criteria are developed after a research question is finalized but before a search is carried out. They determine the limits for the evidence synthesis and are typically reported in the methods section of the publication. For unfamiliar or unclear concepts, a definition may be necessary to adequately describe the criterion for readers. 

Some examples of common inclusion/exclusion criteria might be:

  • Date of publication : only articles published in the last ten years
  • Exposure to intervention/ or specific health condition : only people who have participated in the DASH diet
  • Language of Publication* : only looking at English articles 
  • Settings : Hospitals, nursing homes, schools
  • Geography : specific locations such as states, countries, or specific populations

*note of caution: research is published all over the world and in multiple languages. Limiting to just English can be considered a bias to your research.

  • Common Inclusion/Exclusion Criteria from the University of Melbourne

What happens if no study meets my inclusion/exclusion criteria?

Empty reviews are when no studies meet the inclusion criteria for a SR. Empty reviews are more likely to subject to publication bias, however, they are important in identifying gaps in the literature. 

  • Unanswered questions implications of an empty review Slyer, Jason T. Unanswered questions, JBI Database of Systematic Reviews and Implementation Reports: June 2016 - Volume 14 - Issue 6 - p 1-2 doi: 10.11124/JBISRIR-2016-002934
  • Rapid Prompting Method and Autism Spectrum Disorder: Systematic Review Exposes Lack of Evidence Schlosser, R.W., Hemsley, B., Shane, H. et al. Rapid Prompting Method and Autism Spectrum Disorder: Systematic Review Exposes Lack of Evidence. Rev J Autism Dev Disord 6, 403–412 (2019).
  • << Previous: Formulating Your Research Question
  • Next: Creating a Protocol >>
  • Last Updated: Sep 6, 2024 1:05 PM
  • URL: https://guides.lib.lsu.edu/Systematic_Reviews

Provide Website Feedback Accessibility Statement

Banner

Evidence-Based Practice (EBP)

  • The EBP Process
  • Forming a Clinical Question
  • Inclusion & Exclusion Criteria
  • Acquiring Evidence
  • Appraising the Quality of the Evidence
  • Writing a Literature Review
  • Finding Psychological Tests & Assessment Instruments

Selection Criteria

Inclusion and exclusion are two sides of the same coin.

Inclusion and exclusion criteria are determined after formulating the research question but usually before the search is conducted (although preliminary scoping searches may need to be undertaken to determine appropriate criteria).  It may be helpful to determine the inclusion criteria and exclusion criteria for each PICO component.

Be aware that you may  introduce bias  into the final review if these are not used thoughtfully. 

Inclusion and exclusion are two sides of the same coin, so—depending on your perspective—a single database filter can be said to either include or exclude. For instance, if articles must be published within the last 3 years, that is inclusion. If articles cannot be more than 3 years old, that is exclusion. 

The most straightforward way to include or exclude results is to use database limiters (filters), usually found on the left side of the search results page.

Inclusion Criteria

Inclusion criteria are the elements of an article  that must be present  in order for it to be eligible for inclusion in a literature review. Some examples are:

  • Included studies must have compared certain treatments
  • Included studies must be a certain type (e.g., only Randomized Controlled Trials)
  • Included studies must be located in a certain geographic area
  • Included studies must have been published in the last 5 years

Exclusion Criteria

Exclusion criteria are the elements of an article that  disqualify the study from inclusion  in a literature review. Some examples are:

  • Study used an observational design
  • Study used a qualitative methodology
  • Study was published more than 5 years ago
  • Study was published in a language other than English
  • << Previous: Forming a Clinical Question
  • Next: Acquiring Evidence >>
  • Last Updated: May 16, 2024 2:44 PM
  • URL: https://libguides.umsl.edu/ebp

UHN Library Logo

  • Introduction
  • Preamble: Systematic Review: What it is and isn't
  • Systematic Review Guidelines
  • 1. Formulate a Research Question
  • 2. Develop a Research Protocol
  • 3. Conduct a Thorough Literature Search
  • 4. Apply Inclusion and Exclusion Criteria
  • 5. Perform Data Extraction/Abstraction
  • 6. Conduct a Quality Appraisal of Included Studies
  • 7. Complete Data Analysis and Compile Results
  • 8. Interpret Results
  • How to Appraise a Systematic Review
  • Systematic Review Software and Tools
  • Knowledge Synthesis Services This link opens in a new window

Systematic Review Overview : 4. Apply Inclusion and Exclusion Criteria

  • Health Science Information Consortium
  • University Health Network - New
  • Systematic Review Overview

Table of Contents

  • Systematic Review Software

Step 4. Apply Inclusion and Exclusion Criteria

At the beginning of large systematic reviews, researchers discuss and develop a series of inclusion and exclusion criteria to fit in with their review question and/or the brief provided by whoever is funding the project.

Systematic reviews often exclude studies if they do not conform to specific study designs, are not written in English or within a certain time frame. As a researcher, you should be cautious of any bias you might introduce into the review by adding certain inclusion or exclusion criteria. For example: limiting to studies in English may miss important studies published in other languages, leading to language bias.

All decisions to include or exclude certain studies or groups of studies should be documented in the methods section of the research proposal/protocol - this way it can be demonstrated that a systematic process has been followed.

In large systematic reviews, the inclusion/exclusion criteria are applied by at least 2 reviewers to all the studies retrieved by the literature search. A strategy to resolve any disagreements between the reviewers should be outlined in the protocol, such as bringing in a third screener.

There are two levels of the screening process. The first level of screening involves scanning the titles and abstracts of the articles; those that are clearly irrelevant can be excluded.

Full text papers are obtained for the remaining articles and the criteria are applied again for the second level of screening on the full text. Those that meet the criteria are included in the review (although sometimes if too many papers are obtained, the question and criteria are refined and the process repeated). At this stage of screening, the reason for exclusion(s) must be recorded. This process is represented by the following flow diagram ( See PRISMA Flow Diagram ).

Key Points Regarding Study Selection

  • Section 1.3.2. Process for Study selection (http://www.york.ac.uk/inst/crd/pdf/Systematic_Reviews.pdf, actual page #35)
  • Studies should be selected in an unbiased way, based on selection criteria that flow directly from the review questions, and that have been piloted to check that they can be reliably applied.
  • Study selection is a staged process involving sifting through the citations located by the search, retrieving full reports of potentially relevant citations and, from their assessment, identifying those studies that fulfill the inclusion criteria.
  • Parallel independent assessments should be conducted to minimize the risk of errors of judgment. If disagreements occur between reviewers, they should be resolved according to a predefined strategy using consensus and arbitration as appropriate.
  • The study selection process should be documented, detailing reasons for inclusion and exclusion.

Tips to Improve Inter-Rater Reliability / Screener Selection Accuracy

While awaiting search strategy development and final citation results:

  • Provide clear and explicit inclusion and exclusion criteria, with definitions and explanations where warranted.
  • Conduct thorough training for all involved.
  • Provide clear guidelines which should be reviewed by all prior to starting the activity.
  • Provide pilot testing or beta testing of screening tools/procedures, using samples/subsets of real data (with test inter-rater reliability calculations to determine preliminary agreement or variability).
  • Optional: pilot or beta test screeners in pairs: one screener with previous experience paired with a more novice screener.
  • Conduct ongoing, active surveillance/auditing of activities (can see if/when going off course)
  • Provide ongoing opportunities for discussion, education, and training.
  • The Screening Phase for Reviews Tutorial (5 min+) This tutorial presents information on the screening process for systematic reviews or other knowledge syntheses, and contains a variety of resources including guidelines, best practices, tips, and tools for successfully preparing to complete this important research stage.
  • 1. Slavin RE. Best evidence synthesis: an intelligent alternative to meta-analysis. J Clin Epidemiol. 1995 Jan;48(1):9-18.
  • 2. Eysenck HJ. Meta-analysis and its problems. BMJ. 1994 Sep 24;309(6957):789-92.
  • 3. Moher D, Fortin P, Jadad AR, Juni P, Klassen T, Le Lorier J, et al. Completeness of reporting of trials published in languages other than English: implications for conduct and reporting of systematic reviews. Lancet. 1996 Feb 10;347(8998):363-6.
  • 4. Vickers A, Goyal N, Harland R, Rees R. Do certain countries produce only positive results? A systematic review of controlled trials. Control Clin Trials. 1998 Apr;19(2):159-66.
  • 5. Moher D, Pham B, Klassen T, Schultz KF, Berlin J, Jadad AR, et al. Does the language of publication of reports of randomized trials influence the estimates of intervention effectiveness reported in meta-analyses? Systematic Reviews: Evidence in Action,
  • 6. PRISMA Statement. "The PRISMA Statement consists of a 27-item checklist and a four-phase flow diagram. It is an evolving document that is subject to change periodically as new evidence emerges. In fact, the PRISMA Statement is an update and expansion of the now-out dated QUORUM Statement. This website contains the current definitive version of the PRISMA Statement."
  • << Previous: 3. Conduct a Thorough Literature Search
  • Next: 5. Perform Data Extraction/Abstraction >>
  • Last Updated: Sep 12, 2024 1:14 PM
  • URL: https://guides.hsict.library.utoronto.ca/c.php?g=699108

We acknowledge this sacred land on which the University Health Network operates. For thousands of years it has been the traditional territory of the Huron-Wendat, the Haudenosaunee, and most recently, the Mississaugas of the Credit River. This territory was the subject of the Dish With One Spoon Wampum Belt Covenant, an agreement between the Haudenosaunee Confederacy and the Confederacy of the Ojibwe and allied nations to peaceably share and care for the resources around the Great Lakes. Today, the meeting place of Toronto is still the home to many Indigenous people from across Turtle Island and we are grateful to have the opportunity to work and learn on this territory

UHN Library and Information Services

Nature

Library guides

Our library guides bring together the essential resources in your subject area and connect you quickly and easily to information about Library Services

CityLibrary Search

Literature searching and finding evidence.

  • Literature searching or literature review?
  • Use the PICO or PEO frameworks

Establish your Inclusion and Exclusion criteria

  • Find related search terms
  • Subject Heading/MeSH Searching
  • Select databases to search
  • Structure your search
  • Search techniques
  • Search key databases
  • Manage results in EBSCOhost and Ovid
  • Analyse your search results
  • Document your search results
  • Training and support

These criteria help you decide which pieces of evidence (for example, which primary research studies) will/will not be included in your work. Using specific criteria will help make sure your final review is as unbiased, transparent and ethical as possible.

How to establish your Inclusion and Exclusion criteria

To establish your criteria you need to define each aspect of your question to clarify what you are focusing on, and consider if there are any variations you also wish to explore. This is where using frameworks like PICO help:

Example:   Alternatives to drugs for controlling headaches in children.

Using the PICO structure you clarify what aspects you are most interested in. Here are some examples to consider:

    Children

A specific age group? Teenagers and adolescents?

    Alternatives to drugs

What alternatives are there? Complementary therapies? Alternative medicines? Changes in lifestyle? All three?

If you decide to focus on 'complementary therapies' do you want to examine all therapies or a specific therapy like holistic therapy?

    Drugs

All drugs that treat headaches, or a group of drugs, or a specific drug?

   Headaches

All types of headaches, or a specific type such as tension headaches or migraines?

The aspects of the topic you decide to focus on are the  Inclusion  criteria.

The aspects you don't wish to include are the  Exclusion  criteria.

  • << Previous: Use the PICO or PEO frameworks
  • Next: Find related search terms >>
  • Last Updated: Aug 23, 2024 3:26 PM
  • URL: https://libguides.city.ac.uk/SHS-Litsearchguide

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

The PMC website is updating on October 15, 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • v.8(11); 2016 Nov

Logo of cureus

How to Conduct a Systematic Review: A Narrative Literature Review

Nusrat jahan.

1 Psychiatry, Mount Sinai Chicago

Sadiq Naveed

2 Psychiatry, KVC Prairie Ridge Hospital

Muhammad Zeshan

3 Department of Psychiatry, Bronx Lebanon Hospital Icahn School of Medicine at Mount Sinai, Bronx, NY

Muhammad A Tahir

4 Psychiatry, Suny Upstate Medical University, Syracuse, NY

Systematic reviews are ranked very high in research and are considered the most valid form of medical evidence. They provide a complete summary of the current literature relevant to a research question and can be of immense use to medical professionals. Our goal with this paper is to conduct a narrative review of the literature about systematic reviews and outline the essential elements of a systematic review along with the limitations of such a review.

Introduction and background

A literature review provides an important insight into a particular scholarly topic. It compiles published research on a topic, surveys different sources of research, and critically examines these sources [ 1 ]. A literature review may be argumentative, integrative, historical, methodological, systematic, or theoretical, and these approaches may be adopted depending upon the types of analysis in a particular study [ 2 ].

Our topic of interest in this article is to understand the different steps of conducting a systematic review. Systematic reviews, according to Wright, et al., are defined as a “review of the evidence on a clearly formulated question that uses systematic and explicit methods to identify, select and critically appraise relevant primary research, and to extract and analyze data from the studies that are included in the review” [ 3 ]. A systematic review provides an unbiased assessment of these studies [ 4 ]. Such reviews emerged in the 1970s in the field of social sciences. Systematic reviews, as well as the meta-analyses of the appropriate studies, can be the best form of evidence available to clinicians [ 3 ]. The unsystematic narrative review is more likely to include only research selected by the authors, which introduces bias and, therefore, frequently lags behind and contradicts the available evidence [ 5 ].

Epidemiologist Archie Cochrane played a vital role in formulating the methodology of the systematic review [ 6 ]. Dr. Cochrane loved to study patterns of disease and how these related to the environment. In the early 1970s, he found that many decisions in health care were made without reliable, up-to-date evidence about the treatments used [ 6 ].

A systematic review may or may not include meta-analysis, depending on whether results from different studies can be combined to provide a meaningful conclusion. David Sackett defined meta-analysis as a “specific statistical strategy for assembling the results of several studies into a single estimate” [ 7 - 8 ].

While the systematic review has several advantages, it has several limitations which can affect the conclusion. Inadequate literature searches and heterogeneous studies can lead to false conclusions. Similarly, the quality of assessment is an important step in systematic reviews, and it can lead to adverse consequences if not done properly.

The purpose of this article is to understand the important steps involved in conducting a systematic review of all kinds of clinical studies. We conducted a narrative review of the literature about systematic reviews with a special focus on articles that discuss conducting reviews of randomized controlled trials. We discuss key guidelines and important terminologies and present the advantages and limitations of systematic reviews.

Narrative reviews are a discussion of important topics on a theoretical point of view, and they are considered an important educational tool in continuing medical education [ 9 ]. Narrative reviews take a less formal approach than systematic reviews in that narrative reviews do not require the presentation of the more rigorous aspects characteristic of a systematic review such as reporting methodology, search terms, databases used, and inclusion and exclusion criteria [ 9 ]. With this in mind, our narrative review will give a detailed explanation of the important steps of a systematic review.

Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) checklist

Systematic reviews are conducted based on predefined criteria and protocol. The PRISMA-P checklist, developed by Moher, et al., contains 17 items (26 including sub-items) comprising the important steps of a systematic review, including information about authors, co-authors, their mailing and email addresses, affiliations, and any new or updated version of a previous systematic review [ 9 ]. It also identifies a plan for documenting important protocol amendments, registry names, registration numbers, financial disclosures, and other support services [ 10 ]. Moher, et al. also state that methods of systematic reviews involve developing eligibility criteria and describing information sources, search strategies, study selection processes, outcomes, assessment of bias in individual studies, and data synthesis [ 10 ].

Research question

Writing a research question is the first step in conducting a systematic review and is of paramount importance as it outlines both the need and validity of systematic reviews (Nguyen, et al., unpublished data). It also increases the efficiency of the review by limiting the time and cost of identifying and obtaining relevant literature [ 11 ]. The research question should summarize the main objective of a systematic review.

An example research question might read, “How does attention-deficit/hyperactivity disorder (ADHD) affect the academic performance of middle school children in North America?” The question focuses on the type of data, analysis, and topic to be discussed (i.e., ADHD among North American middle school students). Try to avoid research questions that are too narrow or broad—they can lead to the selection of only a few studies and the ability to generalize results to any other populations may be limited. An example of a research question that is too narrow would be, “What is the prevalence of ADHD in children and adolescents in Chicago, IL?” Alternately, if the research question is too broad, it can be difficult to reach a conclusion due to poor methodology. An example of a research question that is too broad in scope would be, “What are the effects of ADHD on the functioning of children and adolescents in North America?”

Different tools that can be used to help devise a research question, depending on the type of question, are: population, intervention, comparator, and outcomes (PICO); sample, phenomenon of interest, design, evaluation, and research type (SPIDER); setting, perspective, intervention, comparison, and evaluation (SPICE); and expectation, client group, location, impact, professionals, and service (ECLIPSE).

The PICO approach is mostly used to compare different interventions with each other. It helps to formulate a research question related to prognosis, diagnosis, and therapies [ 12 ].

Scenario: A 50-year-old white woman visited her psychiatrist with a diagnosis of major depressive disorder. She was prescribed fluoxetine, which she feels has been helpful. However, she experienced some unpleasant side effects of nausea and abdominal discomfort. She has recently been told by a friend about the use of St. John’s wort in treating depression and would like to try this in treating her current depression. (Formulating research questions, unpublished data).

In the above-mentioned scenario, the sample population is a 50-year-old female with major depressive disorder; the intervention is St. John’s wort; the comparison is fluoxetine; and the outcome would be efficacy and safety. In order to see the outcome of both efficacy and safety, we will compare the efficacy and safety of both St. John’s wort and fluoxetine in a sample population for treating depression. This scenario represents an example where we can apply the PICO approach to compare two interventions.

In contrast, the SPIDER approach is focused more on study design and samples rather than populations [ 13 ]. The SPIDER approach can be used in this research question: “What is the experience of psychiatry residents attending a transgender education?” The sample is psychiatry residents; the phenomenon of interest is transgender education; the design is a survey; the evaluation looks at the experience; and the research type is qualitative. 

The SPICE approach can be used to evaluate the outcome of a service, intervention, or project [ 14 ]. The SPICE approach applies to the following research question: “In psychiatry clinics, does the combined use of selective serotonin reuptake inhibitor (SSRI) and psychotherapy reduce depression in an outpatient clinic versus SSRI therapy alone?” The setting is the psychiatry clinic; the perspective/population is the outpatient; the intervention is combined psychotherapy and SSRI; the comparison is SSRI alone; and the evaluation is reduced depression. 

The ECLIPSE approach is useful for evaluating the outcome of a policy or service (Nguyen, et al., unpublished data). ECLIPSE can apply in the following research question: “How can a resident get access to medical records of patients admitted to inpatient from other hospitals?” The expectation is: “What are you looking to improve/change to increase access to medical records for patients admitted to inpatient?” The client group is the residents; the location is the inpatient setting; the impact would be the residents having easy access to medical records from other hospitals; and the professionals in this scenario would be those involved in improving the service experiences such as hospital administrators and IT staff.

Inclusion and exclusion criteria

Establishing inclusion and exclusion criteria come after formulating research questions. The concept of inclusion and exclusion of data in a systematic review provides a basis on which the reviewer draws valid and reliable conclusions regarding the effect of the intervention for the disorder under consideration [ 11 ]. Inclusions and exclusion are based on preset criteria for specific systematic review. It should be done before starting the literature search in order to minimize the possibility of bias.

Eligibility criteria provide the boundaries of the systematic review [ 15 ]. Participants, interventions, and comparison of a research question provide the basis for eligibility criteria [ 15 ]. The inclusion criteria should be able to identify the studies of interest and, if the inclusion criteria are too broad or too narrow, it can lead to an ineffective screening process.

Protocol registration

Developing and registering research protocol is another important step of conducting a systematic review. The research protocol ensures that a systematic review is carefully planned and explicitly documented before the review starts, thus promoting consistency in conduct for the review team and supporting the accountability, research integrity, and transparency of the eventually completed review [ 10 ]. PROSPERO and the Cochrane Database of Systematic Reviews are utilized for registering research protocols and research questions, and they check for prior existing duplicate protocols or research questions. PROSPERO is an international database of prospectively registered systematic reviews related to health care and social sciences (PRISMA, 2016). It is funded by the National Institute for Health Research. The Cochrane Collaboration concentrates on producing systematic reviews of interventions and diagnostic test accuracy but does not currently produce reviews on questions of prognosis or etiology [ 16 ].

A detailed and extensive search strategy is important for the systematic review since it minimizes bias in the review process [ 17 ].

Selecting and searching appropriate electronic databases is determined by the topic of interest. Important databases are: MEDLARS Online (MEDLINE), which is the online counterpart to the Medical Literature Analysis and Retrieval System (MEDLARS); Excerpta Medica Database (EMBASE); and Google Scholar. There are multiple electronic databases available based on the area of interest. Other important databases include: PsycINFO for psychology and psychiatry; Allied and Complementary Medicine Database (AMED) for complementary medicine; Manual, Alternative, and Natural Therapy Index System (MANTIS) for alternative medical literature; and Cumulative Index to Nursing and Allied Health Literature (CINAHL) for nursing and allied health [ 15 ].

Additional studies relevant for the review may be found by looking at the references of studies identified by different databases [ 15 ]. Non-indexed articles may be found by searching the content of journals, conferences proceedings, and abstracts. It will also help with letters and commentaries which may not get indexed [ 15 ]. Reviewing clinical trial registries can provide information about any ongoing trials or unpublished research [ 15 ]. A gray literature search can access unpublished papers, reports, and conference reports, and it generally covers studies that are published in an informal fashion, rather than in an indexed journal [ 15 ]. Further search can be performed by selecting important key articles and going through in-text citations [ 15 ].

Using Boolean operators, truncation, and wildcards

Boolean operators use the relationship between different search words to help with the search strategy. These are simple words (i.e., AND, OR, and NOT) which can help with more focused and productive results (poster, Jahan, et al.: How to conduct a systematic review. APPNA 39th Summer Convention. Washington, DC. 2016). The Boolean operator AND finds articles with all the search words. The use of OR broadens the focus of the search, and it will include articles with at least one search term. The researchers can also ignore certain results from the records by using NOT in the search strategy.

An example of AND would be using “depression” AND “children” in the search strategy with the goal of studying depression in children. This search strategy will include all the articles about both depression and children. The researchers may use OR if the emphasis of the study is mood disorders or affective disorders in adolescents. In that case, the search strategy will be “mood disorders” OR “affective disorders” AND “adolescents.” This search will find all the articles about mood disorders or affective disorders in adolescents. The researchers can use NOT if they only want to study depression in children and want to ignore bipolar disorder from the search. An example search in this scenario would be “depression” NOT “bipolar disorder” AND “children.” This will help ignore studies related to bipolar disorder in children.

Truncation and wildcards are other tools to make search strategy more comprehensive and focused. While the researchers search a database for certain articles, they frequently face terminologies that have the same initial root of a word but different endings. An example would be "autism," "autistic," and "autism spectrum disorder." These words have a similar initial root derived from “autis” but they end differently in each case. The truncation symbol (*) retrieves articles that contain words beginning with “autis” plus any additional characters. Wildcards are used for words with the same meanings but different spellings due to various reasons. For the words with spelling variations of a single letter, wildcard symbols can be used. When the researcher inputs “M+N” in the search bar, this returns results containing both “man” or “men” as the wildcard accounts for the spelling variations between the letters M and N.

Study selection

Study selection should be performed in a systematic manner, so reviewers deal with fewer errors and a lower risk of bias (online course, Li T, Dickersin K: Introduction to systematic review and meta-analysis. 2016. https://www.coursera.org/learn/systematic-review #). Study selection should involve two independent reviewers who select studies using inclusion and exclusion criteria. Any disagreements during this process should be resolved by discussion or by a third reviewer [ 10 ]. Specific study types can be selected depending on the research question. For example, questions on incidence and prevalence can be answered by surveys and cohort studies. Clinical trials can provide answers to questions related to therapy and screening. Queries regarding diagnostic accuracy can be answered by clinical trials and cross-sectional studies (online course, Li T, Dickersin K: Introduction to systematic review and meta-analysis. 2016. https://www.coursera.org/learn/systematic-review #). Prognosis and harm-related questions should use cohort studies and clinical trials, and etiology questions should use case-control and cohort studies (online course, Li T, Dickersin K: Introduction to systematic review and meta-analysis. 2016. https://www.coursera.org/learn/systematic-review #).

Data screening and data extractions are two of the major steps in conducting a systematic review [ 18 ]. Data screening involves searching for relevant articles in different databases using keywords. The next step of data screening is manuscript selection by reviewing each manuscript in the search results to compare that manuscript against the inclusion criteria [ 18 ]. The researchers should also review the references of the papers selected before selecting the final paper, which is the last step of data screening [ 18 ].

The next stage is extracting and appraising the data of the included articles [ 18 ]. A data extraction form should be used to help reduce the number of errors, and more than one person should record the data [ 17 ]. Data should be collected on specific points like population type, study authors, agency, study design, humanitarian crisis, target age groups, research strengths from the literature, setting, study country, type(s) of public health intervention, and health outcome(s) addressed by the public health intervention. All this information should then be put into an electronic database [ 18 ].

Assessing bias

Bias is a systematic error (or deviation from the truth) in results or inferences. Biases can change the results of any study and lead to an underestimation or overestimation of the true intervention effect [ 19 ]. Biases can impact any aspect of a review, including selecting studies, collecting and extracting data, and making a conclusion. Biases can vary in magnitude; some are small, with negligible effect, but some are substantial to a degree where an apparent finding may be entirely due to bias [ 19 ]. There are different types of bias, including, but not limited to, selection, detection, attrition, reporting, and performance.

Selection bias occurs when a sample selected is not representative of the whole general population. If randomization of the sample is done correctly, then chances of selection bias can be minimized [ 20 ].

Detection bias refers to systematic differences between groups in how outcomes are determined. This type of bias is based on knowledge of the intervention provided and its outcome [ 19 ].

Attrition bias refers to systematic differences between groups in withdrawals from a study [ 19 ]. The data will be considered incomplete if some subjects are withdrawn or have irregular visits during data collection.

Reporting bias refers to systematic differences between reported and unreported findings, and it is commonly seen during article reviews. Reporting bias is based on reviewer judgment about the outcome of selected articles [ 20 ].

Performance bias develops due to the knowledge of the allocated interventions by participants and personnel during the study [ 20 ]. Using a double-blind study design helps prevent performance bias, where neither the experimenter nor the subjects know which group contains controls and which group contains the test article [ 14 ].

Last step of systematic review: discussion

The discussion of a systematic review is where a summary of the available evidence for different outcomes is written and discussed [ 10 ]. The limitations of a systematic review are also discussed in detail. Finally, a conclusion is drawn after evaluating the results and considering limitations [ 10 ].

Discussion of the current article

Systematic reviews with or without a meta-analysis are currently ranked to be the best available evidence in the hierarchy of evidence-based practice [ 21 ]. We have discussed the methodology of a systematic review. A systematic review is classified in the category of filtered information because it appraises the quality of the study and its application in the field of medicine [ 21 ]. However, there are some limitations of the systematic review, as we mentioned earlier in our article. A large randomized controlled trial may provide a better conclusion than a systematic review of many smaller trials due to their larger sample sizes [ 22 ], which help the researchers generalize their conclusions for a bigger population. Other important factors to consider include higher dropout rates in large studies, co-interventions, and heterogeneity among studies included in the review.

As we discussed the limitations of the systematic review and its effect on quality of evidence, there are several tools to rate the evidence, such as the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system [ 22 ]. GRADE provides a structured approach to evaluating the risk of bias, serious inconsistency between studies, indirectness, imprecision of the results, and publication bias [ 22 ]. Another approach used to rate the quality of evidence is a measurement tool to assess systematic reviews (AMSTAR) [ 23 ]. It is also available in several languages [ 23 ].

Conclusions

Despite its limitations, a systematic review can add to the knowledge of the scientific community especially when there are gaps in the existing knowledge. However, conducting a systematic review requires different steps that involve different tools and strategies. It can be difficult at times to access and utilize these resources. A researcher can understand and strategize a systematic review following the different steps outlined in this literature review. However, conducting a systematic review requires a thorough understanding of all the concepts and tools involved, which is an extensive endeavor to be summed up in one article.

The Cochrane Handbook for Systematic Reviews of Interventions and the Center for Reviews and Dissemination (CRD) provide excellent guidance through their insightful and detailed guidelines. We recommend consulting these resources for further guidance.

Given that our article is a narrative review of the scholarly literature, it contains the same limitations as noted for any narrative review. We hope that our review of the means and methods for conducting a systematic review will be helpful in providing basic knowledge to utilize the resources available to the scientific community.

The content published in Cureus is the result of clinical experience and/or research by independent individuals or organizations. Cureus is not responsible for the scientific accuracy or reliability of data or conclusions published herein. All content published within Cureus is intended only for educational, research and reference purposes. Additionally, articles published within Cureus should not be deemed a suitable substitute for the advice of a qualified health care professional. Do not disregard or avoid professional medical advice due to content published within Cureus.

The authors have declared that no competing interests exist.

  • Reserve a study room
  • Library Account
  • Undergraduate Students
  • Graduate Students
  • Faculty & Staff

How to Conduct a Literature Review (Health Sciences and Beyond)

  • What is a Literature Review?
  • Developing a Research Question

Selection Criteria

Inclusion criteria, exclusion criteria.

  • Database Search
  • Documenting Your Search
  • Organize Key Findings
  • Reference Management

You may want to think about criteria that will be used to select articles for your literature review based on your research question.  These are commonly known as  inclusion criteria  and  exclusion criteria .  Be aware that you may introduce bias into the final review if these are not used thoughtfully.

Inclusion criteria are the elements of an article that must be present in order for it to be eligible for inclusion in a literature review.  Some examples are:

  • Included studies must have compared certain treatments
  • Included studies must be experimental
  • Included studies must have been published in the last 5 years

Exclusion criteria are the elements of an article that disqualify the study from inclusion in a literature review.  Some examples are:

  • Study used an observational design
  • Study used a qualitative methodology
  • Study was published more than 5 years ago
  • Study was published in a language other than English
  • << Previous: Developing a Research Question
  • Next: Databases >>
  • Last Updated: Mar 15, 2024 12:22 PM
  • URL: https://guides.library.vcu.edu/health-sciences-lit-review

Banner

  • JABSOM Library

Literature Review Basics and Searching Skills

  • Selecting Criteria
  • Getting Started
  • Developing Research Questions
  • Selecting Databases
  • Searching Databases
  • Documenting Searches
  • Organizing Findings
  • Managing Citations & References
  • Submitting Your Manuscript
  • Finding Help

Selection Criteria

You may want to think about criteria that will be used to select articles for your literature review based on your research question. These are commonly known as  inclusion criteria  and  exclusion criteria . Be aware that you may introduce bias into the final review if these are not used thoughtfully.

Inclusion Criteria

Inclusion criteria are the elements of an article that must be present in order for it to be eligible for inclusion in a literature review.  Some examples are:

  • Included studies must have compared certain treatments
  • Included studies must be experimental
  • Included studies must have been published in the last 5 years

Exclusion Criteria

Exclusion criteria are the elements of an article that disqualify the study from inclusion in a literature review.  Some examples are:

  • Study used an observational design
  • Study used a qualitative methodology
  • Study was published more than 5 years ago
  • Study was published in a language other than English
  • << Previous: Developing Research Questions
  • Next: Selecting Databases >>
  • Last Updated: Mar 20, 2024 11:38 AM
  • URL: https://hslib.jabsom.hawaii.edu/lit_review

Health Sciences Library, John A. Burns School of Medicine, University of Hawai‘i at Mānoa, 651 Ilalo Street, MEB 101, Honolulu, HI 96813 - Phone: 808-692-0810, Fax: 808-692-1244

Copyright © 2004-2024. All rights reserved. Library Staff Page - Other UH Libraries

icon

site header image

Literature Reviews: Systematic, Scoping, Integrative

  • Introduction to Literature Reviews
  • Creating a Search Strategy

Using Limits and Inclusion/Exclusion Criteria

Filters and Limits

Inclusion and Exclusion Criteria

Limits and Inclusion Criteria

  • Review Protocols
  • Elements of a Systematic Review
  • Review Tools and Applications
  • Writing a Literature Review

Ask A Librarian

Once you have some search results, you will need to decide which articles you will actually use in your literature review. This can be done using filters/limits in the databases, applying inclusion/exclusion criteria, and appraising the articles.

Filters and limits (the name varies by database) are tools the database provides to help you narrow your search results. Different databases offer different filters, but these are some of the more common ones you'll find.

  • Publication year
  • Language of the article
  • Age of study subjects
  • Study design

Your search terms and the filters/limits you apply are generally not enough to narrow your results to the most relevant and highest quality studies for your project. The final step to selecting these studies is to apply your inclusion and exclusion criteria. Basically, these are the reasons why you keep (include) or reject (exclude) articles as you look through the results, reading titles and abstracts (and sometimes the whole article)

Examples of types of Inclusion/Exclusion Criteria

  • PICO(T) elements - if one of the main elements of your topic does not match those of the study, you may need to exclude it
  • Age - if you can't use a filter/limit to exclude studies that do not focus on the age group you require, you may need to exclude those studies yourself.
  • Setting - i.e. home, acute care, assisted living facility
  • Study Design - sometimes a filter/limit doesn't exist for the study design you're interested in; in that case you'll need to look through articles to find that detail yourself.
  • Number of subjects - do you have a minimum study group size? 
  • Study drop-out rate  

  • << Previous: Creating a Search Strategy
  • Next: Review Protocols >>
  • Last Updated: Sep 13, 2024 11:03 AM
  • URL: https://libguides.massgeneral.org/reviews

exclusion and inclusion criteria in a literature review

University of Texas

  • University of Texas Libraries

Literature Reviews

Determine inclusion and exclusion criteria.

  • What is a literature review?
  • Steps in the Literature Review Process
  • Define your research question
  • Choose databases and search
  • Review Results
  • Synthesize Results
  • Analyze Results
  • Librarian Support
  • Artificial Intelligence (AI) Tools

Once you have a clearly defined research question, make sure you are getting precisely the right search results from searching the databases by making decisions about these items:

  • Would the most recent five years be appropriate?
  • Is your research from a more historical perspective?
  • Where has this type of research taken place?
  • Will you confine your results to the United States?
  • To English speaking countries?
  • Will you translate works if needed?
  • Is there a particular methodology, or population that you are focused on?
  • Are there adjacent fields in which this type of research has been conducted that you would like to include?
  • Is there a controversy or debate in your research field that you want to highlight
  • Are you creating a historical overview? Is this background reading for your research?
  • Is there new technology that can shed light on an old problem or an old technology that can be used in a new way?
  • Last Updated: Aug 26, 2024 5:59 AM
  • URL: https://guides.lib.utexas.edu/literaturereviews

Creative Commons License

Cranfield University logo

Conducting your literature review

  • Introduction
  • Your literature review
  • Defining a research question
  • Choosing where to search
  • Search strings
  • Limiters and filters

Developing inclusion/exclusion criteria

  • Managing your search results
  • Screening, evaluating and recording
  • Snowballing and grey literature
  • Further information and resources

A feature of the systematic literature review is using pre-specified criteria to include/exclude studies. Through searching the literature and formulating your review questions, for example by using PICO, PEO , etc., you will be able to define the specific attributes that research studies must have to be eligible for inclusion in your review, along with other attributes that will exclude them. These attributes will form your inclusion and exclusion criteria, which you will use to assess the relevance and quality of the studies to be included in your final analysis.

Examples of inclusion/exclusion criteria could be:

  • Language, e.g., only include articles published in English.
  • Timeframe, e.g., papers published after a certain date.
  • Geographic location, e.g., UK only.
  • Format, e.g., peer reviewed journal articles.
  • Type of research, e.g., case studies, empirical papers, qualitative research.

To justify their use, you will need to provide a rationale for each of your inclusion/exclusion criteria.

You will find examples of inclusion/exclusion criteria in research theses on CERES, Cranfield’s repository. Simply keyword search for “systematic review”.

  • << Previous: Running your search and reporting search terms
  • Next: Managing your search results >>
  • Last Updated: Jul 23, 2024 4:06 PM
  • URL: https://library.cranfield.ac.uk/literature-review

exclusion and inclusion criteria in a literature review

Systematic reviews

  • Defining your research topic
  • Developing a protocol
  • Finding existing systematic reviews and registration sites

Inclusion/exclusion criteria

  • Conducting a comprehensive search
  • Searching for grey literature
  • Handsearching
  • Screening your search results
  • Critical appraisal
  • Extracting data
  • Data synthesis and meta-analysis
  • Reporting your results
  • Managing your citations
  • Scoping reviews
  • Other Systematic Review tools
  • Searching health databases This link opens in a new window
  • Additional support This link opens in a new window

Will you restrict by dates, study designs, populations (age, gender, ethnicity, diseases, location, psychosocial or emotional factors), languages of references, interventions, outcomes etc.? Clear eligibility criteria will make it easier to identify relevant articles at the screening stage.

The resources below may assist to better inform your decisions:

  • Cochrane: Defining the criteria for including studies Chapter 3 of the Cochrane Handbook provides advice on selecting inclusion and exclusion criteria
  • Designing Inclusion and Exclusion Criteria A useful article, published in 2020 by Hornberger & Rangu and available via the Scholarly Commons, University of Pennsylvania
  • JBI Manual for Evidence Synthesis Provides guidance to authors for the conduct and preparation of JBI systematic reviews and evidence syntheses.
  • << Previous: Finding existing systematic reviews and registration sites
  • Next: Conducting a comprehensive search >>
  • Last Updated: Jun 27, 2024 10:56 AM
  • URL: https://libguides.adelaide.edu.au/systematicreviews

exclusion and inclusion criteria in a literature review

Information

  • Author Services

Initiatives

You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.

All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .

Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.

Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Original Submission Date Received: .

  • Active Journals
  • Find a Journal
  • Proceedings Series
  • For Authors
  • For Reviewers
  • For Editors
  • For Librarians
  • For Publishers
  • For Societies
  • For Conference Organizers
  • Open Access Policy
  • Institutional Open Access Program
  • Special Issues Guidelines
  • Editorial Process
  • Research and Publication Ethics
  • Article Processing Charges
  • Testimonials
  • Preprints.org
  • SciProfiles
  • Encyclopedia

healthcare-logo

Article Menu

exclusion and inclusion criteria in a literature review

  • Subscribe SciFeed
  • Google Scholar
  • on Google Scholar
  • Table of Contents

Find support for a specific problem in the support section of our website.

Please let us know what you think of our products and services.

Visit our dedicated information section to learn more about MDPI.

JSmol Viewer

The relationship between training load and injury risk in basketball: a systematic review.

exclusion and inclusion criteria in a literature review

1. Introduction

2. materials and methods, 2.1. literature search, 2.2. selection criteria, 2.3. quality assessment, 2.4. data extraction and analysis, 3.1. article identification, 3.2. description of the included articles, 3.3. definitions of injury, 3.4. measures of load, 3.5. assessment of article quality, level of evidence, and conflict of interest, 4. discussion, 4.1. load monitoring in basketball, 4.2. training and/or competition time and injury risk, 4.3. relative load, rapid changes in load, and injury risk, 4.4. minutes played per game (mpg) and injury risk, 4.5. sleep and injury risk, 4.6. competition calendar congestion and injury risk, 4.7. limitation, 4.8. practical applications and future direction, 5. conclusions, author contributions, institutional review board statement, informed consent statement, data availability statement, acknowledgments, conflicts of interest.

  • Soligard, T.; Schwellnus, M.; Alonso, J.-M.; Bahr, R.; Clarsen, B.; Dijkstra, H.P.; Gabbett, T.; Gleeson, M.; Hägglund, M.; Hutchinson, M.R.; et al. How much is too much? (Part 1) International Olympic Committee consensus statement on load in sport and risk of injury. Br. J. Sports Med. 2016 , 50 , 1030–1041. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Moreno-Pérez, V.; Ruiz, J.; Vazquez-Guerrero, J.; Rodas, G.; Del Coso, J. Training and competition injury epidemiology in professional basketball players: A prospective observational study. Physician Sportsmed. 2023 , 51 , 121–128. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Gabbett, T.J. Debunking the myths about training load, injury and performance: Empirical evidence, hot topics and recommendations for practitioners. Br. J. Sports Med. 2020 , 54 , 58–66. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Lewis, M. It’s a hard-knock life: Game load, fatigue, and injury risk in the National Basketball Association. J. Athl. Train. 2018 , 53 , 503–509. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Bullock, G.S.; Ferguson, T.; Vaughan, J.; Gillespie, D.; Collins, G.; Kluzek, S. Temporal trends and severity in injury and illness incidence in the National Basketball Association over 11 seasons. Orthop. J. Sports Med. 2021 , 9 , 23259671211004094. [ Google Scholar ] [ CrossRef ]
  • Torres-Ronda, L.; Gámez, I.; Robertson, S.; Fernández, J. Epidemiology and injury trends in the National Basketball Association: Pre- and per-COVID-19 (2017–2021). PLoS ONE 2022 , 17 , e0263354. [ Google Scholar ] [ CrossRef ]
  • Esteves, P.T.; Mikolajec, K.; Schelling, X.; Sampaio, J. Basketball performance is affected by the schedule congestion: NBA back-to-backs under the microscope. Eur. J. Sport Sci. 2021 , 21 , 26–35. [ Google Scholar ] [ CrossRef ]
  • Wang, X.; Zhang, S.; Gasperi, L.; Robertson, S.; Ruano, M.A.G. Rest or rust? Complex influence of schedule congestion on the home advantage in the National Basketball Association. Chaos Solit. Fractals 2023 , 174 , 113698. [ Google Scholar ] [ CrossRef ]
  • Morikawa, L.H.; Tummala, S.V.; Brinkman, J.C.; Buckner Petty, S.A.; Chhabra, A. Effect of a condensed NBA season on injury risk: An analysis of the 2020 season and player safety. Ortho. J. Sports Med. 2022 , 10 , 23259671221121116. [ Google Scholar ] [ CrossRef ]
  • Teramoto, M.; Cross, C.L.; Cushman, D.M.; Maak, T.G.; Petron, D.J.; Willick, S.E. Game injuries in relation to game schedules in the National Basketball Association. J. Sci. Med. Sport 2017 , 20 , 230–235. [ Google Scholar ] [ CrossRef ]
  • Eckard, T.G.; Padua, D.A.; Hearn, D.W.; Pexa, B.S.; Frank, B.S. The relationship between training load and injury in athletes: A systematic review. Sports Med. 2018 , 48 , 1929–1961. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Jones, C.M.; Griffiths, P.C.; Mellalieu, S.D. Training load and fatigue marker associations with injury and illness: A systematic review of longitudinal studies. Sports Med. 2017 , 47 , 943–974. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Drew, M.K.; Finch, C.F. The relationship between training load and injury, illness and soreness: A systematic and literature review. Sports Med. 2016 , 46 , 861–883. [ Google Scholar ] [ CrossRef ]
  • Perrett, C.; Lamb, P.; Bussey, M. Is there an association between external workload and lower-back injuries in cricket fast bowlers? A systematic review. Phys. Ther. Sport 2020 , 41 , 71–79. [ Google Scholar ] [ CrossRef ]
  • Coughlin, R.P.; Lee, Y.; Horner, N.S.; Simunovic, N.; Cadet, E.R.; Ayeni, O.R. Increased pitch velocity and workload are common risk factors for ulnar collateral ligament injury in baseball players: A systematic review. J. ISAKOS 2019 , 4 , 41–47. [ Google Scholar ] [ CrossRef ]
  • Wells, G.; Shea, B.; O’Connell, D.; Peterson, J.; Welch, V.; Losos, M.; Tugwell, P. The Newcastle-Ottawa Scale (NOS) for Assessing the Quality of Nonrandomised Studies in Meta-Analyses ; University of Ottawa: Ottawa, ON, Canada, 2000. [ Google Scholar ]
  • Ferioli, D.; La Torre, A.; Tibiletti, E.; Dotto, A.; Rampinini, E. Determining the relationship between load markers and non-contact injuries during the competitive season among professional and semi-professional basketball players. Res. Sports Med. 2021 , 29 , 265–276. [ Google Scholar ] [ CrossRef ]
  • Garcia, L.; Planas, A.; Peirau, X. Analysis of the injuries and workload evolution using the RPE and s-RPE method in basketball. Apunt. Sports Med. 2022 , 57 , 100372. [ Google Scholar ] [ CrossRef ]
  • Caparrós, T.; Alentorn-Geli, E.; Myer, G.D.; Capdevila, L.; Samuelsson, K.; Hamilton, B.; Rodas, G. The relationship of practice exposure and injury rate on game performance and season success in professional male basketball. J. Sports Sci. Med. 2016 , 15 , 397–402. [ Google Scholar ] [ PubMed ]
  • Caparrós, T.; Casals, M.; Solana, Á.; Peña, J. Low external workloads are related to higher injury risk in professional male basketball games. J. Sports Sci. Med. 2018 , 17 , 289–297. [ Google Scholar ]
  • Piedra, A.; Peña, J.; Ciavattini, V.; Caparrós, T. Relationship between injury risk, workload, and rate of perceived exertion in professional women’s basketball. Apunt. Sports Med. 2020 , 55 , 71–79. [ Google Scholar ] [ CrossRef ]
  • Doeven, S.H.; Brink, M.S.; Huijgen, B.C.H.; de Jong, J.; Lemmink, K.A.P.M. Managing load to optimize well-being and recovery during short-term match congestion in elite basketball. Int. J. Sports Physiol. Perform. 2021 , 16 , 45–50. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Benson, L.C.; Owoeye, O.B.A.; Räisänen, A.M.; Stilling, C.; Edwards, W.B.; Emery, C.A. Magnitude, frequency, and accumulation: Workload among injured and uninjured youth basketball players. Front. Sports Act. Living 2021 , 3 , 607205. [ Google Scholar ] [ CrossRef ]
  • Anderson, L.; Triplett-Mcbride, T.; Foster, C.; Doberstein, S.; Brice, G. Impact of training patterns on incidence of illness and injury during a women’s collegiate basketball season. J. Strength Cond. Res. 2003 , 17 , 734–738. [ Google Scholar ] [ CrossRef ]
  • Watson, A.; Johnson, M.; Sanfilippo, J. Decreased sleep is an independent predictor of in-season injury in male collegiate basketball players. Orthop. J. Sports Med. 2020 , 8 , 2325967120964481. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Orringer, M.J.; Pandya, N.K. Acutely increased workload is correlated with significant injuries among National Basketball Association players. Int. J. Sports Sci. Coach. 2022 , 17 , 568–575. [ Google Scholar ] [ CrossRef ]
  • Menon, S.; Morikawa, L.; Tummala, S.V.; Buckner-Petty, S.; Chhabra, A. The primary risk factors for season-ending injuries in professional basketball are minutes played per game and later season games. Arthrosc. J. Arthrosc. Relat. Surg. 2024 , in press . [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Senbel, S.; Sharma, S.; Raval, M.S.; Taber, C.; Nolan, J.; Artan, N.S.; Ezzeddine, D.; Kaya, T. Impact of sleep and training on game performance and injury in division-1 women’s basketball amidst the pandemic. IEEE Access 2022 , 10 , 15516–15527. [ Google Scholar ] [ CrossRef ]
  • Weiss, K.J.; Allen, S.V.; McGuigan, M.R.; Whatman, C.S. The relationship between training load and injury in men’s professional basketball. Int. J. Sports Physiol. Perform. 2017 , 12 , 1238–1242. [ Google Scholar ] [ CrossRef ]
  • Gianoudis, J.; Webster, K.E.; Cook, J. Volume of physical activity and injury occurrence in young basketball players. J. Sports Sci. Med. 2008 , 7 , 139–143. [ Google Scholar ]
  • Fuller, C.W.; Ekstrand, J.; Junge, A.; Andersen, T.E.; Bahr, R.; Dvorak, J.; Hägglund, M.; McCrory, P.; Meeuwisse, W.H. Consensus statement on injury definitions and data collection procedures in studies of football (soccer) injuries. Br. J. Sports Med. 2006 , 40 , 193–201. [ Google Scholar ] [ CrossRef ]
  • Hagglund, M.; Walden, M.; Bahr, R.; Ekstrand, J. Methods for epidemiological study of injuries to professional football players: Developing the UEFA model. Br. J. Sports Med. 2005 , 39 , 340–346. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Clarsen, B.; Myklebust, G.; Bahr, R. Development and validation of a new method for the registration of overuse injuries in sports injury epidemiology: The Oslo Sports Trauma Research Centre (OSTRC) overuse injury questionnaire. Br. J. Sports Med. 2013 , 47 , 495–502. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Noyes, F.R.; Lindenfeld, T.N.; Marshall, M.T. What determines an athletic injury (definition)? Who determines an injury (occurrence)? Am. J. Sports Med. 1988 , 16 (Suppl. S1), S-65–S-68. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Foster, C.; Florhaug, J.A.; Franklin, J.; Gottschall, L.; Hrovatin, L.A.; Parker, S.; Doleshal, P.; Dodge, C. A new approach to monitoring exercise training. J. Strength Cond. Res. 2001 , 15 , 109–115. [ Google Scholar ] [ CrossRef ]
  • Borg, G. Borg’s Perceived Exertion and Pain Scales ; Human Kinetics: Champaign, IL, USA, 1988. [ Google Scholar ]
  • Foster, C. Monitoring training in athletes with reference to overtraining syndrome. Med. Sci. Sports Exerc. 1998 , 30 , 1164–1168. [ Google Scholar ] [ CrossRef ]
  • Russell, J.L.; McLean, B.D.; Impellizzeri, F.M.; Strack, D.S.; Coutts, A.J. Measuring physical demands in basketball: An explorative systematic review of practices. Sports Med. 2021 , 51 , 81–112. [ Google Scholar ] [ CrossRef ]
  • Piedra, A.; Peña, J.; Caparrós, T. Monitoring Training Loads in Basketball: A Narrative Review and Practical Guide for Coaches and Practitioners. Strength Cond. J. 2021 , 43 , 12–35. [ Google Scholar ] [ CrossRef ]
  • Svilar, L.; Castellano, J.; Jukic, I.; Casamichana, D. Positional differences in elite basketball: Selecting appropriate training-load measures. Int. J. Sports Physiol Perform. 2018 , 13 , 947–952. [ Google Scholar ] [ CrossRef ]
  • Koyama, T.; Rikukawa, A.; Nagano, Y.; Sasaki, S.; Ichikawa, H.; Hirose, N. High-acceleration movement, muscle damage, and perceived exertion in basketball games. Int. J. Sports Physiol. Perform. 2022 , 17 , 16–21. [ Google Scholar ] [ CrossRef ]
  • Vázquez-Guerrero, J.; Suarez-Arrones, L.; Gómez, D.C.; Rodas, G. Comparing external total load, acceleration and deceleration outputs in elite basketball players across positions during match play. Kinesiology 2018 , 50 , 228–234. [ Google Scholar ] [ CrossRef ]
  • Petway, A.J.; Freitas, T.T.; Calleja-González, J.; Medina Leal, D.; Alcaraz, P.E. Training load and match-play demands in basketball based on competition level: A systematic review. PLoS ONE 2020 , 15 , e0229212. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Griffin, A.; Kenny, I.C.; Comyns, T.M.; Lyons, M. The association between the acute: Chronic workload ratio and injury and its application in team sports: A systematic review. Sports Med. 2020 , 50 , 561–580. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Andrade, R.; Wik, E.H.; Rebelo-Marques, A.; Blanch, P.; Whiteley, R.; Espregueira-Mendes, J.; Gabbett, T.J. Is the acute: Chronic workload ratio (ACWR) associated with risk of time-loss injury in professional team sports? A systematic review of methodology, variables and injury risk in practical situations. Sports Med. 2020 , 50 , 1613–1635. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Tummala, S.V.; Morikawa, L.; Brinkman, J.; Crijns, T.J.; Economopoulos, K.; Chhabra, A. Knee Injuries and associated risk factors in National Basketball Association athletes. Arthroc. Sports Med. Rehabil. 2022 , 4 , e1639–e1645. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Tummala, S.V.; Morikawa, L.; Brinkman, J.C.; Crijns, T.J.; Vij, N.; Gill, V.; Kile, T.A.; Patel, K.; Chhabra, A. Characterization of ankle injuries and associated risk factors in the National Basketball Association: Minutes per game and usage rate associated with time loss. Ortho. J. Sports Med. 2023 , 11 , 23259671231184459. [ Google Scholar ] [ CrossRef ]
  • Okoroha, K.R.; Marfo, K.; Meta, F.; Matar, R.; Shehab, R.; Thompson, T.; Moutzouros, V.; Makhni, E.C. Amount of minutes played does not contribute to anterior cruciate ligament injury in National Basketball Association athletes. Orthopedics 2017 , 40 , e658–e662. [ Google Scholar ] [ CrossRef ]
  • Page, R.M.; Field, A.; Langley, B.; Harper, L.D.; Julian, R. The effects of fixture congestion on injury in professional male soccer: A systematic review. Sports Med. 2023 , 53 , 667–685. [ Google Scholar ] [ CrossRef ]
  • Willberg, C.; Wieland, B.; Rettenmaier, L.; Behringer, M.; Zentgraf, K. The relationship between external and internal load parameters in 3 x 3 basketball tournaments. BMC Sports Sci. Med. Rehabil. 2022 , 14 , 152. [ Google Scholar ] [ CrossRef ]

Click here to enlarge figure

VariableSearch Strings
Training load and/or competition load“load *” OR “workload *” OR “train *” OR “compet *” OR “recovery” OR “volume *” OR “intensit *” OR “duration *” OR “stress *” OR “congestion” OR “saturation” OR “distance” OR “exposure *” OR “hours” OR “days” OR “weeks” OR “jump *” OR “psychosocial *” OR “travel” OR “acute:chronic load ratio” OR “acute: chronic workload ratio” OR “ACWR” OR “exponentially weighted moving average” OR “EWMA” OR “perception of effort” OR “rating of perceived exertion” OR “RPE”
ArticlesParticipantsInjury DefinitionInternal LoadExternal LoadSummary of Findings
Anderson et al. [ ]
Prospective
USA
1 season
n = 12
NCAA D3
All female
Age 18–22
An injury was defined as a circumstance in which the athlete received an evaluation from the team’s student athletic trainer and ATC and required limiting their practice for at least 1 day NilA moderately positive correlation was found between weekly injuries and total weekly training load (p ≤ 0.01; r = 0.675) and between strain and monotony (p ≤ 0.01; r = 0.668) in A Pearson Product Moment correlation
Gianoudis et al. [ ]
Prospective
Australia
1 season
n = 46
28 males
18 females
High school
Mean age 16.0
An injury was defined as an incident related to physical activity, that resulted in either time lost from athletic participation, medical diagnosis and treatment, or the presence of pain or discomfortNil No significant differences were found in the average weekly participation hours of physical activity of injured and uninjured players in independent t test (p = 0.67)
Caparrós et al. [ ]
Retrospective
Spain
7 seasons
n = 44
F.C. Barcelona
No gender information
Age 27.6 ± 4.1
Time-loss injury: any injury occurring during a practice season or matches that caused an absence for at least the next practice session or matchNil A strong positive correlation between exposure (total number of practices and hours of exposure) and the total number of injuries in Pearson’s correlation (r = 0.77; p = 0.04)
Weiss et al. [ ]
Prospective
Australia
1 season
n = 13
Australia New Zealand Basketball League
All male
Age 24.4 ± 4.7
Self-reported injury: Oslo Sports Trauma Research Center Injury Questionnaire NilProportions of injured squad members at workload ratios between 1.0–1.49 were substantially less than those observed at all other ratios by clear small to moderate amounts. Workload ratios ≤ 0.5, between 0.5–0.99, and ≥1.5 resulted in 1.5, 1.4, and 1.7 times more injured players, respectively. Comparisons between all other workload ratio ranges were trivial-to-small in magnitude and unclear, using the 90% CI to determine the significance
Caparrós et al. [ ]
Retrospective
Spain
3 seasons
n = 33
Professional team
All male
Age 24.9 ± 2.9
Time-loss injury: any injury (contact and non-contact) occurring during a practice session or game that caused an absence for at least the next practice session or competitionNil A significant higher risk of injury during games were found in athletes with ≤3 decelerations with 2 m/s (IRR, 4.36; 95% CI, 1.78–10.6) and those running ≤ 1.3 miles (lower workload) (IRR, 6.42; 95% CI, 2.52–16.3) (p < 0.01 in both cases)
Piedra et al. [ ]
Prospective
Spain
1 season
n = 11
Women’s league 1
All female
Age 23.36 ± 2.99
Muscular pain/injuries required attention of the team physiotherapist/time-loss injury: any injury that occurred during training or a game and that led to the absence for at least the following session or game Several significant differences were observed between the injury risk values and the morning RPE (F = 5.0811; p = 0.032), the sRPE of the morning practices (F = 7.3585; p = 0.010) and the total time of exposure (F = 3.5055; p = 0.064) in the one-way ANOVA test. Significant negative relationship was observed between total training time and the number of time-loss injuries (rho = −0.797; p = 0.003) in the Spearman Rho test, as well as a possible association was observed between exposure time and a lower risk of time-loss injury (R = 0.645) in lineal regression analysis
Watson et al. [ ]
Prospective
USA
2 seasons
n = 19
NCAA D1
All male
No age information
Time-loss injury: recorded by the team athletic trainer NilIn the initial prediction models that were conducted separately, several factors were found to be significantly predictive of in-season injury. These factors included mood, fatigue, stress, soreness, and sleep duration (p < 0.001 for all), with odds ratios ranging from 0.41 to 0.57. However, in the subsequent multivariable models, only sleep duration and soreness remained significant, independent predictors, with odds ratios ranging from 0.52 to 0.69 and 0.65, respectively (p < 0.001 and p = 0.024, respectively). Mood, fatigue, and stress were no longer significant predictors, with odds ratios ranging from 1.1 to 1.2 and p values ranging from 0.43 to 0.69.
Benson et al. [ ]
Prospective
Canada
1 season
n = 49
25 males
24 females
High school teams in Calgary, AB
Age 16.5 ± 0.6
Medical attention/time-loss injury: any physical complaint, including pain, ache, joint instability, stiffness, or any other complaint resulting from participating in basketball-related activities A low workload accumulation over 3 and 4 weeks coupled with a high 1-week workload could contribute to injury risk
Doeven et al. [ ]
Prospective
Netherlands
1 season
n = 16
Dutch Basketball League
All male
Age 24.8 ± 2.0
Self-reported injury: Oslo Sports Trauma Research Center Questionnaire No significant differences for severity scores and time loss were observed between short-term match congestion and regular competition
Ferioli et al. [ ]
Prospective
Italy
2 seasons
n = 35
Italian Basketball League (D1-D3)
All male
Age 24 ± 6
Time-loss injury (non-contact injuries only): when a player was unable to fully take part in future
basketball training or match due to physical complaints
The study did not find any significant associations between the load markers and non-contact injuries (all p > 0.05). Additionally, the load markers exhibited no ability to predict injuries, as evidenced by the low Area Under the Curve (AUC) range of 0.468 to 0.537 and Youden index range of 0.019 to 0.132.
Garcia et al. [ ]
Prospective
Spain
1 season
n = 8
Pardinyes competed in the “Leb plata” category
All male
Age 23.5 ± 2.56
A time-loss injury in basketball refers to a physical ailment sustained by a player during a match or training, caused by excessive transfer of energy that surpasses the body’s ability to maintain its structural and/or functional integrity. Such injuries result in the player being unable to fully participate in future basketball training or match play. A directly proportional but statistically non-significant relationship was observed in the connection between microtrauma injuries and RPE (F = 3.492; p = 0.112), but there is a directly proportional and statistically significant association between the team’s RPE and the one perceived by the coach (r = 0.775; p < 0.001)
Orringer & Pandya [ ]
Retrospective
USA
3 seasons
n = 34
NBA
All male
Age 26.6 ± 4.89
Significant in-game injury leading to missing at least 10 consecutive games from (accessed on 21 July 2021)Nil A higher number of minutes played per game in the three (4.9% increase, p = 0.04), five (5.8% increase, p = 0.004), and ten (4.0% increase, p = 0.02) games prior to the injury were significantly associated with a greater likelihood of injury occurrence.
Seibel et al. [ ]
Prospective
USA
1 season
n = 16
NCAA D1
All female
No age information
Injury data were extracted from medical injury reports generated as injuries occurred The study found that rapid eye movement (REM) sleep was the most significant contributor to injuries, with a 0.11 correlation coefficient for CORR, 2.7% for XGB, and 12.9% for RFC models. Additionally, low (<20%) and high (>30%) percentages of REM sleep increase the likelihood of injury. The partial dependence plots (PDPs) indicated that sleep disturbances increase when the respiratory rate falls outside the typical range of 12–18 repetitions per minute. Consequently, this increases the risk of injury.
Menon et al. [ ]
Retrospective
USA
5 seasons
n = 196
NBA
All male
No age information
Season-ending injuries (SEIs) from Pro Sports Transactions: any injury that resulted in failure to return at least 5 games before the end of the team’s game scheduleNil A SEIs was significantly associated with minutes per game (odds ratio, 1.06, 95% confidence interval, 1.04–1.08, p < 0.001)
StudyNOS ScoreLevel of Evidence
SelectionComparabilityOutcomeTotal Scores
Anderson et al. (2003) [ ]3126G1
Gianoudis et al. (2008) [ ]2024P0
Caparrós et al. (2016) [ ]4127G1
Weiss et al. (2017) [ ]3115P1
Caparrós et al. (2018) [ ]3137G1
Piedra et al. (2020) [ ]4127G1
Watson et al. (2020) [ ]3238G2
Benson et al. (2021) [ ]3238G2
Doeven et al. (2021) [ ]3115P1
Ferioli et al. (2021) [ ]3137G1
Garcia et al. (2022) [ ]3115P1
Orringer and Pandya (2022) [ ]3137G1
Senbel et al. (2022) [ ]3238G2
Menon et al. (2024) [ ]3126G1
Median (range)3 (2–4)1 (0–2)2 (1–3)6 (4–8)1 (0–2)
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

Chan, C.-C.; Yung, P.S.-H.; Mok, K.-M. The Relationship between Training Load and Injury Risk in Basketball: A Systematic Review. Healthcare 2024 , 12 , 1829. https://doi.org/10.3390/healthcare12181829

Chan C-C, Yung PS-H, Mok K-M. The Relationship between Training Load and Injury Risk in Basketball: A Systematic Review. Healthcare . 2024; 12(18):1829. https://doi.org/10.3390/healthcare12181829

Chan, Chi-Chung, Patrick Shu-Hang Yung, and Kam-Ming Mok. 2024. "The Relationship between Training Load and Injury Risk in Basketball: A Systematic Review" Healthcare 12, no. 18: 1829. https://doi.org/10.3390/healthcare12181829

Article Metrics

Article access statistics, further information, mdpi initiatives, follow mdpi.

MDPI

Subscribe to receive issue release notifications and newsletters from MDPI journals

  • Open access
  • Published: 17 September 2024

Mapping health-related quality of life of children and families receiving pediatric invasive home mechanical ventilation: a scoping review protocol

  • Keisha White Makinde   ORCID: orcid.org/0000-0003-2643-1303 1 ,
  • Maysara Mitchell 1 ,
  • Alexandra F. Merz 1 &
  • Michael Youssef 1  

Systematic Reviews volume  13 , Article number:  236 ( 2024 ) Cite this article

Metrics details

Children utilizing invasive home mechanical ventilation (administered via tracheostomy tube) receive intensive care at home without the support of trained staff typically present in an intensive care unit; within the context of worsening home nursing shortages, much of the 24/7 care burden falls to families which are likely under supported. Prior reviews have explored the quality of life of children receiving various forms of mechanical ventilation, without addressing the impact on the family. Additionally, the literature inconsistently differentiates the unique experience of families with children using invasive home mechanical ventilation from non-invasive, which has lower morbidity and mortality and requires less nursing care in the home. Therefore, our study aims to explore and map the existing literature regarding the impact of invasive home mechanical ventilation on the child and family’s quality of life. Identified gaps will inform future research focused on improving the family quality of life of children with invasive home mechanical ventilation.

Five databases will be searched using keywords and controlled vocabulary to identify relevant studies: Ovid Medline, Embase, Scopus, and Cochrane Library. English language studies will meet inclusion criteria if they include primary research studies of children or families of children utilizing invasive home mechanical ventilation at home and assess quality of life. Children and young adults aged 0–25 years will be included. We exclude studies of hospitalized children, studies focused solely on healthcare professional experiences or clinical outcomes, and those focused on the period surrounding discharge from admission for tracheostomy placement. Two independent reviewers will screen studies at the title/abstract and full-text levels. Two independent reviewers will extract data from relevant studies. Disagreements will be resolved by an independent third reviewer. A targeted grey literature search will be performed utilizing ProQuest, clinicaltrials.gov, WHO trial registry, Google Scholar, and professional societies. Findings will be presented in tables and figures along with a narrative summary.

This scoping review seeks to map the literature and provide a descriptive report of the health-related quality of life of children using invasive home mechanical ventilation and their families.

Registration

Open Science Framework https://doi.org/10.17605/OSF.IO/6GB84

Date of Registration: November 29, 2023.

Peer Review reports

The number of children with medical complexity who utilize medical technology is growing [ 1 , 2 , 3 ]. This has resulted in increased survival and longer lifespan [ 4 , 5 ]—two quality metrics frequently used to assess the quality of healthcare received. Yet, stakeholders, payors, and patient advocates have highlighted the importance of quality of life as a critical metric that should also be used to determine the success or failure of a healthcare intervention [ 6 , 7 , 8 ]. Despite this, there has been a lag in the collection of quality of life indicators and integration into metrics for high-quality healthcare, particularly for new pediatric technologies [ 7 , 9 ]. This scoping review protocol focuses on quality of life in regards to a medical technology which provides the highest level of medical life support available in the home setting—pediatric invasive home mechanical ventilation (HMV).

Home mechanical ventilation is a vital intervention for children experiencing chronic respiratory failure, promoting respiratory stability and enhanced longevity in the comfort of a child’s home. HMV has the potential to benefit children with respiratory conditions by improving alveolar ventilation, alleviating symptoms associated with chronic respiratory failure, improving blood gases, reducing morbidity and mortality, and enhancing the child’s quality of life [ 10 ]. HMV can be administered either invasively or noninvasively. Non-invasive HMV (for instance bilevel positive airway pressure (BIPAP)) provides a lower amount of breathing support and is administered via mask. Conversely, invasive ventilation provides a much higher amount of breathing support and is administered via a surgically placed tracheostomy tube which connects to the breathing machine. Originally conceived for pediatric patients with isolated spinal injury or neuromuscular conditions 11, over time the use of invasive HMV has expanded to treat children with more complex diseases and multiple comorbidities. Typical pediatric patients utilizing invasive HMV may have primary lung diseases such as chronic lung disease of prematurity [ 12 , 13 ], underlying genetic conditions such as congenital central hypoventilation syndrome [ 14 ], and cardiopulmonary disease [ 4 , 13 , 15 ]. Invasive HMV is associated with a higher risk for morbidity, frequent and high acuity readmission, and higher mortality compared with non-invasive ventilation [ 4 , 16 ]. Any sudden loss of tracheostomy patency (e.g., mucus plug, accidental tracheostomy decannulation) or loss of ventilator function (e.g., loss of power in the home, unaddressed ventilator alarms) would be imminently life threatening. Due to the tenuousness of maintaining a patent airway, the American Thoracic Society guidelines recommends that optimal care for children with invasive home mechanical ventilation requires 24/7 hands-on nursing care in the home, two trained family caregivers living in the child’s household, along with monitoring equipment and regular multidisciplinary clinic visits [ 8 ]. In reality, the extensive and unrelenting nursing shortages throughout the country [ 17 , 18 ] mean that much of the in-home care falls to parents and families creating a significant burden for which they are underprepared.

Parents of children who utilize HMV are expected to provide extensive and ongoing care for their child—administering medications, managing medical emergencies that may arise, and calling off from work when home nursing services are inaccessible. There are few studies that examine the impacts on the family for children with invasive HMV [ 19 , 20 ]. On preliminary search, available studies focus on the parent [ 19 , 21 ] with little information on siblings or how the family’s functioning is impacted. Studies of HMV (including both invasive and non-invasive) highlight that a parent’s assumption of the primary caregiver role for their ventilator-dependent child can exacerbate financial burdens [ 9 , 10 ], sleep deprivation [ 10 ], and anxiety, impacting the overall family quality of life [ 11 ]. Chan et al. and Wang and Barnard interviewed parents of children who utilize ventilators at home and expose the significant strain on personal and romantic relationships, lack of friends and supports, frequent needs to transition between parent and caregiver, and constant worry that the child might suddenly die [ 22 , 23 ]. Further complicating the situation, nearly half of parents of children with any medical technology use (ranging from nebulizers and glucose monitors to ventilators) endorse having a need for respite care within the past year, yet only half of those needing respite had their needs met, often due to lack of availability or cost [ 24 ]. Considering these are the lived experiences of families of mostly children with non-invasive ventilation, it is imperative to understand more about the family quality of life of children utilizing invasive home mechanical ventilation given its increased demands for nursing, family caregiving, and higher morbidity and mortality.

Health-related quality of life (HRQOL) is a multidimensional concept described by many scholars which can be thought of as an individual’s outlook or perspective on life and its resultant satisfaction (or dissatisfaction) given the presence of a medical condition. This perspective is grounded in the context of the individual’s culture and value systems which are related to their goals, expectations, and concerns [ 25 ]. For the purpose of this review, we focus on the health-related quality of life of children, adolescents, and young adults with invasive home mechanical ventilation. For this protocol, we focus on the following domains [ 26 , 27 ]: (1) physical functioning, (2) psychological functioning, (3) social functioning, (4) cognitive functioning, and (5) general well-being.

We use the theory of health-related family quality of life (HRFQOL) as coined by Radina et al. [ 28 ] as the unifying theory for this review; the theory (see Fig.  1 ) defines HRFQOL as the intersection between the patient’s health-related quality of life and the family’s quality of life. Health-related family quality of life (HRFQOL) comprises 3 concepts: emotional closeness, family sense of coherence, and family functioning (see Fig.  2 ). For this review, we focus on the concepts and sub-concepts delineated by Radina et al. (see Fig.  2 ).

figure 1

Diagram of domains of quality of life

figure 2

Conceptual model of the theory of health-related family quality of life

Family can have many definitions. For the purposes of this review, we draw upon the definition of family quality of life offered by Park et al. as “people who think of themselves as part of the family, whether related by blood or marriage or not, and who support and care for each other on a regular basis” [ 29 ].

Tracheostomy is a surgical airway management procedure whereby an incision is made in the trachea to divert the passage of air for breathing. Tracheostomy is used interchangeably with tracheotomy for the purposes of this review. Patients with a tracheostomy may breathe independently or with assistance of a ventilator. For this review, we focus on patients with tracheostomy who utilize mechanical ventilation.

Mechanical ventilation is a type of assisted breathing whereby a medical device (i.e., ventilator) is used to fully or partially provide artificial ventilation. Practically, the support can be positive pressure ventilation (pressure-supported ventilation or bilevel positive airway pressure (BiPAP) or continuous positive airway pressure (CPAP). For this review, we focus on any level of mechanical ventilation that is administered through a tracheostomy. Patients with isolated oxygen use without ventilator support will be excluded. Invasive mechanical ventilation refers to ventilation delivered through a breathing tube—an endotracheal tube or tracheostomy tube. For the purpose of this review, we focus solely on invasive mechanical ventilation delivered via tracheostomy tube.

We define home as a location where the patient primarily lives with family. We exclude long-term care facilities in the definition of home for this study.

A preliminary search of PROSPERO, MEDLINE, the Cochrane Database of Systematic Reviews, and JBI Evidence Synthesis was conducted, and no current or in-progress scoping reviews or systematic reviews on this specific topic of interest. Mattson et al. [ 30 ] recently published a scoping review focused on quality of life of children with home mechanical ventilation; although informative, this review does not differentiate the experience of children living with invasive mechanical ventilation and their families. Our scoping review differs in two key ways. First, we focus on the family’s quality of life instead of the child’s quality of life. Secondly, we spotlight the experiences of children with invasive home mechanical ventilation, given their increased medically fragility, requisite home nursing needs, and higher risk of morbidity and mortality. Additionally, our review is strengthened by the use of a framework definition of health-related family quality of life from Radina et al. [ 28 ]which extends our focus beyond the challenges faced by parents to include the impact on the entire family unity, including siblings and extended family. By utilizing this approach and definition, we have preliminarily identified additional studies meeting our criteria which were not included in the review conducted by Mattson and colleagues, underscoring the differences in our search and screening approaches.

The existing literature predominantly focuses on mortality rates and medical outcomes of children utilizing HMV, with limited attention to the vital issue of family quality of life; though it is significantly impacted when intensive medical care is introduced in the home environment [ 31 ]. In addition to the few studies available, even fewer focus on family-level quality of life indicators or experiences of families with medically complex children. While previous scoping reviews have explored these concepts separately, no scoping review has reviewed both the health-related quality of life of the pediatric patient as well as the family quality of life of the overall family unit. Additionally, we aim to provide an updated overview of the literature, given the most recent scoping reviews assessed studies through 2020 [ 30 , 32 ].

The primary objective of this scoping review is to comprehensively map the existing literature on pediatric invasive mechanical ventilation in the home environment to understand the child’s health-related quality of life (HRQOL) and the health-related family quality of life (HRFQOL).

Authors will utilize the JBI Manual for Evidence Synthesis Chapter 11 entitled “Scoping Reviews” as a guideline for rigorous procedures [ 33 ]. Authors will utilize the Preferred Reporting Items for Systematic Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) as a guideline for reporting the findings of the scoping review [ 34 ].

This review will consider primary studies that include pediatric patients (0–25 years) who utilize invasive HMV, as well as the experiences of their family members. Furthermore, this review will consider studies that explore (1) the relationship between pediatric invasive HMV and health-related family quality of life (HRFQOL), (2) the relationship between pediatric invasive HMV and health-related quality of life (HRQOL) among children, adolescents, and young adults and their families, and (3) studies that address the experiences of children who utilize home mechanical ventilation with a tracheostomy. Studies must be published in English from 2004 to 2024 to meet inclusion criteria. This review will consider studies that explore the presence of invasive mechanical ventilation in the home environment. Studies that address the presence of invasive mechanical ventilation in the healthcare setting or within long-term care facilities will not be included. This scoping review will consider quantitative, qualitative, and mixed methods study designs for inclusion.

The search strategy will aim to locate published primary studies and grey literature, excluding reviews, and text and opinion papers. An initial limited search of the literature was undertaken by the medical librarian to identify studies on the topic. The text words contained in the titles and abstracts of relevant studies, and the index terms used to describe the studies, were used to develop an initial search strategy for Embase. The search strategy, including all identified keywords and index terms, will be adapted for each included information source. The initial search strategy will be piloted and adapted in partnership with the medical librarian to develop the final search strategy (see Appendix 1). Studies published in an English publication between 2004 and 2024 will be included. The databases to be searched include Ovid Medline 1946-, Embase.com 1947-, Scopus 1823-, and Cochrane Library 1996-.

Following the search, all identified records will be collated and uploaded into Endnote v.21 (Clarivate Analytics, PA, USA) and Covidence (Veritas Health Innovation, Melbourne, Australia), and duplicates removed. Covidence will be used to screen and manage the results of the scoping review to optimize collaboration and thoroughness among the research team. Pilot testing of source selection will be conducted prior to screening. The primary investigator will select a random sample ( n  = 20) of studies, which will be independently reviewed by all reviewers. Reviewers will screen the titles and abstracts using the inclusion and exclusion criteria provided in Covidence. After all pilot studies have been reviewed, reviewers will meet to discuss inter-rater reliability. If reliability is > 75%, reviewers will proceed with Screening. If reliability does not reach 75%, reviewers will have an in-depth discussion regarding discrepancies. Inclusion and exclusion criteria will be modified to meet newly shared understanding. Then reviewers will separately pilot the revised criteria. The formal screening will proceed once 75% agreement is reached.

During screening, titles and abstracts will be assessed by 2 independent reviewers against the inclusion criteria. Reviewers 1 and 2 will independently assess the title and abstract of each article using Covidence’s title and abstract screening feature. If there is disagreement among Reviewers 1 and 2, Reviewer 3—the primary investigator—will review the title and abstract to make the final determination on the article’s eligibility. To ensure fidelity to protocol, the primary investigator will provide oversight and review a random selection of screenings completed by Reviewers 1 and 2 to confirm adherence to review protocol. Potentially relevant papers will be retrieved in full and imported into Covidence.

During full-text review, the full text of selected citations will be assessed in detail against the inclusion criteria by 2 independent reviewers. Reasons for exclusion of full-text papers that do not meet the inclusion criteria will be recorded and reported in Covidence. Any disagreements that arise between the reviewers at each stage of the selection process will be resolved through discussion or with a third reviewer. The results of the search will be reported in full in the final scoping review and presented in a PRISMA flow diagram [ 21 ]. To ensure fidelity to protocol, the primary investigator will provide oversight and review a random selection of full texts completed by Reviewers 1 and 2 to confirm adherence to review protocol.

Several sources will be used to inform the grey literature search, which will be an adaptation of methods described by Godin et al. 35 . Utilizing keywords identified previously, we will search ProQuest Dissertations & Theses, National Library of Medicine clinical trials registry (clinicaltrials.gov), World Health Organization International Clinical Trials Registry Platform (trialsearch.who.int), Google Scholar, and relevant professional societies to identify clinical guidelines, dissertations and thesis, reports, and other findings from organizations that fit the inclusion criteria for this scoping review. The intention remains to identify and map the scientific literature and consensus statements from reputable sources while excluding sources with individualistic viewpoints, such as social media and blog postings.

Prior to the start of data extraction, the data extraction instrument will be pilot tested on 3 sources to ensure all relevant results are consistently extracted. Each reviewer will read the pilot studies and extract data using the extraction instrument in Covidence. Team members will then meet to discuss discrepancies, offer clarification, and make any modifications to the extraction instrument. Extraction will begin once consensus on the extraction instrument is reached.

Data will be extracted from papers included in the scoping review by 2 independent reviewers using a data extraction tool developed by the reviewers (see Appendix 2). The data extracted will include specific details about the population, concept, context, methods, and key findings, relevant to the review question. A draft extraction tool is provided (see Appendix 2). The draft data extraction tool will be modified and revised as necessary during the process of extracting data from each included paper. Modifications will be detailed in the full scoping review. Any disagreements that arise between the reviewers will be resolved through discussion or with a third reviewer. Authors of papers will be contacted to request missing or additional data, where required.

We will first present a flow diagram of our scoping review methodology including the study selection process. Extracted data will be analyzed using figures and tables, frequency counts of concepts, populations, and study characteristics. Then, we will utilize a table to present an overview of study characteristics including year, country, participant characteristics, and methodology. Lastly, we will present in a table an overview of themes and concepts elicited in the included studies.

This scoping review has begun and is in the data selection phase at submission. Inclusion and exclusion criteria were revised following screening. Notably, we exclude conference abstracts; although these are often published in peer-reviewed journals, they many times do not include thorough details of the data and results to allow us to extract findings with confidence that they represent the true and full findings of the primary research. Additionally, conference abstracts often presented preliminary results which may have changed following the abstract acceptance. We conducted a search using the abstract first author to determine if a manuscript was available; none of our conference abstracts had corresponding manuscripts and thus were excluded. We also had several clinical trial registrations returned in our search protocol; these registrations were excluded from review; however, the authors contacted the clinical trial primary investigator to ascertain if the study had concluded and if a published manuscript was available; if manuscripts become available in the process, we will add them to title/abstract screening and perform screening consistent with the full protocol.

Availability of data and materials

Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.

Abbreviations

Bilevel positive airway pressure

Continuous positive airway pressure

Health-related quality of life

Health-related family quality of life

Home mechanical ventilation

Preferred Reporting Items for Systematic Meta-Analyses extension for Scoping Reviews

Bogetz JF, Munjapara V, Henderson CM, et al. Home mechanical ventilation for children with severe neurological impairment: parents’ perspectives on clinician counselling. Dev Med Child Neurol. 2022;64(7):840–6.

PubMed   Google Scholar  

Jose D, Parameswaran N. Advances in management of respiratory failure in children. Indian J Pediatr. 2023;90(5):470–80. https://doi.org/10.1007/s12098-023-04559-z .

Chen IL, Chen HL. New developments in neonatal respiratory management. Pediatr Neonatol. 2022;63(4):341–7. https://doi.org/10.1016/j.pedneo.2022.02.002 .

Amin R, Verma R, Bai YQ, et al. Incidence and mortality of children receiving home mechanical ventilation. Pediatrics. 2023;151(4): e2022059898. https://doi.org/10.1542/peds.2022-059898 .

Van Den Oudenrijn LV: G M: Veldhoen, E. Forty years of home mechanical ventilation in children. Eur Resp J. 2019;54. https://doi.org/10.1183/13993003.congress-2019.PA699

World Health Organization Programme on Mental Health. WHOQOL User Manual . Division of mental health and prevention of substance abuse; 1998. Accessed July 15, 2024. https://www.who.int/toolkits/whoqol

Gettel CJ, Suter LG, Bagshaw K, et al. Patient-reported outcome-based performance measures in alternative payment models: current use, implementation barriers, and principles to succeed. Value in Health. 2024;27(2):199–205. https://doi.org/10.1016/j.jval.2023.10.017 .

Sterni LM, Collaco JM, Baker CD, et al. An official American Thoracic Society clinical practice guideline: pediatric chronic home invasive ventilation. Am J Respir Crit Care Med. 2016;193(8):e16–35. https://doi.org/10.1164/rccm.201602-0276ST .

PubMed   PubMed Central   Google Scholar  

Coleman CL, Morrison M, Perkins SK, Brosco JP, Schor EL. Quality of life and well-being for children and youth with special health care needs and their families: a vision for the future. Pediatrics. 2022;149(Supplement 7):e2021056150G. https://doi.org/10.1542/peds.2021-056150G .

Kwak S. Home mechanical ventilation in children with chronic respiratory failure: a narrative review. J Yeungnam Med Sci. 2023;40(2):123–35. https://doi.org/10.12701/jyms.2022.00227 .

Frates RC, Splaingard ML, Smith EO, Harrison GM. Outcome of home mechanical ventilation in children. J Pediatr. 1985;106(5):850–6. https://doi.org/10.1016/S0022-3476(85)80372-3 .

Upadhyay K, Vallarino DA, Talati AJ. Outcomes of neonates with tracheostomy secondary to bronchopulmonary dysplasia. BMC Pediatr. 2020;20(1):414. https://doi.org/10.1186/s12887-020-02324-1 .

Akangire G, Taylor JB, McAnany S, et al. Respiratory, growth, and survival outcomes of infants with tracheostomy and ventilator dependence. Pediatr Res. 2021;90(2):381–9. https://doi.org/10.1038/s41390-020-01183-x .

Evers-Bikker EE, de Weerd W, Wijkstra PJ, Corel L, Verweij LP, Vosse B a. H. Characteristics and outcomes in children with congenital central hypoventilation syndrome on long-term mechanical ventilation in the Netherlands. Eur J Pediatr. Published online November 25, 2023. https://doi.org/10.1007/s00431-023-05339-9

Edwards JD, Kun SS, Keens TG. Outcomes and causes of death in children on home mechanical ventilation via tracheostomy: an institutional and literature review. J Pediatr. 2010;157(6):955-959.e2. https://doi.org/10.1016/j.jpeds.2010.06.012 .

Amin RS, Fitton CM. Tracheostomy and home ventilation in children. Semin Neonatol. 2003;8(2):127–35. https://doi.org/10.1016/S1084-2756(02)00220-8 .

Zhavoronka M, Custer B, Neal A, Schweitzer J, Bombardieri M. How to ease the nursing shortage in America .; 2022. Accessed August 6, 2023. https://www.americanprogress.org/article/how-to-ease-the-nursing-shortage-in-america/

National Conference of State Legislatures. Addressing nursing shortages: options for states .; 2022. Accessed August 6, 2023. https://www.ncsl.org/health/addressing-nursing-shortages-options-for-states

Ozcan G, Zirek F, Tekin MN, et al. Psychosocial factors affecting the quality of life of parents who have children with home mechanical ventilation. Pediatr Pulmonol. Published online December 13, 2023. https://doi.org/10.1002/ppul.26799

Vo HH, Mercer AH, Jabre NA, Henderson CM, Boss RD, Wilfond BS. Parent perspectives on the child experience of pediatric home ventilation via tracheostomy. Hosp Pediatr. 2023;13(12):1124–33. https://doi.org/10.1542/hpeds.2023-007217 .

Israelsson-Skogsberg Å, Persson C, Markström A, Hedén L. Children with home mechanical ventilation-parents’ health-related quality of life, family functioning and sleep. Acta Paediatr. 2020;109(9):1807–14. https://doi.org/10.1111/apa.15177 .

Chan YH, Lim CZR, Bautista D, Malhotra R, Østbye T. The health and well-being of caregivers of technologically dependent children. Glob Pediatr Health. 2019;6:2333794X18823000. https://doi.org/10.1177/2333794X18823000 .

Wang KWK, Barnard A. Caregivers’ experiences at home with a ventilator-dependent child. Qual Health Res. 2008;18(4):501–8. https://doi.org/10.1177/1049732307306185 .

Sobotka SA, Lynch E, Quinn MT, Awadalla SS, Agrawal RK, Peek ME. Unmet respite needs of children with medical technology dependence. Clin Pediatr (Phila). 2019;58(11–12):1175–86. https://doi.org/10.1177/0009922819870251 .

WHOQOL - Measuring Quality of Life| The World Health Organization. Accessed November 13, 2023. https://www.who.int/tools/whoqol

Revicki D. Health-related quality of life in the evaluation of medical therapy for chronic illness. J Fam Pract. 1989;29(4). Accessed November 13, 2023. https://www.mdedge.com/familymedicine/article/179863/health-related-quality-life-evaluation-medical-therapy-chronic-illness

Quittner AL, Romero SL, Kimberg CI, Blackwell LS, Cruz I. Chronic Illness. In: Brown BB, Prinstein MJ, eds. Encyclopedia of adolescence. Academic Press; 2011:91–99. https://doi.org/10.1016/B978-0-12-373951-3.00105-8

Radina ME. Toward a theory of health-related family quality of life. J Fam Theory Rev. 2013;5(1):35–50. https://doi.org/10.1111/jftr.12001 .

Google Scholar  

Park J, Hoffman L, Marquis J, et al. Toward assessing family outcomes of service delivery: validation of a family quality of life survey. J Intellect Disabil Res. 2003;47(4–5):367–84. https://doi.org/10.1046/j.1365-2788.2003.00497.x .

CAS   PubMed   Google Scholar  

Mattson J, Lunnelie J, Löfholm T, Andersson ES, Aune RE, Björling G. Quality of life in children with home mechanical ventilation - a scoping review. SAGE Open Nursing. 2022;8:1–12.

Seear M, Kapur A, Wensley D, Morrison K, Behroozi A. The quality of life of home-ventilated children and their primary caregivers plus the associated social and economic burdens: a prospective study. Arch Dis Child. 2016;101(7):620–7. https://doi.org/10.1136/archdischild-2015-309796 .

Falkson S, Knecht C, Hellmers C, Metzing S. The perspective of families with a ventilator-dependent child at home. A literature review J Pediatric Nursing. 2017;36:213–24. https://doi.org/10.1016/j.pedn.2017.06.021 .

JBI Manual for evidence synthesis. JBI. 2020. https://doi.org/10.46658/JBIMES-20-01 .

Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–73. https://doi.org/10.7326/M18-0850 .

Godin K, Stapleton J, Kirkpatrick SI, Hanning RM, Leatherdale ST. Applying systematic review search methods to the grey literature: a case study examining guidelines for school-based breakfast programs in Canada. Syst Rev. 2015;4:138. https://doi.org/10.1186/s13643-015-0125-0 .

Download references

Acknowledgements

Not applicable.

Author information

Authors and affiliations.

Washington University in St. Louis School of Medicine, 660 South Euclid Avenue, MSC 8116-0043-08, Saint Louis, MO 63110-1010, USA

Keisha White Makinde, Maysara Mitchell, Alexandra F. Merz & Michael Youssef

You can also search for this author in PubMed   Google Scholar

Contributions

Keisha White Makinde participated in the conception and design of this protocol, drafting and revision of manuscript, and approval of final version. Maysara Mitchell participated in the conception and design of this protocol, drafting and revision of manuscript, and approval of final version. Alexandra Merz participated in the design of this protocol, revision of manuscript, and approval of final version. Michael Youssef participated in the design of this protocol, revision of manuscript, and approval of final version.

Authors’ information

Dr. KWM is a pediatric hospice and palliative medicine physician-scientist interested in understanding racial and ethnic health disparities and promoting health equity in patients facing serious illness. Dr. KWM has extensive educational background focused on the biopsychosocial experiences of individuals with illness, including a bachelor’s degree in Sociology and Medicine, Health, and Society and Master of Public Health. As an attending physician, Dr. KWM cares for children with serious illness including children who utilize home mechanical ventilation seen at St. Louis Children’s Hospital with a focus on interdisciplinary, family-centered, holistic care.

Corresponding author

Correspondence to Keisha White Makinde .

Ethics declarations

Ethics approval and consent to participate.

Not applicable, no human subjects.

Consent for publication

Competing interests.

The authors declare that they have no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix 1 Search strategy

Search conducted on March 8, 2024.

Search

Query

Records retrieved

#1

“adolescence”/exp OR “child”/exp OR “preschool child”/exp OR “adolescent”/exp OR “pediatrics”/exp OR “juvenile”/exp OR “child”:ti,ab OR “children”:ti,ab OR “preschool child”:ti,ab OR “preschooler”:ti,ab OR “adolescent”:ti,ab OR “teenager”:ti,ab OR “teenagers”:ti,ab OR “teen”:ti,ab OR “teens”:ti,ab OR “teenage”:ti,ab OR “juvenile”:ti,ab OR “juveniles”:ti,ab OR “youth”:ti,ab OR “youths”:ti,ab OR “paediatric care”:ti,ab OR “paediatrics”:ti,ab OR “pediatric care”:ti,ab OR “pediatrics”:ti,ab OR babies:ti,ab OR baby:ti,ab OR boy:ti,ab OR boys:ti,ab OR girl:ti,ab OR girls:ti,ab OR infant:ti,ab OR infants:ti,ab OR kid:ti,ab OR kids:ti,ab OR newborn:ti,ab OR newborns:ti,ab OR pubescent:ti,ab OR “school child”:ti,ab OR “school children”:ti,ab OR schoolchild:ti,ab OR schoolchildren:ti,ab OR toddler:ti,ab OR toddlers:ti,ab

AND

“home”/exp OR “home”:ti,ab OR “transitional home”:ti,ab OR “household”/exp OR “domestic unit”:ti,ab OR “household”:ti,ab

AND

(“invasive ventilation”/exp OR “artificial ventilation”/exp OR “mechanical ventilator”/exp OR “invasive mechanical ventilation”:ti,ab OR “home invasive mechanical ventilation”:ti,ab OR “invasive home mechanical ventilation”:ti,ab OR “invasive respiratory support”:ti,ab OR “invasive ventilation”:ti,ab OR “invasive ventilatory support”:ti,ab OR “artificial respiration”:ti,ab OR “artificial respiratory support”:ti,ab OR “artificial ventilation”:ti,ab OR “artificial ventilatory support”:ti,ab OR “controlled respiration”:ti,ab OR “controlled ventilation”:ti,ab OR “mechanical respiration”:ti,ab OR “mechanical ventilation”:ti,ab OR “home mechanical ventilation”:ti,ab OR “home mechanical ventilator”:ti,ab OR “bt-v2s”:ti,ab OR “elisee 150”:ti,ab OR “life2000”:ti,ab OR “plv-100”:ti,ab OR “respironics v60”:ti,ab OR “servo-air”:ti,ab OR “servo-air niv”:ti,ab OR “servo-i”:ti,ab OR “servo-n”:ti,ab OR “servo-s”:ti,ab OR “servo-u mr”:ti,ab OR “tangens 2c”:ti,ab OR “trilogy 100”:ti,ab OR “mechanical ventilator”:ti,ab OR “mechanical ventilators”:ti,ab) OR (“tracheostomy”/exp OR “open surgical tracheostomy”:ti,ab OR “open tracheostomy”:ti,ab OR “tracheostomy”:ti,ab OR “tracheotomy”:ti,ab OR tracheotomies:ti,ab)

AND

“quality of life”/exp OR “happiness”/exp OR “wellbeing”/exp OR “family conflict”/exp OR “family support”/exp OR “sibling relation”/exp OR “child parent relation”/exp OR “happiness”:ti,ab OR “well being”:ti,ab OR “wellbeing”:ti,ab OR “wellness”:ti,ab OR “family conflict”:ti,ab OR “family conflicts”:ti,ab OR “interparental conflict”:ti,ab OR “interparental conflicts”:ti,ab OR “marital conflict”:ti,ab OR “marital conflicts”:ti,ab OR “parent child conflict”:ti,ab OR “parent child conflicts”:ti,ab OR “family support”:ti,ab OR “kin support”:ti,ab OR “kinship support”:ti,ab OR “sibling relation”:ti,ab OR “sibling relations”:ti,ab OR “sibling rivalry”:ti,ab OR “child parent relation”:ti,ab OR “child parent relationship”:ti,ab OR “parent child relation”:ti,ab OR “parent child relationship”:ti,ab OR “parent infant bonding”:ti,ab OR “parent infant relation”:ti,ab OR “parent to child relation”:ti,ab OR “parent to child relationship”:ti,ab OR “parental role”:ti,ab OR “parenting”:ti,ab OR “family relations”:ti,ab OR “family relationship”:ti,ab OR “family relation”:ti,ab OR “family relationships”:ti,ab OR fqol:ti,ab OR “hrql”:ti,ab OR “health related quality of life”:ti,ab OR “life quality”:ti,ab OR “quality of life”:ti,ab OR “health related family quality of life”:ti,ab OR “health-related quality of life”:ti,ab OR “hr fqol”:ti,ab OR “family harmony”:ti,ab OR “family happiness”:ti,ab OR “family life satisfaction”:ti,ab)

409

Appendix 2 Data extraction instrument

exclusion and inclusion criteria in a literature review

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/ .

Reprints and permissions

About this article

Cite this article.

White Makinde, K., Mitchell, M., Merz, A.F. et al. Mapping health-related quality of life of children and families receiving pediatric invasive home mechanical ventilation: a scoping review protocol. Syst Rev 13 , 236 (2024). https://doi.org/10.1186/s13643-024-02658-2

Download citation

Received : 21 December 2023

Accepted : 06 September 2024

Published : 17 September 2024

DOI : https://doi.org/10.1186/s13643-024-02658-2

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Invasive mechanical ventilation
  • Quality of life

Systematic Reviews

ISSN: 2046-4053

  • Submission enquiries: Access here and click Contact Us
  • General enquiries: [email protected]

exclusion and inclusion criteria in a literature review

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • View all journals
  • Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • Published: 17 September 2024

Reporting nasal pressure injuries in neonates receiving non-invasive ventilation: a scoping review

  • Alexander E. Graf   ORCID: orcid.org/0000-0001-7749-1301 1 ,
  • Simon Bellido 2 ,
  • Chellapriya Vythinathan 3 ,
  • Jigar Govind 1 ,
  • Lawrence Fordjour 4 ,
  • Sydney C. Butts 1 &
  • Ann Woodhouse Plum 1  

Journal of Perinatology ( 2024 ) Cite this article

Metrics details

  • Physical examination
  • Risk factors
  • Signs and symptoms

Background/Objectives

Although neonates receiving Non-Invasive Ventilation (NIV) for respiratory support are at risk for nasal pressure injuries, efforts to standardize reporting are limited. A scoping review was conducted to identify the reporting systems used for describing these injuries.

Subjects/Methods

PubMed, Embase, and Web of Science were queried for papers reporting nasal injury with NIV usage in neonates. The primary outcome was reporting system usage.

705 titles and abstracts were screened. 40 papers met inclusion criteria. Most studies were Randomized Clinical Trials (37.5%) or cohort studies (37.5%). Most commonly, nasal injuries were reported using a unique, descriptive scale developed by the authors (10 studies, 25%). The Fischer et al 2010 scale, a three-stage reporting system, was used in 8 studies (20%). While 15 studies (38.0%) reported on specific anatomic subsite injury, only 2 studies (5.0%) employed endoscopy for assessment.

Conclusions

Wide heterogeneity in pressure injury reporting secondary to NIV exists across specialties, institutions, and literature.

This is a preview of subscription content, access via your institution

Access options

Subscribe to this journal

Receive 12 print issues and online access

251,40 € per year

only 20,95 € per issue

Buy this article

  • Purchase on SpringerLink
  • Instant access to full article PDF

Prices may be subject to local taxes which are calculated during checkout

exclusion and inclusion criteria in a literature review

Donda K, Vijayakanthi N, Dapaah-Siakwan F, Bhatt P, Rastogi D, Rastogi S. Trends in epidemiology and outcomes of respiratory distress syndrome in the United States. Pediatr Pulmonol. 2019;54:405–14.

Article   PubMed   Google Scholar  

Committee on Fetus and Newborn. American Academy of Pediatrics. Respiratory support in preterm infants at birth. Pediatrics. 2014;133:171–4.

Article   Google Scholar  

Manley BJ, Buckmaster AG, Travadi J, Owen LS, Roberts CT, Wright IMR, et al. Trends in the use of non-invasive respiratory support for term infants in tertiary neonatal units in Australia and New Zealand. Arch Dis Child Fetal Neonatal Ed. 2022;107:572–6.

Davis PG, Morley CJ, Owen LS. Non-invasive respiratory support of preterm neonates with respiratory distress: Continuous positive airway pressure and nasal intermittent positive pressure ventilation. Semin Fetal Neonatal Med. 2009;14:14–20.

Narendran V, Donovan EF, Hoath SB, Akinbi HT, Steichen JJ, Jobe AH. Early bubble CPAP and outcomes in ELBW preterm infants. J Perinatol. 2003;23:195–9.

Pascual A, Wielenga JM. Nasal pressure injuries among newborns caused by nasal CPAP: An incidence study. J Neonatal Nurs. 2022;29:477–81. https://doi.org/10.1016/j.jnn.2022.09.006 .

Fu Y, Li X, Yu Y, Li R, Shi T. Summary of the best evidence for the prevention of nasal injury in preterm infants with nasal noninvasive ventilation. Transl Pediatr. 2024;13:224–35.

Article   PubMed   PubMed Central   Google Scholar  

Li Y, Sepulveda A, Buchanan EP. Late presenting nasal deformities after nasal continuous positive airway pressure injury: 33-year experience. J Plast Reconstr Aesthetic Surg. 2015;68:339–43.

Newnam KM, McGrath JM, Salyer J, Estes T, Jallo N, Bass WT. A comparative effectiveness study of continuous positive airway pressure-related skin breakdown when using different nasal interfaces in the extremely low birth weight neonate. Appl Nurs Res. 2015;28:36–41.

Fischer C, Bertelle V, Hohlfeld J, Forcada-Guex M, Stadelmann-Diaw C, Tolsa JF. Nasal trauma due to continuous positive airway pressure in neonates. Arch Dis Child Fetal Neonatal Ed. 2010;95:447–51.

Black J, Baharestani MM, Cuddigan J, Dorner B, Edsberg L, Langemo D, et al. National Pressure Ulcer Advisory Panel’s updated pressure ulcer staging system. Adv Ski Wound Care. 2007;20:269–74.

Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation. Ann Intern Med. 2018;169:467–73.

Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-A web and mobile app for systematic reviews. Syst Rev. 2016;5:210.

Jatana KR, Oplatek A, Stein M, Phillips G, Kang DR, Elmaraghy CA. Effects of nasal continuous positive airway pressure and cannula use in the neonatal intensive care unit setting. Arch Otolaryngol Head Neck Surg. 2010;136:287–91.

Gökdoğan O, İleri F. Nasal complications related with cpap treatment. ENT Updat. 2018;8:133–8.

Wu Y, Lv J, Xu J, Zhang S, Zhang L, Fu L. Application of a photoelectric magnifier to nasal injury in preterm infants receiving non-invasive ventilation: A prospective observational study. J Tissue Viability. 2022;31:130–4.

Xie L. Hydrocolloid dressing in preventing nasal trauma secondary to nasal continuous positive airway pressure in preterm infants. World J Emerg Med. 2014;5:218–22.

Boyar V. Pressure injuries of the nose and columella in preterm neonates receiving noninvasive ventilation via a specialized nasal cannula: A retrospective comparison cohort study. J Wound, Ostomy Cont Nurs. 2020;47:111–6.

Imbulana DI, Owen LS, Dawson JA, Bailey JL, Davis PG, Manley BJ. A randomized controlled trial of a barrier dressing to reduce nasal injury in preterm infants receiving binasal noninvasive respiratory support. J Pediatr. 2018;201:34–39.e3.

Ribeiro DFC, Fernandes BL, Nohama P. Correlation between sterilized prongs and nasal injury in newborns subjected to non-invasive ventilation. IFMBE Proceedings, vol 75. Selected articles from: VIII Latin American Conference on Biomedical Engineering and XLII National Conference on Biomedical Engineering (CLAIB 2019). Springe, Cham. 2020;75:1410–6.

Google Scholar  

Woodhead DD, Lambert DK, Clark JM, Christensen RD. Comparing two methods of delivering high-flow gas therapy by nasal cannula following endotracheal extubation: A prospective, randomized, masked, crossover trial. J Perinatol. 2006;26:481–5.

Article   CAS   PubMed   Google Scholar  

Buettiker V, Hug MI, Baenziger O, Meyer C, Frey B. Advantages and disadvantages of different nasal CPAP systems in newborns. Intensive Care Med. 2004;30:926–30.

Ahmad S, Bhat AA, Akhthar R, Wani MA, Wani T. Nasal trauma in neonates receiving CPAP and its prevention in tertiary care hospital. J Med Sci 2017;20:96–100.

Badr LK, Zeineddine MH, Abbas H, Charafeddine L. Neoseal to prevent nasal injury in preterm infants receiving oxygen therapy. Neonatal Netw. 2016;35:228–33.

Bashir T, Murki S, Kiran S, Reddy VK, Oleti TP. Nasal mask’ in comparison with ‘nasal prongs’ or ‘rotation of nasal mask with nasal prongs’ reduce the incidence of nasal injury in preterm neonates supported on nasal continuous positive airway pressure (nCPAP): A randomized controlled trial. PLoS One. 2019;14:1–11.

Bonfim Sde F, de Vasconcelos MG, de Sousa NF, da Silva DV, Leal LP. Nasal septum injury in preterm infants using nasal prongs. Rev Lat Am Enferm. 2014;22:826–33.

Camillo DF, Barros FS, Costa TD.Nohama P, Incidence and risks associated with nasal injury in newborns undergoing non-invasive ventilation through the binasal prong. In: IFMBE Proceedings, vol 60. Selected articles from: VII Latin American Conference on Biomedical Engineering (CLAIB 2016). Cham: Springer; 2017. 60, 469–72.

Chen CY, Chou AK, Chen YL, Chou HC, Tsao PN, Hsieh WS. Quality improvement of nasal continuous positive airway pressure therapy in neonatal intensive care unit. Pediatr Neonatol. 2017;58:229–35.

Collins CL, Barfield C, Horne RSC, Davis PG. A comparison of nasal trauma in preterm infants extubated to either heated humidified high-flow nasal cannulae or nasal continuous positive airway pressure. Eur J Pediatr. 2014;173:181–6.

Dai T, Lv L, Liu X, Chen J, Ye Y, Xu L. Nasal pressure injuries due to nasal continuous positive airway pressure treatment in newborns: A prospective observational study. J Wound Ostomy Cont Nurs. 2020;47:26–31.

Fernandez-Alvarez JR, Gandhi RS, Amess P, Mahoney L, Watkins R, Rabe H. Heated humidified high-flow nasal cannula versus low-flow nasal cannula as weaning mode from nasal CPAP in infants ≤28 weeks of gestation. Eur J Pediatr. 2014;173:93–98.

Guimarães AR, Rocha G, Rodrigues M, Guimarães H. Nasal CPAP complications in very low birth weight preterm infants. J Neonatal Perinat Med. 2020;13:197–206.

Günlemez A, Isken T, Gökalp AS, Türker G, Arisoy EA. Effect of silicon gel sheeting in nasal injury associated with nasal CPAP in preterm infants. Indian Pediatr. 2010;47:265–7.

Jabraeili M, Mahallei M, Arshadi M, Mohammadpouras A, Shamshiri M, Salimi Z, et al. The efficacy of a protocolized nursing care on nasal skin breakdown in preterm neonates receiving nasal continuous positive airway pressure. Int J Pediatr. 2017;5:4217–25.

Khan J, Sundaram V, Murki S, Bhatti A, Saini SS, Kumar P. Nasal injury and comfort with jet versus bubble continuous positive airway pressure delivery systems in preterm infants with respiratory distress. Eur J Pediatr. 2017;176:1629–35.

Krzyzewski JJ, Rogers KK, Ritchey AM, Farmer CR, Harman AS, Machry JS. Reducing device-related pressure injuries associated with noninvasive ventilation in the neonatal intensive care unit. Respir Care. 2022;67:24–33.

Maram S, Murki S, Nayyar S, Kadam S, Oleti TP, Anne RP, et al. RAM cannula with Cannulaide versus Hudson prongs for delivery of nasal continuous positive airway pressure in preterm infants: an RCT. Sci Rep. 2021;11:1–8.

Mariam S, Buddhavarapu S. Impact of systematic training and CPAP checklist in the prevention of NCPAP related nasal injuries in neonates: a quality improvement study. Indian J Pediatr. 2020;87:256–61.

Milligan PS, Goldstein MR. Implementation of an evidence-based non-invasive respiratory support (NIRS) bundle in the NICU to decrease nasal injury complications. J Neonatal Nurs. 2017;23:89–98.

Morris LD, Behr JH, Smith SL. Hydrocolloid to prevent breakdown of nares in preterm infants. Am J Matern Nurs. 2015;40:39–43.

Naha N, Pournami F, Prabhakar J, Jain N. Nasal injury with Continuous Positive Airway Pressure: need for ‘privileging’ nursing staff. Indian J Pediatr. 2019;86:595–8.

do Nascimento RM, Ferreira ALC, Coutinho ACFP, Veríssimo RCSS. The frequency of nasal injury in newborns due to the use of continuous positive airway pressure with prongs. Rev Lat Am Enferm. 2009;17:489–94.

Ota NT, Davidson J, Guinsburg R. Early nasal injury resulting from the use of nasal prongs in preterm infants with very low birth weight: A pilot study. Rev Bras Ter Intensiv. 2013;25:245–50.

Prakash S, Dubey A, Malik S. A comparative study of outcomes of nasal prongs and nasal mask as CPAP interface in preterm neonates: A randomized control trial. J Clin Neonatol. 2019;8:147–50.

Rego MAC. Comparison of two nasal prongs for application of continuous positive airway pressure in neonates. Pediatr Crit Care Med. 2003;3:239–43.

Rezaei P, Jafari-Mianaeib S, Sadeghnia A, Heidari Z. Protective dressings, injury, and device failure in preterm infants receiving nasal continuous positive airway pressure: A randomized controlled trial. Adv Ski Wound Care. 2021;34:1–6.

Ribeiro DFC, Barros FS, Fernandes BL, Nohama P. Comparative analysis between two models of short binasal prongs used in newborns subjected to non-invasive ventilation. Paper presented at: 2021 Global Medical Engineering Physics Exchanges/Pan American Health Care Exchanges; Sevilla, Spain: Institute of Electrical and Electronics Engineers, March 15-20, 2021.

Ribeiro DFC, Barros FS, Fernandes BL, Nakato AM, Nohama P. Incidence and severity of nasal injuries in preterm infants associated to non-invasive ventilation using short binasal prong. Glob Pediatr Heal. 2021;8:2333794X211010459.

Ribeiro DFS, Barros FS, Fernandes BL, Nakato AM, Nohama P. Nasal prongs: Risks, injuries incidence and preventive approaches associated with their use in newborns. J Multidiscip Health. 2020;13:527–37.

Cabral de Sousa NF, Bonfim Sde F, Lucena de Vasconcelos MG, Bezerra JL, Câmara da Silva DV, Leal LP, et al. Prevalence of nasal septum injury in premature infants using nasal prongs. Rev da Esc Enferm. 2013;47:1285–90.

Yong SC, Chen SJ, Boo NY. Incidence of nasal trauma associated with nasal prong versus nasal mask during continuous positive airway pressure treatment in very low birthweight infants: A randomised control study. Arch Dis Child Fetal Neonatal Ed. 2005;90:480–3.

Alsop EA, Cooke J, Gupta S, Sinha SK. Nasal trauma in preterm infants receiving nasal continuous positive airway pressure. Arch Dis Child. 2008;93:n23.

Lund CH, Osborne JW. Validity and reliability of the neonatal skin condition score. J Obstet Gynecol Neonatal Nurs. 2004;33:320–7.

Kaufman D, Zanelli S, Walsh B, Hicks T. Evaluation of a nasal break-down scoring system for premature infants requiring CPAP. Respir Care EPAS. 2007:61390.

Download references

Author information

Authors and affiliations.

Department of Otolaryngology-Head and Neck Surgery, SUNY Downstate Health Sciences University, Brooklyn, NY, USA

Alexander E. Graf, Jigar Govind, Sydney C. Butts & Ann Woodhouse Plum

College of Medicine, SUNY Downstate Health Sciences University, Brooklyn, NY, USA

Simon Bellido

Department of Pediatrics, SUNY Downstate Health Sciences University, Brooklyn, NY, USA

Chellapriya Vythinathan

Department of Neonatology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA

Lawrence Fordjour

You can also search for this author in PubMed   Google Scholar

Contributions

Alexander E. Graf: design, conduct, analysis, manuscript writing, approved final version, accountable for all work. Simon Bellido: design, conduct, analysis, manuscript writing, approved final version, accountable for all work. Jigar Govind: design, conduct, analysis, manuscript writing, approved final version, accountable for all work. Chellapriya Vythinathan: design, conduct, analysis, manuscript writing, approved final version, accountable for all work. Lawrence Fordjour: design, analysis, manuscript revision, approved final version, accountable for all work. Sydney Butts: design, analysis, manuscript revision, approved final version, accountable for all work. Ann Plum: design, conduct, analysis, manuscript revision, approved final version, accountable for all work.

Corresponding author

Correspondence to Alexander E. Graf .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary exhibit, rights and permissions.

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Cite this article.

Graf, A.E., Bellido, S., Vythinathan, C. et al. Reporting nasal pressure injuries in neonates receiving non-invasive ventilation: a scoping review. J Perinatol (2024). https://doi.org/10.1038/s41372-024-02006-1

Download citation

Received : 11 December 2023

Revised : 28 April 2024

Accepted : 13 May 2024

Published : 17 September 2024

DOI : https://doi.org/10.1038/s41372-024-02006-1

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Quick links

  • Explore articles by subject
  • Guide to authors
  • Editorial policies

exclusion and inclusion criteria in a literature review

The role of women and the obstacles to biodiversity conservation in developed and developing countries

  • Published: 16 September 2024

Cite this article

exclusion and inclusion criteria in a literature review

  • Helyone Sarita das Mercês Lima   ORCID: orcid.org/0000-0003-4866-7528 1 &
  • Helenilza Ferreira Albuquerque Cunha   ORCID: orcid.org/0000-0001-7101-9305 1  

Women play several significant roles in biodiversity conservation, be they linked to conservation’s main activities or decision-making. However, there are countless barriers and disparities capable of affecting the performance of their roles. From this perspective, this study aimed to investigate and compare the roles played by women in the conservation and management of biodiversity. Additionally, it sought to evaluate the obstacles and disparities they face in this process, focusing on both developed and developing countries. We carried out a systematic review of the literature, using the PRISMA Protocol to avoid biased data. We reviewed 400 articles. However, only 73 articles were included in this study, as they met the inclusion criteria. We used the Discursive Textual Analysis method to identify the categories of roles and obstacles found in the articles. We have identified 8 categories of roles played by women in biodiversity conservation and 11 obstacles/difficulties faced by them to perform their role. Developed countries did not show conservation’s main activities, only environmental governance categories, biodiversity management, and others (environmentalist movements). Concerning developing countries, ‘management of natural resources’ was the most cited category in the analyzed studies. There were several main activities related to agriculture in developing countries, mainly agroecology, sustainable agriculture, and agrobiodiversity. Developed countries stood out for double shifts, lack of public policies, lack of financing, gender discrimination, cross-sectional factors, and climatic skepticism, as obstacles to biodiversity conservation. We have concluded that there are differences in the roles played by women in developed and developing countries. We understood that the cross-sectional factors, that is, factors that encompass ethnicity, race, age, geographic location, gender, religion, sexual orientation, and/or the condition of a person with a disability, were the most observed obstacle/difficulty in both developing and developed countries.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save.

  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

exclusion and inclusion criteria in a literature review

Source : Elaborated by the authors, 2023

exclusion and inclusion criteria in a literature review

Data Availability

The entire dataset supporting the results of this study is available on request from the corresponding author: Name of corresponding author: Helenilza Ferreira Albuquerque Cunha Reason for restriction: the authors understand that they can make the data available upon request, as it would be important for the authors to know the purpose of using these data.

Abade, J. I. O., & Mace, R. (1999). Managing protected woodlands: fuelwood collection and law enforcement in lake malawi national park. Conservation Biology, 13 (2), 418–421.

Article   Google Scholar  

Abdelali-Martini, M., et al. (2008). Gender dimension in the conservation and sustainable use of agro-biodiversity in West Asia. The Journal of Socio-Economics, 37 , 365–383.

Aelst, K. V., & Holvoet, N. (2016). Intersections of gender and marital status in accessing climate change adaptation: evidence from rural Tanzania. World Development, 79 , 40–50. https://doi.org/10.1016/j.worlddev.2015.11.003

Agarwal, B. (2010). Does women’s proportional strength affect their participation? Government local forests in South Asia. Word Development, 38 (1), 98–112.

Ahmed, M. R., & Laarman, J. G. (2000). Gender equity in social forestry programs in Bangladesh. Human Ecology, 28 (3), 433–450.

Akhter, S., et al. (2010). The role of women in traditional farming systems as practiced in homegardens: a case study in Sylhet Sadar Upazila Bangladesh. Tropical Conservation Science, 3 (1), 17–30.

Alencar, E. F., & Sousa, I. S. (2021). Mulheres na gestão de recursos pesqueiros na região do médio Solimões, Amazônia: conservação da biodiversidade, acesso à renda e resiliência da pesca. Novos Olhares Sociais, 4 (2), 139–169.

Google Scholar  

Alho, C. J. R. (2012). Importância da biodiversidade para a saúde humana: uma perspectiva ecológica. Estudos Avançados, 26 , 151–165. https://doi.org/10.1590/S0103-40142012000100011

Alvares, M. L. M., & Maneschy, M. C. (1997). From invisible work to collective action: research and participation with women from the fishing communities of the Amazonian coast. PLA Notes, 30 , 62–65.

Arora-Jonsson, S. (2013). Gender, development, and environmental governance: Theorizing connections . Routledge.

Arora-Jonsson, S. (2014). Forty years of gender research and environmental policy: Where do we stand? Women’s Studies International Forum, 47 , 295–308. https://doi.org/10.1016/j.wsif.2014.02.009

Assefa, W., Kewessa, G., & Datiko, D. (2022). Agrobiodiversity and gender: The role of women in farm diversification among smallholder farmers in Sinana district, Southeastern Ethiopia. Biodiversity and Conservation, 31 , 2329–2348. https://doi.org/10.1007/s10531-021-02343-z

Badola, H., & Hussain, S. A. (2003). Conflict in paradise: Women and protected areas in the Indian Himalayas. Mountain Research and Development, 23 (3), 234–237.

Bähr, C. C., et al. (2018). KlimaSeniorinnen: lessons from the Swiss senior women’s case for future climate litigation. Journal of Human Rights and the Environment, 09 , 194–222. https://doi.org/10.4337/jhre.2018.02.04

Bair, J. (2010). On difference and capital: Gender and the globalization of production. Signs, 36 , 203–226. https://doi.org/10.1086/652912

Bandiaky, S. (2008). Gender inequality in malidino biodiversity community-based reserve, senegal: Political parties and the ‘village approach.’ Conservation and Society, 6 (1), 62–73.

Bar-Ilan, J. (2010). Citations to the “Introduction to informetrics” indexed by WOS, Scopus, and Google Scholar. Scientomotrics, 82 , 495–506. https://doi.org/10.1111/j.1467-2979.2010.00368.x

Brandão, G. H., et al. (2019). Female participation in Agroecology: Sustainable development and the search for gender equality. Revista Verde De Agroecologia e Desenvolvimento Sustentável, 14 (5), 671–677.

Bukenya, M. et al. (2012). Gender, tenure, and community forests in Uganda. CIFOR Working Paper , https://doi.org/10.17528/cifor/003778 .

Caballero-Serrano, V., et al. (2019). Traditional ecological knowledge and medicinal plant diversity in Ecuadorian Amazon home gardens. Global Ecology and Conservation, 17 , e00524. https://doi.org/10.1016/j.gecco.2019.e00524

Cabrera, I. R., Martelo, E. Z., & García, V. V. (2001). Gender, rural households, and biodiversity in native Mexico. Agriculture and Human Values, 18 , 85–93. https://doi.org/10.1023/A:1007669132011

Cáceres-Arteaga, N., & Lane, K. M. D. (2020). Agroecological practices as a climate change adaptation mechanism in four highland communities in ecuador. Journal of Latin American Geography, 19 (3), 47–73.

Call, M., & Sellers, S. (2019). How does gendered vulnerability shape the adoption and impact of sustainable livelihood interventions in an era of global climate change? Environmental Research Letters, 14 , 01–15. https://doi.org/10.1088/1748-9326/ab2f57

Cavalcante, L. T. C., & Oliveira, A. A. S. (2020). Métodos de revisão bibliográfica nos estudos científicos. Psicologia Em Revista, 26 (1), 83–102. https://doi.org/10.5752/P.1678-9563.2020v26n1p82-100

Centrone, F. A., et al. (2017). Water gender indicators in agriculture: A study of horticultural farmer organizations in senegal. Water, 9 (12), 972. https://doi.org/10.3390/w9120972

Cheng, S. H., et al. (2019). A systematic map of evidence on the contribution of forests to poverty alleviation. Environ Evid . https://doi.org/10.1186/s13750-019-0148-4

Cidreira Neto, I. R. G., Candeias, A. L. B., & Rodrigues, G. G. (2020). Pesca artesanal: Identidade e representatividade da mulher pescadora. Cadernos De Gênero e Tecnologia, 13 (42), 62–76.

Costa, S., Casanova, C., & Lee, P. (2017). What Does conservation mean for women? The case of the cantanhez forest national park. Conservation and Society, 15 (2), 168–178.

Cruz, T. A. (2010). Mulheres da floresta do Vale do Guaporé e suas interações com o meio ambiente. Revista Estudos Feministas, 18 (3), 913–925. https://doi.org/10.1590/S0104-026X2010000300016

Cureau, S., Soares, I. V. P. (2023). O cotidiano das mulheres e a (in)justiça ambiental . Disponível em: https://www.conjur.com.br/2023-abr-26/cureau-soares-cotidiano-mulheres-injustica-ambiental .

Daniels, C. W., Ens, E. J., & Russell, S. (2022). Empowering young Aboriginal women to care for country: A case study of the ngukurr yangbala rangers, remote northern Australia. Ecological Management and Restoration, 23 (1), 53–63.

Darling, E. S. (2014). Assessing the effect of marine reserves on household food security in kenyan coral reef fishing communities. PLoS ONE, 9 (11), e113614. https://doi.org/10.1371/journal.pone.0113614

Deda, P., & Rubian, R. (2004). Women and biodiversity: the long journey from users to policymakers. Natural Resources Forum, 28 , 201–204. https://doi.org/10.1111/j.1477-8947.2004.00089.x

Deepa, J. (2014). Feminist solidarity? Women’s engagement in politics and the implications for water management in the Darjeeling Himalaya. Mountain Research and Development, 34 , 243–254.

Di Ciommo, R. C. (2007). Pescadoras e pescadores: a questão da equidade de gênero em uma reserva extrativista marinha. Ambiente & Sociedade, 10 (1), 151–163. https://doi.org/10.1590/S1414-753X2007000100010

Egunyu, F., & Reed, M. G. (2015). Social learning by whom? Assessing gendered opportunities for participation and social learning in collaborative forest governance. Ecology and Society, 20 (4), 44–57.

Elias, M., Grosso, A., & Campbell, N. (2020). Unpacking ‘gender’ in joint forest management: Lessons from two Indian states. Geoforum, 111 , 218–228.

Frenova, S. (2021). Orchestrating the participation of women organisations in the UNFCCC Led climate finance decision making. Climate, 9 (9), e135. https://doi.org/10.3390/cli9090135

Fröcklin, S., et al. (2013). fish traders as key actors in fisheries: Gender and adaptive management. Ambio, 42 , 951–962. https://doi.org/10.1007/s13280-013-0451-1

Fröcklin, S., et al. (2014). Towards improved management of tropical invertebrate fisheries: Including time series and gender. PLoS ONE, 9 (3), e91161. https://doi.org/10.1371/journal.pone.0091161

Galiazzi, M. C., & Souza, R. S. (2019). A dialética na categorização da análise textual discursiva: O movimento recursivo entre palavra e conceito. Revista Pesquisa Qualitativa, 7 (13), 01–22. https://doi.org/10.33361/RPQ.2019.v.7.n.13.227

Galvão, T. F., Pansani, T. S. A., & Harrad, D. (2015). Principais itens para relatar revisões sistemáticas e meta-análises: a recomendação PRISMA. Epidemiol Serv Saúde, 24 (2), 335–342. https://doi.org/10.5123/S1679-49742015000200017

Germain, N., et al. (2015). Ornamental reef fish fisheries: New indicators of sustainability and human development at a coastal community level. Ocean & Coastal Management, 104 , 136–149. https://doi.org/10.1016/j.ocecoaman.2014.12.007

Gore, M. L., & Kahler, J. S. (2012). Gendered risk perceptions associated with human-wildlife conflict: Implications for participatory conservation. PLoS ONE, 7 (3), e32901. https://doi.org/10.1371/journal.pone.0032901

Gupta, H. (2015). Women and climate change: linking ground perspectives to the global scenario. Indian Journal of Gender Studies, 22 , 408–420. https://doi.org/10.1177/0971521515594278

Hernández, C. O. (2010). Le gendre et l’environnement: La construction du discours dans le développement durable. Ambiente y Desarrollo, 14 , 13–33.

James, R., et al. (2021). Conservation and natural resource management: Where are all the women? Oryx, 55 , 860–867. https://doi.org/10.1017/S0030605320001349

Jones, M. S., & Solomon, J. (2019). Challenges and supports for women conservation leaders. Conservation Science and Practice, 1 , e36. https://doi.org/10.1111/csp2.36

Kaijser, A., & Kronsell, A. (2013). Climate change through the lens of intersectionality. Environmental Politics, 23 , 417–433. https://doi.org/10.1080/09644016.2013.835203

Karami, E., & Mansoorabadi, A. (2008). Sustainable agricultural attitudes and behaviors: A gender analysis of Iranian farmers. Environment, Development and Sustainability, 10 , 883–898. https://doi.org/10.1007/s10668-007-9090-7

Kendall, S. S., et al. (2021). Gender equality for a thriving Sustainable Arctic. Sustainability, 13 , 10825. https://doi.org/10.3390/su131910825

Kronen, M. (2002). Women’s fishing in Tonga: Case studies from Ha’apai and Vava’u islands. SPC Women in Fisheries Information Bulletin, 11 , 17–22.

Kumar, P. S. (2019). Women’s role in environmental conservation. International Journal of Social Sciences and Economic Research, 04 , 6812–6819.

Kwok, Y. K. E., et al. (2019). Perceptions of gender dynamics in small-scale fisheries and conservation areas in the Pursat province of Tonle Sap Lake, Cambodia. Asia Pacific Viewpoint, 61 , 54–70. https://doi.org/10.1111/apv.12225

Ladia, J. R., Malenab, M. C. T., & Visco, E. S. (2019). Bridging the Gap between gender and marine conservation: The case of calatagan mangrove forest conservation park in Batangas, Philippines pertanika. Journal of Social Sciences and Humanities, 27 , 193–213.

Lagos, M. B., et al. (2014). A perspectiva de gênero na construção da sustentabilidade. Cadernos De Gêneros e Tecnologia, 30 , 62–73. https://doi.org/10.3895/cgt.v8n31/32.6114

Larson, A. M., et al. (2018). Gender lessons for climate initiatives: A comparative study of REDD-plus impacts on subjective wellbeing. World Development, 108 , 86–102. https://doi.org/10.1016/j.worlddev.2018.02.027

Leach, M. (2007). Earth mother myths and other ecofeminist fables: How a strategic notion rose and fell. Development and Change, 38 , 67–85. https://doi.org/10.1111/j.1467-7660.2007.00403.x

Leal, L. S. G., et al. (2020). Quintais produtivos como espaços da agroecologia desenvolvidos por mulheres rurais. Perspectivas Em Diálogo, 7 (14), 31–54.

Leisher, C., et al. (2015). Does the gender composition of forest and fishery management groups affect resource governance and conservation outcomes: a systematic map protocol? Environmental Evidence, 04 , 01–07. https://doi.org/10.1186/s13750-015-0039-2

Luzuriaga-Quichimbo, C., et al. (2019). Plant biodiversity knowledge varies by gender in sustainable amazonian agricultural systems called Chacras. Sustainability, 11 , 02–13. https://doi.org/10.3390/su11154211

Maas, B., et al. (2021). Women and the global south are strikingly underrepresented among top-publishing ecologists. Conservation Letters, 14 , 1–9. https://doi.org/10.1111/conl.12797

Makindi, S. M., Mokua, M. A., & Bob, U. (2019). Integrating gender and conservation of biodiversity as a climate change adaptation strategy. Environment and Forestry, 132 , 53377–53382.

Makindi, S. M. (2010). Communities’ perceptions and assessment of biodiversity conservation strategies: The case of protected areas in Kenya. PhD Thesis, University of KwaZulu-Natal, Durban South Africa.

Manoa, D. O. (2017). Gender and environmental management: who’s role? who’s responsible? World Journal of Social Sciences and Humanities, 03 , 61–63. https://doi.org/10.12691/wjssh-3-3-2

Martinez-Silveira, M. S., Silva, C. H., & Laguardia, J. (2014). A revisão sistemática como método em estudo bibliométrico. In: Encontro Nacional de Pesquisa em Ciência da Informação, 15., Belo Horizonte, MG (pp. 5222–5240). Anais... PPGCI, ECI, UFMG. GT -11 Informação em Saúde. https://www.arca.fiocruz.br/handle/icict/29527

Masuda, Y. J., et al. (2022). Does balancing gender composition lead to more prosocial outcomes? Experimental evidence of equality in public goods and extraction games from rural Kenya. World Development, 156 , e105923. https://doi.org/10.1016/j.worlddev.2022.105923

Mathibela, M. K., et al. (2015). Socio-cultural profile of Bapedi traditional healers as indigenous knowledge custodians and conservation partners in the Blouberg area, Limpopo province, South Africa. Journal Ethnobiology Ethnomedicine . https://doi.org/10.1186/s13002-015-0025-3

Matos, F., et al. (2020). As mulheres das águas: algumas reflexões sobre a participação feminina nos comitês de bacias hidrográficas no Brasil. Revista Desarrollo Local Sostenible, 13 (37). https://ojs.revistadelos.com/ojs/index.php/delos/article/view/680

Meinzen-Dick, R., et al. (2016). Games for groundwater governance: Field experiments in Andhra Pradesh, India. Ecology and Society, 21 , 03–38. https://doi.org/10.5751/ES-08416-210338

Miranda, C. M. (2012). Brasil, Canadá e a integração de políticas de gênero a partir da plataforma de Ação de Pequim. Interfaces, 12 , 83–100.

Molina, C. A., et al. (2022). Gender roles and native potato diversity management in highland communities of peru. Sustainability, 14 (6), e3455. https://doi.org/10.3390/su14063455

Moreno-Black, G., Somnasang, P., & Thamathawan, S. (1996). Cultivating continuity and creating change: Women’s home garden practices in northeastern Thailand. Agriculture and Human Values, 13 , 03–11. https://doi.org/10.1007/BF01538222

Nagel, J. (2012). Intersecting identities and global climate change. Identities, 19 (4), 467–476. https://doi.org/10.1080/1070289X.2012.710550

Nandigama, S. (2020). Performance of success and failure in grassroots conservation and development interventions: Gender dynamics in participatory forest management in India. Land Use Policy, 97 , e103445. https://doi.org/10.1016/j.landusepol.2018.05.061

Nischalke, S. M., et al. (2017). Forgotten forests? Food potential of ancient coffee forests and agroforestry systems in the Southwestern Ethiopian mountains, seen through a gender lens. Mountain Research and Development, 37 (3), 254–262.

Oliveira, U. R., et al. (2018). A systematic literature review on green supply chain management: Research implications and future perspectives. Journal of Cleaner Production, 187 , 537–561. https://doi.org/10.1016/j.jclepro.2018.03.083

Parada, S. P., et al. (2020). Agroforestry in the Andean Araucanía: An Experience of agroecological transition with women from cherquén in Southern Chile. Sustainability, 12 (24), e10401. https://doi.org/10.3390/su122410401

Parra-Sosa, B., et al. (2007). Reproducción campesina, recursos naturales y género en una comunidad campesina en puebla, México. Agricultura, Sociedad y Desarrollo, 4 , 53–67.

Pearse, R. (2017). Gender and Climate change. Wires Climate Change, 8 , 451–466. https://doi.org/10.1002/wcc.451

Peralta, N., & Alencar, E. F. (2008). Ecoturismo e mudança social na amazônia rural: Efeitos sobre o papel da mulher e as relações de gênero. Revista De Antropologia Social, 9 (1), 109–130. https://doi.org/10.5380/cam.v9i1.13876

Pereira, M. G., & Galvão, T. F. (2014). Etapas de busca e seleção de artigos em revisões sistemática da literatura. Epidemiologia e Serviços de Saúde, 23 , 369–371.

Picanço, J. R. (2009). Desenvolvimento e conservação da biodiversidade na Amazônia: a produção familiar agroextrativista em áreas protegidas no sul do Amapá. Tese (Doutorado em Ciências Sociais), Universidade Federal do Rio Grande do Norte, Natal, Brasil.

Poor, E. E., et al. (2021). Increasing diversity to save biodiversity: Rising to the challenge and supporting Indonesian women in conservation. Conserv. Sci. Pract., 3 (6), 395. https://doi.org/10.1111/csp2.395

Porter, A. L., Kongthon, A., & Lu, J. C. (2002). Research profiling: Improving the literature review. Scientometrics, 53 , 351–370. https://doi.org/10.1023/A:1014873029258

Purwanti, A., Ispriyarso, B., & Wijaningsih, D. (2018). Strategising local regulations on women’s representation in village policymaking as a realisation of sustainable development goals: A study on semarang regency. Journal of Social Studies Education Research, 9 , 319–333.

Ravera, F., et al. (2016). Gender perspectives in resilience, vulnerability, and adaptation to global environmental change. Ambio, 45 (3), 235–247. https://doi.org/10.1007/s13280-016-0842-1

Ravera, F., et al. (2019). Gendered agrobiodiversity management and adaptation to climate change: differentiated strategies in two marginal rural areas of India. Agriculture and Human Values, 36 , 455–474. https://doi.org/10.1007/s10460-018-09907-w

Redmore, L. E., & Tynon, J. F. (2011). Women owning woodlands: Understanding women’s roles in forest ownership and management. Journal of Forestry, 109 , 255–259. https://doi.org/10.1093/jof/109.5.255

Rocheleau, D. E. (1991). Gender, ecology, and the science of survival: Stories and lessons from Kenya. Agriculture and Human Values, 8 , 156–165. https://doi.org/10.1007/BF01579669

Santos, K. P. (2021). The women of castanha do Alto Cajari: empowerment by the solidarity economy. Ambiente & Sociedade, 24 , e00661. https://doi.org/10.1590/1809-4422asoc20200066r1vu2021L4AO

Santos, M. F. R. (2010). Metodologia da pesquisa em educação . UemaNet, São Luís, Maranhão, Brasil.

Sganzerla, C. M., et al. (2021). Socioeconomic and cultural aspects of healers who use medicinal plants in their popular healing practices in the City of Guatambu, Santa Catarina. Research, Society and Development, 10 (13), e451101321538. https://doi.org/10.33448/rsd-v10i13.21538

Shinbrot, X. A., et al. (2019). Unlocking women’s sustainability leadership potential: Perceptions of contributions and challenges for women in sustainable development. World Development, 119 , 120–132. https://doi.org/10.1016/j.worlddev.2019.03.009

Silva, F. R. F. (2017). Gênero, agroecologia e economia solidária: estudo de caso do grupo de mulheres do Acampamento Recanto da Natureza em Laranjeiras do Sul – PR. Desenvolvimento e Meio Ambiente, 39 , 115–132.

Singh, R. K., Rallen, O., & Padung, E. (2013). Elderly adi women of Arunachal Pradesh: “Living Encyclopedias” and cultural refugia in biodiversity conservation of the Eastern Himalaya. India. Environmental Management, 52 , 712–735. https://doi.org/10.1007/s00267-013-0113-x

Singh, R. K., et al. (2018). Classification and management of community forests in Indian Eastern Himalayas: implications on ecosystem services, conservation, and livelihoods. Ecological Process . https://doi.org/10.1186/s13717-018-0137-5

Sisto, I., & Furst, M. (2019). Why shall we consider the gender implications of biodiversity management? The role of women in the Mediterranean region. New Medit, 18 (3), 109–111. https://doi.org/10.30682/nm1903n

Soares, D. (2007). Acceso, abasto y control del agua en una comunidad indígena chamula en Chiapas: Un análisis a través de la perspectiva de género, ambiente y desarrollo. Región y Sociedad, 19 (38), 25–50.

Stoddart, M. C. J., & Tindall, D. B. (2010). Feminism and environmentalism: Perspectives on gender in the British Columbia environmental movement during the 1990s. BC Studies, N., 165 , 75–100. https://doi.org/10.14288/bcs.v0i165.297

Suárez, L. G., et al. (2016). Género y empoderamiento comunitario en un contexto de posconflicto: el caso de Vergara, Cundinamarca (Colombia). Estudios Socio-Jurídicos, 18 (2), 115–144. https://doi.org/10.12804/esj18.02.2016.04

Sülün, E. E. (2018). Women, water resource management, and sustainable development: The Turkey-North Cyprus water pipeline project. Resources, 7 (3), e50. https://doi.org/10.3390/resources7030050

Tavares, J. M. F., et al. (2020). Evolução dos direitos das mulheres e desafios para alcançar a igualdade de gênero no século XXI. Revista de Direito da Amazônia, 1 , 01–23.

Torell, E., et al. (2019). Assessing the Impacts of gender integration in Ghana’s fisheries sector. Coastal Management, 47 , 507–526. https://doi.org/10.1080/08920753.2019.1669098

Torri, M. C. (2010). Power, structure, gender relations, and community-based conservation: The cawswe study of the Sariska Region, Rajasthan, India. Journal of International Women’s Studies, 11 (4), 01–18.

Tsegaye, B. (1997). The significance of biodiversity for sustaining agricultural production and role of women in the traditional sector: The Ethiopian experience. Agriculture, Ecosystems & Environment, 62 , 215–227. https://doi.org/10.1016/S0167-8809(96)01134-6

Tupinambá, F. S., et al. (2012). Conhecimento tradicional das marisqueiras de Barra Grande, área de proteção ambiental do delta do Rio Parnaíba, Piauí Brasil. Ambiente & Sociedade, 15 (2), 91–112. https://doi.org/10.1590/S1414-753X2012000200006

Unay-Gailhard, I., & Bojnec, S. (2021). Gender and the environmental concerns of young farmers: Do young women farmers make a difference on family farms? Journal of Rural Studies, 88 , 71–82. https://doi.org/10.1016/j.jrurstud.2021.09.027

Varela, E. P., et al. (2022). Semeando saberes: a etnobotânica e o quintal na valorização do conhecimento da mulher agricultora. Revista Etnobiología, 20 (2), 213–235.

Vazquez-Garcia, V. (2008). Gender, ethnicity, and economic status in plant management: Uncultivated edible plants among the nahuas and popolucas of Veracruz, Mexico. Agriculture and Human Values, 25 , 65–77. https://doi.org/10.1007/s10460-007-9093-x

Veuthey, S., & Gerber, J. F. (2010). Logging conflicts in Southern Cameroon: A feminist ecological economics perspective. Ecological Economics, 70 , 170–177. https://doi.org/10.1016/j.ecolecon.2009.09.012

Weeratunge, N., Snyder, K. A., & Sze, C. P. (2010). Gleaner, fisher, trader, processor: Understanding gendered employment in fisheries and aquaculture. Fish and Fisheries, 11 , 405–420. https://doi.org/10.1111/j.1467-2979.2010.00368.x

Ylipaa, J., Gabrielsson, S., & Jerneck, A. (2019). Climate Change adaptation and gender inequality: insights from rural vietnam. Sustainability, 11 (10), e2805. https://doi.org/10.3390/su11102805

Żuk, P., & Pacześniak, A. (2020). Sustainable development, energy transition, and climate challenges in the context of gender: The framework of gender determinants of environmental orientation in Poland. Sustainability, 12 (21), e9214. https://doi.org/10.3390/su12219214

Download references

Acknowledgement

We are grateful to Programa de Pós-Graduação em Biodiversidade Tropical (PPGBIO) and to PROPESPg of Federal University of Amapá.

Author information

Authors and affiliations.

Graduate Program in Tropical Biodiversity, Universidade Federal do Amapá, Rodovia Juscelino Kubitschek de Oliveira, km 02, Jardim Marco Zero, Macapa, Amapá, 68903‑419, Brazil

Helyone Sarita das Mercês Lima & Helenilza Ferreira Albuquerque Cunha

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Helenilza Ferreira Albuquerque Cunha .

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Lima, H.S.M., Cunha, H.F.A. The role of women and the obstacles to biodiversity conservation in developed and developing countries. Environ Dev Sustain (2024). https://doi.org/10.1007/s10668-024-05407-6

Download citation

Received : 29 August 2023

Accepted : 05 September 2024

Published : 16 September 2024

DOI : https://doi.org/10.1007/s10668-024-05407-6

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Women’s participation
  • Biodiversity conservation
  • Governance and management
  • Obstacles for conservation
  • Find a journal
  • Publish with us
  • Track your research

COMMENTS

  1. Inclusion/Exclusion Criteria

    Exclusion criteria are the elements of an article that disqualify the study from inclusion in a literature review. For example, excluded studies: used qualitative methodology; used a certain study design (e.g, observational) are a certain publication type (e.g., systematic reviews) were published before a certain year (must have compelling reason)

  2. Chapter 3: Defining the criteria for including studies and how they

    First, the diseases or conditions of interest should be defined using explicit criteria for establishing their presence (or absence). Criteria that will force the unnecessary exclusion of studies should be avoided. For example, diagnostic criteria that were developed more recently - which may be viewed as the current gold standard for diagnosing the condition of interest - will not have ...

  3. Inclusion and exclusion criteria in research studies: definitions and

    Establishing inclusion and exclusion criteria for study participants is a standard, required practice when designing high-quality research protocols. Inclusion criteria are defined as the key features of the target population that the investigators will use to answer their research question. 2 Typical inclusion criteria include demographic ...

  4. Define Inclusion/Exclusion Criteria

    Tip: Choose your criteria carefully to avoid bias. For example, if you exclude non-English language articles, you may be ignoring relevant studies. The following 6-minute video explains the relationship between inclusion and exclusion criteria and database searches.

  5. LibGuides: Systematic Reviews : Inclusion and Exclusion Criteria

    A type of literature review that uses a systematic and rigorous approach to identify, select, appraise, and synthesize all available evidence on a particular topic. ... The inclusion and exclusion criteria must be decided before you start the review. Inclusion criteria is everything a study must have to be included. Exclusion criteria are the ...

  6. Inclusion and Exclusion Criteria

    Step 1: Developing and testing criteria. Developing the inclusion and exclusion criteria may involve an iterative process of refinement during review conceptualization and construction (see Chapter 2).During conceptualization, criteria may be adjusted as reviewers scope the likely literature base, consult stakeholders, and explore what questions may be feasible or relevant.

  7. Avoiding Bias in Selecting Studies

    The EPC should carefully consider whether PICOTS criteria are effect modifiers and how inclusion and exclusion criteria may potentially skew the studies and thus results reported in the review. Table 2 below suggests potential implications or biases that may result from specific hypothetical examples of inclusion and exclusion criteria.

  8. Selecting Studies for Systematic Review: Inclusion and Exclusion Criteria

    The eligibility criteria are liberally applied in the beginning to ensure that relevant studies are included and no study is excluded without thorough evaluation. At the outset, studies are only excluded if they clearly meet one or more of the exclusion criteria. For example, if the focus of review is children, then studies with adult ...

  9. Inclusion and exclusion criteria

    Inclusion and exclusion criteria set the boundaries for the systematic review. They are determined after setting the research question usually before the search is conducted, however scoping searches may need to be undertaken to determine appropriate criteria. Many different factors can be used as inclusion or exclusion criteria.

  10. Systematic Reviews: Inclusion and Exclusion Criteria

    An important part of the SR process is defining what will and will not be included in your review. Inclusion and exclusion criteria are developed after a research question is finalized but before a search is carried out. ... they are important in identifying gaps in the literature. Unanswered questions implications of an empty review. Slyer ...

  11. Inclusion & Exclusion Criteria

    These are commonly known as inclusion criteria and exclusion criteria, and they set the boundaries for the literature review. Inclusion and exclusion criteria are determined after formulating the research question but usually before the search is conducted (although preliminary scoping searches may need to be undertaken to determine appropriate ...

  12. 4. Apply Inclusion and Exclusion Criteria

    In large systematic reviews, the inclusion/exclusion criteria are applied by at least 2 reviewers to all the studies retrieved by the literature search. A strategy to resolve any disagreements between the reviewers should be outlined in the protocol, such as bringing in a third screener. There are two levels of the screening process.

  13. Establish your Inclusion and Exclusion criteria

    Using specific criteria will help make sure your final review is as unbiased, transparent and ethical as possible. How to establish your Inclusion and Exclusion criteria To establish your criteria you need to define each aspect of your question to clarify what you are focusing on, and consider if there are any variations you also wish to explore.

  14. How to Conduct a Systematic Review: A Narrative Literature Review

    Inclusion and exclusion criteria. Establishing inclusion and exclusion criteria come after formulating research questions. The concept of inclusion and exclusion of data in a systematic review provides a basis on which the reviewer draws valid and reliable conclusions regarding the effect of the intervention for the disorder under consideration ...

  15. Selection Criteria

    Exclusion criteria are the elements of an article that disqualify the study from inclusion in a literature review. Some examples are: Study used an observational design; Study used a qualitative methodology; Study was published more than 5 years ago; Study was published in a language other than English

  16. LibGuides: Systematic Reviews: Inclusion and Exclusion Criteria

    A balance of specific inclusion and exclusion criteria is paramount. For some systematic reviews, there may already be a large pre-existing body of literature. The search strategy may retrieve thousands of results that must be screened. Having explicit exclusion criteria from the beginning allows those conducting the screening process, an ...

  17. Sample Selection in Systematic Literature Reviews of Management

    I used somewhat relaxed inclusion criteria to avoid excluding many of the earlier systematic reviews that did not necessarily refer to the Tranfield et al. (2003) article or did not use the term systematic literature review. That is, I used the question of whether the articles disclosed their inclusion or exclusion criteria as my overriding ...

  18. Guidelines for writing a systematic review

    The most robust review method, usually with the involvement of more than one author, intends to systematically search for and appraise literature with pre-existing inclusion criteria. (Salem et al., 2023) Rapid review: Utilises Systematic Review methods but may be time limited. (Randles and Finnegan, 2022) Meta-analysis

  19. Selecting Criteria

    Exclusion criteria are the elements of an article that disqualify the study from inclusion in a literature review. Some examples are: Study used an observational design; Study used a qualitative methodology; Study was published more than 5 years ago; Study was published in a language other than English

  20. Limits and Inclusion Criteria

    Using Limits and Inclusion/Exclusion Criteria. Once you have some search results, you will need to decide which articles you will actually use in your literature review. This can be done using filters/limits in the databases, applying inclusion/exclusion criteria, and appraising the articles.

  21. Determine inclusion and exclusion criteria

    What is a literature review? Steps in the Literature Review Process; Define your research question; Determine inclusion and exclusion criteria; ... Analyze Results; Write; Librarian Support; Artificial Intelligence (AI) Tools; Determine inclusion and exclusion criteria. Once you have a clearly defined research question, make sure you are ...

  22. Developing inclusion/exclusion criteria

    A feature of the systematic literature review is using pre-specified criteria to include/exclude studies. Through searching the literature and formulating your review questions, for example by using PICO, PEO, etc., you will be able to define the specific attributes that research studies must have to be eligible for inclusion in your review, along with other attributes that will exclude them.

  23. How do I guides: Systematic reviews: Inclusion/exclusion criteria

    Clear eligibility criteria will make it easier to identify relevant articles at the screening stage. The resources below may assist to better inform your decisions: Cochrane: Defining the criteria for including studies. Chapter 3 of the Cochrane Handbook provides advice on selecting inclusion and exclusion criteria.

  24. The Effectiveness of Psychological Intervention for Women Who Committed

    All types of study designs were considered for this review (S). Exclusion criteria were: (a) literature review; (b) reviews, systematic reviews, and meta-analyses; (c ) studies that collected and analyzed only qualitative data (e.g., interview); (d) papers not peer-reviewed (i.e., gray literature), and (e) studies not written in English ...

  25. Healthcare

    The present study employed specific inclusion criteria to identify studies for analysis. Only prospective or retrospective cohort designs were considered, with the exclusion of case studies, case series, case-control studies, review papers, or purely epidemiology [11,13]. The study population consisted of basketball athletes participating at ...

  26. Aphasia therapy software: an investigation of the research literature

    2.1.2. Selecting literature. Inclusion and exclusion criteria for article selection were largely adapted from those defined by Zheng et al. (Citation 2016), with some additions in order to accommodate to our specific research questions. The inclusion/exclusion criteria are summarised in Table 2.

  27. Mapping health-related quality of life of children and families

    This scoping review seeks to map the literature and provide a descriptive report of the health-related quality of life of children using invasive home mechanical ventilation and their families. ... Reviewers will screen the titles and abstracts using the inclusion and exclusion criteria provided in Covidence. After all pilot studies have been ...

  28. A systematic review and meta analysis on digital mental health

    Following the evaluation by exclusion criteria, 30 studies were selected for risk of bias evaluation. ... all data is provided to replicate assessment of literature according to inclusion criteria ...

  29. Reporting nasal pressure injuries in neonates receiving non-invasive

    Full-text review yielded 37 studies that satisfied inclusion criteria. Review of the reference lists of the included studies identified three additional studies meeting inclusion criteria.

  30. The role of women and the obstacles to biodiversity conservation in

    Thus, to achieve the proposal of this research, we conducted a systematic review of the literature in scientific publications of indexed journals, using the PRISMA Protocol to avoid biased data and maintain the scientific rigor of the research. For the selection of articles, inclusion and exclusion criteria were respected.