Overview of systematic reviews - a new type of study. Part I: why and for whom?

ABSTRACT CONTEXT AND OBJECTIVE: Healthcare decision-making is complex and should involve healthcare professionals, patients and the best level of evidence. The speed of information production creates barriers against keeping up to date. In this light, methodologists have proposed a new type of study: overviews of systematic reviews (OoRs). The aim here was to introduce and demonstrate the role of OoRs in information synthesis for healthcare professionals, managers, researchers and patients. DESIGN AND SETTING: Time-series study conducted at the Brazilian Cochrane Center, jointly with the Postgraduate Program on Internal Medicine and Therapeutics, Discipline of Emergency Medicine and Evidence-Based Medicine, Department of Medicine, Federal University of São Paulo. METHODS: To show the growth in the numbers of published papers that provide high-level evidence and thus demonstrate the importance of OoRs for synthesis and integration of information, three filters for study designs were applied to two databases. An equation for predicting the expected number of published papers was developed and applied. RESULTS: Over the present decade, the number of randomized controlled trials in Medline might reach 2,863,203 and the number of systematic reviews might reach 174,262. Nine OoRs and 15 OoRs protocols have been published in the Cochrane Library. CONCLUSIONS: With the exponential growth of published papers, as shown in this study, a new type of study directed especially towards healthcare decision-makers was proposed, named “overview of systematic reviews”. This could reduce the uncertainties in decision-making and generate a new hierarchy in the pyramid of evidence.


INTRODUCTION
2][3] In order to make this process work, healthcare professionals need to keep up to date.However, this is a complex challenge, given the globalized world and the speed at which information is disseminated.
One example of the complexity of keeping up to date was given by Davidoff et al. 4 In 1992, it was estimated that healthcare professionals should read 17 to 20 original papers every day to keep up to date in their field.In Medline, 5 the world's largest medical library, more than 736,000 new records were published in 2011, with over 21 million citations in PubMed.
An alternative way to reduce the complexity of keeping up to date and facilitate clinical decision-making is to use systematic reviews (SRs).One of the primary functions of this type of study is to summarize clinical information from several studies in order to answer a question relating to diagnosis, prevention or treatment in areas in which the results may or may not be in agreement, through critical evaluation of the evidence. 6,7king into consideration only the most important database of SRs, i.e. the Cochrane Library, more than 7,000 articles have been published. 8Given this large amount of information, professional updating remains a challenge, even when resorting to SRs.[11] For didactic purposes, the present analysis will be published as a series of three articles.Part I, presented here, focuses on the growth of published papers presenting the best level of evidence for decision-making relating to healthcare, thereby justifying the creation of OoRs.Part II, to be presented in a forthcoming article, will describe the state of the art of OoRs from the Cochrane Collaboration.In Part III, a new hierarchical evidence pyramid will be proposed, taking this new type of study into consideration.

OBJECTIVE
The objective of this study was to introduce and demonstrate the role of OoRs in relation to synthesis of information for healthcare professionals, managers, researchers and patients.

METHODS
This was a time-series study that included application of filters to study designs (to select studies that provide the highest level of evidence) in virtual databases, in order to show the growing number of published papers within the field of healthcare that provide high levels of evidence for decision-making and thus seek to demonstrate the importance of OoRs as a type of study that provides a synthesis of the evidence and integrates it.For this, two databases were selected (the Cochrane Library via the Cochrane Database of Systematic Reviews, and Medline via PubMed) and three search filters for study designs were applied.The first filter used (filter A) was the sensitivity-maximizing version of the Cochrane Highly Sensitive Search Strategy 12 for identifying randomized controlled trials (RCTs) in Medline.The second filter (filter B) was designed to search for all systematic reviews (SRs) in Medline. 13,14The third search filter (filter C) was developed to identify overviews of systematic reviews (OoRs) in the Cochrane Library.The three search filters used are shown in Chart 1.
Subsequently, an equation to predict expected future numbers of published papers was modeled (designed).This equation was based on the fraction of the present decade that has already elapsed, in order to determine the cumulative frequency for the period.The equation thus developed is shown in Figure 1.By applying filter C, to identify OoRs in the Cochrane Library, 57 studies were identified, but 33 were excluded because they were not OoRs (using a very sensitive but lowspecificity search).Thus, up to the cutoff date of June 15, 2012, nine OoRs had been published, and 15 OoRs protocols were in this database (Table 1).

DISCUSSION
The information from Medline, which is the world's largest medical library, 5 with citations in its database going back to the 1940s, shows that PubMed (http://www.ncbi.nlm.nih.gov/pubmed/)includes over 21 million citations for biomedical literature, comprising journals and books on the life sciences that are online through Medline.In 2011 alone, over 736,000 new references were published and, therefore, to acknowledge all of these new papers would have meant reading about 84 articles per day.
In this study, we chose to analyze the growth in the numbers of published RCTs, SRs and OoRs, because these study designs present the highest levels in the hierarchy of evidence for clinical decision-making. 39dline was chosen as the database to assess because it is considered to be the most important search tool within the field of healthcare. 5The Cochrane Library was chosen because it is the largest and most important database of SRs and OoRs with over 7,000 citations. 7 evidence-level hierarchy was previously proposed in order to provide the best evidence for decision-making in healthcare. 39However, this was a heuristic solution, i.e. it assumed a solution that was close to the ideal, even though such a solution would not necessarily be the best possible solution.Nonetheless, it may be considered satisfactory.In order to achieve a satisfactory hierarchy for evidence levels, the quality of evidence is crucial and should be evaluated.
The quality of published papers may be compromised for a variety of reasons, which may include methodological faults, conflicts of interest, data manipulation and so on.Thus, healthcare professionals not only need to keep up to date but also should know how to judge the quality of evidence.To do this, certain tools are recommended, such as the Cochrane Collaboration's tool 40 for assessing RCT risk of bias and the AMSTAR tool for assessing the methodological quality of SRs. 41 reduce the uncertainties in healthcare decision-making, all the relevant studies need to be found.Therefore, the search strategy should be highly sensitized, i.e. it should be able to detect Mesh terms (Medical Subject Headings) and free-text terms within titles and abstracts indexed in the databases considered. 11is implies that not all RCTs and SRs counted in Figure 2 are actually the types of studies for which the search strategy was developed.This is a possible limitation of the present analysis.
Another point to be noted is in relation to the predicted growth among the types of studies considered in the present analysis.These numbers represent numerical approximations based on the publication behavior of previous decades.Despite the limitations noted, the growth in RCTs and SRs has, as seen from the results, been exponential.Because healthcare decision-making is naturally complex, SR methodologists have proposed the use of overviews of systematic reviews, [8][9][10] which have also shown growth in the number of published papers.

B. Filter for systematic reviews (Medline via PubMed) (((((((systematic review[ti] OR meta-analysis[pt] OR meta-analysis[ti] OR systematic literature review[ti] OR (systematic review[tiab] AND review
In Part II of this series of three papers, the state of art of overviews of systematic reviews and details of study design will be presented.

CONCLUSIONS
Keeping up to date remains a challenge, considering the great quantity and varying quality of information available.Thus, SR methodologists have proposed a new type of study especially suited for healthcare decision-makers, named "overview of systematic reviews".This new type of study was developed to provide a synthesis and integrate information from multiple studies in order to reduce the uncertainties in decision-making.This may generate a new hierarchy in the pyramid of evidence.
BSc. Specialist in Cardiac Rehabilitation, Obesity and Statistics and Master's Student in the Postgraduate Program on Internal Medicine and Therapeutics, Federal University of São Paulo (Escola Paulista de Medicina, Universidade Federal de São Paulo, EPM-Unifesp); Volunteer Research Assistant at the Brazilian Cochrane Centre, São Paulo; Professor at Itapeva Social and Agrarian Sciences College (Faculdade de Ciências Sociais e Agrárias de Itapeva, FAIT), Itapeva, São Paulo, Brazil.II BSc, MSc.Master's Student in the Postgraduate Program on Internal Medicine and Therapeutics, Federal University of São Paulo (Escola Paulista de Medicina, Universidade Federal de São Paulo, EPM-Unifesp); Volunteer Research Assistant at the Brazilian Cochrane Centre, São Paulo, Brazil.III BSc.Specialist in Orthopedics and Master's Student in the Postgraduate Program on Internal Medicine and Therapeutics, Federal University of São Paulo (Escola Paulista de Medicina, Universidade Federal de São Paulo, EPM-Unifesp); Volunteer Research Assistant at the Brazilian Cochrane Centre and Preceptor at EPM-Unifesp, São Paulo, Brazil.IV MD, MSc, PhD.Rheumatologist and Professor at Federal University of São Paulo (Escola Paulista de Medicina, Universidade Federal de São Paulo, EPM-Unifesp); Coordinator at Brazilian Cochrane Centre, São Paulo, Brazil.
May 21, 2012, more than two million RCTs (n = 2,336,617) were identified by applying filter A (Figure2, part "a", in dark gray).The forecast growth was taken to be based on the number of studies published over the date range of the search.Thus, over the decade between 2010 and 2020, the number of RCTs in Medline might reach 2,863,203 (Figure 2, part "a", in light gray).263,002 RCTs were published in the decade beginning in 2010, up to the cutoff date considered, but more than 526,586 RCTs are expected over the remainder of the decade, thus resulting in almost 800,000 new RCTs published in Medline over the entire decade 2010-2020.Up to the cutoff date of June 6, 2012, more than 100,000 SRs (n = 127,044) were identified by applying filter B to the Medline database (Figure 2, part "b", in dark gray).The forecast growth was taken to be based on the number of studies published over the date range of the search.Thus, over the decade between 2010 and 2020, the number of SRs in Medline might reach 174,262 (Figure 2, part "b", in light gray).37,785 SRs were published in the decade beginning in 2010, up to the cutoff date considered, but more than 47,281 SRs are expected over the remainder of the decade, thus resulting in more than 85,000 new SRs published in Medline over the entire decade 2010-2020.

Figure 1 .
Figure 1.Equation for predicting the expected number of published papers.
Part "a" of the figure represents the number and growth rate (%) of randomized controlled trials (RCTs) per decade, published in Medline.Part "b" of the figure represents the number and growth rate (%) of systematic reviews (SRs) per decade, published in Medline.The dark gray regions represent the observed values up to 2012; the light gray region represents the prediction for the remainder of the decade 2010 |-2020.

Figure 2 .
Figure 2. Growth in the numbers of published papers in Medline with a high level of evidence for healthcare decision-making.

Table 1 .
Growth of overviews of systematic reviews (OoRs) in the Cochrane Library