Acessibilidade / Reportar erro

Methodological Quality of Randomized Clinical Trials of Respiratory Physiotherapy in Coronary Artery Bypass Grafting Patients in the Intensive Care Unit: a Systematic Review

Abstract

Objective:

To assess methodological quality of the randomized controlled trials of physiotherapy in patients undergoing coronary artery bypass grafting in the intensive care unit.

Methods:

The studies published until May 2015, in MEDLINE, Cochrane and PEDro were included. The primary outcome extracted was proper filling of the Cochrane Collaboration's tool's items and the secondary was suitability to the requirements of the CONSORT Statement and its extension.

Results:

From 807 studies identified, 39 were included. Most at CONSORT items showed a better adequacy after the statement's publication. Studies with positive outcomes presented better methodological quality.

Conclusion:

The methodological quality of the studies has been improving over the years. However, many aspects can still be better designed.

Keywords:
Physical Therapy Modalities; Thoracic Surgery; Cardiac Surgical Procedures; Methodology; Systematic Review; Review Literature as Topic; Intensive Care Unit

Abbreviations, acronyms & symbols CABG = Coronary artery bypass grafting FEV1 = Forced expiratory volume in one second ICU = Intensive care unit PaO2 = Partial pressure of oxygen PEDro = Physiotherapy evidence database RCT = Randomized clinical trials

INTRODUCTION

The large amount of publications in health care makes professionals have difficulty to stay up to date. Moreover, a great part of the available information does not come from studies with adequate methodological quality, what makes them of little clinical relevance. Incomplete or inadequate publication of information on the study planning and driving affects the identification of possible methodological errors, also hampering the use of its findings by the interested parties, since they cannot critically assess its clinical applicability[11 Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, et al. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001;134(8):663-94.,22 Schriger DL, Arora S, Altman DG. The content of medical journal instructions for authors. Ann Emer Med. 2006;48(6):743-9.].

Even though randomized clinical trials (RCT) are gold standard for the assessment of health interventions, this type of study is also prone to bias whether due to researchers arbitrariness when selecting the sample and gauging the analyzed variables, or due to the difficulty of controlling other factors that may influence the clinical outcome. Bias or systematic error can be defined as any tendentiousness in the collection, analysis, interpretation, publication or revision of data, which induces conclusions that systematically tend to distance themselves from the truth[33 Carvalho APV, Silva V, Grande AJ. Avaliação do risco de viés de ensaios clínicos randomizados pela ferramenta da colaboração Cochrane. Diagn Tratamento. 2013;18(1):38-44.].

In phase I of cardiac rehabilitation, physiotherapy has an increasingly important role in contributing to the patients return to their social and professional activities in the best possible clinical conditions, thus improving the quality of life[44 Carvalho T, Cortez AA, Ferraz A, Nóbrega ACL, Brunetto AF, Herdy AH, et al. Diretriz de reabilitação cardiopulmonar e metabólica: aspectos práticos e responsabilidades. Arq Bras Cardiol. 2006;86(1):74-82.]. In the early postoperative period after a coronary artery bypass grafting (CABG), respiratory physiotherapy has been widely requested in order to reverse or minimize postoperative pulmonary complications[55 Renault JA, Costa-Val R, Rossetti MB. Fisioterapia respiratória na disfunção pulmonar pós-cirurgia cardíaca. Rev Bras Cir Cardiovasc. 2008;23(4):562-9.]. Techniques that can improve respiratory mechanics, lung re-expansion and bronchial hygiene are applied, contributing to the patients proper ventilation[66 Padovani C, Cavenaghi OM. Recrutamento alveolar em pacientes no pós-operatório imediato de cirurgia cardíaca. Rev Bras Cir Cardiovasc. 2011;26(1):116-21.].

Numerous studies over the past decade have documented that physiotherapists are in favor of evidence-based medicine and recognize the importance of using research results to achieve a more scientific-based clinical practice. Therefore, the number of publications that consistently support the best physiotherapy procedures to be followed have been increasing[77 Dannapfel P, Peolsson A, Nilsen P. What supports physiotherapist's use of research in clinical practice? A qualitative study in Sweden. Implement Sci. 2013;8:31.]. Assessments of physiotherapy intervention studies demonstrate an upward curve in relation to the enrichment of the methodological quality over the past decades[88 Moseley A, Sherrington C, Herbert R, Maher C. The extent and quality of evidence in neurological physiotherapy: an analysis of the Physiotherapy Evidence Database (PEDro). Brain Impair. 2000;1(2):130-40.

9 Sherrington C, Moseley AM, Herbert RD, Elkins MR, Maher CG. Ten years of evidence to guide physiotherapy interventions: Physiotherapy Evidence Database (PEDro). Br J Sports Med. 2010;44(12):836-7.

10 Geha NN, Moseley AM, Elkins MR, Chiavegato LD, Shiwa SR, Costa LO. The quality and reporting of randomized trials in cardiothoracic physical therapy could be substantially improved. Respir Care. 2013;58(11):1899-906.
-1111 Gimenes RO, Fontes SV, Fukujima MM, Matas SLA, Prado GF. Análise crítica de ensaios clínicos aleatórios sobre fisioterapia aquática para pacientes neuroológicos. Rev Neurociências. 2005;13(1):5-10.]. However, there is still great potential for improvement in their elaboration and development.

It should be noted that no evidence can be observed on the methodological quality of RCT of physiotherapy intervention on CABG postoperative patients in the intensive care unit (ICU). Therefore, this research is needed since the fulfillment or not of the criteria for a correct development of this research design can influence the results. Also, complementarily, the dissemination of these data will stimulate further research to be developed with a superior methodological quality, showing the main points that should be better outlined and planned. It will then be possible to obtain greater benefits, as well as improved outcomes for critical patients in daily clinical practice. It should be noted that there is no evidence on the methodological quality of RCT of physiotherapy intervention on CABG postoperative patients in the Intensive Care Unit (ICU).

METHODS

This review was conducted in accordance with the recommendations proposed by the Cochrane Collaboration and the Preferred Reporting Items for Systematic Review and Meta-analyses: The PRISMA[1212 Higgins JPT, Green S. (editors). Cochrane handbook for systematic reviews of interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from: www.cochrane-handbook.org
www.cochrane-handbook.org...
,1313 Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.]. The studies methodological quality was evaluated using the Cochrane Collaboration's tool for assessing risk of bias[1212 Higgins JPT, Green S. (editors). Cochrane handbook for systematic reviews of interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from: www.cochrane-handbook.org
www.cochrane-handbook.org...
], and the correct description of the RCT's items was evaluated using the CONSORT Statement[1414 Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Deveraux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.] and its extension for clinical trials of nonpharmacologic treatment interventions[1515 Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P; CONSORT Group. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008;148(4):295-309.]. When certain items were not applicable to all studies (as in the case of the evaluation of multicenter studies), they were considered as adequate.

Eligibility Criteria

Studies designed as RCT's, with respiratory physiotherapy intervention, associated or not with neuromusculoskeletal physiotherapy, in postoperative patients of CABG in the ICU were included. Studies whose intervention also happened in the preoperative period were included as well. The following were ineligible for inclusion in the review: studies whose patients had undergone another associated surgery and studies that did not contain terms related to physiotherapy and its synonyms (physiotherapy, physical therapy, physiotherapists, physical therapists, and respiratory therapists) anywhere in the paper.

Search Strategies

The search was conducted in the following electronic databases (from inception to May 26, 2015): MEDLINE (via PubMed), Central Register of Controlled Trials (Cochrane CENTRAL) and Physiotherapy Evidence Database (PEDro). Additionally, manual search was conducted in the references of published papers. The search terms used were "Coronary Artery Bypass Grafting", terms related to respiratory physiotherapy interventions, such as "breathing exercises" and "respiratory muscle training", and a word sequence with high sensitivity for the search of randomized RCT described by Robinson & Dickersin[1616 Robinson KA, Dickersin K. Development of a highly sensitive search strategy for the retrieval of reports of controlled trials using PubMed. Int J Epidemiol. 2002;31(1):150-3.]. Papers not published in English were excluded. The full search strategy used in the PubMed, which was adjusted for the search in the other databases, is shown in Table 1.

Table 1
Strategy used for PubMed.

Study Selection and Data Extraction

The selection of studies was carried out by two reviewers (J.L. and C.S.), independently, in two stages: I - selection of studies by reading the titles and abstracts; II - full analysis of papers selected in Phase I. Papers were included in accordance with the eligibility criteria specified previously. In case of disagreement on the paper's inclusion and with no consensus between the reviewers, a third reviewer (R.P.) was consulted. The primary outcome extracted was proper fulfilling of the Cochrane Collaboration's tool's items, and the secondary outcome extracted was suitability to the requirements of the CONSORT Statement and its extension. The data extraction was performed separately and independently by both reviewers (J.L. and C.S.) and cross-checked. Disagreements regarding the data extraction were solved by a third author (R.P.). Three standardized forms were used, which contained: the 25 items of the CONSORT checklist, the 7 items of the Cochrane Collaboration's tool for assessing risk of bias, and the 16 items of the CONSORT checklist extension for clinical trials of non-pharmacologic treatment interventions. For the CONSORT Statement items, the concept of "adequate" or "inadequate" was assigned, according to the description or not of each item in the checklist. The Cochrane Collaboration's tool's items without a clear description were classified with the word "no" or "not report". In the case of missing data, the authors were contacted by e-mail at least twice. The study was excluded if the data were still insufficient after this process.

Data Analysis

The results are going to be descriptively displayed (frequency and percentage).

RESULTS

Description of Studies

The search strategy identified 807 potentially relevant studies, adding a further 17 studies drawn from the reference lists. Subsequently, 172 duplicates were discarded and 565 irrelevant studies were excluded. Among the 87 resulting records, two were excluded for not having been published in English, 25 had not described a term related to physiotherapy and its synonyms, three were not RCT's, seven were not with postoperative patients of CABG or had other associated surgery, two studies had not been performed in the ICU and nine studies were not available. Figure 1 shows the study flowchart.

Fig. 1
Study flowchart.

Among the 39 studies included[1717 Al Jaaly E, Fiorentino F, Reeves BC, Ind PW, Angelini GD, Kemp S, et al. Effect of adding postoperative noninvasive ventilation to usual care to prevent pulmonary complications in patients undergoing coronary artery bypass grafting: a randomized controlled trial. J Thorac Cardiovasc Surg. 2013;146(4):912-8.

18 Barros GF, Santos CS, Granado FB, Costa PT, Limaco RP, Gardenghi G. Treinamento muscular respiratório na revascularização do miocárdio. Rev Bras Cir Cardiovasc. 2010;25(4):483-90.

19 Blattner C, Guaragna JC, Saadi E. Oxygenation and static compliance is improved immediately after early manual hyperinflation following myocardial revascularisation: a randomised controlled trial. Aust J Physiother. 2008;54(3):173-8.

20 Borges DL, Nina VJ, Costal MA, Baldez TE, Santos NP, Lima IM, et al. Effects of different PEEP levels on respiratory mechanics and oxygenation after coronary artery bypass grafting. Rev Bras Cir Cardiovasc. 2013;28(3):380-5.

21 Borgui-Silva A, Mendes RG, Costa FS, Di Lorenzo VA, Oliveira CR, Luzzi S. The influences of positive end expiratory pressure (PEEP) associated wth physiotherapy intervention in phase I cardiac rehabilitation. Clinics (Sao Paulo). 2005;60(6):465-72.

22 Castellana FB, Malbouisson LMS, Carmona MJC, Lopes CR, Auler Júnior JOC. Comparação entre ventilação controlada a volume e a pressão no tratamento da hipoxemia no período pós-operatório de cirurgia de revascularização do miocárdio. Rev Bras Anestesiol. 2003;53(4):440-8.

23 Celebi S, Köner O, Menda F, Omay O, Günay I, Suzer K, et al. Pulmonary effects of noninvasive ventilation combined with the recruitment maneuver after cardiac surgery. Anesth Analg. 2008;107(2):614-9.

24 Crowe JM, Bradley CA. The effectiveness of incentive spirometry with physical therapy for high-risk patients after coronary artery bypass surgery. Phys Ther. 1997;77(3):260-8.

25 Dongelmans DA, Veelo DP, Paulus F, de Mol BA, Korevaar JC, Kudoga A, et al. Weaning automation with adaptive support ventilation: a randomized controlled trial in cardiothoracic surgery patients. Anesth Analg. 2009;108(2):565-71.

26 El-Kader SMA. Blood gases response to different breathing modalities in phase I of cardiac rehabilitation program after coronary artery bypass graft. Eur J Gen Med. 2011;8(2):85-9.

27 Ferreira GM, Haeddner MP, Barreto SSM, Dall'ago P. Espirometria de incentivo com pressão positiva expiratória é benéfica após revascularização miocárdio. Arq Bras Cardiol. 2010;94(2):246-51.

28 Franco AM, Torres FCC, Simon ISL, Morales D, Rodrigues AJ. Avaliação da ventilação não-invasiva com dois níveis de pressão positiva nas vias aéreas após cirurgia cardíaca. Rev Bras Cir Cardiovasc. 2011;26(4):582-90.

29 Garcia RCP, Costa D. Treinamento muscular respiratório em pós-operatório de cirurgia cardíaca eletiva. Rev Bras Fisioter. 2002;6(3):139-46.

30 Gust R, Gottschalk A, Schmidt H, Böttiger BW, Böhrer H, Martin E. Effects of continuous (CPAP) and bi-level positive airway pressure (BiPAP) on extravascular lung water after extubation of the trachea in patients following coronary artery bypass grafting. Intensive Care Med. 1996;22(12):1345-50.

31 Haeffener MP, Ferreira GM, Barreto SS, Arena R, Dall'Ago P. Incentive spirometry with expiratory positive airway pressure reduces pulmonary complications, improves pulmonary function and 6-minute walk distance in patients undergoing coronary artery bypass graft surgery. Am Heart J. 2008;156(5):900.

32 Hendrix H, Kaiser ME, Yusen RD, Merk J. A randomized trial of automated versus conventional protocol-driven weaning from mechanical ventilation following coronary artery bypass surgery. Eur J Cardiothorac Surg. 2006;29(6):957-63.

33 Herdy AH, Marcchi PL, Vila A, Tavares C, Collaço J, Niebauer J, et al. Pre- and postoperative cardiopulmonary rehabilitation in hospitalized patients undergoing coronary artery bypass surgery: a randomized controlled trial. Am J Phys Med Rehabil. 2008;87(9):714-9.

34 Hirschhorn AD, Richards D, Mungovan SF, Morris NR, Adams L. Supervised moderate intensity exercise improves distance walked at hospital discharge following coronary artery bypass graft surgery: a randomised controlled trial. Heart Lung Circ. 2008;17(2):129-38.

35 Jenkins SC, Soutar SA, Loukota JM, Johnson LC, Moxham J. Physiotherapy after coronary artery surgery: are breathing exercises necessary? Thorax. 1989;44(8):634-9.

36 Johnson D, Kelm C, To T, Hurst T, Naik C, Gulka I, et al. Postoperative physical therapy after coronary artery bypass surgery. Am J Respir Crit Care Med. 1995;152(3):953-8.

37 Marvel SL, Elliott CG, Tocino I, Greenway LW, Metcalf SM, Chapman RH. Positive end-expiratory pressure following coronary artery bypass grafting. Chest. 1986;90(4):537-41.

38 Matheus GB, Dragosavac D, Trevisan P, Costa CE, Lopes MM, Ribeiro GCA. Treinamento muscular melhora o volume corrente e a capacidade vital no pós-operatório de revascularização do miocárdio. Rev Bras Cir Cardiovasc. 2012;27(3):362-9.

39 Matte P, Jacquet L, Van Dyck M, Goenen M. Effects of conventional physiotherapy, continuous positive airway pressure and non-invasive ventilatory support with bilevel positive airway pressure after coronary artery bypass grafting. Acta Anaesthesiol Scand. 2000;44(1):75-81.

40 Mendes RG, Simões RP, De Souza Melo Costa F, Pantoni CB, Di Thommazo L, Luzzi S, et al. Short-term supervised inpatient physiotherapy exercise protocol improves cardiac autonomic function after coronary artery bypass graft surgery: a randomised controlled trial. Disabil Rehabil. 2010;32(16):1320-7.

41 Michalopoulos A, Anthi A, Rellos K, Geroulanos S. Effects of positive end-expiratory pressure (PEEP) in cardiac surgery patients. Respir Med. 1998;92(6):858-62.

42 Müller AP, Olandoski M, Macedo R, Costantini C, Guarita-Souza LC. Estudo comparativo entre a pressão positiva intermitente (reanimador de Müller) e contínua no pós-operatório de cirurgia de revascularização do miocárdio. Arq Bras Cardiol. 2006;86(3):232-9.

43 Oikkonen M, Karjalainen K, Kähärä V, Kuosa R, Schavikin L. Comparison of incentive spirometry and intermittent positive pressure breathing after coronary artery bypass graft. Chest. 1991;99(1):60-5.

44 Renault JA, Costa-Val R, Rossetti MB, Neto MH. Comparação entre exercícios de respiração profunda e espirometria de incentivo no pós-operatório de cirurgia de revascularização do miocárdio. Rev Bras Cir Cardiovasc. 2009;24(2):165-72.

45 Richter Larsen K, Ingwersen U, Thode S, Jakobsen S. Mask physiotherapy in patients after heart surgery: a controlled study. Intensive Care Med. 1995;21(6):469-74.

46 Romanini W, Muller AP, Carvalho KAT, Olandoski M, Faria-Neto JR, Mendes FL, et al. Os efeitos da pressão positiva intermitente e do incentivador respiratório no pós-operatório de revascularização miocárdica. Arq Bras Cardiol. 2007; 89(2):105-10.

47 Savci S, Degirmenci B, Saglam M, Arikan H, Inal-Ince D, Turan HN, et al. Short-term effects of inspiratory muscle training in coronary artery bypass graft surgery: a randomized controlled trial. Scand Cardiovasc J. 2011;45(5):286-93.

48 Savci S, Sakinç S, Inal-Ince DI, Kuralay E. Active cycle of breathing techniques and incentive spirometer in coronary artery bypass graft surgery. Fizyoterapi Rehabilitasyon. 2006;17(2):61-9.

49 Stein R, Maia CP, Silveira AD, Chiappa GR, Myers J, Ribeiro JP. Inspiratory muscle strength as a determinant of functional capacity early after coronary artery bypass graft surgery. Arch Phys Med Rehabil. 2009;90(10):1685-91.

50 Stiller K, Montarello J, Wallace M, Daff M, Grant R, Jenkins S, et al. Efficacy of breathing and coughing exercises in the prevention of pulmonary complications after coronary artery surgery. Chest. 1994;105(3):741-7.

51 Sulzer CF, Chioléro R, Chassot PG, Mueller XM, Revelly JP. Adaptive support ventilation for fast tracheal extubation after cardiac surgery: a randomized controlled study. Anesthesiology. 2001;95(6):1339-45.

52 Thomas AN, Ryan JP, Doran BR, Pollard BJ. Nasal CPAP after coronary artery surgery. Anaesthesia. 1992;47(4):316-9.

53 Westerdahl E, Lindmark B, Almgren SO, Tenling A. Chest physiotherapy after coronary artery bypass graft surgery: a comparison of three different deep breathing techniques. J Rehabil Med. 2001;33(2):79-84.

54 Westerdahl E, Lindmark B, Eriksson T, Friberg O, Hedenstierna G, Tenling A. Deep-breathing exercises reduce atelectasis and improve pulmonary function after coronary artery bypass surgery. Chest. 2005;128(5):3482-8.
-5555 Westerdahl E, Lindmark B, Eriksson T, Hedenstierna G, Tenling. The immediate effects of deep breathing exercises on atelectasis and oxygenation after cardiac surgery. Scand Cardiovasc J. 2003;37(6):363-7.], 41.02% (n=16) were conducted in Brazil, 56.41% (n=22) were published between 2000 and 2010, and only 12.82% (n=5) were published in journals specialized in physiotherapy. In relation to the sample, in 33.33% (n=13) of the studies the number of patients was higher than 70, in 58.97% (n=23) the average age was of over 60 years, and in 84.61% (n=33) of the studies more than half of the sample consisted of males. The treatment was provided only in the postoperative period in 69.23% (n=27) of the studies, and in 51.28% (n=20) a patients were monitored until discharge.

The most widely used techniques were re-expansive ventilatory exercises (56.41%), ventilatory exercises for bronchial hygiene (48.71%) and non-invasive mechanical ventilation (41.02%). There was an association of techniques in 69.23% (n=27) of the studies.

The most researched outcomes were atelectasis (48.71%), forced expiratory volume in one second (FEV1) (41.02%), invasive mechanical ventilation time (35.89%) and partial pressure of oxygen (PaO2) (35.89%). The Table 2 shows the characterization studies.

Table 2
Characteristics of studies included in systematic review.

CONSORT Statement

According to the CONSORT assessment, the three items that were best and worst described were, respectively: introduction (100%), interventions (100%), and outcomes and estimation (100%); allocation concealment (7.69%), ancillary analysis (7.69%), and generalizability (2.56%) (Table 3). The CONSORT extension (Table 4) presented as the best described items: participants (100%), interventions (100%), and components of the interventions (100%). On the other hand, the lowest scoring items were title and abstract (0%), assessment of adherence with the protocol (0%), and concealment method (5.12%).

Table 3
CONSORT Statement.
Table 4
Extension of CONSORT Statement.

Seven studies conducted before the CONSORT publication were identified. When compared to other studies, the items introduction, interventions, results, outcomes and estimation, interpretation, and protocol remained equally adequate. The correct description of the items blinding and statistical methods decreased 41.96% and 6.25% respectively in the studies published after the CONSORT. All of the 17 remaining items were described more frequently after the CONSORT publication, as follows: title and abstract (increase of 10.72%), design (increase of 26.34%), participants (increase of 52.68%), sample size (no description of this item was found in any of the studies published previously to the CONSORT, but it was described in 46.87% of the studies after it), random sequence generation (increase of 30.80%), allocation concealment (no description of this item was found in any of the studies published previously to the CONSORT, but it was described in 9.37% of the studies after it), allocation implementation (no description of this item was found in any of the studies published previously to the CONSORT, but it was described in 12.50% of the studies after it), participant flow diagram (increase of 6.69%), recruitment (increase of 15.18%), characteristics (increase of 1.79%), numbers analyzed (increase of 35.27%), ancillary analyses (no description of this item was found in any of the studies published previously to the CONSORT, but it was described in 9.37% of the studies after it), harms (increase of 4.47%), limitations (no description of this item was found in any of the studies published previously to the CONSORT, but it was described in 50% of the studies after it), generalizability (no description of this item was found in any of the studies published previously to the CONSORT, but it was described in 3.12% of the studies after it), registration (no description of this item was found in any of the studies published previously to the CONSORT, but it was described in 6.25% of the studies after it) and funding (increase of 1.34%). The item "protocol" was not appropriate according to the CONSORT requirements in any of the studies evaluated (Figure 2).

Fig. 2
Comparison studies published before and after the CONSORT Statement.

Among the 39 studies, 27 presented its final outcomes as positive and 12 as negative with the proposed treatment. Regarding the CONSORT checklist's Methods section, when evaluated separately in accordance with the outcome, all items showed to have equal or better methodological quality in the studies with positive outcomes, except for the Statistical Methods item (Figure 3).

Fig. 3
Methods section of CONSORT: comparison studies with positive and negative outcomes.

Risk of Bias

Regarding the assessment of the Cochrane Collaboration's tool for risk of bias, description of losses and exclusions in 66.66% of the studies, proper random sequence generation in 51.28%, blinding of outcome assessors in 46.15%, intention-to-treat analysis in 12.82%, and allocation concealment and blinding of patients and investigators in 7.69% could be noted (Table 5).

Table 5
Risk of bias.

DISCUSSION

The development of research related to the assessment of the methodological quality of scientific production in health, especially in physiotherapy, is still of little expression. Therefore, this is the first systematic review that has assessed the methodological quality of RCT of physiotherapy treatment in postoperative patients of CABG in the ICU based on the instruments CONSORT Statement, its extension for non-pharmacologic treatment interventions and the Cochrane Collaboration's tool for assessing risk of bias.

In general, over the years, the methodological quality of studies has increased, especially if we set as a cutoff the year of publication of the CONSORT Statement checklist. Among the checklist's 25 items, five have remained with an equal adequacy rate and 17 have been more broadly documented. Geha et al.[1010 Geha NN, Moseley AM, Elkins MR, Chiavegato LD, Shiwa SR, Costa LO. The quality and reporting of randomized trials in cardiothoracic physical therapy could be substantially improved. Respir Care. 2013;58(11):1899-906.] when assessing the quality of cardiorespiratory physiotherapy studies, found similar results, with a rising curve of quality assessed through the PEDro scale. In a study published by Hopewell et al.[5656 Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG. The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010;340:c723.], in which the quality of trials indexed by the PubMed published between 2000 and 2006 were evaluated, the results were very similar. While the quality of the studies had improved over time, it was still below an acceptable level (for example, only 45% of the trials had included a calculation of the sample size). This suggests that, despite the release of the CONSORT Statement over the last decade, a large proportion of authors, reviewers and journal editors have not yet implemented these recommendations.

The two items that showed an adequacy decline were statistical methods and blinding. The first demonstrated a difference smaller than 7% (two studies), being therefore irrelevant. In studies published after the CONSORT, a reduction of the reporting of blinding in 41.96% of the studies was observed, and only 43.75% informed that blinding was performed in their methodology, with no further details. When the evaluation was directed at whom was blinded (patient, investigators or outcome assessor), the adequacy was even lower, reaching 7.69%. Our results are similar to the studies[88 Moseley A, Sherrington C, Herbert R, Maher C. The extent and quality of evidence in neurological physiotherapy: an analysis of the Physiotherapy Evidence Database (PEDro). Brain Impair. 2000;1(2):130-40.

9 Sherrington C, Moseley AM, Herbert RD, Elkins MR, Maher CG. Ten years of evidence to guide physiotherapy interventions: Physiotherapy Evidence Database (PEDro). Br J Sports Med. 2010;44(12):836-7.

10 Geha NN, Moseley AM, Elkins MR, Chiavegato LD, Shiwa SR, Costa LO. The quality and reporting of randomized trials in cardiothoracic physical therapy could be substantially improved. Respir Care. 2013;58(11):1899-906.
-1111 Gimenes RO, Fontes SV, Fukujima MM, Matas SLA, Prado GF. Análise crítica de ensaios clínicos aleatórios sobre fisioterapia aquática para pacientes neuroológicos. Rev Neurociências. 2005;13(1):5-10.] who assessed the quality of studies in the areas of cardiothoracic, neurological, sports and aquatic physiotherapy, respectively. Research indicates that blinding, or lack thereof, is associated with a greater tendency to maximize the treatment's effect[5757 Gluud LL. Bias in clinical intervention research. Am J Epidemiol. 2006;163(6):493-501.

58 Jüni P, Altman DG, Egger M. Systematic reviews in health care: assessing the quality of controlled clinical trials. BMJ. 2001;323(7303):42-6.

59 Kjaergard LL, Villumsen J, Gluud C. Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med. 2001;135(11):982-9.

60 Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet. 1998;352(9128):609-13.
-6161 Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995;273(5):408-12.]. In a study by Boutron et al.[6262 Boutron I, Tubach F, Giraudeau B, Ravaud P. Blinding was judged more difficult to achieve and maintain in nonpharmacologic than pharmacologic trials. J Clin Epidemiol. 2004;57(6):543-50.], in which pharmacologic and non-pharmacologic treatments for hip or knee osteoarthritis were compared, blinding was found to be less frequent in nonpharmacologic studies, even when there is a possibility to do it. It should be emphasized that an adequate methodological conduct in relation to blinding results in a higher number of professionals involved and often adds costs to the research, which becomes a limiting factor. The lack of blinding interferes directly on the results, making both its internal and external validity look dubious. Consequently, the use of these studies in systematic reviews becomes limited, generating biased results.

Due to the large number of publications, the standardization of papers to the rules of each journal must be followed, which mainly includes a limit for the number of words, tables and figures. For this reason, very precise details of the research development may end up without space. Given this reality, none of the papers included in this review presented the items title and abstract, assessment of adherence to the protocol, interpretation, and generalizability as required by the CONSORT extension for non-pharmacologic treatment interventions. However, these undescribed data may have been part of the research development, but they were not disclosed. Specifically, there is no available information in the literature for us to corroborate such finding. A combination of techniques was present in 69.23% of the studies. This result is in accordance with a systematic review published by Stiller[6363 Stiller K. Physiotherapy in intensive care: an updated systematic review. Chest. 2013;144(3):825-47.] on physiotherapy performance in the ICU. It was not possible to evaluate the effectiveness of each technique alone, the same way as the large heterogeneity of methodologies and samples made it impossible to carry out a statistical analysis.

Another interesting finding of our research was that the 27 studies with positive outcomes demonstrated a better quality regarding the 10 items of CONSORT Methods section. Except for the statistical methods, in which the difference was of only 7%, all other items were appropriately described more often in studies with positive outcomes. Beckerman et al.[6464 Beckerman H, de Bie RA, Bouter LM, De Cuyper HJ, Oostendorp RA. The efficacy of laser therapy for musculoskeletal and skin disorders: a criteria-based meta-analysis of randomized clinical trials. Phys Ther. 1992;72(7):483-91.], when evaluating laser therapy in different musculoskeletal and dermatological conditions, found similar results, with studies with positive outcomes having better quality. A year later, the same author found contrary results when assessing the effectiveness of physiotherapy in musculoskeletal disorders[6565 Beckerman H, Bouter LM, van der Heijden GJ, de Bie RA, Koes BW. Efficacy of physiotherapy for musculoskeletal disorders: what can we learn from research? Br J Gen Pract. 1993;43(367):73-7.]. Studies with negative outcomes tend to be submitted less frequently, with a lower acceptance by journal reviewers. Therefore, there may be an overestimation of treatment effects, leading to important implications in choosing the best treatment to follow.

The gap between the publication of the results of a scientific research and its actual implementation in the professional routine is still substantial, leading to health care practices of levels lower than expected[6666 Ohtake PJ, Strasser DC, Needham DM. Translating research into clinical practice: the role of quality improvement in providing rehabilitation for people with critical illness. Phys Ther. 2013;93(2):128-33.]. However, prior to this, the research planning and development should be improved so that its results are as close as possible to the truth and are legitimized by a methodology of quality.

Limitation of the Study

A limitation of this systematic review is that literature search was not conducted in Embase database.

CONCLUSION

The description of the necessary items for the correct execution, conduction and publication of studies has increased over the years, but it still has great scope for improvement. In general, the methodological quality is below an acceptable level in order to obtain results that are reliable and applicable in the daily practice.

Authors' roles & responsibilities JL Conception and design of the work; acquisition, analysis, interpretation of data for the work; drafting the work and revising it critically for important intellectual content; final approval of the version to be published CS Conception and design of the work; acquisition, analysis, interpretation of data for the work; drafting the work and revising it critically for important intellectual content; final approval of the version to be published RDMP Conception and design of the work; acquisition, analysis, interpretation of data for the work; drafting the work and revising it critically for important intellectual content; final approval of the version to be published
  • This study was carried out at Universidade Federal de Ciências da Saúde de Porto Alegre, RS, Brazil.
  • No financial support.

References

  • 1
    Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, et al. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001;134(8):663-94.
  • 2
    Schriger DL, Arora S, Altman DG. The content of medical journal instructions for authors. Ann Emer Med. 2006;48(6):743-9.
  • 3
    Carvalho APV, Silva V, Grande AJ. Avaliação do risco de viés de ensaios clínicos randomizados pela ferramenta da colaboração Cochrane. Diagn Tratamento. 2013;18(1):38-44.
  • 4
    Carvalho T, Cortez AA, Ferraz A, Nóbrega ACL, Brunetto AF, Herdy AH, et al. Diretriz de reabilitação cardiopulmonar e metabólica: aspectos práticos e responsabilidades. Arq Bras Cardiol. 2006;86(1):74-82.
  • 5
    Renault JA, Costa-Val R, Rossetti MB. Fisioterapia respiratória na disfunção pulmonar pós-cirurgia cardíaca. Rev Bras Cir Cardiovasc. 2008;23(4):562-9.
  • 6
    Padovani C, Cavenaghi OM. Recrutamento alveolar em pacientes no pós-operatório imediato de cirurgia cardíaca. Rev Bras Cir Cardiovasc. 2011;26(1):116-21.
  • 7
    Dannapfel P, Peolsson A, Nilsen P. What supports physiotherapist's use of research in clinical practice? A qualitative study in Sweden. Implement Sci. 2013;8:31.
  • 8
    Moseley A, Sherrington C, Herbert R, Maher C. The extent and quality of evidence in neurological physiotherapy: an analysis of the Physiotherapy Evidence Database (PEDro). Brain Impair. 2000;1(2):130-40.
  • 9
    Sherrington C, Moseley AM, Herbert RD, Elkins MR, Maher CG. Ten years of evidence to guide physiotherapy interventions: Physiotherapy Evidence Database (PEDro). Br J Sports Med. 2010;44(12):836-7.
  • 10
    Geha NN, Moseley AM, Elkins MR, Chiavegato LD, Shiwa SR, Costa LO. The quality and reporting of randomized trials in cardiothoracic physical therapy could be substantially improved. Respir Care. 2013;58(11):1899-906.
  • 11
    Gimenes RO, Fontes SV, Fukujima MM, Matas SLA, Prado GF. Análise crítica de ensaios clínicos aleatórios sobre fisioterapia aquática para pacientes neuroológicos. Rev Neurociências. 2005;13(1):5-10.
  • 12
    Higgins JPT, Green S. (editors). Cochrane handbook for systematic reviews of interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from: www.cochrane-handbook.org
    » www.cochrane-handbook.org
  • 13
    Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.
  • 14
    Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Deveraux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.
  • 15
    Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P; CONSORT Group. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008;148(4):295-309.
  • 16
    Robinson KA, Dickersin K. Development of a highly sensitive search strategy for the retrieval of reports of controlled trials using PubMed. Int J Epidemiol. 2002;31(1):150-3.
  • 17
    Al Jaaly E, Fiorentino F, Reeves BC, Ind PW, Angelini GD, Kemp S, et al. Effect of adding postoperative noninvasive ventilation to usual care to prevent pulmonary complications in patients undergoing coronary artery bypass grafting: a randomized controlled trial. J Thorac Cardiovasc Surg. 2013;146(4):912-8.
  • 18
    Barros GF, Santos CS, Granado FB, Costa PT, Limaco RP, Gardenghi G. Treinamento muscular respiratório na revascularização do miocárdio. Rev Bras Cir Cardiovasc. 2010;25(4):483-90.
  • 19
    Blattner C, Guaragna JC, Saadi E. Oxygenation and static compliance is improved immediately after early manual hyperinflation following myocardial revascularisation: a randomised controlled trial. Aust J Physiother. 2008;54(3):173-8.
  • 20
    Borges DL, Nina VJ, Costal MA, Baldez TE, Santos NP, Lima IM, et al. Effects of different PEEP levels on respiratory mechanics and oxygenation after coronary artery bypass grafting. Rev Bras Cir Cardiovasc. 2013;28(3):380-5.
  • 21
    Borgui-Silva A, Mendes RG, Costa FS, Di Lorenzo VA, Oliveira CR, Luzzi S. The influences of positive end expiratory pressure (PEEP) associated wth physiotherapy intervention in phase I cardiac rehabilitation. Clinics (Sao Paulo). 2005;60(6):465-72.
  • 22
    Castellana FB, Malbouisson LMS, Carmona MJC, Lopes CR, Auler Júnior JOC. Comparação entre ventilação controlada a volume e a pressão no tratamento da hipoxemia no período pós-operatório de cirurgia de revascularização do miocárdio. Rev Bras Anestesiol. 2003;53(4):440-8.
  • 23
    Celebi S, Köner O, Menda F, Omay O, Günay I, Suzer K, et al. Pulmonary effects of noninvasive ventilation combined with the recruitment maneuver after cardiac surgery. Anesth Analg. 2008;107(2):614-9.
  • 24
    Crowe JM, Bradley CA. The effectiveness of incentive spirometry with physical therapy for high-risk patients after coronary artery bypass surgery. Phys Ther. 1997;77(3):260-8.
  • 25
    Dongelmans DA, Veelo DP, Paulus F, de Mol BA, Korevaar JC, Kudoga A, et al. Weaning automation with adaptive support ventilation: a randomized controlled trial in cardiothoracic surgery patients. Anesth Analg. 2009;108(2):565-71.
  • 26
    El-Kader SMA. Blood gases response to different breathing modalities in phase I of cardiac rehabilitation program after coronary artery bypass graft. Eur J Gen Med. 2011;8(2):85-9.
  • 27
    Ferreira GM, Haeddner MP, Barreto SSM, Dall'ago P. Espirometria de incentivo com pressão positiva expiratória é benéfica após revascularização miocárdio. Arq Bras Cardiol. 2010;94(2):246-51.
  • 28
    Franco AM, Torres FCC, Simon ISL, Morales D, Rodrigues AJ. Avaliação da ventilação não-invasiva com dois níveis de pressão positiva nas vias aéreas após cirurgia cardíaca. Rev Bras Cir Cardiovasc. 2011;26(4):582-90.
  • 29
    Garcia RCP, Costa D. Treinamento muscular respiratório em pós-operatório de cirurgia cardíaca eletiva. Rev Bras Fisioter. 2002;6(3):139-46.
  • 30
    Gust R, Gottschalk A, Schmidt H, Böttiger BW, Böhrer H, Martin E. Effects of continuous (CPAP) and bi-level positive airway pressure (BiPAP) on extravascular lung water after extubation of the trachea in patients following coronary artery bypass grafting. Intensive Care Med. 1996;22(12):1345-50.
  • 31
    Haeffener MP, Ferreira GM, Barreto SS, Arena R, Dall'Ago P. Incentive spirometry with expiratory positive airway pressure reduces pulmonary complications, improves pulmonary function and 6-minute walk distance in patients undergoing coronary artery bypass graft surgery. Am Heart J. 2008;156(5):900.
  • 32
    Hendrix H, Kaiser ME, Yusen RD, Merk J. A randomized trial of automated versus conventional protocol-driven weaning from mechanical ventilation following coronary artery bypass surgery. Eur J Cardiothorac Surg. 2006;29(6):957-63.
  • 33
    Herdy AH, Marcchi PL, Vila A, Tavares C, Collaço J, Niebauer J, et al. Pre- and postoperative cardiopulmonary rehabilitation in hospitalized patients undergoing coronary artery bypass surgery: a randomized controlled trial. Am J Phys Med Rehabil. 2008;87(9):714-9.
  • 34
    Hirschhorn AD, Richards D, Mungovan SF, Morris NR, Adams L. Supervised moderate intensity exercise improves distance walked at hospital discharge following coronary artery bypass graft surgery: a randomised controlled trial. Heart Lung Circ. 2008;17(2):129-38.
  • 35
    Jenkins SC, Soutar SA, Loukota JM, Johnson LC, Moxham J. Physiotherapy after coronary artery surgery: are breathing exercises necessary? Thorax. 1989;44(8):634-9.
  • 36
    Johnson D, Kelm C, To T, Hurst T, Naik C, Gulka I, et al. Postoperative physical therapy after coronary artery bypass surgery. Am J Respir Crit Care Med. 1995;152(3):953-8.
  • 37
    Marvel SL, Elliott CG, Tocino I, Greenway LW, Metcalf SM, Chapman RH. Positive end-expiratory pressure following coronary artery bypass grafting. Chest. 1986;90(4):537-41.
  • 38
    Matheus GB, Dragosavac D, Trevisan P, Costa CE, Lopes MM, Ribeiro GCA. Treinamento muscular melhora o volume corrente e a capacidade vital no pós-operatório de revascularização do miocárdio. Rev Bras Cir Cardiovasc. 2012;27(3):362-9.
  • 39
    Matte P, Jacquet L, Van Dyck M, Goenen M. Effects of conventional physiotherapy, continuous positive airway pressure and non-invasive ventilatory support with bilevel positive airway pressure after coronary artery bypass grafting. Acta Anaesthesiol Scand. 2000;44(1):75-81.
  • 40
    Mendes RG, Simões RP, De Souza Melo Costa F, Pantoni CB, Di Thommazo L, Luzzi S, et al. Short-term supervised inpatient physiotherapy exercise protocol improves cardiac autonomic function after coronary artery bypass graft surgery: a randomised controlled trial. Disabil Rehabil. 2010;32(16):1320-7.
  • 41
    Michalopoulos A, Anthi A, Rellos K, Geroulanos S. Effects of positive end-expiratory pressure (PEEP) in cardiac surgery patients. Respir Med. 1998;92(6):858-62.
  • 42
    Müller AP, Olandoski M, Macedo R, Costantini C, Guarita-Souza LC. Estudo comparativo entre a pressão positiva intermitente (reanimador de Müller) e contínua no pós-operatório de cirurgia de revascularização do miocárdio. Arq Bras Cardiol. 2006;86(3):232-9.
  • 43
    Oikkonen M, Karjalainen K, Kähärä V, Kuosa R, Schavikin L. Comparison of incentive spirometry and intermittent positive pressure breathing after coronary artery bypass graft. Chest. 1991;99(1):60-5.
  • 44
    Renault JA, Costa-Val R, Rossetti MB, Neto MH. Comparação entre exercícios de respiração profunda e espirometria de incentivo no pós-operatório de cirurgia de revascularização do miocárdio. Rev Bras Cir Cardiovasc. 2009;24(2):165-72.
  • 45
    Richter Larsen K, Ingwersen U, Thode S, Jakobsen S. Mask physiotherapy in patients after heart surgery: a controlled study. Intensive Care Med. 1995;21(6):469-74.
  • 46
    Romanini W, Muller AP, Carvalho KAT, Olandoski M, Faria-Neto JR, Mendes FL, et al. Os efeitos da pressão positiva intermitente e do incentivador respiratório no pós-operatório de revascularização miocárdica. Arq Bras Cardiol. 2007; 89(2):105-10.
  • 47
    Savci S, Degirmenci B, Saglam M, Arikan H, Inal-Ince D, Turan HN, et al. Short-term effects of inspiratory muscle training in coronary artery bypass graft surgery: a randomized controlled trial. Scand Cardiovasc J. 2011;45(5):286-93.
  • 48
    Savci S, Sakinç S, Inal-Ince DI, Kuralay E. Active cycle of breathing techniques and incentive spirometer in coronary artery bypass graft surgery. Fizyoterapi Rehabilitasyon. 2006;17(2):61-9.
  • 49
    Stein R, Maia CP, Silveira AD, Chiappa GR, Myers J, Ribeiro JP. Inspiratory muscle strength as a determinant of functional capacity early after coronary artery bypass graft surgery. Arch Phys Med Rehabil. 2009;90(10):1685-91.
  • 50
    Stiller K, Montarello J, Wallace M, Daff M, Grant R, Jenkins S, et al. Efficacy of breathing and coughing exercises in the prevention of pulmonary complications after coronary artery surgery. Chest. 1994;105(3):741-7.
  • 51
    Sulzer CF, Chioléro R, Chassot PG, Mueller XM, Revelly JP. Adaptive support ventilation for fast tracheal extubation after cardiac surgery: a randomized controlled study. Anesthesiology. 2001;95(6):1339-45.
  • 52
    Thomas AN, Ryan JP, Doran BR, Pollard BJ. Nasal CPAP after coronary artery surgery. Anaesthesia. 1992;47(4):316-9.
  • 53
    Westerdahl E, Lindmark B, Almgren SO, Tenling A. Chest physiotherapy after coronary artery bypass graft surgery: a comparison of three different deep breathing techniques. J Rehabil Med. 2001;33(2):79-84.
  • 54
    Westerdahl E, Lindmark B, Eriksson T, Friberg O, Hedenstierna G, Tenling A. Deep-breathing exercises reduce atelectasis and improve pulmonary function after coronary artery bypass surgery. Chest. 2005;128(5):3482-8.
  • 55
    Westerdahl E, Lindmark B, Eriksson T, Hedenstierna G, Tenling. The immediate effects of deep breathing exercises on atelectasis and oxygenation after cardiac surgery. Scand Cardiovasc J. 2003;37(6):363-7.
  • 56
    Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG. The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010;340:c723.
  • 57
    Gluud LL. Bias in clinical intervention research. Am J Epidemiol. 2006;163(6):493-501.
  • 58
    Jüni P, Altman DG, Egger M. Systematic reviews in health care: assessing the quality of controlled clinical trials. BMJ. 2001;323(7303):42-6.
  • 59
    Kjaergard LL, Villumsen J, Gluud C. Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med. 2001;135(11):982-9.
  • 60
    Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet. 1998;352(9128):609-13.
  • 61
    Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995;273(5):408-12.
  • 62
    Boutron I, Tubach F, Giraudeau B, Ravaud P. Blinding was judged more difficult to achieve and maintain in nonpharmacologic than pharmacologic trials. J Clin Epidemiol. 2004;57(6):543-50.
  • 63
    Stiller K. Physiotherapy in intensive care: an updated systematic review. Chest. 2013;144(3):825-47.
  • 64
    Beckerman H, de Bie RA, Bouter LM, De Cuyper HJ, Oostendorp RA. The efficacy of laser therapy for musculoskeletal and skin disorders: a criteria-based meta-analysis of randomized clinical trials. Phys Ther. 1992;72(7):483-91.
  • 65
    Beckerman H, Bouter LM, van der Heijden GJ, de Bie RA, Koes BW. Efficacy of physiotherapy for musculoskeletal disorders: what can we learn from research? Br J Gen Pract. 1993;43(367):73-7.
  • 66
    Ohtake PJ, Strasser DC, Needham DM. Translating research into clinical practice: the role of quality improvement in providing rehabilitation for people with critical illness. Phys Ther. 2013;93(2):128-33.

Publication Dates

  • Publication in this collection
    Jul-Aug 2017

History

  • Received
    16 Jan 2017
  • Accepted
    11 May 2017
Sociedade Brasileira de Cirurgia Cardiovascular Rua Afonso Celso, 1178 Vila Mariana, CEP: 04119-061 - São Paulo/SP Brazil, Tel +55 (11) 3849-0341, Tel +55 (11) 5096-0079 - São Paulo - SP - Brazil
E-mail: bjcvs@sbccv.org.br