Acessibilidade / Reportar erro

What do Cochrane systematic reviews say about telemedicine for healthcare?

ABSTRACT

BACKGROUND:

Telemedicine has emerged as a tool for overcoming the challenges of healthcare systems and is likely to become increasingly viable, since information and communication technologies have become more sophisticated and user-friendly.

OBJECTIVE:

We aimed to identify all Cochrane systematic reviews (CSRs) on telemedicine within healthcare and to summarize the current evidence regarding its use.

DESIGN AND SETTING:

Review of CSRs, developed at the Discipline of Emergency and Evidence-Based Medicine, Escola Paulista de Medicina, Universidade Federal de São Paulo.

METHODS:

We searched for studies that compared use of telemedicine with conventional treatment or management of diseases within healthcare. Diagnostic telemedicine studies or studies using automatic text, voice-text or even self-managed care were excluded. The main characteristics and the certainty of evidence were synthetized and critically discussed by all authors.

RESULTS:

We included 10 CSRs that investigated a broad range of diseases. There is still insufficient evidence to determine what types of telemedicine interventions are effective, for which patients and in which settings, and whether such interventions can be used as a replacement for the standard treatment. Harm relating to telemedicine technologies needs to be better investigated and addressed.

CONCLUSION:

Telemedicine might be an excellent way to facilitate access to treatment, monitoring and dissemination of important clinical knowledge. However, given the recognition of systematic reviews as the best evidence resource available for decision-making, further randomized controlled trials with stricter methods are necessary to reduce the uncertainties in evidence-based use of telemedicine.

KEY WORDS:
Telemedicine; Electronic health records; Telerehabilitation; Telephone; Delivery of health care

INTRODUCTION

Telemedicine is the use of information and communication technologies to provide healthcare services, especially when distance is a critical factor in accessing the healthcare provider.11. Maldonado JMSV, Marques AB, Cruz A. Telemedicina: desafios à sua difusão no Brasil [Telemedicine: challenges to dissemination in Brazil]. Cad Saúde Pública. 2016;32 (Suppl 2):e00155615. PMID: 27828681; doi: 10.1590/0102-311X00155615.
https://doi.org/10.1590/0102-311X0015561...
Since 1879, the year in which the first medical telephone consultation was documented in an article published in the Lancet journal,22. Notes, short comments, and answers to correspondents. Lancet. 1879;114(2935):819-22. doi: 10.1016/S0140-6736(02)47536-8.
https://doi.org/10.1016/S0140-6736(02)47...
telemedicine and its use as a tool for improving healthcare have been continually expanding.

Although telemedicine is not a novel activity, it has over the past few years emerged as an alternative tool for addressing the challenges of universal healthcare systems, such as expansion of access to specialized healthcare services in regions that lack these resources.33. World Health Organization. Telemedicine: opportunities and developments in Member States: report on the second global survey on eHealth. 2009. Geneva: World Health Organization (Global Observatory for eHealth Series, 2) Available from: Available from: https://www.who.int/goe/publications/goe_telemedicine_2010.pdf . Accessed in 2019 (Apr 9).
https://www.who.int/goe/publications/goe...
This type of technology not only has the direct impact of improving access to treatment but also positively affects the environment while decreasing emissions of pollutants through reduction of staff and patients’ need to travel. This is favored through remote care,44. World Health Organization. Health and Sustainable development: Telehealth. Available from: Available from: https://www.who.int/sustainable-development/health-sector/strategies/telehealth/en/ . Accessed in 2019 (Apr 9).
https://www.who.int/sustainable-developm...
given that the physical distance between the patient and the provider of the intervention always exists.55. Pagliari C, Sloan D, Gregor P, et al. What is eHealth (4): a scoping exercise to map the field. J Med Internet Res. 2005;7(1):e9. PMID: 15829481; doi: 10.2196/jmir.7.1.e9.
https://doi.org/10.2196/jmir.7.1.e9...

Telemedicine provides a virtual environment that enables remote interaction between healthcare professionals and their patients, and among healthcare professionals themselves. This particular characteristic, which goes beyond conventional standards, changes paradigms and has ethical and legal implications in each country where it is used, especially in relation to the confidentiality of patients’ data.66. Craig J, Patterson V. Introduction to the practice of telemedicine. J Telemed Telecare. 2005;11(1):3-9. PMID: 15829036; doi: 10.1177/1357633X0501100102.
https://doi.org/10.1177/1357633X05011001...
The role of telemedicine within healthcare professionals’ continuing education, research and evaluation is emphasized. This not only improves healthcare access for patients but also enables access to high-quality information for healthcare professionals located in remote settings.77. Rezende EJ, Melo M do C, Tavares EC, Santos A de F, Souza Cd. Ética e telessaúde: reflexões para uma prática segura [Ethics and eHealth: reflections for a safe practice]. Rev Panam Salud Publica. 2010;28(1):58-65. PMID: 20857022; doi: 10.1590/S1020-49892010000700009.
https://doi.org/10.1590/S1020-4989201000...

In the United States, it has been estimated that more than a quarter of consultations are undertaken through telephone calls.88. Vaona A, Pappas Y, Grewal RS, et al. Training interventions for improving telephone consultation skills in clinicians. Cochrane Database Syst Rev. 2017;1:CD010034. PMID: 28052316; doi: 10.1002/14651858.CD010034.pub2.
https://doi.org/10.1002/14651858.CD01003...
Telemedicine has been evolving and progressing through the advent of mobile phone applications such as Doctor On Demand, HealthTap and Pingmd.

The territorial extent of Brazil is huge, with thousands of isolated, difficult-to-access places and unequal distribution of good-quality medical resources. These characteristics put the right to universal, comprehensive and equitable healthcare services at risk and indicate that there is great potential for expansion of telemedicine in this country.11. Maldonado JMSV, Marques AB, Cruz A. Telemedicina: desafios à sua difusão no Brasil [Telemedicine: challenges to dissemination in Brazil]. Cad Saúde Pública. 2016;32 (Suppl 2):e00155615. PMID: 27828681; doi: 10.1590/0102-311X00155615.
https://doi.org/10.1590/0102-311X0015561...
On the other hand, the benefits and harm relating to its use have not yet been established.

OBJECTIVE

The aim of this study was to identify all Cochrane systematic reviews (CSRs) on telemedicine within healthcare and to summarize the current evidence regarding its use.

METHODS

Design

Review of Cochrane systematic reviews (SRs).

Setting

Discipline of Urgency and Evidence-Based Medicine, Escola Paulista de Medicina (EPM), Universidade Federal de São Paulo (UNIFESP), Brazil.

Criteria for including reviews

Types of studies

We considered the latest versions of the published Cochrane SRs. We did not include any protocols or any SRs that had been withdrawn from the Cochrane Database of Systematic Reviews.

Types of participants

We considered all patients who made use of any category of telehealth intervention, without any restriction relating to type of intervention or the age or sex of the participants.

Types of interventions

We considered any category of telemedicine intervention for treatment or management of diseases within healthcare. We excluded studies that assessed the effect of telemedicine for diagnostic purposes or studies that used automatic text or voice-text or even self-managed care.

Types of outcomes

We considered any outcomes that had been assessed and reported by the authors of the SRs included.

Search strategy

We conducted an unrestricted systematic search within the Cochrane Database of Systematic Reviews (via Wiley) on February 26, 2019. The search strategy is presented in Table 1.

Table 1.
Search Strategy in Cochrane Library

Selection of systematic reviews

The selection phase consisted of reading of all the abstracts retrieved, by three researchers independently (APR, ACPNP, KMM), to check their eligibility in relation to the inclusion criteria. Any disagreement was resolved through reaching a consensus among these three authors or by consulting a fourth author (CDQF).

RESULTS

Out of the 326 reviews that had been included in the primary analysis, we selected 10 SRs (published between 2011 and 2016) containing data on 53 randomized controlled trials (RCTs) with 6,836 participants, which had assessed the effectiveness and safety of telemedicine within healthcare. These SRs addressed the effects of telemedicine regarding heart-failure patients (n = 1),77. Rezende EJ, Melo M do C, Tavares EC, Santos A de F, Souza Cd. Ética e telessaúde: reflexões para uma prática segura [Ethics and eHealth: reflections for a safe practice]. Rev Panam Salud Publica. 2010;28(1):58-65. PMID: 20857022; doi: 10.1590/S1020-49892010000700009.
https://doi.org/10.1590/S1020-4989201000...
chronic obstructive pulmonary disease (n = 1),99. McLean S, Nurmatov U, Liu JL, et al. Telehealthcare for chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2011;7:CD007718. PMID: 21735417; doi: 10.1002/14651858.CD007718.pub2.
https://doi.org/10.1002/14651858.CD00771...
treatment and management of asthma (n = 2),1010. Kew KM, Cates CJ. Remote versus face‐to‐face check‐ups for asthma. Cochrane Database Syst Rev. 2016;4:CD011715. PMID: 27087257; doi: 10.1002/14651858.CD011715.pub2.
https://doi.org/10.1002/14651858.CD01171...
,1111. Kew KM, Cates CJ. Home telemonitoring and remote feedback between clinic visits for asthma. Cochrane Database Syst Rev. 2016;8:CD011714. PMID: 27486836; doi: 10.1002/14651858.CD011714.pub2.
https://doi.org/10.1002/14651858.CD01171...
low vision (n = 1),1212. Bittner AK, Wykstra SL, Yoshinaga PD, Li T. Telerehabilitation for people with low vision. Cochrane Database Syst Rev. 2015;8:CD011019. PMID: 26329308; doi: 10.1002/14651858.CD011019.pub2.
https://doi.org/10.1002/14651858.CD01101...
multiple sclerosis (n = 1),1313. Khan F, Amatya B, Kesselring J, Galea M. Telerehabilitation for persons with multiple sclerosis. Cochrane Database Syst Rev. 2015;(4):CD010508; PMID: 25854331; doi: 10.1002/14651858.CD010508.pub2.
https://doi.org/10.1002/14651858.CD01050...
stroke (n = 1),1414. Laver KE, Schoene D, Crotty M, et al. Telerehabilitation services for stroke. Cochrane Database Syst Rev. 2013;12:CD010255. PMID: 24338496; doi: 10.1002/14651858.CD010255.pub2.
https://doi.org/10.1002/14651858.CD01025...
parents of high-risk newborns (n = 1),1515. Tan K, Lai NM. Telemedicine for the support of parents of high‐risk newborn infants. Cochrane Database Syst Rev. 2012;(6):CD006818. PMID: 22696360; doi: 10.1002/14651858.CD006818.pub2.
https://doi.org/10.1002/14651858.CD00681...
HIV patients (n = 1),1616. Gentry S, van-Velthoven MH, Tudor Car L, Car J. Telephone delivered interventions for reducing morbidity and mortality in people with HIV infection. Cochrane Database Syst Rev. 2013;(5):CD009189. PMID: 23728687; doi: 10.1002/14651858.CD009189.pub2.
https://doi.org/10.1002/14651858.CD00918...
and children and adolescents with chronic pain (n = 1).1818. Fisher E, Law E, Palermo TM, Eccleston C. Psychological therapies (remotely delivered) for the management of chronic and recurrent pain in children and adolescents. Cochrane Database Syst Rev. 2015;(3):CD011118. PMID: 25803793; doi: 10.1002/14651858.CD011118.pub2.
https://doi.org/10.1002/14651858.CD01111...
The main results are shown in Table 2.

Table 2.
Characteristics of studies included

Home telemonitoring and remote feedback for asthma

This review1111. Kew KM, Cates CJ. Home telemonitoring and remote feedback between clinic visits for asthma. Cochrane Database Syst Rev. 2016;8:CD011714. PMID: 27486836; doi: 10.1002/14651858.CD011714.pub2.
https://doi.org/10.1002/14651858.CD01171...
included 18 parallel RCTs with a total of 2,268 participants. The results from this review showed that there was no difference between home telemonitoring and the usual monitoring relating to exacerbations that would require use of oral corticosteroids (odds ratio [OR] 0.93; 95% confidence interval [CI] 0.60 to 1.44; 466 participants; four studies; I2 = 0%; low quality of evidence). In relation to exacerbations requiring hospitalization, there was uncertainty regarding the benefit or harm, compared with the standard monitoring procedure (OR 0.56; 95% CI 0.21 to 1.49; 1,042 participants; 10 studies; I2 = 45%; moderate quality of evidence).

Overall, the evidence relating to asthma control was very weak due to the inconsistency of outcomes. The patients in the telemedicine groups scored better in the Asthma Quality of Life Questionnaire than did those who were monitored using standard protocols (median difference [MD] 0.23; 95% CI 0.01 to 0.45; 796 participants; six studies; I2 = 54%; low quality of evidence). Adverse events, whether serious or non-serious, were not reported in any of the studies included in this review. Small benefits regarding quality of life were observed, although the studies were unblinded. Some benefits regarding lung function were reported, but the effects were uncertain due to possible attrition bias.

The quality of evidence was downgraded by the SR authors because of imprecision, inconsistency, publication bias and the risk of bias. The authors of the review1111. Kew KM, Cates CJ. Home telemonitoring and remote feedback between clinic visits for asthma. Cochrane Database Syst Rev. 2016;8:CD011714. PMID: 27486836; doi: 10.1002/14651858.CD011714.pub2.
https://doi.org/10.1002/14651858.CD01171...
concluded that the current evidence did not support widespread implementation of telemonitoring, with feedback between visits to asthma clinics.

For further details, the full content of this review can be accessed through: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD011714.pub2/full.

Remote check-ups for asthma

Six RCTs with 2,100 participants were included in this review.1010. Kew KM, Cates CJ. Remote versus face‐to‐face check‐ups for asthma. Cochrane Database Syst Rev. 2016;4:CD011715. PMID: 27087257; doi: 10.1002/14651858.CD011715.pub2.
https://doi.org/10.1002/14651858.CD01171...
These RCTs compared remote check-ups using various forms of telehealth technology (telephone calls or video-conferencing) versus standard face-to-face check-ups. The results from a cluster study and an oral steroid tapering study were also included, but they were reported separately.

The effects from use of telehealth among people who required oral corticosteroids to treat exacerbations were greater in the telehealth group than in the control group, although the confidence intervals were very wide due to the small number of events (OR 1.74; 95% CI 0.41 to 7.44; 278 participants; low quality of evidence). Moreover, the cluster study showed that there were positive effects in the face-to-face check-up groups (OR 1.43, 95% CI 1.04 to 1.97).

The effect of exacerbation events that needed emergency department visits favored the face-to-face check-up groups, but this was uncertain due to the small number of events (OR 2.60; 95% CI 0.63 to 10.64; 651 participants; three studies; low quality of evidence). However, neither the RCTs (Peto OR 0.63; 95% CI 0.06 to 6.32; 651 participants; three studies; low quality of evidence) nor the cluster implementation study (Peto OR 2.18; 95% CI 0.83 to 5.69; 1,213 participants; one study) showed any statistically significant benefits, compared with face-to-face check-ups, regarding exacerbations that required hospital admission.

The authors of this review reported that there were no differences relating to the scores obtained in the Asthma Control Questionnaire between the remote and face-to-face groups (MD 0.07; 95% CI −0.35 to 0.21; 146 participants; one study; moderate quality of evidence). There were no differences between the two groups regarding asthma-related quality of life, as determined through the Asthma Quality of Life Questionnaire (MD 0.08; 95% CI −0.14 to 0.30; 544 participants; three studies; moderate quality of evidence).

The results relating to unscheduled healthcare visits were imprecise with few events and, therefore, it was impossible to draw a conclusion. Lung function assessed by means of forced expiratory volume in the first second (FEV1) was only reported in one study. The authors of this review1010. Kew KM, Cates CJ. Remote versus face‐to‐face check‐ups for asthma. Cochrane Database Syst Rev. 2016;4:CD011715. PMID: 27087257; doi: 10.1002/14651858.CD011715.pub2.
https://doi.org/10.1002/14651858.CD01171...
identified enhancement of lung function in the remote check-up group, compared with the face-to-face group (MD 166.76; 95% CI 78.03 to 255.50; 253 participants; one study; moderate quality of evidence). No adverse events, whether serious or non-serious, were recorded in any of the studies included in this review.

All the available evidence was based on small RCTs. Outcomes relating to lung function, asthma control and exacerbations requiring oral corticosteroids were only reported in one study. The evidence was downgraded by the SR authors to moderate quality regarding asthma-related quality of life and asthma control because of the lack of blinding of the participants and outcome assessments. The evidence regarding the lung function was downgraded because of imprecision relating to the small sample size. The data on the other outcomes were of low quality due to the wide CIs, small number of events and risk of bias.

For further details, the full content of this review can be accessed through: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD011715.pub2/full.

Telehealthcare for chronic obstructive pulmonary disease (COPD)

This review99. McLean S, Nurmatov U, Liu JL, et al. Telehealthcare for chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2011;7:CD007718. PMID: 21735417; doi: 10.1002/14651858.CD007718.pub2.
https://doi.org/10.1002/14651858.CD00771...
included 10 RCTs comparing telehealth with the usual care among 1,004 patients who had been diagnosed with COPD.

Total number of exacerbations was only analyzed in one RCT, with borderline statistical significance (P = 0.06). In another trial, it was reported that the mean number of exacerbations per month was significantly higher among the controls than in the telehealthcare group (0.78 ± 0.77 and 0.23 ± 0.38, respectively; P < 0.0001). The number of days that were free from exacerbation after one year was higher in the intervention group (30%) than in the control group (5%).

Quality of life was assessed through scores from the validated St George Respiratory Questionnaire (SGRQ), and improvement of quality of life showed slight clinical significance with very wide confidence intervals (MD -6.57; 95% CI -13.62 to 0.48; 253 participants; two studies). The patients who received telehealthcare were much less likely to attend the emergency department than were the individuals in the control group (OR 0.27; 95% CI 0.11 to 0.66; 449 patients; three studies), and the number of patients with one or more hospital admissions was lower in the telehealthcare group (OR 0.46; 95% CI 0.33 to 0.65; P < 0.00001; 604 patients; four studies). There was no difference in mortality rate between the groups (OR 1.05; 95% CI 0.63 to 1.75; P = 0.86; 503 patients; three studies). There were no differences between the groups regarding lung function or patient satisfaction. The authors of this review encouraged support for telehealthcare, even though the evidence came from very heterogeneous studies.

For further details, the full content of this review can be accessed through: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD007718.pub2/full.

Telerehabilitation for people with low vision

This review1212. Bittner AK, Wykstra SL, Yoshinaga PD, Li T. Telerehabilitation for people with low vision. Cochrane Database Syst Rev. 2015;8:CD011019. PMID: 26329308; doi: 10.1002/14651858.CD011019.pub2.
https://doi.org/10.1002/14651858.CD01101...
did not find any RCTs that had evaluated the effectiveness and/or safety of telerehabilitation for people with low vision. However, given the growing interest in telemedicine and the burden of low vision, it was recommended that pilot studies should be conducted in the future in order to explore the potential for telemedicine to provide rehabilitation for people with low vision.

For further details, the full content of this review can be accessed through: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD011019.pub2/full?highlightAbstract­=telerehabilit%7Cwithdrawn%7Ctelerehabilitation.

Telerehabilitation for patients with multiple sclerosis

This review1313. Khan F, Amatya B, Kesselring J, Galea M. Telerehabilitation for persons with multiple sclerosis. Cochrane Database Syst Rev. 2015;(4):CD010508; PMID: 25854331; doi: 10.1002/14651858.CD010508.pub2.
https://doi.org/10.1002/14651858.CD01050...
included nine RCTs (n = 531 participants) that assessed a wide variety of telerehabilitation methods among adults with multiple sclerosis. The patients’ ages ranged from 41 to 52 years (mean of 46.5 years). The mean number of years since the patients received their diagnosis ranged from 7.7 to 19 years (mean of 12.3 years).

The telerehabilitation interventions included physical activity and educational, behavioral and symptom management programs. The duration of the interventions ranged from one to six months (median of 12 weeks). The main outcomes evaluated were the following: functional activities; improvement in symptoms or impairments (pain, fatigue, spasms frequency, spasticity and others); quality of life; and psychosocial outcomes.

No quantitative analysis could be conducted in this review,1313. Khan F, Amatya B, Kesselring J, Galea M. Telerehabilitation for persons with multiple sclerosis. Cochrane Database Syst Rev. 2015;(4):CD010508; PMID: 25854331; doi: 10.1002/14651858.CD010508.pub2.
https://doi.org/10.1002/14651858.CD01050...
due to clinical and methodological heterogeneity. Overall, the review found that there was a low level of certainty regarding telerehabilitation interventions for reducing short-term disability and symptoms, such as fatigue in patients with multiple sclerosis. In longer-term follow-ups, there was also a low level of certainty regarding telerehabilitation for improving functional activities and impairments (such as fatigue, pain and insomnia); and regarding participation, as measured in terms of quality of life and psychological outcomes. Regarding safety, the studies included did not report any adverse event relating to telerehabilitation.

Multiple sclerosis is a complex condition and the range of telerehabilitation interventions and their prescription requirements can vary from person to person and are difficult to standardize. Factors such as the patients’ functional abilities, personal characteristics and comorbidities and the characteristics of the healthcare system may influence patients’ outcomes. The interaction of these factors with rehabilitation strategies and their impact on patients’ outcomes is still little understood. However, because the multiple sclerosis population is young and has high rates of internet use, these patients are likely to be receptive to telerehabilitation.

In addition to the limited number of studies in this review and the high heterogeneity among these studies, methodological weaknesses were identified in them (underpowered data due to small sample sizes, high risk of bias, short follow-up periods, lack of rigorous methodology and differences in outcome measurements).

For further details, the full content of this review can be accessed through: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD010508.pub2/full?highlightAbstract­=telerehabilit%7Cwithdrawn%7Ctelerehabilitation.

Telerehabilitation for stroke

Ten RCTs (n = 933) were included in this review.1414. Laver KE, Schoene D, Crotty M, et al. Telerehabilitation services for stroke. Cochrane Database Syst Rev. 2013;12:CD010255. PMID: 24338496; doi: 10.1002/14651858.CD010255.pub2.
https://doi.org/10.1002/14651858.CD01025...
Regarding age, the patients were in their 50s to 70s. All interventions were delivered in the patients’ own homes. The patients were generally in the chronic phase following a stroke.

The telerehabilitation interventions included use of telephones, videoconferencing hardware and software, desktop videophones, in-home messaging devices, video recordings, emails, online chat programs and online resource rooms. The intervention approaches included upper limb training, lower limb and mobility retraining, case management and caregiver support. Several outcomes were evaluated, such as physical function, independence in activities of daily living, quality of life and participant satisfaction.

Pooled data from 661 participants did not show any statistically significant results regarding independence in activities of daily living when a case management intervention was evaluated (standardized mean difference [SMD] 0.00; 95% CI ‐0.15 to 0.15). No statistically significant results regarding upper limb function (based on two studies with 46 participants: MD 3.65; 95% CI ‐0.26 to 7.57) were observed when computer software was used to remotely retrain upper limb function.

Insufficient evidence was found to draw any conclusions regarding the effects of the intervention on mobility, health‐related quality of life or participant satisfaction with the intervention. No adverse events were reported within the studies.

Overall, telerehabilitation offers great potential as an intervention to be used in addition to current therapies or as a therapy for patients with difficulty in accessing places where face-to-face rehabilitation can be provided. However, it is still important to investigate whether there are any differences in the same therapy between delivery face-to-face and delivery via telecommunication.

For further details, the full content of this review can be accessed through: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD010255.pub2/full?highlightAbstract­=telerehabilit%7Cwithdrawn%7Ctelerehabilitation.

Telemedicine for supporting parents or caregivers of high-risk newborns while hospitalized in an intensive care unit

The aim of this review1515. Tan K, Lai NM. Telemedicine for the support of parents of high‐risk newborn infants. Cochrane Database Syst Rev. 2012;(6):CD006818. PMID: 22696360; doi: 10.1002/14651858.CD006818.pub2.
https://doi.org/10.1002/14651858.CD00681...
was to assess the effects of use of telemedicine (Baby Carelink) to support the families of newborns, regarding the newborn’s length of hospital stay and the family’s satisfaction while the newborn was hospitalized in an neonatal intensive care unit (NICU), compared with those that received standard care without access to this telemedicine program. The study included one RCT (n = 56 newborn infants). The Baby Carelink program consisted of use of multimedia and videoconference devices that provided the families with the infant’s daily clinical progress and also enabled provision of clinical information, communication through a message center, release preparation, viewing of the infant and a family room.

The results from the review showed that the lengths of hospital stay were similar in the telemedicine group (68.5 days; standard deviation [SD] 28.3 days) and the control group (70.6 days; SD 35.6 days; MD -2.10 days; 95% CI -18.85 to 14.65 days). The quality of the evidence was very low due to the small sample size and imprecision of the effect estimates.

The participants formed a very specific group: families living within the urban area, with good internet access, who were competent in English and had higher economic status than other possible candidates. There was a withdrawal rate of 20% within the control group, since these newborns were transferred back to level-2 nurseries. The data regarding family satisfaction and other outcomes were insufficient for conducting proper analysis.

Thus, so far, there is not enough evidence to promote use of telemedicine to support parents or caregivers of newborns receiving intensive care as an effective procedure. However, this study dates back to the year 2000 and many technological resources have been developed since then. For this reason, we cannot rule out the idea that application of telemedicine to this kind of population now could have a different outcome.

For further details, the full content of this review can be accessed through: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD006818.pub2/epdf/full.

Telephone-delivered interventions for HIV-infected patients:

The aim of this review1616. Gentry S, van-Velthoven MH, Tudor Car L, Car J. Telephone delivered interventions for reducing morbidity and mortality in people with HIV infection. Cochrane Database Syst Rev. 2013;(5):CD009189. PMID: 23728687; doi: 10.1002/14651858.CD009189.pub2.
https://doi.org/10.1002/14651858.CD00918...
was to assess the effectiveness of interventions delivered by telephone, compared with standard care for HIV-infected patients. It included 11 RCTs, with 1,381 participants.

The main findings were that there were no differences between the intervention and control groups regarding adherence to antiretroviral medication, with low quality of evidence (3 studies; 191 participants; SMD 0.49; 95% CI -1.12 to 2.11; P = 0.55), or regarding depressive symptoms, also with low quality of evidence (3 studies; 447 participants; SMD 0.02; 95% CI -0.18 to 0.21; P = 0.85). In relation to all other information (reduction of risky sexual behavior, virological outcomes and psychiatric symptoms other than depression), there was insufficient data to provide meta-analyses.

For further details, the full content of this review can be accessed through: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD009189.pub2/full.

Structured telephone support or non-invasive telemonitoring for patients with heart failure

This review1717. Inglis SC, Clark RA, Dierckx R, Prieto‐Merino D, Cleland JG. Structured telephone support or non‐invasive telemonitoring for patients with heart failure. Cochrane Database Syst Rev. 2015;(10):CD007228. PMID: 26517969; doi: 10.1002/14651858.CD007228.pub3.
https://doi.org/10.1002/14651858.CD00722...
addressed how telemonitoring and structured telephone support could help patients with heart failure in relation to undesirable outcomes such as hospitalization and death. The difference between these two interventions lay in the manner in which they were used: structured telephone support only used the technology of transmission by telephone to collect patient data; while telemonitoring involved multiple ways of transmission, such as Bluetooth, satellite and wireless technologies. For this review, 25 studies evaluated structured telephone support interventions (9,332 participants) and 18 studies assessed non-invasive home telemonitoring (3,860 participants).

The main findings from this review regarding non-invasive telemonitoring were that it gave rise to reductions in the all-cause mortality rates (17 studies; 3,740 participants; relative risk [RR] 0.80; 95% CI 0.68 to 0.94; P = 0.0057); and reductions in heart failure-related hospitalizations (8 studies; 2148 participants; RR 0.71; 95% CI 0.60 to 0.83; P = 0.000013). Structured telephone support also reduced all-cause mortality (22 studies; 9,222 participants; RR 0.87; 95% CI 0.77 to 0.98; P = 0.017) and had a positive impact regarding reduction of hospitalizations caused by heart failure (16 studies; 7,030 participants; RR 0.85; 95% CI 0.77 to 0.93; P = 0.00047). All of these outcomes were graded as presenting moderate quality of evidence.

This review did not show any difference regarding reduction of the risk of all-cause hospitalizations, (structured telephone support: 16 studies; 7,216 participants; RR 0.95; 95% CI 0.90 to 1.00; P = 0.055; and non-invasive telemonitoring: 13 studies; 3,332 participants; RR 0.95; 95% CI 0.89 to 1.01; P = 0.033), with very low quality of evidence. The outcomes of length of stay, quality of life related to the health condition, cost effectiveness and treatment adherence were not described consistently, which hindered development of a meta-analysis. The funnel plot analyses demonstrated that there was strong evidence of publication bias.

For further details, the full content of this review can be accessed through: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD007228.pub3/full.

Psychological therapies (remotely delivered) for management of chronic and recurrent pain in children and adolescents

This review1818. Fisher E, Law E, Palermo TM, Eccleston C. Psychological therapies (remotely delivered) for the management of chronic and recurrent pain in children and adolescents. Cochrane Database Syst Rev. 2015;(3):CD011118. PMID: 25803793; doi: 10.1002/14651858.CD011118.pub2.
https://doi.org/10.1002/14651858.CD01111...
examined the effectiveness of treatments performed remotely (via the internet, telephone and audiotapes, among other methods), in comparison with face-to-face psychological therapy or waiting-list control in a population from 0 to 18 years of age with chronic and recurrent pain. It included 8 studies, with 371 participants.

The severity of headache pain was reduced through remote psychological treatments (6 studies; 247 participants; RR 2.65; 95% CI 1.56 to 4.50; P = 0.00030; number needed to treat to benefit [NNTB] 2.88). For mixed pain conditions, i.e. musculoskeletal pain or abdominal pain with recurrence, there was a beneficial effect regarding reduction of pain intensity post-treatment (3 studies; 131 participants; standardized mean difference [SMD] -0.61; 95% CI -0.96 to -0.25; P = 0.00074).

At follow-up, however, no statistical difference in headache conditions was achieved (3 studies; 85 participants; RR 1.56; 95% CI 0.67 to 3.68; P = 0.30). This was also observed regarding the outcome of depression, when analyzed in the same headache groups (2 studies; 103 participants; SMD 0.02; 95% CI -0.38 to 0.43; P = 0.91). For headache and mixed conditions, there were no beneficial effects from the therapies included as interventions in this review (2 studies; 94 participants; SMD -0.50; 95% CI -1.02 to 0.02; P = 0.06). No data were available in relation to any other outcomes, or in relation to adverse events.

The authors of this review did not use GRADE (the grading of recommendations, assessment, development and evaluations recommended by Cochrane) in the assessment of risk of bias because of the lack of information in the studies included. However, they classified most of the studies as presenting “low risk” or “unclear risk” of bias.

For further details, the full content of this review can be accessed through: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD011118.pub2/full.

DISCUSSION

The use of telemedicine is likely to become increasingly viable as information and communication technologies within healthcare become more sophisticated and user friendly. The driving force behind this is the need for an alternative to face-to-face interventions that enables service delivery in the natural environment, i.e. in patients’ homes.

For pulmonary care, telemedicine has become an important alternative to the standard care. Chronic obstructive pulmonary disease (COPD) is the third leading cause of death worldwide.1919. World Health Organization. Chronic obstructive pulmonary disease (COPD). 2017. Geneva: World Health Organization . Available from: Available from: https://www.who.int/news-room/fact-sheets/detail/chronic-obstructive-pulmonary-disease-(copd) . Accessed in 2019 (May 8).
https://www.who.int/news-room/fact-sheet...
,2020. Vitacca M, Montini A, Comini L. How will telemedicine change clinical practice in chronic obstructive pulmonary disease? Ther Adv Respir Dis. 2018;12:1753465818754778. PMID: 29411700; doi: 10.1177/1753465818754778.
https://doi.org/10.1177/1753465818754778...
Moreover, it has been estimated that around 300 million people around the world are affected by asthma. Thus, there is a need to explore the available evidence regarding the benefits or harm from telemedicine care. Telemedicine seems to reduce hospitalization and emergency department visits, and it possibly has an impact on the quality of life of patients with COPD.2121. Murphy LA, Harrington P, Taylor SJ, et al. Clinical-effectiveness of self-management interventions in chronic obstructive pulmonary disease: An overview of reviews. Chron Respir Dis. 2017;14(3):276-88. PMID: 28774200; doi: 10.1177/1479972316687208.
https://doi.org/10.1177/1479972316687208...
,99. McLean S, Nurmatov U, Liu JL, et al. Telehealthcare for chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2011;7:CD007718. PMID: 21735417; doi: 10.1002/14651858.CD007718.pub2.
https://doi.org/10.1002/14651858.CD00771...

Telerehabilitation is an emerging method that extends rehabilitative care beyond the hospital, using telecommunication technology at home or in the community.2222. Hailey D, Roine R, Ohinmaa A, Dennett L. Evidence of benefit from telerehabilitation in routine care: a systematic review. J Telemed Telecare. 2011;17(6):281-7. PMID: 21844172; doi: 10.1258/jtt.2011.101208.
https://doi.org/10.1258/jtt.2011.101208...
Overall, a wide range of telerehabilitation methods have been studied, but the evidence for their effectiveness remains unclear. In this review, we found that the telerehabilitation interventions evaluated were complex, with various rehabilitation components that included physical activity and educational, behavioral and symptom management programs. These interventions had different purposes and used different technologies, and therefore no single definitive overall conclusion was possible.

We also performed a broad search in the Medline database via PubMed on March 12, 2019, in order to find other reviews. The PubMed search strategy is provided in Appendix A Appendix A. MEDLINE via PubMed search strategy (((“Telemedicine”[Mesh]) OR (mobile health) OR (health, mobile) OR telehealth OR ehealth))) AND ((((systematic review[ti] OR systematic literature review[ti] OR systematic scoping review[ti] OR systematic narrative review[ti] OR systematic qualitative review[ti] OR systematic evidence review[ti] OR systematic quantitative review[ti] OR systematic meta-review[ti] OR systematic critical review[ti] OR systematic mixed studies review[ti] OR systematic mapping review[ti] OR systematic cochrane review[ti] OR systematic search and review[ti] OR systematic integrative review[ti]) NOT comment[pt] NOT (protocol[ti] OR protocols[ti])) NOT MEDLINE[subset]) OR (Cochrane Database Syst Rev[ta] AND review[pt]) OR systematic review[pt]) . Our search retrieved 1,274 reviews. We looked for SRs on asthma, chronic obstructive pulmonary disease, stroke, low vision, multiple sclerosis, parents of high-risk newborns, HIV patients, heart-failure patients or children and adolescents with chronic pain, in order to make comparisons with our Cochrane database findings.

In general, the Cochrane reviews had broader searches and identified greater numbers of randomized trials than were described in other reviews2323. Johansson T, Wild C. Telerehabilitation in stroke care--a systematic review. J Telemed Telecare. 2011;17(1):1‐6. PMID: 21097560; doi: 10.1258/jtt.2010.100105.
https://doi.org/10.1258/jtt.2010.100105...
,2424. Kairy D, Lehoux P, Vincent C, Visintin M. A systematic review of clinical outcomes, clinical process, healthcare utilisation and costs associated with telerehabilitation. Disabil Rehabil. 2009;31(6):427-47. PMID: 18720118; doi: 10.1080/09638280802062553.
https://doi.org/10.1080/0963828080206255...
published within the same period as the Cochrane SRs (2011-2016). However, it seems that the Cochrane and non-Cochrane reviews came to similar conclusions: namely, that the evidence is currently insufficient to draw any conclusions regarding the effectiveness of telemedicine.2525. Zhao J, Zhai YK, Zhu WJ, Sun DX. Effectiveness of telemedicine for controlling asthma symptoms: a systematic review and meta-analysis. Telemed J E-Health. 2015;21(6):484-92. PMID: 25393915; doi: 10.1089/tmj.2014.0119.
https://doi.org/10.1089/tmj.2014.0119...
Nonetheless, a recent review (found in Medline) that was published after 2016 showed that telemedicine was a promising alternative tool for improving motor function in patients who had suffered a stroke.2626. Sarfo FS, Ulasavets U, Opare-Sem OK, Ovbiagele B. Tele-rehabilitation after stroke: an updated systematic review of the literature. J Stroke Cerebrovasc Dis. 2018;27(9):2306-18. PMID: 29880211; doi: 10.1016/j.jstrokecerebrovasdis.2018.05.013.
https://doi.org/10.1016/j.jstrokecerebro...

Furthermore, although the purpose of telemedicine is to reduce costs and overcome some barriers such as availability of transportation, hospital costs and ability to make visits to healthcare professionals, no Cochrane reviews have identified any trials on its cost-effectiveness. Establishment of telemedicine services can be expensive due to the costs of equipment, training and ongoing technical support. Therefore, it is important to determine whether, once telemedicine services have been established, they should be used as an alternative or as a supplement to the conventional therapy that is delivered face‐to‐face.

It is also relevant to note that the use of technology to facilitate communication may, on the other hand, lead to miscommunication. For example, healthcare professionals may make errors relating to their assessments of patients, or these patients may misunderstand the advice or instructions provided by the healthcare professional. Therefore, not only the benefits, but also the harm associated with telemedicine needs to be addressed.

Overall, there is still insufficient evidence regarding what types of telemedicine interventions are effective, and for which patients in which setting. Here, we can also highlight the lack of robust, methodologically strong studies evaluating the effectiveness of the different technologies relating to telemedicine interventions. Researchers should ensure that trials are adequately powered, developed with high methodological quality and reported in compliance with the Consolidated Standards of Reporting Trials (CONSORT) guidelines.

CONCLUSION

In the data universe of the Cochrane Library, we found 10 Cochrane systematic reviews relating to the use of telemedicine within healthcare. The quality of the evidence reported was too low to support or refute the use of this technology within clinical practice as an effective intervention for replacement of standard treatment. The best evidence available was of moderate quality, relating to the effectiveness of telemedicine among patients with heart failure, for reducing the risks of heart failure-related hospitalization and all-cause mortality.

Given the growing interest in telemedicine and the recognition of the Cochrane Library as the best evidence resource available for decision-making, further RCTs with stricter methods are necessary in order to address many structured clinical questions and inform better systematic reviews. Such RCTs will be able to evaluate the efficacy, effectiveness, efficiency and safety of telemedicine. In this manner, the uncertainties regarding the therapeutic, managerial, ethical and economic aspects of evidence-based telemedicine could be reduced. Moreover, telemedicine may be an excellent way to facilitate access to treatment and monitoring and to disseminate important clinical knowledge among healthcare professionals.

REFERENCES

  • 1
    Maldonado JMSV, Marques AB, Cruz A. Telemedicina: desafios à sua difusão no Brasil [Telemedicine: challenges to dissemination in Brazil]. Cad Saúde Pública. 2016;32 (Suppl 2):e00155615. PMID: 27828681; doi: 10.1590/0102-311X00155615.
    » https://doi.org/10.1590/0102-311X00155615
  • 2
    Notes, short comments, and answers to correspondents. Lancet. 1879;114(2935):819-22. doi: 10.1016/S0140-6736(02)47536-8.
    » https://doi.org/10.1016/S0140-6736(02)47536-8
  • 3
    World Health Organization. Telemedicine: opportunities and developments in Member States: report on the second global survey on eHealth. 2009. Geneva: World Health Organization (Global Observatory for eHealth Series, 2) Available from: Available from: https://www.who.int/goe/publications/goe_telemedicine_2010.pdf Accessed in 2019 (Apr 9).
    » https://www.who.int/goe/publications/goe_telemedicine_2010.pdf
  • 4
    World Health Organization. Health and Sustainable development: Telehealth. Available from: Available from: https://www.who.int/sustainable-development/health-sector/strategies/telehealth/en/ Accessed in 2019 (Apr 9).
    » https://www.who.int/sustainable-development/health-sector/strategies/telehealth/en/
  • 5
    Pagliari C, Sloan D, Gregor P, et al. What is eHealth (4): a scoping exercise to map the field. J Med Internet Res. 2005;7(1):e9. PMID: 15829481; doi: 10.2196/jmir.7.1.e9.
    » https://doi.org/10.2196/jmir.7.1.e9
  • 6
    Craig J, Patterson V. Introduction to the practice of telemedicine. J Telemed Telecare. 2005;11(1):3-9. PMID: 15829036; doi: 10.1177/1357633X0501100102.
    » https://doi.org/10.1177/1357633X0501100102
  • 7
    Rezende EJ, Melo M do C, Tavares EC, Santos A de F, Souza Cd. Ética e telessaúde: reflexões para uma prática segura [Ethics and eHealth: reflections for a safe practice]. Rev Panam Salud Publica. 2010;28(1):58-65. PMID: 20857022; doi: 10.1590/S1020-49892010000700009.
    » https://doi.org/10.1590/S1020-49892010000700009
  • 8
    Vaona A, Pappas Y, Grewal RS, et al. Training interventions for improving telephone consultation skills in clinicians. Cochrane Database Syst Rev. 2017;1:CD010034. PMID: 28052316; doi: 10.1002/14651858.CD010034.pub2.
    » https://doi.org/10.1002/14651858.CD010034.pub2
  • 9
    McLean S, Nurmatov U, Liu JL, et al. Telehealthcare for chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2011;7:CD007718. PMID: 21735417; doi: 10.1002/14651858.CD007718.pub2.
    » https://doi.org/10.1002/14651858.CD007718.pub2
  • 10
    Kew KM, Cates CJ. Remote versus face‐to‐face check‐ups for asthma. Cochrane Database Syst Rev. 2016;4:CD011715. PMID: 27087257; doi: 10.1002/14651858.CD011715.pub2.
    » https://doi.org/10.1002/14651858.CD011715.pub2
  • 11
    Kew KM, Cates CJ. Home telemonitoring and remote feedback between clinic visits for asthma. Cochrane Database Syst Rev. 2016;8:CD011714. PMID: 27486836; doi: 10.1002/14651858.CD011714.pub2.
    » https://doi.org/10.1002/14651858.CD011714.pub2
  • 12
    Bittner AK, Wykstra SL, Yoshinaga PD, Li T. Telerehabilitation for people with low vision. Cochrane Database Syst Rev. 2015;8:CD011019. PMID: 26329308; doi: 10.1002/14651858.CD011019.pub2.
    » https://doi.org/10.1002/14651858.CD011019.pub2
  • 13
    Khan F, Amatya B, Kesselring J, Galea M. Telerehabilitation for persons with multiple sclerosis. Cochrane Database Syst Rev. 2015;(4):CD010508; PMID: 25854331; doi: 10.1002/14651858.CD010508.pub2.
    » https://doi.org/10.1002/14651858.CD010508.pub2
  • 14
    Laver KE, Schoene D, Crotty M, et al. Telerehabilitation services for stroke. Cochrane Database Syst Rev. 2013;12:CD010255. PMID: 24338496; doi: 10.1002/14651858.CD010255.pub2.
    » https://doi.org/10.1002/14651858.CD010255.pub2
  • 15
    Tan K, Lai NM. Telemedicine for the support of parents of high‐risk newborn infants. Cochrane Database Syst Rev. 2012;(6):CD006818. PMID: 22696360; doi: 10.1002/14651858.CD006818.pub2.
    » https://doi.org/10.1002/14651858.CD006818.pub2
  • 16
    Gentry S, van-Velthoven MH, Tudor Car L, Car J. Telephone delivered interventions for reducing morbidity and mortality in people with HIV infection. Cochrane Database Syst Rev. 2013;(5):CD009189. PMID: 23728687; doi: 10.1002/14651858.CD009189.pub2.
    » https://doi.org/10.1002/14651858.CD009189.pub2
  • 17
    Inglis SC, Clark RA, Dierckx R, Prieto‐Merino D, Cleland JG. Structured telephone support or non‐invasive telemonitoring for patients with heart failure. Cochrane Database Syst Rev. 2015;(10):CD007228. PMID: 26517969; doi: 10.1002/14651858.CD007228.pub3.
    » https://doi.org/10.1002/14651858.CD007228.pub3
  • 18
    Fisher E, Law E, Palermo TM, Eccleston C. Psychological therapies (remotely delivered) for the management of chronic and recurrent pain in children and adolescents. Cochrane Database Syst Rev. 2015;(3):CD011118. PMID: 25803793; doi: 10.1002/14651858.CD011118.pub2.
    » https://doi.org/10.1002/14651858.CD011118.pub2
  • 19
    World Health Organization. Chronic obstructive pulmonary disease (COPD). 2017. Geneva: World Health Organization . Available from: Available from: https://www.who.int/news-room/fact-sheets/detail/chronic-obstructive-pulmonary-disease-(copd) Accessed in 2019 (May 8).
    » https://www.who.int/news-room/fact-sheets/detail/chronic-obstructive-pulmonary-disease-(copd)
  • 20
    Vitacca M, Montini A, Comini L. How will telemedicine change clinical practice in chronic obstructive pulmonary disease? Ther Adv Respir Dis. 2018;12:1753465818754778. PMID: 29411700; doi: 10.1177/1753465818754778.
    » https://doi.org/10.1177/1753465818754778
  • 21
    Murphy LA, Harrington P, Taylor SJ, et al. Clinical-effectiveness of self-management interventions in chronic obstructive pulmonary disease: An overview of reviews. Chron Respir Dis. 2017;14(3):276-88. PMID: 28774200; doi: 10.1177/1479972316687208.
    » https://doi.org/10.1177/1479972316687208
  • 22
    Hailey D, Roine R, Ohinmaa A, Dennett L. Evidence of benefit from telerehabilitation in routine care: a systematic review. J Telemed Telecare. 2011;17(6):281-7. PMID: 21844172; doi: 10.1258/jtt.2011.101208.
    » https://doi.org/10.1258/jtt.2011.101208
  • 23
    Johansson T, Wild C. Telerehabilitation in stroke care--a systematic review. J Telemed Telecare. 2011;17(1):1‐6. PMID: 21097560; doi: 10.1258/jtt.2010.100105.
    » https://doi.org/10.1258/jtt.2010.100105
  • 24
    Kairy D, Lehoux P, Vincent C, Visintin M. A systematic review of clinical outcomes, clinical process, healthcare utilisation and costs associated with telerehabilitation. Disabil Rehabil. 2009;31(6):427-47. PMID: 18720118; doi: 10.1080/09638280802062553.
    » https://doi.org/10.1080/09638280802062553
  • 25
    Zhao J, Zhai YK, Zhu WJ, Sun DX. Effectiveness of telemedicine for controlling asthma symptoms: a systematic review and meta-analysis. Telemed J E-Health. 2015;21(6):484-92. PMID: 25393915; doi: 10.1089/tmj.2014.0119.
    » https://doi.org/10.1089/tmj.2014.0119
  • 26
    Sarfo FS, Ulasavets U, Opare-Sem OK, Ovbiagele B. Tele-rehabilitation after stroke: an updated systematic review of the literature. J Stroke Cerebrovasc Dis. 2018;27(9):2306-18. PMID: 29880211; doi: 10.1016/j.jstrokecerebrovasdis.2018.05.013.
    » https://doi.org/10.1016/j.jstrokecerebrovasdis.2018.05.013
  • 1
    Cochrane Brazil, São Paulo (SP), Brazil
  • Source of funding: None

Appendix A. MEDLINE via PubMed search strategy

(((“Telemedicine”[Mesh]) OR (mobile health) OR (health, mobile) OR telehealth OR ehealth))) AND ((((systematic review[ti] OR systematic literature review[ti] OR systematic scoping review[ti] OR systematic narrative review[ti] OR systematic qualitative review[ti] OR systematic evidence review[ti] OR systematic quantitative review[ti] OR systematic meta-review[ti] OR systematic critical review[ti] OR systematic mixed studies review[ti] OR systematic mapping review[ti] OR systematic cochrane review[ti] OR systematic search and review[ti] OR systematic integrative review[ti]) NOT comment[pt] NOT (protocol[ti] OR protocols[ti])) NOT MEDLINE[subset]) OR (Cochrane Database Syst Rev[ta] AND review[pt]) OR systematic review[pt])

Publication Dates

  • Publication in this collection
    15 July 2019
  • Date of issue
    Mar-Apr 2019

History

  • Reviewed
    11 Apr 2019
  • Received
    11 Apr 2019
  • Accepted
    24 Apr 2019
Associação Paulista de Medicina - APM APM / Publicações Científicas, Av. Brigadeiro Luís Antonio, 278 - 7º and., 01318-901 São Paulo SP - Brazil, Tel.: +55 11 3188-4310 / 3188-4311, Fax: +55 11 3188-4255 - São Paulo - SP - Brazil
E-mail: revistas@apm.org.br