Acessibilidade / Reportar erro

Early Rehabilitation Index: translation and cross-cultural adaptation to Brazilian Portuguese; and Early Rehabilitation Barthel Index: validation for use in the intensive care unit

ABSTRACT

Objective:

To translate and cross-culturally adapt the Early Rehabilitation Index to Brazilian Portuguese and validate the Early Rehabilitation Barthel Index for use in the intensive care unit to assess functional status.

Methods:

The following steps were performed: preparation, translation, reconciliation, back-translation, revision, harmonization, pretesting, and psychometric evaluation. After this initial process, the Portuguese version was applied by two evaluators to patients hospitalized in the intensive care unit for at least 48 hours. The reliability of the scale was assessed by internal consistency, interrater reliability, and floor and ceiling effects. To measure construct validity, the Early Rehabilitation Barthel Index was correlated with instruments typically used to assess functional status in the intensive care unit.

Results:

A total of 122 patients with a median age of 56 (46.8 - 66) years participated in the study. The Early Rehabilitation Barthel Index had adequate reliability, with a Cronbach’s alpha coefficient of 0.65. The interrater reliability was excellent, with an intraclass correlation coefficient of 0.94 (95%CI 0.92 - 0.96), and agreement was moderate to excellent, with a kappa agreement index of 0.54 to 1.0. The floor and ceiling effects were minimal. The validity of the Early Rehabilitation Barthel Index was observed through its correlations with the total Perme score (rho = 0.72), the Functional Status Score for the ICU (rho = 0.77), the Physical Function in the Intensive Care Test score (rho = 0.69), and the Medical Research Council sum score (rho = 0.58), in addition to handgrip strength (rho = 0.58) and knee extensor strength measured by hand-held dynamometry (rho = 0.55), all with p < 0.001.

Conclusion:

The adapted versions of the Early Rehabilitation Index for Brazilian Portuguese and, in its entirety, the Early Rehabilitation Barthel Index are reliable and valid for assessing the functional status of patients at discharge from the intensive care unit.

Keywords:
Functional status; Rehabilitation; Validation study; Psychometrics; Critical care; Intensive care units

RESUMO

Objetivo:

Traduzir, adaptar transculturalmente para o português do Brasil o instrumento Early Rehabilitation Index e validar para uso na unidade de terapia intensiva o instrumento Early Rehabilitation Barthel Index, para avaliação do estado funcional.

Métodos:

Foram executadas as seguintes etapas: preparação, tradução, reconciliação, tradução reversa, revisão, harmonização, pré-teste e avaliação psicométrica. Após esse processo inicial, a versão em português foi aplicada por dois avaliadores em pacientes que permaneciam pelo menos 48 horas internados na unidade de terapia intensiva. Verificou-se a confiabilidade da escala por meio da consistência interna, da confiabilidade entre avaliadores e do efeito piso e teto. Para a validade de constructo, correlacionou-se o Early Rehabilitation Barthel Index com instrumentos que usualmente são utilizados para avaliação do estado funcional na unidade de terapia intensiva.

Resultados:

Participaram 122 pacientes com mediana de idade de 56 [46,8 - 66] anos. O Early Rehabilitation Barthel Index teve confiabilidade adequada com coeficiente alfa de Cronbach de 0,65. A confiabilidade entre avaliadores foi excelente, com coeficiente de correlação intraclasse de 0,94 (IC95% 0,92 - 0,96) e moderado a excelente com índice de concordância de kappa de 0,54 a 1,0. Os efeitos piso e teto foram mínimos. Observou-se a validade do Early Rehabilitation Barthel Index por meio das correlações com o escore total do Perme Escore (rô = 0,72), da Escala de Estado Funcional em UTI (rô = 0,77), do Physical Function in Intensive Care Test-score (rô = 0,69), do Medical Research Council sum score (rô = 0,58), além das dinamometrias de preensão palmar (rô = 0,58) e manual de coxa (rô = 0,55), todos com p < 0,001.

Conclusão:

A versão adaptada do Early Rehabilitation Index para o português brasileiro e na sua totalidade, Early Rehabilitation Barthel Index é confiável e válida para avaliação do estado funcional dos pacientes na alta da unidade de terapia intensiva.

Descritores:
Estado funcional; Reabilitação; Estudo de validação; Psicometria; Cuidados críticos; Unidades de terapia intensiva

INTRODUCTION

A longer time on bed restriction during hospitalization in the intensive care unit (ICU), combined with vital organ dysfunction, sepsis, hypoxemia, and neuromuscular toxicity due to medication use, impair the performance of the cardiovascular and musculoskeletal systems and thus cause a decline in functional status.11 Topp R, Ditmyer M, King K, Doherty K, Hornyak J 3rd. The effect of bed rest and potential of prehabilitation on patients in the intensive care unit. AACN Clin Issues. 2002;13(2):263-76.)

Assessing the functional status of these patients and starting an early mobilization program in the ICU can increase the success rate of weaning from mechanical ventilation (MV), shorten the ICU and hospital stays, and improve the quality of life.22 Morris PE. Moving our critically ill patients: mobility barriers and benefits. Crit Care Clin. 2007;23(1):1-20.,33 Needham DM. Mobilizing patients in the intensive care unit. JAMA. 2008;300(14):1685-90. For this assessment, a reliable, reproducible, and valid instrument should be chosen.44 Christakou A, Papadopoulos E, Patsaki E, Sidiras G, Nanas S. Functional assessment scales in a general intensive care unit. A review. Hosp Chronicles. 2013;8(4):164-70.

Several scales have been developed in recent years to evaluate the functional aspects of patients admitted to the ICU,55 Parry SM, Granger CL, Berney S, Jones J, Beach L, El-Ansary D, et al. Assessment of impairment and activity limitations in the critically ill: a systematic review of measurement instruments and their clinimetric properties. Intensive Care Med. 2015;41(5):744-62. and existing scales meant for other populations have also been used for this purpose.44 Christakou A, Papadopoulos E, Patsaki E, Sidiras G, Nanas S. Functional assessment scales in a general intensive care unit. A review. Hosp Chronicles. 2013;8(4):164-70. This is done to standardize the physical therapy outcome and measure the progression of critically ill patients during their ICU and hospital stays. Among these scales, an extension of the Barthel Index (BI), called the Early Rehabilitation Barthel Index (ERBI), is extensively used in Germany to assess acute neurological patients.66 Rollnik JD. The Early Rehabilitation Barthel Index (ERBI). Rehabilitation (Stuttg). 2011;50(6):408-11.

The ERBI is the sum of the Early Rehabilitation Index (ERI) and the BI. The ERI comprises relevant items for early rehabilitation assessment of acute patients, including intensive medical monitoring, tracheostomy tube use and management, MV use, confusional state, behavioral disturbances, communication deficit, and feeding assistance. There are seven items, which if applicable have a negative value of -50 or -25 points.77 Rollnik JD, Bertram M, Bucka C, Hartwich M, Jöbges M, Ketter G, et al. Criterion validity and sensitivity to change of the Early Rehabilitation Index (ERI): results from a German multi-center study. BMC Res Notes. 2016;9:356.) The BI is a widely known scale that was created to evaluate the response to rehabilitation of individuals with chronic neurological disease. Its objective is to measure the ability to perform 10 activities of daily living (ADLs) independently, with some help or completely depending on help.88 Mahoney FI, Barthel DW. Functional evaluation: The Barthel Index. Md State Med J. 1965;14:61-5. The BI has already been translated and adapted to Brazilian Portuguese99 Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of Health Stroke Scale, modified Rankin Scale and Barthel Index in Brazil: the role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. and validated for elderly outpatients.1010 Minosso JS, Amendola F, Alvarenga MR, Oliveira MA. Validação, no Brasil, do Índice de Barthel em idosos atendidos em ambulatórios. Acta Paul Enferm. 2010;23(2):218-23. To calculated the ERBI score, it is necessary to add the ERI (-325 to 0 points) to the BI (0 to 100 points), which results in an ERBI total score of -325 to 100 points.77 Rollnik JD, Bertram M, Bucka C, Hartwich M, Jöbges M, Ketter G, et al. Criterion validity and sensitivity to change of the Early Rehabilitation Index (ERI): results from a German multi-center study. BMC Res Notes. 2016;9:356. The scale showed high interrater reliability and validity compared with other neurological assessment scales.66 Rollnik JD. The Early Rehabilitation Barthel Index (ERBI). Rehabilitation (Stuttg). 2011;50(6):408-11.,77 Rollnik JD, Bertram M, Bucka C, Hartwich M, Jöbges M, Ketter G, et al. Criterion validity and sensitivity to change of the Early Rehabilitation Index (ERI): results from a German multi-center study. BMC Res Notes. 2016;9:356.

The ERBI was developed to increase the sensitivity to changes in the BI and to monitor the progression of patients during the treatment phase,66 Rollnik JD. The Early Rehabilitation Barthel Index (ERBI). Rehabilitation (Stuttg). 2011;50(6):408-11. and it can be used to improve the characterization of critically ill patients. Cross-cultural adaption is the best choice for assessment instruments available in the health field because it allows them to be applied in any country, culture, and language.1111 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91.

The objective of this study was to translate and cross-culturally adapt the ERI to Brazilian Portuguese and to evaluate the psychometric properties of the ERBI at discharge from the intensive care unit.

METHODS

A methodological study (translation and adaptation) combined with a cross-sectional observational study (validation) was conducted in the ICU of Hospital Universitário Professor Polydoro Ernani de São Thiago of Universidade Federal de Santa Catarina from January to August 2018. The study was approved by the university’s Ethics Committee in Research on Human Beings under protocol no. 63173716.0.0000.0121. The study began with the process of translation and cross-cultural adaptation of the ERI into Brazilian Portuguese according to the recommendations of the Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes,1212 Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P; ISPOR Task Force for Translation and Cultural Adaptation. Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes ( PRO ) Measures?: report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health. 2005;8(2):94-104. followed by the evaluation of the psychometric properties of the ERBI through the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN).1313 Mokkink LB, de Vet HC, Prinsen CA, Patrick DL, Alonso J, Bouter LM, et al. COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures. Qual Life Res. 2018;27(5):1171-9.

Translation and cross-cultural adaptation process

The process of translation and cross-cultural adaptation of the ERI into Brazilian Portuguese had the following steps: preparation, which consisted of obtaining the authorization of Dr. Jens D. Rollnik, Institute for Neurorehabilitation Research (InFo), Germany, to use the instrument; translation from English to Portuguese, performed independently by two translators native in Portuguese and fluent in English, one familiar and the other unfamiliar with the scale (T1 and T2); reconciliation, in which the two translated versions were compared and analyzed by a coordinator (any existing discrepancies were analyzed and discussed, and this process resulted in a version translated by consensus - T12); back-translation into English, in which the Brazilian Portuguese version was translated back into English by two other independent translators, native in English and fluent in Portuguese (none of them had contact with the original English versions - BT1 and BT2); revision and harmonization of the back-translations, in which a committee composed of three researchers reviewed the back-translations of the scales against the original version, in search of possible discrepancies and in order to make the necessary adjustments, and a final version of the back-translation was created and sent to the original author of the scale for approval and comments; lastly, a final version in Portuguese was created by the committee (BT12), called the Índice de Reabilitação Precoce (IRP), and the pretest was performed: with the final version in Portuguese, a pilot study was conducted in which two physical therapists applied the scale to volunteers. The objective of this phase was to identify interpretation problems and difficulties in applying the scale (Table 1S - Supplementary material).

Validation process

After final approval of the translation and cross-cultural adaptation process, the new version needed to demonstrate adequate measurement properties.1414 Ware JE, Keller SD, Gandek B, Brazier JE, Sullivan M. Evaluating translations of health status questionnaires. Methods from the IQOLA project. International Quality of Life Assessment. Int J Technol Assess Health Care. 1995;11(3):525-51. The relevant guidelines say that eight main attributes should be evaluated to confirm the adequacy of the instrument: content, criterion, and construct validity; internal consistency; reproducibility; responsiveness; floor and ceiling effects; and interpretability.1515 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. Hereafter, we will refer to the ERBI instrument in its entirety as Índice de Reabilitação Precoce e Barthel (IRPB).

For this study, the psychometric properties of the IRPB at discharge from the ICU were evaluated through the following attributes: internal consistency, which is the measure of whether the scale items correlate with each other;1515 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. interrater reliability, which refers to the degree to which the measurement is free of measurement error when measured by different individuals at the same time;1515 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42.,1616 Mokkink LB, Prinsen CA, Bouter LM, Vet HC, Terwee CB. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument. Braz J Phys Ther. 2016;20(2):105-13. interrater measurement error, which consists of systematic and random errors of a patient’s score and how close the scores are in repeated measures.1515 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42.,1616 Mokkink LB, Prinsen CA, Bouter LM, Vet HC, Terwee CB. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument. Braz J Phys Ther. 2016;20(2):105-13. The measurement error is expressed by the standard error of measurement (SEM).1515 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. Floor and ceiling effects are present when more than 15% of participants achieve the highest and lowest scores, respectively, on the scale.1515 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. Construct validity refers to the degree to which the scores of the instrument are related to other measures that measure the same concept through hypotheses.1515 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42.

Participants

All patients who were consecutively admitted to the general ICU and were aged ≥ 18 years were eligible for the study. The inclusion criterion adopted was completing 48 hours of ICU stay and signing of the informed consent form by a family member, a guardian, or the participant. Individuals who progressed to palliative care, brain death, or death, those who were transferred to another hospital during their ICU stay, those unable to perform at least three of the five essential commands (open and close their eyes, raise their eyebrow, stick out their tongue, move their head, and look at the evaluator),1717 De Jonghe B, Sharshar T, Lefaucheur JP, Authier FJ, Durand-Zaleski I, Boussarsar M, Cerf C, Renaud E, Mesrati F, Carlet J, Raphaël JC, Outin H, Bastuji-Garin S; Groupe de Réflexion et d'Etude des Neuromyopathies en Réanimation. Paresis acquired in the intensive care unit: a prospective multicenter study. JAMA. 2002;288(22):2859-67. upper- or lower-limb amputees, and those who withdrew by the decision of their relative, their guardian, or themselves were excluded.

Study variables and data collection

Based on the fulfillment of the inclusion criteria, data including age, sex, body mass index (BMI), Acute Physiology and Chronic Health Evaluation II (APACHE II) score, Simplified Acute Physiology Score III (SAPS III) score, Charlson comorbidity index score, reason for ICU admission, lengths of ICU and hospital stays, use and duration of invasive MV (IMV), and hospital outcome were collected.

Patients were followed up until discharge from the ICU. The assessments were performed at ICU discharge or within 24 hours after discharge by two physical therapists with the same level of clinical experience. This assessment consisted of the application of the following instruments (Table 2S - Supplementary material): ERI/IRP, which measures seven items relevant to early rehabilitation assessment in acute patients, with a total score ranging from -325 to 0 points;66 Rollnik JD. The Early Rehabilitation Barthel Index (ERBI). Rehabilitation (Stuttg). 2011;50(6):408-11. BI, which measures the ability to perform 10 ADLs, with a total score ranging from 0 to 100 points;88 Mahoney FI, Barthel DW. Functional evaluation: The Barthel Index. Md State Med J. 1965;14:61-5.,1010 Minosso JS, Amendola F, Alvarenga MR, Oliveira MA. Validação, no Brasil, do Índice de Barthel em idosos atendidos em ambulatórios. Acta Paul Enferm. 2010;23(2):218-23.) Perme ICU Mobility Score (Perme Score), which measures the mobility of ICU patients, with a total score ranging from 0 to 32 points;1818 Kawaguchi YM, Nawa RK, Figueiredo TB, Martins L, Pires-Neto RC. Perme Intensive Care Unit Mobility Score e ICU Mobility Scale: tradução e adaptação cultural para a língua portuguesa falada no Brasil. J Bras Pneumol. 2016;42(6):429-34.,1919 Perme C, Nawa RK, Winkelman C, Masud F. A tool to assess mobility status in critically ill patients: the Perme Intensive Care Unit Mobility Score. Methodist Debakey Cardiovasc J. 2014;10(1):41-9. Functional Status Score for the ICU (FSS-ICU), which measures five functional tasks with a total score ranging from 0 to 35 points;2020 Huang M, Chan KS, Zanni JM, Parry SM, Neto SG, Neto JA, et al. Functional Status Score for the ICU: An International Clinimetric Analysis of Validity, Responsiveness, and Minimal Important Difference. Crit Care Med. 2016;44(12):e1155-64.,2121 Silva VZ, Araújo JA Neto, Cipriano G Jr, Pinedo M, Needham DM, Zanni JM, et al. Brazilian version of the Functional Status Score for the ICU: translation and cross-cultural adaptation. Rev Bras Ter Intensiva. 2017;29(1):34-8. Physical Function in Intensive Care Test-scored (PFIT-s), which measures the patient’s ability to perform four tasks, with a total score ranging from 0 to 12 points (ordinal scale);2222 Denehy L, de Morton NA, Skinner EH, Edbrooke L, Haines K, Warrillow S, et al. A physical function test for use in the intensive care unit: validity, responsiveness, and predictive utility of the physical function ICU test (scored). Phys Ther. 2013;93(12):1636-45. Medical Research Council sum score (MRC-SS), which evaluates peripheral muscle strength, with a total score ranging from 0 to 60 points;2323 Ciesla N, Dinglas V, Fan E, Kho M, Kuramoto J, Needham D. Manual muscle testing: a method of measuring extremity muscle strength applied to critically ill patients. J Vis Exp. 2011;(50):2632. handgrip dynamometry to measure handgrip strength in the dominant hand, using a Jamar dynamometer (Jamar Plus+, model 12-0604, Bolingbrook, Illinois, United States) and following the recommendations of the American Society of Hand Therapists (ASHT);2424 Bohannon RW, Peolsson A, Massy-Westropp N, Desrosiers J, Bear-Lehman J. Reference values for adult grip strength measured with a Jamar dynamometer: a descriptive meta-analysis. Physiotherapy. 2006;92(1):11-5. and hand-held dynamometry for isometric strength, by using a dynamometer to measure the knee extensor strength (Lafayette instrument, model 01165, Lafayette, Indiana, United States).2525 Andrews AW, Thomas MW, Bohannon RW. Normative values for isometric muscle force measurements obtained with hand-held dynamometers. Phys Ther. 1996;76(3):248-59. The measurement of muscle strength by dynamometry was performed three times, and the one with the highest score was used for evaluation.2424 Bohannon RW, Peolsson A, Massy-Westropp N, Desrosiers J, Bear-Lehman J. Reference values for adult grip strength measured with a Jamar dynamometer: a descriptive meta-analysis. Physiotherapy. 2006;92(1):11-5. For all instruments, a high score reflects better functional status or muscle strength.

Some instruments used in this study have items that are evaluated in the same way (for example, transfer from sitting to standing). As a result, an evaluation sequence and form were created to prevent the patient from performing the same task more than once and experiencing fatigue and to allow the scoring of several scales at the same time. The assessment was conducted by a principal evaluator, who applied the tests and scales, and by a secondary evaluator, who only observed the procedure. Both were trained and familiarized with the evaluation sequence. The roles of the principal evaluator and observer switched at each evaluation. To avoid bias, after the evaluation, the two evaluators filled out the scoring sheet of the instruments without contact or discussion between them. The same evaluation order was used for all patients and lasted approximately 1 hour.

For better understanding, the Perme score, FSS-ICU, and PFIT-s will be referred to as “functional scales specific to the ICU” and the MRC-SS and the handgrip and knee extensor dynamometry as “muscle strength measurements”.

Statistical analysis

Measures of central tendency and dispersion, including arithmetic mean, standard deviation (SD), median, interquartile range (IQR25-75%), frequency, and percentage, were applied to the variables according to the normality and type of the data. The normality of the data was assessed using the Kolmogorov-Smirnov test.

To determine the internal consistency, Cronbach’s alpha coefficient was calculated for the scale in its entirety and after excluding each item one by one. The gold-standard minimum alpha value of 0.70 was adopted.1515 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42.

The interrater reliability was assessed using the two-way random intraclass correlation coefficient (ICC), which measures absolute agreement, for single measures and for the total score, and the kappa agreement index for each item individually (1 to 17). A value above 0.70 is recommended as a minimum standard for reliability,1515 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. and values above 0.75 were considered excellent.2626 Fleiss JL, Levin B, Paik MC. The measurement of interrater agreement. In: Fleiss JL, Levin B, Paik MC. Statistical methods for rates and proportions. 3rd ed. New Jersey: John Wiley & Sons; 2003. p. 598-626. For the analysis of interrater measurement error, the SEM of agreement (SEMagreement) and the minimum detectable change in the individual (MDCindividual) were calculated.

The floor and ceiling effects were determined from the proportions of the assessments that obtained the lowest and highest scores. The effects are considered present when more than 15% of the respondents achieve the lowest and highest possible scores. This indicates that the instrument has a limitation in its content validation and the subjects cannot be distinguished from each other, which would reduce its reliability.1515 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42.

Although several instruments have been developed in recent years, none has yet been considered the gold standard for assessing the functional status of critically ill patients. Thus, construct validation was performed by correlating the IRPB with functional scales specific for the ICU and muscle strength measurements. The hypothesis that the IRPB score would have a positive correlation with the other measures was adopted, with an r of at least 0.75.1515 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. The Spearman correlation coefficient was used for the analyses.2727 Mukaka MM. Statistics corner: a guide to appropriate use of correlation coefficient in medical research. Malawi Med J. 2012;24(3):69-71.

A sample size of at least 100 participants is recommended and is considered excellent,2828 Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bouter LM, de Vet HC. Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012;21(4):651-7. which was the objective of this study. All patients included were considered for the analyses of reliability, floor and ceiling effects, and construct validity. There were no missing data, and when only one IRPB value was needed, the values from the principal evaluator were considered. All analyses were performed using the Statistical Package for the Social Sciences (SPSS), version 22.0 (SPSS Inc., Chicago, Illinois, United States). For all analyses, the significance level adopted was 5%.

RESULTS

From January to August 2018, 290 patients admitted to the ICU were eligible. After exclusion, 122 patients were included in the study (Figure 1). Their baseline and clinical characteristics are shown in table 1. The values for the functional scales and muscle strength measurements applied at ICU discharge are shown in table 2.

Table 1
Baseline and clinical characteristics of the sample
Table 2
Functional status and muscle strength characteristics at discharge from the intensive care unit
Figure 1
Eligibility and inclusion criteria

ICU - intensive care unit.


Translation and cross-cultural adaptation

During the development of the Portuguese version (IRP), the translated versions were similar. In the back-translation to English, no differences were found from the original scale that changed the meaning of any item.

In the pretest phase, the physical therapists reported uncertainty regarding the item “swallowing disorders in need of supervision” given two situations: whether the option should be checked only if the swallowing disorder was diagnosed by the speech therapist and whether the use of a feeding tube should be considered help. The question raised was answered by Dr. Rollnik, who explained that the scale also evaluated the need for help and supervision by the team for feeding. Thus, in consensus among the evaluators, it was defined that the item should be checked when the patient was using a feeding tube (because the patient needed a change of diet) and when the patient needed help to eat orally. As a matter of routine in Brazilian ICUs, the item was replaced by “help and/or supervision in feeding”, and its interrater agreement was excellent (kappa of 0.88; p < 0.001). The translated scale is included as table 3.

Table 3
Índice de Reabilitação Precoce, version translated to Brazilian Portuguese

Reliability and measurement error

The IRPB showed internal consistency, with a Cronbach’s alpha of 0.65, a value close to that desired by the study. The interrater reliability, based on the total value of the scale, was considered excellent, and when the items were evaluated individually, the values ranged from moderate to excellent. The SEMagreement was 31.58, and the MDCindividual was 87.54 points. There was no floor effect of the IRPB, and the ceiling effect value found was below the 15% limit (Table 4).

Table 4
Internal consistency and interrater reliability based on the total and per-item score (1 to 17) of the Índice de Reabilitação Precoce e Barthel

Construct validity

In the correlation of the IRPB with the Perme score and FSS-ICU, the study hypothesis was accepted, as a strong positive correlation was found. In contrast, the muscle strength measurements and PFIT-s showed a moderate correlation (Table 5).

Table 5
Correlations between the Índice de Reabilitação Precoce e Barthel and functional scales specific to the intensive care unit and muscle strength tests

DISCUSSION

The IRP, translated and adapted to Brazilian Portuguese, was found to be easy to understand. The version in its entirety, the IRPB, was reliable when applied by different evaluators to critically ill patients at the time of ICU discharge.

The internal consistency of the IRPB for use at ICU discharge was lower than the adopted gold standard, which could indicate a low correlation between the items.1515 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. Some aspects are believed to have influenced this result and should be taken into consideration. First, the scale was originally developed for the assessment of acute neurological patients, without any internal consistency value reported,66 Rollnik JD. The Early Rehabilitation Barthel Index (ERBI). Rehabilitation (Stuttg). 2011;50(6):408-11. and in this study, the IRPB was used in a population with different diagnoses, predominantly sepsis and recovery from elective surgery. The application of a scale in different populations can cause variations in its internal consistency.2929 Streiner DL. Being inconsistent about consistency: when coefficient alpha does and doesn't matter. J Pers Assess. 2003;80(3):217-22. In addition, the IRPB is a sum of two indices that measure different aspects, as a way to better characterize the patient’s rehabilitation (for example, monitoring, MV use, confusional state, behavior, and ADLs), which could influence the correlation between its items individually but which does not invalidate its importance and applicability. Thus, the internal consistency of the IRPB reflects an acceptable correlation for its application in a general ICU population at the time of discharge.2929 Streiner DL. Being inconsistent about consistency: when coefficient alpha does and doesn't matter. J Pers Assess. 2003;80(3):217-22.,3030 Taber KS. The use of Cronbach's Alpha when developing and reporting research instruments in science education. Res Sci Educ. 2018;48(6):1273-96.

The best internal consistency value was achieved when the item “intensive care supervision” was removed. This could be because the patients were in an intensive care environment and under constant supervision; the interrater agreement for this item was perfect. However, we think it is helpful to keep this item in this tool for assessing the progression of the functional status and care of the patient throughout hospitalization and after discharge.

When the interrater reliability of the items was individually evaluated by the kappa agreement index, those with lower values were “mental confusion” and “behavioral disturbance”. In the original study of the scale, similar values were found through correlation analysis.66 Rollnik JD. The Early Rehabilitation Barthel Index (ERBI). Rehabilitation (Stuttg). 2011;50(6):408-11. These lower values may have occurred due to the inherent subjectivity of these items and the dependence on the evaluators’ interpretation. Nevertheless, the variation in agreement was moderate to excellent, which can be considered acceptable. However, to enable greater accuracy in the scoring of these items, a tool that objectively diagnoses delirium in critically ill patients could be applied, such as the Confusion Assessment Method for Intensive Care Unit.3131 Pessoa RF, Nácul FE. Delirium em pacientes críticos. Rev Bras Ter Intensiva. 2006;18(2):190-5.

The interrater reliability of the total score of the scale, as judged by the ICC, was also considered excellent. These results, combined with floor and ceiling effects of less than 15%, suggest that the IRPB is adequate and reliable for application at ICU discharge. In addition, according to the COSMIN classification, the interrater measurement error was considered indeterminate3232 Prinsen CA, Mokkink LB, Bouter LM, Alonso J, Patrick DL, de Vet HC, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147-57. because there is still no minimum change value deemed important for the IPRB, which will be necessary for its complete analysis. However, due to the variation in the IRPB score (-325 to 100 points), the SEMagreement and the MDCindividual are considered acceptable.

The IRPB was shown to have construct validity when correlated with other instruments that assess the functional status and muscle strength of patients in the ICU. The Brazilian version correlated strongly and positively with the Perme score and FSS-ICU. These scales were created specifically for the ICU and evaluate the functional status predominantly through the amount of help required for transfers and the barriers to mobilization. These results may be explained by the fact that the IRPB has some similar items, focusing on the care and supervision that the patient requires, in addition to some mobility aspects originating from the BI. With the PFIT-s, MRC-SS, and handgrip and knee extensor dynamometry, the correlations were positive and moderate. The PFIT-s is a score that has four items, two of which refer to the muscle strength domain.3333 González-Seguel F, Corner EJ, Merino-Osorio C. Internation Classification of Functioning, Disability, and Health Domains of 60 Physical Functioning Measurement Instruments Used During the Adult Intensive Care Unit Stay: A Scoping Review. Phys Ther. 2019;99(5):627-40. Most likely this was the reason the correlations between the IRPB and these instruments did not come out as we hypothesized.

Some limitations of this study should be considered. The assessments were performed preferably in the ICU or with a maximum tolerance of up to 24 hours after discharge from the ICU. To minimize the possible effects of changing the assessment site, some items (e.g., using the bathroom, bathing, bowel and bladder continence) were scored according to the reports of the patients and/or the multidisciplinary team specifically for the reference site, the ICU. The IRPB should be used with caution in future studies and in clinical practice, and it should be remembered that the present study is single-center, with patients admitted to a general ICU with different diagnoses, baseline characteristics, and ventilation statuses. Additional studies could test other psychometric properties that were not considered in this study and/or other populations.

The IRPB assesses critically ill patients through different aspects: need for monitoring, use of MV and tracheostoma, confusional state and behavior, communication, feeding, ADLs, and mobility. Learning more about these components would allow for a better differentiation of how these patients leave the ICU and progress during rehabilitation. This version translated and cross-culturally adapted for Brazil allows access by professionals to the tool and a similar description of the disease or treatment for comparison with studies from other countries,1111 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. which can ensure a better quality of patient care and research.1818 Kawaguchi YM, Nawa RK, Figueiredo TB, Martins L, Pires-Neto RC. Perme Intensive Care Unit Mobility Score e ICU Mobility Scale: tradução e adaptação cultural para a língua portuguesa falada no Brasil. J Bras Pneumol. 2016;42(6):429-34.

CONCLUSION

The version of the Early Rehabilitation Index adapted for Brazilian Portuguese, the Índice de Reabilitação Precoce, was easy to understand and apply. The Early Rehabilitation Barthel Index, or Índice de Reabilitação Precoce e Barthel, is sufficiently reliable and can be applied by different evaluators, in addition to having satisfactory construct validity, and is a tool that can be used to assess functional status at the time of discharge from the intensive care unit.

ACKNOWLEDGMENTS

This study was conducted with the support of the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES), funding code 001, for the scholarship recipients Nair Fritzen dos Reis and Fernanda Cabral Xavier Sarmento Figueiredo. Rosemeri Maurici receives funding from the Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), code 309040/2019-1.

REFERÊNCIAS

  • 1
    Topp R, Ditmyer M, King K, Doherty K, Hornyak J 3rd. The effect of bed rest and potential of prehabilitation on patients in the intensive care unit. AACN Clin Issues. 2002;13(2):263-76.
  • 2
    Morris PE. Moving our critically ill patients: mobility barriers and benefits. Crit Care Clin. 2007;23(1):1-20.
  • 3
    Needham DM. Mobilizing patients in the intensive care unit. JAMA. 2008;300(14):1685-90.
  • 4
    Christakou A, Papadopoulos E, Patsaki E, Sidiras G, Nanas S. Functional assessment scales in a general intensive care unit. A review. Hosp Chronicles. 2013;8(4):164-70.
  • 5
    Parry SM, Granger CL, Berney S, Jones J, Beach L, El-Ansary D, et al. Assessment of impairment and activity limitations in the critically ill: a systematic review of measurement instruments and their clinimetric properties. Intensive Care Med. 2015;41(5):744-62.
  • 6
    Rollnik JD. The Early Rehabilitation Barthel Index (ERBI). Rehabilitation (Stuttg). 2011;50(6):408-11.
  • 7
    Rollnik JD, Bertram M, Bucka C, Hartwich M, Jöbges M, Ketter G, et al. Criterion validity and sensitivity to change of the Early Rehabilitation Index (ERI): results from a German multi-center study. BMC Res Notes. 2016;9:356.
  • 8
    Mahoney FI, Barthel DW. Functional evaluation: The Barthel Index. Md State Med J. 1965;14:61-5.
  • 9
    Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of Health Stroke Scale, modified Rankin Scale and Barthel Index in Brazil: the role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22.
  • 10
    Minosso JS, Amendola F, Alvarenga MR, Oliveira MA. Validação, no Brasil, do Índice de Barthel em idosos atendidos em ambulatórios. Acta Paul Enferm. 2010;23(2):218-23.
  • 11
    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91.
  • 12
    Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P; ISPOR Task Force for Translation and Cultural Adaptation. Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes ( PRO ) Measures?: report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health. 2005;8(2):94-104.
  • 13
    Mokkink LB, de Vet HC, Prinsen CA, Patrick DL, Alonso J, Bouter LM, et al. COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures. Qual Life Res. 2018;27(5):1171-9.
  • 14
    Ware JE, Keller SD, Gandek B, Brazier JE, Sullivan M. Evaluating translations of health status questionnaires. Methods from the IQOLA project. International Quality of Life Assessment. Int J Technol Assess Health Care. 1995;11(3):525-51.
  • 15
    Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42.
  • 16
    Mokkink LB, Prinsen CA, Bouter LM, Vet HC, Terwee CB. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument. Braz J Phys Ther. 2016;20(2):105-13.
  • 17
    De Jonghe B, Sharshar T, Lefaucheur JP, Authier FJ, Durand-Zaleski I, Boussarsar M, Cerf C, Renaud E, Mesrati F, Carlet J, Raphaël JC, Outin H, Bastuji-Garin S; Groupe de Réflexion et d'Etude des Neuromyopathies en Réanimation. Paresis acquired in the intensive care unit: a prospective multicenter study. JAMA. 2002;288(22):2859-67.
  • 18
    Kawaguchi YM, Nawa RK, Figueiredo TB, Martins L, Pires-Neto RC. Perme Intensive Care Unit Mobility Score e ICU Mobility Scale: tradução e adaptação cultural para a língua portuguesa falada no Brasil. J Bras Pneumol. 2016;42(6):429-34.
  • 19
    Perme C, Nawa RK, Winkelman C, Masud F. A tool to assess mobility status in critically ill patients: the Perme Intensive Care Unit Mobility Score. Methodist Debakey Cardiovasc J. 2014;10(1):41-9.
  • 20
    Huang M, Chan KS, Zanni JM, Parry SM, Neto SG, Neto JA, et al. Functional Status Score for the ICU: An International Clinimetric Analysis of Validity, Responsiveness, and Minimal Important Difference. Crit Care Med. 2016;44(12):e1155-64.
  • 21
    Silva VZ, Araújo JA Neto, Cipriano G Jr, Pinedo M, Needham DM, Zanni JM, et al. Brazilian version of the Functional Status Score for the ICU: translation and cross-cultural adaptation. Rev Bras Ter Intensiva. 2017;29(1):34-8.
  • 22
    Denehy L, de Morton NA, Skinner EH, Edbrooke L, Haines K, Warrillow S, et al. A physical function test for use in the intensive care unit: validity, responsiveness, and predictive utility of the physical function ICU test (scored). Phys Ther. 2013;93(12):1636-45.
  • 23
    Ciesla N, Dinglas V, Fan E, Kho M, Kuramoto J, Needham D. Manual muscle testing: a method of measuring extremity muscle strength applied to critically ill patients. J Vis Exp. 2011;(50):2632.
  • 24
    Bohannon RW, Peolsson A, Massy-Westropp N, Desrosiers J, Bear-Lehman J. Reference values for adult grip strength measured with a Jamar dynamometer: a descriptive meta-analysis. Physiotherapy. 2006;92(1):11-5.
  • 25
    Andrews AW, Thomas MW, Bohannon RW. Normative values for isometric muscle force measurements obtained with hand-held dynamometers. Phys Ther. 1996;76(3):248-59.
  • 26
    Fleiss JL, Levin B, Paik MC. The measurement of interrater agreement. In: Fleiss JL, Levin B, Paik MC. Statistical methods for rates and proportions. 3rd ed. New Jersey: John Wiley & Sons; 2003. p. 598-626.
  • 27
    Mukaka MM. Statistics corner: a guide to appropriate use of correlation coefficient in medical research. Malawi Med J. 2012;24(3):69-71.
  • 28
    Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bouter LM, de Vet HC. Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012;21(4):651-7.
  • 29
    Streiner DL. Being inconsistent about consistency: when coefficient alpha does and doesn't matter. J Pers Assess. 2003;80(3):217-22.
  • 30
    Taber KS. The use of Cronbach's Alpha when developing and reporting research instruments in science education. Res Sci Educ. 2018;48(6):1273-96.
  • 31
    Pessoa RF, Nácul FE. Delirium em pacientes críticos. Rev Bras Ter Intensiva. 2006;18(2):190-5.
  • 32
    Prinsen CA, Mokkink LB, Bouter LM, Alonso J, Patrick DL, de Vet HC, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147-57.
  • 33
    González-Seguel F, Corner EJ, Merino-Osorio C. Internation Classification of Functioning, Disability, and Health Domains of 60 Physical Functioning Measurement Instruments Used During the Adult Intensive Care Unit Stay: A Scoping Review. Phys Ther. 2019;99(5):627-40.

Edited by

Responsible editor: Antonio Paulo Nassar Jr.

Publication Dates

  • Publication in this collection
    25 Oct 2021
  • Date of issue
    2021

History

  • Received
    18 Aug 2020
  • Accepted
    01 Nov 2020
Associação de Medicina Intensiva Brasileira - AMIB Rua Arminda, 93 - Vila Olímpia, CEP 04545-100 - São Paulo - SP - Brasil, Tel.: (11) 5089-2642 - São Paulo - SP - Brazil
E-mail: rbti.artigos@amib.com.br