Accessibility / Report Error

Assessment of the measurement properties of the Brazilian versions of the Functional Status Score for the ICU and the Functional Independence Measure in critically ill patients in the intensive care unit

ABSTRACT

Objective:

To compare the measurement properties (internal consistency, intra and interrater reliability, construct validity, and ceiling and floor effects) of the Functional Status Score for the ICU (FSS-ICU) and the Functional Independence Measure (FIM-motor domain).

Methods:

In this study of measurement properties, the FSS-ICU and FIM were applied to 100 patients (72.1 ± 15.9 years; 53% male; Sequential Organ Failure Assessment = 11.0 ± 3.5 points, Simplified Acute Physiology Score 3 = 50.2 ± 16.8 points) in an intensive care unit at baseline and after 2 hours by physiotherapist 1 (test and retest) and 30 minutes after baseline by physiotherapist 2. The measurement properties evaluated were internal consistency (Cronbach's alpha), intra- and interrater reliability (intraclass correlation coefficient), agreement (standard error of measurement) and minimum detectable change at a 90% confidence level, ceiling and floor effects (frequency of maximum and minimum scores) and construct validity (Pearson's correlation).

Results:

The FSS-ICU and FIM presented adequate internal consistency (Cronbach's alpha, FSS-ICU = 0.95 and FIM = 0.86), intra-and interrater reliability for overall FSS-ICU and FIM score (ICC > 0.75), agreement (minimum detectable change at a 90% confidence level: FSS-ICU and FIM = 1.0 point; standard error of measurement: FSS-ICU = 2% and FIM = 1%) and construct validity (r = 0.94; p < 0.001). However, the FSS-ICU and FIM presented ceiling effects (maximum score for 16% of patients for the FSS-ICU and 18% for the FIM).

Conclusion:

The FSS-ICU and FIM present adequate measurement properties to assess functionality in critically ill patients, although they present ceiling effects.

Keywords:
Functional scales; Measurement property; Critical care; Activities of daily living

RESUMO

Objetivo:

Comparar as propriedades de medida (consistência interna, confiabilidade intra e interavaliadores, validade do construto, e efeitos teto e piso) da Escala de Estado Funcional para UTI (FSS-ICU - Functional Status Score for the ICU) e da Medida de Independência Funcional (MIF)-domínio motor).

Métodos:

Neste estudo de propriedades de medida, a FSS-ICU e a MIF foram aplicadas em 100 pacientes (72,1 ± 15,9 anos; 53% masculino; Sequential Organ Failure Assessment = 11,0 ± 3,5 pontos; Simplified Acute Physiology Score 3 = 50,2 ± 16,8 pontos) na unidade de terapia intensiva na linha de base e após 2 horas pelo fisioterapeuta 1 (teste e reteste) e 30 minutos após a linha de base pelo fisioterapeuta 2. As propriedades de medidas avaliadas foram a consistência interna (alfa de Cronbach), as confiabilidades intra e interavaliadores (coeficiente de correlação intraclasse), a concordância (erro padrão de medida), a diferença mínima detectável com confiança de 90%, os efeitos teto e piso (frequência de pontuação máxima e mínima) e a validade do construto (correlação de Pearson).

Resultados:

Para a FSS-ICU e a MIF, foram encontradas adequadas consistência interna (alfa de Cronbach: FSS-ICU = 0,95 e MIF = 0,86), confiabilidades intra e interavaliadores para pontuação geral da FSS-ICU e MIF (coeficiente de correlação intraclasse > 0,75), concordância (diferença mínima detectável com confiança de 90% e MIF = 1,0 ponto; erro padrão de medida: FSS-ICU = 2% e MIF = 1%) e validade do construto (r = 0,94; p < 0,001). A FSS-ICU apresentou efeito teto de 16% e a MIF de 18%.

Conclusão:

As escalas FSS-ICU e MIF têm adequadas propriedades de medida para avaliarem funcionalidade em pacientes críticos, embora apresentem efeito teto.

Descritores:
Escalas funcionais; Propriedade de medida; Cuidados críticos; Atividades cotidianas

INTRODUCTION

Approximately 20 million people are admitted every year to intensive care units (ICU) around the world.(11 Fan E, Cheek F, Chlan L, Gosselink R, Hart N, Herridge MS, Hopkins RO, Hough CL, Kress JP, Latronico N, Moss M, Needham DM, Rich MM, Stevens RD, Wilson KC, Winkelman C, Zochodne DW, Ali NA; ATS Committee on ICU-acquired Weakness in Adults; American Thoracic Society. An official American Thoracic Society Clinical Practice guideline: the diagnosis of intensive care unit-acquired weakness in adults. Am J Respir Crit Care Med. 2014;190(12):1437-46.) Improvements in ICU care have allowed for increased survival of these patients; however, the impact on functionality has been an increasingly reported adverse effect.(22 Castro-Avila AC, Serón P, Fan E, Gaete M, Mickan S. Effect of early rehabilitation during intensive care unit stay on functional status: systematic review and meta-analysis. PLoS One. 2015;10(7):e0130722.

3 Desai SV, Law TJ, Needham DM. Long-term complications of critical care. Crit Care Med. 2011;39(2):371-9.
-44 Robinson CC, Rosa RG, Kochhann R, Schneider D, Sganzerla D, Dietrich C, et al. Quality of life after intensive care unit: a multicenter cohort study protocol for assessment of long-term outcomes among intensive care survivors in Brazil. Rev Bras Ter Intensiva. 2018;30(4):405-13.)

Functionality is conceptualized as the ability to perform activities ranging from self-care to activities that demand high strength and mobility.(55 Bruce B, Fries JF, Ambrosini D, Lingala B, Gandek B, Rose M, et al. Better assessment of physical function: item improvement is neglected but essential. Arthritis Res Ther. 2009;11(6):R191.) Some factors are associated with impaired functionality, where severity of the critical illness, use of sedatives and/or replacement therapies such as hemodialysis, need for invasive mechanical ventilation and prolonged bed rest are associated with impaired physical fitness and reduced functionality.(11 Fan E, Cheek F, Chlan L, Gosselink R, Hart N, Herridge MS, Hopkins RO, Hough CL, Kress JP, Latronico N, Moss M, Needham DM, Rich MM, Stevens RD, Wilson KC, Winkelman C, Zochodne DW, Ali NA; ATS Committee on ICU-acquired Weakness in Adults; American Thoracic Society. An official American Thoracic Society Clinical Practice guideline: the diagnosis of intensive care unit-acquired weakness in adults. Am J Respir Crit Care Med. 2014;190(12):1437-46.,22 Castro-Avila AC, Serón P, Fan E, Gaete M, Mickan S. Effect of early rehabilitation during intensive care unit stay on functional status: systematic review and meta-analysis. PLoS One. 2015;10(7):e0130722.,66 Cornette P, Swine C, Malhomme B, Gillet JB, Meert P, D'Hoore W. Early evaluation of the risk of functional decline following hospitalization of older patients: development of a predictive tool. Eur J Public Health. 2006;16(2):203-8.,77 Dietrich C, Cardoso JR, Vargas F, Sanchez EC, Dutra FH, Moreira C, et al. Functional ability in younger and older elderlies after discharge from the intensive care unit. A prospective cohort. Rev Bras Ter Intensiva. 2017;29(3):293-302.) This negative impact on physical fitness and functionality acquired in the ICU may compromise the patients' return to full social functioning for up to 5 years.(88 Garland A, Dawson NV, Altmann I, Thomas CL, Phillips RS, Tsevat J, Desbiens NA, Bellamy PE, Knaus WA, Connors AF Jr; SUPPORT Investigators. Outcomes up to 5 years after severe, acute respiratory failure. Chest. 2004;126(6):1897-904.)

In an attempt to minimize or prevent these adverse effects of ICU admission, early mobilization has been increasingly studied and implemented,(22 Castro-Avila AC, Serón P, Fan E, Gaete M, Mickan S. Effect of early rehabilitation during intensive care unit stay on functional status: systematic review and meta-analysis. PLoS One. 2015;10(7):e0130722.) with positive effects on the improvement of muscle strength, gait independence, reduced length of hospital stay and continuous improvements in functionality.(11 Fan E, Cheek F, Chlan L, Gosselink R, Hart N, Herridge MS, Hopkins RO, Hough CL, Kress JP, Latronico N, Moss M, Needham DM, Rich MM, Stevens RD, Wilson KC, Winkelman C, Zochodne DW, Ali NA; ATS Committee on ICU-acquired Weakness in Adults; American Thoracic Society. An official American Thoracic Society Clinical Practice guideline: the diagnosis of intensive care unit-acquired weakness in adults. Am J Respir Crit Care Med. 2014;190(12):1437-46.,99 Schweickert WD, Pohlman MC, Pohlman AS, Nigos C, Pawlik AJ, Esbrook CL, et al. Early physical and occupational therapy in mechanically ventilated, critically ill patients: a randomised controlled trial. Lancet. 2009;373(9678):1874-82.) However, to evaluate the impact of early mobilization in the ICU, it is essential to use instruments validated and tested in this setting.(1010 Christakou A, Papadopoulos E, Patsaki E, Sidiras G, Nanas S. Functional assessment scales in a general intensive care unit. A review. Hosp Chron. 2013;8(4):159-66.) The first scales for functional evaluation in the ICU were adapted from rehabilitation centers to this setting and include the Functional Independence Measure - FIM.(1010 Christakou A, Papadopoulos E, Patsaki E, Sidiras G, Nanas S. Functional assessment scales in a general intensive care unit. A review. Hosp Chron. 2013;8(4):159-66.,1111 Riberto M, Miyazaki MH, Jucá SS, Sakamoto H, Pinto PP, Battistella LR. Validação da Versão Brasileira da Medida de Independência Funcional. Acta Fisiatr. 2004;11(2):72-6.) To use the FIM for the ICU setting, some modifications were necessary in the scale, such as the reduction of 18 evaluation items to only 2, with an emphasis on the most relevant tasks in the ICU setting.(1212 Jesus FS, Paim DM, Brito JO, Barros IA, Nogueira TB, Martinez BP, et al. Mobility decline in patients hospitalized in an intensive care unit. Rev Bras Ter Intensiva. 2016;28(2):114-9.

13 Hinkle JL, McClaran J, Davies J, Ng D. Reliability and validity of the adult alpha functional independence measure instrument in England. J Neurosci Nurs. 2010;42(1):12-8.

14 Riberto M, Miyazaki MH, Jorge Filho D, Sakamoto H, Battistella LR. Reprodutibilidade da versão brasileira da Medida de Independência Funcional. Acta Fisiatr. 2001;8(1):45-52.
-1515 Elliott D, Denehy L, Berney S, Alison JA. Assessing physical function and activity for survivors of a critical illness: a review of instruments. Aust Crit Care. 2011;24(3):155-66.)

To improve the functional assessment process, functional scales were specifically developed for the ICU setting.(1616 Parry SM, Granger CL, Berney S, Jones J, Beach L, El-Ansary D, et al. Assessment of impairment and activity limitations in the critically ill: a systematic review of measurement instruments and their clinimetric properties. Intensive Care Med. 2015;41(5):744-62.) Such scales include the Functional Status Scale for the ICU (FSS-ICU), which evaluates the ability to roll in bed, transfer from laying to sitting, transfer from sitting to standing, sit at the edge of the bed and walk.(1717 Zanni JM, Korupolu R, Fan E, Pradhan P, Janjua K, Palmer JB, et al. Rehabilitation therapy and outcomes in acute respiratory failure: an observational pilot project. J Crit Care. 2010;25(2):254-62.

18 Parry SM, Denehy L, Beach LJ, Berney S, Williamson HC, Granger CL. Functional outcomes in ICU - what should we be using? - an observational study. Crit Care. 2015;19:127.
-1919 Thrush A, Rozek M, Dekerlegand JL. The clinical utility of the functional status score for the intensive care unit (FSS-ICU) at a long-term acute care hospital: a prospective cohort study. Phys Ther. 2012;92(12):1536-45.) Higher final scores on the FIM and FSS-ICU indicate better functionality, and lower scores indicate dependency of the patients for the activities evaluated.(2020 Curzel J, Forgiarini Junior LA, Rieder Mde M. Evaluation of functional independence after discharge from the intensive care unit. Rev Bras Ter Intensiva. 2013;25(2):93-8.,2121 Silva VZ, Araújo JA Neto, Cipriano G Jr, Pinedo M, Needham DM, Zanni JM, et al. Brazilian version of the Functional Status Score for the ICU: translation and cross-cultural adaptation. Rev Bras Ter Intensiva. 2017;29(1):34-8.) The FIM and the FSS-ICU have already been validated and translated into Portuguese, but only the sensitivity of the FIM and the reliability of the FSS-ICU were previously tested.(2121 Silva VZ, Araújo JA Neto, Cipriano G Jr, Pinedo M, Needham DM, Zanni JM, et al. Brazilian version of the Functional Status Score for the ICU: translation and cross-cultural adaptation. Rev Bras Ter Intensiva. 2017;29(1):34-8.,2222 Riberto M, Miyazaki MH, Jucá SS, Sakamoto, Pinto PP, Battistella LR. Validação da Versão Brasileira da Medida de Independência Funcional. Acta Fisiatr. 2004;11(2):72-6.) However, the assessment of reliability, ceiling and floor effects, and construct validity are part of a set of measurement properties that should be tested in health instruments to assist in selecting the most appropriate instrument for application in clinical practice.(1111 Riberto M, Miyazaki MH, Jucá SS, Sakamoto H, Pinto PP, Battistella LR. Validação da Versão Brasileira da Medida de Independência Funcional. Acta Fisiatr. 2004;11(2):72-6.,2121 Silva VZ, Araújo JA Neto, Cipriano G Jr, Pinedo M, Needham DM, Zanni JM, et al. Brazilian version of the Functional Status Score for the ICU: translation and cross-cultural adaptation. Rev Bras Ter Intensiva. 2017;29(1):34-8.,2323 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42.,2424 Mokkink LB, Terwee CB, Gibbons E, Stratford PW, Alonso J, Patrick DL, et al. Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) checklist. BMC Med Res Methodol. 2010;10:82.)

The objective of this study was to evaluate the measurement properties (convergent validity, intra- and interrater reliability, internal consistency, agreement, and ceiling and floor effects) of the FSS-ICU and of the motor domain of the FIM in patients admitted to the ICU.

METHODS

This was a study of measurement properties, approved by the Human Research Ethics Committee of the Universidade Cidade de São Paulo under number 45685215.8.0000.0064.

All eligible patients signed an informed consent form. The patients evaluated were admitted consecutively to the ICU of the Hospital Aliança of Salvador, Bahia, Brazil, for clinical or surgical reasons, between January 2016 and December 2017. This facility is a private and medium-size hospital, with a general ICU with 15 beds, that treats clinical and surgical patients. Physiotherapists, physicians, nurses, nursing technicians, nutritionists, social workers and psychologists are part of the ICU team.

According to the guidelines of the Consensus-based standards for the selection of health measurement instruments (COSMIN), a sample of 100 patients is required to analyze reproducibility, construct validity and ceiling and floor effects. Therefore, a sample size of 100 patients was determined.(2525 Souza DC, Wegner F, Costa LC, Chiavegato LD, Lunardi AC. Measurement properties of the Human Activity Profile questionnaire in hospitalized patients. Braz J Phys Ther. 2017;21(3):153-8.) The patients included were those admitted for more than 48 hours in the ICU, without clinical restrictions of mobilization, who were awake, cooperative and understood the requested commands and who agreed to participate in the study.

Once a patient was selected for the study, a consent form was presented to him/her and/or a family member during visiting hours. The scales were not applied the first time the patients got up from bed after long periods of immobilization due to the greater likelihood of orthostatic hypotension and the consequent fear of patients in performing the tests, which could compromise the reliability analyses. Mobilization after analgesia was also defined, in consultation with the nursing team, for those patients who required it.

Patients with an altered clinical status, detected by the medical team, between assessments (hypotension or hypertension, bradycardia or tachycardia, tachypnea and/or sensory changes relative to baseline), under the effect of sedation and vasoactive drugs and using invasive mechanical ventilation at the time of assessment were excluded.

All patients evaluated were prescribed relative rest confirmed by the attending physician and the stability of the physiological systems (respiratory, cardiovascular and mental); thus, the physiotherapist was able to evaluate the neuromusculoskeletal system by means of the FSS-ICU and the FIM-motor domain.

To evaluate the patients, 15 physiotherapists were included in the study. All were intensive care specialists and trained on the application of the scales, which are routinely used in the hospital. Each patient was evaluated by 2 of these physiotherapists. Physiotherapist 1 began the procedures for assessment at baseline, applying the FSS-ICU and the FIM-motor domain (test 1) to analyze the internal consistency and the ceiling and floor effects. After 30 minutes, physiotherapist 2, blind to the results of test 1, also applied the FSS-ICU and the FIM-motor domain (test 2) to analyze interrater reliability. After 2 hours, physiotherapist 1 reapplied the scales (retest) for analysis of intrarater reliability and agreement (Figure 1). When recording the results on the data sheet, the physiotherapists used an instruction manual that details the levels of assistance used in the assessment.(2121 Silva VZ, Araújo JA Neto, Cipriano G Jr, Pinedo M, Needham DM, Zanni JM, et al. Brazilian version of the Functional Status Score for the ICU: translation and cross-cultural adaptation. Rev Bras Ter Intensiva. 2017;29(1):34-8.)

Figure 1
Flowchart for the application of the Functional Status Score - ICU and Functional Independence Measure - motor domain. FSS-ICU - Functional Status Score for the ICU; FIM - Functional Independence Measure.

Age, sex, dates of ICU admission and discharge, reason for ICU admission, comorbidities, need for invasive mechanical ventilation with recording of intubation and extubation dates, and use of vasoactive drugs and sedatives were recorded in the data collection form. The Sequential Organ Failure Assessment (SOFA)(2626 Minne L, Abu-Hanna A, de Jonge E. Evaluation of SOFA-based models for predicting mortality in the ICU: A systematic review. Crit Care. 2008;12(6):R161.) and the Simplified Acute Physiology Score 3 (SAPS 3)(2727 Silva Junior JM, Malbouisson LM, Nuevo HL, Barbosa LG, Marubayashi LY, Teixeira IC, et al. Applicability of the simplified acute physiology score (SAPS 3) in Brazilian hospitals. Rev Bras Anestesiol. 2010;60(1):20-31.) were used to determine the clinical severity of patients.

The FSS-ICU is used to grade a patient's physical performance and evaluates 5 tasks: rolling in bed, transferring from laying to sitting, transferring from sitting to standing, sitting on the edge of the bed and walking. Each item can receive up to 7 points, depending on the degree of assistance required for each task. In total, the score can range from zero (totally dependent) to 35 (completely independent).(2121 Silva VZ, Araújo JA Neto, Cipriano G Jr, Pinedo M, Needham DM, Zanni JM, et al. Brazilian version of the Functional Status Score for the ICU: translation and cross-cultural adaptation. Rev Bras Ter Intensiva. 2017;29(1):34-8.,2828 Huang M, Chan KS, Zanni JM, Parry SM, Neto SG, Neto JA, et al. Functional Status Score for the ICU: An International Clinimetric Analysis of Validity, Responsiveness, and Minimal Important Difference. Crit Care Med. 2016;44(12):e1155-e1164.)

The FIM-motor domain contains only the transfers and locomotion domains because we consider them to be the most relevant in the ICU for use by the physiotherapist and are also more comparable to the FSS-ICU.(1212 Jesus FS, Paim DM, Brito JO, Barros IA, Nogueira TB, Martinez BP, et al. Mobility decline in patients hospitalized in an intensive care unit. Rev Bras Ter Intensiva. 2016;28(2):114-9.) Its score ranges from zero to 7 for each task, considering the degree of assistance required for the patient to perform bed transfers and locomotion. The sum of the items ranges from a minimum value of zero to a maximum of 14 points.(1111 Riberto M, Miyazaki MH, Jucá SS, Sakamoto H, Pinto PP, Battistella LR. Validação da Versão Brasileira da Medida de Independência Funcional. Acta Fisiatr. 2004;11(2):72-6.,1414 Riberto M, Miyazaki MH, Jorge Filho D, Sakamoto H, Battistella LR. Reprodutibilidade da versão brasileira da Medida de Independência Funcional. Acta Fisiatr. 2001;8(1):45-52.)

The tested properties and respective analyses are presented as the means and standard deviation for continuous variables and as absolute numbers, percentages and frequencies for the categorical variables, after applying the Shapiro-Wilks normality test.

The internal consistency was determined using Cronbach's alpha for the total FSS-ICU and FIM-motor domain scales. In addition to the total analysis, internal consistency without each of the items was also evaluated for the FSS-ICU for detecting redundancy. This index ranges from zero to 1, and the higher the value is, the greater the reliability of the scale. Values between 0.75 and 0.95 are considered appropriate.(2929 Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45.)

The agreement was tested by the standard error of measurement (SEM) and the minimum detectable change at a 90% confidence level (MDC90). The MDC90 corresponded to the score in test 1 minus the score in test 2 divided by the √2 × SEM. The SEM was considered very good if <5% of the total score, good if ≥ 5% and < 10%, doubtful if ≥ 10% and < 20%, and negative if > 20%.(2929 Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45.)

The intra- and interrater reliabilities were tested using the intraclass correlation coefficient (ICC), subtype absolute agreement for single measures, considering the variance in the measurements for each participant, not the mean (ICC2.1), with its respective 95% confidence interval (95%CI). The result was classified as follows: poor if ICC < 0.4; satisfactory if 0.4 ≤ ICC < 0.75 and excellent if ICC ≥ 0.75.(2929 Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45.)

The convergent validity was tested using Pearson's correlation between the FSS-ICU and the FIM-motor domain total scores. The correlation level was characterized as follows: ƿ = 1 indicated a perfect positive correlation between 2 categories of the scales; ƿ = -1 indicated a perfect negative correlation between 2 categories of the scales; and ƿ = 0 indicated that the categories of the scales were not linearly dependent on each other. Our hypothesis was that there was a strong and positive correlation between the scales because they evaluated the same construct (mobility).(2929 Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45.)

Ceiling and floor effects were tested by frequencies and were considered present if 15% or more patients reached a maximum or minimum score for the instruments.(2929 Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45.)

RESULTS

Initially, 145 patients were screened, and 45 were excluded due to clinical changes between assessments (Figure 1). A sample of 100 patients with a mean age of 72.1 ± 15.9 years completed the study. Approximately 19% had 2 or 3 reasons for ICU admission, 70% of the sample had more than 1 associated comorbidity, and postoperative (elective or urgent) conditions were the main causes of ICU admission. The mean SOFA severity score was 11.0 ± 3.5, and the mean SAPS 3 score was 50.2 ± 16.5 (Table 1). For the patients who required it, the average time of invasive mechanical ventilation was 5.36 ± 4.34 days. Sedation was used for 26.9% of patients, and 28.8% required vasoactive drugs.

Table 1
Demographic and clinical characteristics of the patients

Internal consistency

The internal consistency was considered adequate; Cronbach's alpha was 0.95 for the total FSS-ICU score (Table 2), and a Cronbach's alpha of 0.86 was obtained for the total FIM-motor domain score. It was not possible to calculate the Cronbach's alpha for each deleted item of the FIM-motor domain scale because it only has 2 items.

Table 2
Cronbach's alpha per deleted item for each task of the Functional Status Score - ICU

Agreement

The MDC90 was 1.0 point for the FSS-ICU and FIM, with SEMs of 0.54 points (2%) and 0.11 points (1%), respectively.

Reliability

The ICCs of the total FSS-ICU score and total FIM-motor score were considered adequate and are provided in table 3.

Table 3
Intra- and interrater intraclass correlation coefficients for total Functional Status Score - ICU and Functional Independence Measure - motor domain

Convergent validity

A correlation of 0.94 was identified between the total FSS-ICU score and the total FIM-motor domain score, with p < 0.001.

Ceiling and floor effects

The ceiling effect was observed in 16% of the sample for the FSS-ICU, and in 18% of the sample for the FIM. The floor effect was not observed in the scales. The mean total score for the FSS-ICU was 21.37 ± 10.07, and the mean total score for the FIM-motor domain was 8.06 ± 4.31.

DISCUSSION

This study aimed to evaluate the measurement properties of the FSS-ICU and FIM-motor domain, and a strong correlation between them was identified because they evaluate the same construct: mobility. The results of this study demonstrated that the FSS-ICU and the FIM-motor domain showed adequate internal consistency, reliability and agreement for all tasks in the test and retest. Furthermore, the validity was convergent between the scales, and both had no floor effects but had ceiling effects.(2929 Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45.)

Based on the detection of adequate measurement properties in both scales, we can infer that although the FSS-ICU was developed using the FIM as a reference, it is a more complete and robust scale, being specific for the ICU setting, and allows documenting and measuring the efficacy of therapeutic interventions during the provision of care to critically ill in-hospital patients.(1717 Zanni JM, Korupolu R, Fan E, Pradhan P, Janjua K, Palmer JB, et al. Rehabilitation therapy and outcomes in acute respiratory failure: an observational pilot project. J Crit Care. 2010;25(2):254-62.,1919 Thrush A, Rozek M, Dekerlegand JL. The clinical utility of the functional status score for the intensive care unit (FSS-ICU) at a long-term acute care hospital: a prospective cohort study. Phys Ther. 2012;92(12):1536-45.) Finally, the motor domain of the FIM has only 2 items, and its application is therefore quick and may be a good choice for screening and referring patients at functional risk for more or less intense physical therapy during ICU treatment. In addition, a 2-point change in the FSS-ICU seems to be clinically important in chronic patients, and the application of the FSS-ICU does not significantly alter the physiotherapy assessment or treatment sessions, as it is estimated that less than 1 minute is necessary to record the data and, therefore, it is important for documenting the effects of the interventions.(1919 Thrush A, Rozek M, Dekerlegand JL. The clinical utility of the functional status score for the intensive care unit (FSS-ICU) at a long-term acute care hospital: a prospective cohort study. Phys Ther. 2012;92(12):1536-45.)

As FIM was not developed for the hospital setting, a multicenter American study had already investigated the validation of this scale in that setting, where it was applied in subacute and chronic patients predominantly affected by neurological diseases. The study identified adequate internal consistency, although it was lower than 0.70 for the subitem locomotion, being lower than the value of 0.86 found in our study, in which the scale was applied to critically ill patients.(3030 Dodds TA, Martin DP, Stolov WC, Deyo RA. A validation of the functional independence measurement and its performance among rehabilitation inpatients. Arch Phys Med Rehabil. 1993;74(5):531-6.) Dodds et al.(3030 Dodds TA, Martin DP, Stolov WC, Deyo RA. A validation of the functional independence measurement and its performance among rehabilitation inpatients. Arch Phys Med Rehabil. 1993;74(5):531-6.) reinforced that the FIM is an instrument with adequate reliability for identifying the physical changes of patients in a rehabilitation program and confirmed the ability (construct validity) of the instrument to discriminate patients based on age and comorbidities.

The FIM was only translated and validated in Brazilian Portuguese in 2000, and the authors reported no linguistic and cultural equivalence issues, with convergent validity confirmed when applied to patients with greater motor impairment, who presented lower total scores.(1111 Riberto M, Miyazaki MH, Jucá SS, Sakamoto H, Pinto PP, Battistella LR. Validação da Versão Brasileira da Medida de Independência Funcional. Acta Fisiatr. 2004;11(2):72-6.) However, again, the reliability of the scale was lower in the study by Riberto et al.,(1111 Riberto M, Miyazaki MH, Jucá SS, Sakamoto H, Pinto PP, Battistella LR. Validação da Versão Brasileira da Medida de Independência Funcional. Acta Fisiatr. 2004;11(2):72-6.) which involved ICU patients and outpatients in the same sample when compared with our study exclusively with critically ill patients. Another difference between the studies was the use of the qualitative and quantitative scores to evaluate agreement. Riberto et al.(1111 Riberto M, Miyazaki MH, Jucá SS, Sakamoto H, Pinto PP, Battistella LR. Validação da Versão Brasileira da Medida de Independência Funcional. Acta Fisiatr. 2004;11(2):72-6.,1414 Riberto M, Miyazaki MH, Jorge Filho D, Sakamoto H, Battistella LR. Reprodutibilidade da versão brasileira da Medida de Independência Funcional. Acta Fisiatr. 2001;8(1):45-52.) evaluated the reliability of 2 evaluators using the kappa test and considered it to be moderate-substantial, unlike our study, which measured reliability using the ICC and scored it as excellent.

In 2010, the alpha FIM version reduced the scale from 18 items to 6 items (4 motor and 2 cognitive) and maintained a score of 1 to 7 to classify the level of independence for each task.(1313 Hinkle JL, McClaran J, Davies J, Ng D. Reliability and validity of the adult alpha functional independence measure instrument in England. J Neurosci Nurs. 2010;42(1):12-8.) This scale has already been tested in the ICU and was able to identify changes in the ability to perform transfers and locomotion between hospital admission and discharge.(1313 Hinkle JL, McClaran J, Davies J, Ng D. Reliability and validity of the adult alpha functional independence measure instrument in England. J Neurosci Nurs. 2010;42(1):12-8.) A previous study applied the FIM only with the bed transfer and locomotion domains in the ICU, using a score from 1 to 7 to classify the independence of patients to perform the tasks,(1212 Jesus FS, Paim DM, Brito JO, Barros IA, Nogueira TB, Martinez BP, et al. Mobility decline in patients hospitalized in an intensive care unit. Rev Bras Ter Intensiva. 2016;28(2):114-9.) confirming that this scale can be better applied in the ICU with these adaptations; however, the measurement properties of this change in scale were tested for the first time in our study.(1212 Jesus FS, Paim DM, Brito JO, Barros IA, Nogueira TB, Martinez BP, et al. Mobility decline in patients hospitalized in an intensive care unit. Rev Bras Ter Intensiva. 2016;28(2):114-9.)

Unlike the FIM, the FSS-ICU was developed specifically for the ICU setting when it evaluated the functional impact in patients who required invasive mechanical ventilation,(1717 Zanni JM, Korupolu R, Fan E, Pradhan P, Janjua K, Palmer JB, et al. Rehabilitation therapy and outcomes in acute respiratory failure: an observational pilot project. J Crit Care. 2010;25(2):254-62.) and its clinical usefulness was confirmed for the functional evaluation in a population of patients with long hospital stays.(1919 Thrush A, Rozek M, Dekerlegand JL. The clinical utility of the functional status score for the intensive care unit (FSS-ICU) at a long-term acute care hospital: a prospective cohort study. Phys Ther. 2012;92(12):1536-45.)Table 4 shows the measurement properties of studies that used the FSS-ICU and FIM.

Table 4
Distribution of the measurement properties of the Functional State Scale - ICU and Functional Independence Measure

Parry et al.(1818 Parry SM, Denehy L, Beach LJ, Berney S, Williamson HC, Granger CL. Functional outcomes in ICU - what should we be using? - an observational study. Crit Care. 2015;19:127.) developed an observational study of 66 patients and used 4 scales for functional assessment: the FSS-ICU, Physical Function in Intensive Care Unit Test (PFIT), Perme Score, Intensive Care Unit Mobility Scale (IMS) and Short Physical Performance Battery (SPPB). The authors concluded that the FSS-ICU and PFIT had potential for and recommended its use in clinical practice and research. The authors found a minimally important change 4 to 5 times higher than that detected in our study. Most likely, the difference in agreement between the studies was due to the difference in reason for ICU admission, which was predominantly respiratory decompensation in the study by Parry et al.(1818 Parry SM, Denehy L, Beach LJ, Berney S, Williamson HC, Granger CL. Functional outcomes in ICU - what should we be using? - an observational study. Crit Care. 2015;19:127.) and postoperative in our study; thus, the population studied by Parry et al al.(1818 Parry SM, Denehy L, Beach LJ, Berney S, Williamson HC, Granger CL. Functional outcomes in ICU - what should we be using? - an observational study. Crit Care. 2015;19:127.) was potentially more clinically unstable.

Regarding interpretability, in a multicenter study, Huang et al.(2828 Huang M, Chan KS, Zanni JM, Parry SM, Neto SG, Neto JA, et al. Functional Status Score for the ICU: An International Clinimetric Analysis of Validity, Responsiveness, and Minimal Important Difference. Crit Care Med. 2016;44(12):e1155-e1164.) found a ceiling effect only during the assessment at hospital discharge, while our study found the same effect in the FSS-ICU during the ICU stay, which may be explained by the higher prevalence of surgical patients in our sample. In that same study,(2828 Huang M, Chan KS, Zanni JM, Parry SM, Neto SG, Neto JA, et al. Functional Status Score for the ICU: An International Clinimetric Analysis of Validity, Responsiveness, and Minimal Important Difference. Crit Care Med. 2016;44(12):e1155-e1164.) the internal consistency and the convergent validity were similar to those found by us. The intrarater reliability measured in our study was confirmed by the study by Ragavan et al.,(3232 Ragavan V, Greenwood K, Bibi K. The Functional Status Score for the Intensive Care Unit Scale: Is It Reliable in the Intensive Care Unit? Can It Be Used to Determine Discharge Placement? J Acute Care Phys Ther. 2016;7(3):93-100.) although those authors did not follow the COSMIN(3333 Mokkink LB, Prinsen CA, Bouter LM, Vet HC, Terwee CB. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument. Braz J Phys Ther. 2016;20(2):105-13.) recommendations for performing clinimetric studies.

The identification of tools to assess the limitations of activity and disability in critically ill patients who already had their measurement properties tested was the subject of a systematic review conducted by Parry et al.(1616 Parry SM, Granger CL, Berney S, Jones J, Beach L, El-Ansary D, et al. Assessment of impairment and activity limitations in the critically ill: a systematic review of measurement instruments and their clinimetric properties. Intensive Care Med. 2015;41(5):744-62.) The authors found that high PFIT and FSS-ICU scores at ICU discharge are associated with discharge directly to home. However, they emphasize that it is difficult to use a single tool for physical evaluation in the ICU due to the clinical fluctuations of critically ill patients and the limitations for patient cooperation in tests, such as muscle strength assessments. The authors recommend that evaluations be based on the International Classification of Functioning, Disability and Health (ICF), which is covered by the FSS-ICU and evaluates activities (transfers and walking).(1616 Parry SM, Granger CL, Berney S, Jones J, Beach L, El-Ansary D, et al. Assessment of impairment and activity limitations in the critically ill: a systematic review of measurement instruments and their clinimetric properties. Intensive Care Med. 2015;41(5):744-62.)

The evaluation of the measurement properties of the FIM occurred only in hospitalized patients. Therefore, its ability to identify functional changes in the rehabilitation setting is high.(3030 Dodds TA, Martin DP, Stolov WC, Deyo RA. A validation of the functional independence measurement and its performance among rehabilitation inpatients. Arch Phys Med Rehabil. 1993;74(5):531-6.) However, the total FIM has limitations for reproduction in the ICU setting because it includes activities such as using the toilet and climbing stairs.(3434 Christakou A, Papadopoulos E, Patsaki I, Sidiras G, Nanas S. Functional assessment scales in a general intensive care unit. A review. Hosp Chron. 2013;8(4):164-70.) Therefore, the FSS-ICU may be more appropriate for application in the ICU setting because it considers activities more common in the context of critical illness.(3434 Christakou A, Papadopoulos E, Patsaki I, Sidiras G, Nanas S. Functional assessment scales in a general intensive care unit. A review. Hosp Chron. 2013;8(4):164-70.)

The limitations of this study include the possible identification of a ceiling effect in this population due to the higher prevalence of postoperative patients in the sample, with an average length of stay of 4.5 days in the ICU, which does not allow distinguishing whether it is a limitation of the scale or of the sample size. In addition, because this was a single-center study, our results may not necessarily represent the population of critically ill patients from Brazilian ICUs; however, most studies on measurement properties have the same characteristics, and the properties found in this study were similar to those from previous studies in other languages.

CONCLUSION

Most of the measurement properties (internal consistency, agreement, reliability, convergent validity and floor effect) of the FSS-ICU and of the FIM-motor domain are adequate for evaluating bed transfers and the walking ability of critically ill patients in the intensive care unit, although the scales have ceiling effects.

ACKNOWLEDGMENTS

Funding source: The Graduate Support Program of Private Education Institutions (PROSUP) and the Brazilian Federal Agency for Support and Evaluation of Graduate Education (CAPES).

REFERÊNCIAS

  • 1
    Fan E, Cheek F, Chlan L, Gosselink R, Hart N, Herridge MS, Hopkins RO, Hough CL, Kress JP, Latronico N, Moss M, Needham DM, Rich MM, Stevens RD, Wilson KC, Winkelman C, Zochodne DW, Ali NA; ATS Committee on ICU-acquired Weakness in Adults; American Thoracic Society. An official American Thoracic Society Clinical Practice guideline: the diagnosis of intensive care unit-acquired weakness in adults. Am J Respir Crit Care Med. 2014;190(12):1437-46.
  • 2
    Castro-Avila AC, Serón P, Fan E, Gaete M, Mickan S. Effect of early rehabilitation during intensive care unit stay on functional status: systematic review and meta-analysis. PLoS One. 2015;10(7):e0130722.
  • 3
    Desai SV, Law TJ, Needham DM. Long-term complications of critical care. Crit Care Med. 2011;39(2):371-9.
  • 4
    Robinson CC, Rosa RG, Kochhann R, Schneider D, Sganzerla D, Dietrich C, et al. Quality of life after intensive care unit: a multicenter cohort study protocol for assessment of long-term outcomes among intensive care survivors in Brazil. Rev Bras Ter Intensiva. 2018;30(4):405-13.
  • 5
    Bruce B, Fries JF, Ambrosini D, Lingala B, Gandek B, Rose M, et al. Better assessment of physical function: item improvement is neglected but essential. Arthritis Res Ther. 2009;11(6):R191.
  • 6
    Cornette P, Swine C, Malhomme B, Gillet JB, Meert P, D'Hoore W. Early evaluation of the risk of functional decline following hospitalization of older patients: development of a predictive tool. Eur J Public Health. 2006;16(2):203-8.
  • 7
    Dietrich C, Cardoso JR, Vargas F, Sanchez EC, Dutra FH, Moreira C, et al. Functional ability in younger and older elderlies after discharge from the intensive care unit. A prospective cohort. Rev Bras Ter Intensiva. 2017;29(3):293-302.
  • 8
    Garland A, Dawson NV, Altmann I, Thomas CL, Phillips RS, Tsevat J, Desbiens NA, Bellamy PE, Knaus WA, Connors AF Jr; SUPPORT Investigators. Outcomes up to 5 years after severe, acute respiratory failure. Chest. 2004;126(6):1897-904.
  • 9
    Schweickert WD, Pohlman MC, Pohlman AS, Nigos C, Pawlik AJ, Esbrook CL, et al. Early physical and occupational therapy in mechanically ventilated, critically ill patients: a randomised controlled trial. Lancet. 2009;373(9678):1874-82.
  • 10
    Christakou A, Papadopoulos E, Patsaki E, Sidiras G, Nanas S. Functional assessment scales in a general intensive care unit. A review. Hosp Chron. 2013;8(4):159-66.
  • 11
    Riberto M, Miyazaki MH, Jucá SS, Sakamoto H, Pinto PP, Battistella LR. Validação da Versão Brasileira da Medida de Independência Funcional. Acta Fisiatr. 2004;11(2):72-6.
  • 12
    Jesus FS, Paim DM, Brito JO, Barros IA, Nogueira TB, Martinez BP, et al. Mobility decline in patients hospitalized in an intensive care unit. Rev Bras Ter Intensiva. 2016;28(2):114-9.
  • 13
    Hinkle JL, McClaran J, Davies J, Ng D. Reliability and validity of the adult alpha functional independence measure instrument in England. J Neurosci Nurs. 2010;42(1):12-8.
  • 14
    Riberto M, Miyazaki MH, Jorge Filho D, Sakamoto H, Battistella LR. Reprodutibilidade da versão brasileira da Medida de Independência Funcional. Acta Fisiatr. 2001;8(1):45-52.
  • 15
    Elliott D, Denehy L, Berney S, Alison JA. Assessing physical function and activity for survivors of a critical illness: a review of instruments. Aust Crit Care. 2011;24(3):155-66.
  • 16
    Parry SM, Granger CL, Berney S, Jones J, Beach L, El-Ansary D, et al. Assessment of impairment and activity limitations in the critically ill: a systematic review of measurement instruments and their clinimetric properties. Intensive Care Med. 2015;41(5):744-62.
  • 17
    Zanni JM, Korupolu R, Fan E, Pradhan P, Janjua K, Palmer JB, et al. Rehabilitation therapy and outcomes in acute respiratory failure: an observational pilot project. J Crit Care. 2010;25(2):254-62.
  • 18
    Parry SM, Denehy L, Beach LJ, Berney S, Williamson HC, Granger CL. Functional outcomes in ICU - what should we be using? - an observational study. Crit Care. 2015;19:127.
  • 19
    Thrush A, Rozek M, Dekerlegand JL. The clinical utility of the functional status score for the intensive care unit (FSS-ICU) at a long-term acute care hospital: a prospective cohort study. Phys Ther. 2012;92(12):1536-45.
  • 20
    Curzel J, Forgiarini Junior LA, Rieder Mde M. Evaluation of functional independence after discharge from the intensive care unit. Rev Bras Ter Intensiva. 2013;25(2):93-8.
  • 21
    Silva VZ, Araújo JA Neto, Cipriano G Jr, Pinedo M, Needham DM, Zanni JM, et al. Brazilian version of the Functional Status Score for the ICU: translation and cross-cultural adaptation. Rev Bras Ter Intensiva. 2017;29(1):34-8.
  • 22
    Riberto M, Miyazaki MH, Jucá SS, Sakamoto, Pinto PP, Battistella LR. Validação da Versão Brasileira da Medida de Independência Funcional. Acta Fisiatr. 2004;11(2):72-6.
  • 23
    Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42.
  • 24
    Mokkink LB, Terwee CB, Gibbons E, Stratford PW, Alonso J, Patrick DL, et al. Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) checklist. BMC Med Res Methodol. 2010;10:82.
  • 25
    Souza DC, Wegner F, Costa LC, Chiavegato LD, Lunardi AC. Measurement properties of the Human Activity Profile questionnaire in hospitalized patients. Braz J Phys Ther. 2017;21(3):153-8.
  • 26
    Minne L, Abu-Hanna A, de Jonge E. Evaluation of SOFA-based models for predicting mortality in the ICU: A systematic review. Crit Care. 2008;12(6):R161.
  • 27
    Silva Junior JM, Malbouisson LM, Nuevo HL, Barbosa LG, Marubayashi LY, Teixeira IC, et al. Applicability of the simplified acute physiology score (SAPS 3) in Brazilian hospitals. Rev Bras Anestesiol. 2010;60(1):20-31.
  • 28
    Huang M, Chan KS, Zanni JM, Parry SM, Neto SG, Neto JA, et al. Functional Status Score for the ICU: An International Clinimetric Analysis of Validity, Responsiveness, and Minimal Important Difference. Crit Care Med. 2016;44(12):e1155-e1164.
  • 29
    Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45.
  • 30
    Dodds TA, Martin DP, Stolov WC, Deyo RA. A validation of the functional independence measurement and its performance among rehabilitation inpatients. Arch Phys Med Rehabil. 1993;74(5):531-6.
  • 31
    Martin UJ, Hincapie L, Nimchuk M, Gaughan J, Criner GJ. Impact of whole-body rehabilitation in patients receiving chronic mechanical ventilation. Crit Care Med. 2005;33(10):2259-65.
  • 32
    Ragavan V, Greenwood K, Bibi K. The Functional Status Score for the Intensive Care Unit Scale: Is It Reliable in the Intensive Care Unit? Can It Be Used to Determine Discharge Placement? J Acute Care Phys Ther. 2016;7(3):93-100.
  • 33
    Mokkink LB, Prinsen CA, Bouter LM, Vet HC, Terwee CB. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument. Braz J Phys Ther. 2016;20(2):105-13.
  • 34
    Christakou A, Papadopoulos E, Patsaki I, Sidiras G, Nanas S. Functional assessment scales in a general intensive care unit. A review. Hosp Chron. 2013;8(4):164-70.

Edited by

Responsible editor: Leandro Utino Taniguchi

Publication Dates

  • Publication in this collection
    20 Jan 2020
  • Date of issue
    Oct-Dec 2019

History

  • Received
    04 Feb 2019
  • Accepted
    11 July 2019
Associação de Medicina Intensiva Brasileira - AMIB Rua Arminda, 93 - Vila Olímpia, CEP 04545-100 - São Paulo - SP - Brasil, Tel.: (11) 5089-2642 - São Paulo - SP - Brazil
E-mail: rbti.artigos@amib.com.br