Reliability of the Brazilian version of the Functional Assessment of Cancer Therapy-Lung (FACT-L) and the FACT-Lung Symptom Index (FLSI)

CLINICAL SCIENCE

Reliability of the Brazilian version of the Functional Assessment of Cancer Therapy-Lung (FACT-L) and the FACT-Lung Symptom Index (FLSI)

Franceschini Juliana; José R. Jardim; Ana Luisa Godoy Fernandes; Sérgio Jamnik; Ilka Lopes Santoro

Respiratory Diseases Division - Federal University of São Paulo, Botucatu, São Paulo, São Paulo, Brazil. E-mail: [e-mail]. Tel.: [phone]

ABSTRACT

OBJECTIVES: The purpose of this study was to assess the reliability of the Brazilian version of the Functional Assessment of Cancer Therapy-Lung (FACT-L) with the FACT-Lung Symptom Index (FLSI) questionnaire.

INTRODUCTION: The assessment of quality of life in patients with lung cancer has become an important evaluative endpoint in current clinical trials. For lung cancer patients, one of the most common quality of life tools available is the FACT-L. Despite the amount of data available regarding this questionnaire, there are no data on its performance in Brazilian lung cancer patients.

METHODS: The FACT-L with the FLSI questionnaire was prospectively administered to 30 consecutive, stable, lung cancer outpatients at baseline and at 2 weeks.

RESULTS: The intraclass correlation coefficient between test and retest for the FACT-L ranged from 0.79 to 0.96 and for the FLSI was 0.87. There was no correlation between these questionnaire dimensions and clinical or functional parameters.

CONCLUSIONS: The Brazilian version of the FACT-L with FLSI questionnaire is reliable and is quick and simple to apply. This instrument can now be used to properly evaluate the quality of life of Brazilian lung cancer patients.

Keywords: Quality of life; Lung cancer; Questionnaires; Reproducibility of results; Validation studies.

INTRODUCTION

Lung cancer has become a disease of great global impact and remains the leading cause of death from cancer in the world.¹ As smoking and environmental pollution cannot be controlled in the short term, the incidence of lung cancer continues to increase, especially in females.^2,3 In Brazil, the estimate for 2010 is approximately 18 new cases per 100 000 men and 10 per 100 000 women, corresponding to 17 800 and 9 930 new cases of lung cancer among men and women respectively.⁴

Advances in lung cancer therapy have been improving survival rates, although the prognosis remains poor. The 5-year survival rate is around 15% in developed countries¹ and 10% in Brazil.⁴ Therefore, the impact of both disease and treatment on the health and psychosocial functioning of these patients should be considered.⁵ In this context, quality of life assessment and the analysis of the main symptoms that lead to functional capacity limitation have become issues of utmost importance in the evaluation of lung cancer patients. However, in Brazil, there are few studies that evaluate this aspect of the disease, mainly because of the lack of specific tools adapted to and reproducible for the Brazilian Portuguese language.

Several instruments are currently used to evaluate the quality of life in patients with lung cancer. The Functional Assessment of Cancer Therapy-Lung (FACT-L) was generated by the Functional Assessment of Chronic Illness Therapy (FACIT) group. It is a specific, multidimensional questionnaire widely used in clinical studies.^6-9 Moreover, the FACT-Lung Symptom Index (FLSI), which is a brief measure involving five common symptoms in lung cancer patients, can be applied in combination with the FACT-L or alone.

Although the FACT-L is currently used in Brazil, mainly in international multicenter trails, there is no study assessing the reliability of this questionnaire in the Brazilian Portuguese language. Therefore, the purpose of this study was to evaluate the reproducibility of the FACT-L and the FLSI for Brazilian lung cancer patients.

METHODS

A convenience sample comprising 30 patients with lung cancer was recruited from the outpatient lung cancer clinic of the Sao Paulo Hospital - Federal University of Sao Paulo. This study was approved by the Institutional Review Board of our center, and a Term of Informed Consent was signed by all patients.

The following inclusion criteria were used: histologically proven lung cancer; 18 years of age or older; a minimum score of 21 on the Mini Mental State Examination (MMSE);^10,11 out of chemotherapy/radiotherapy treatment; and clinical stability during the study and at least 10 days before the beginning of the evaluations. Clinical stability was defined as the absence of change in cough, sputum, and dyspnea, assessed by a structured form filled out during outpatient follow-up, and no hospitalizations or modifications in the therapeutic regimen. An exclusion criterion was the refusal to answer any questionnaire.

The sample size was based on previous reliability studies of other quality of life questionnaires related to respiratory diseases in Brazil.^12-15

Clinical evaluation and physical examination were performed by a team of physicians, based on a structured form. All patients met the stability criteria. The drug regimen used by the patients remained unchanged during the 15-day interval between questionnaire applications.

In the first visit, the following independent variables were collected: gender (male and female proportion), age (in years), history of tobacco use (yes or no) and consumption (pack-years), histologic subtypes (adenocarcinoma, squamous cell, small cell lung cancer and others),¹⁶ staging according to the 1997 TNM classification for non-small cell lung cancer (NSCLC) patients (stratified from IA to IIIA and from IIIB to IV),¹⁷ Karnofsky Performance Status (KPS),¹⁸ spirometry (forced expiratory volume in the first second (FEV1) and forced vital capacity (FVC) percentage of predicted and FEV1/FVC percentage),¹⁹ MMSE, and FACT-L and FLSI scores.⁹

The Portuguese version of the FACT-L and FLSI was released for use by the FACIT group (the developer of the questionnaire). The translation into Brazilian Portuguese, back translation and review by an expert committee to access the semantic, conceptual, idiomatic, cultural and metabolic equivalences were previously done by that group.^20,21

The FACT-L, version 4, is a combination of the 27-item FACT-General (FACT-G) and the 9-item Lung Cancer Subscale (LCS).

A total FACT-G score is calculated by summing the physical well-being (PWB), social/family well-being (SWB), emotional well-being (EWB), and functional well-being (FWB) subscale scores, with a score ranging from 0 to 108. A total FACT-L score is obtained by summing the FACT-G score with the LCS (two of the nine items are not scored). The FACT-L score ranges from 0 to 136.⁶

The FACT-L Trial Outcome Index (FACT-L TOI) is, a priori, an index that sums the PWB, FWB, and LCS into a 21-item scale. Its score ranges from 0 to 84.⁶

The FLSI is a symptom index with six questions regarding the five most frequent symptoms reported by lung cancer patients, especially in the advanced stages: dyspnea, fatigue, pain, weight loss, and coughing. Its score ranges from 0 to 24.

Higher scores generated by the FACT-L and FLSI correspond to better quality of life.

The score on each aspect of the FACT-L and FLSI is obtained according to the option chosen by the patient. The available options were: ''not at all'', ''a little bit'', "some-what", ''quite a bit'', or ''very much''. The higher the score obtained by each patient in question, the greater the final score of the subscale and the better the quality of life. However, these scores have a non-linear behavior.

Patients answered the questionnaire after being read each question, all by the same interviewer. The process took place in a calm environment with no interruptions allowed. The questionnaires were reviewed at the end of the interview to avoid any missed questions. The response time was timed in the two visits.

All doubts expressed by patients during the questionnaire were documented. Patients were also asked not only about what they felt in terms of question content, but also about the length of the questionnaire.

The test-retest design was adopted for the reliability study. The questionnaire was administered by the same researcher twice with a 15-day interval.

The scores obtained on different scales and subscales of FACT-G were compared with reference values established by the FACIT group.²² For this comparison, we used the minimal clinically significant difference, determined by the same group.⁶

Statistical analysis

Variables were expressed as mean and standard deviation. The intraclass correlation coefficient (ICC) and Kappa reliability coefficient were calculated to assess the reliability of the questionnaire and questions respectively. To compare the two groups, we used the chi-square test for categorical variables, t test for parametric continuous variables, and Mann-Whitney test for nonparametric continuous variables. For the correlations between spirometry and questionnaire scores, the Spearman's correlation coefficient was used. Statistical analysis was performed with SPSS^® software version 13.0. All tests were two-tailed, and the level of significance was 5%.

RESULTS

The main characteristics of the 30 patients who completed the study are shown in Table 1. Some 63.3% of the patients were over 60 years of age.

There was no statistically significant difference between genders regarding age, KPS, spirometry, staging, and histological type.

Among patients who never smoked, only one had a history of passive smoking. There was a prevalence of smoking habits in males (p = 0.04), with a higher tobacco smoke load for men than for women, consuming a mean of 53.2 pack-years (SD = 31.6) and 29.6 pack-years (SD = 25.5) respectively (p = 0.02).

Eight patients (26.7%) were diagnosed with chronic obstructive pulmonary disease (COPD), according to the GOLD guideline.²³

The mean values for each scale of the FACT-L and FLSI are illustrated in Table 2. The intraclass correlation coefficient values for the different scales of the FACT-L and FLSI showed excellent correlations (Table 2).

The kappa coefficient was used to test question reliability, which was less than 0.4 on questions GP1, GP5 (PWB), GS3, GS4, GS5 (SWB), GF1, GF2, GF3, GF5, GF6 (FWB), and LCL4 (LCS). The remaining questions had a moderate agreement. As for the FLSI, the kappa coefficient was moderate on question B1. In the other questions, the kappa coefficient was less than 0.4.

There was no correlation between spirometry and any of the questionnaire scales.

The mean score of the FACT-G scales was similar to the reference values for all scales that have these values established.²²Table 3 shows the mean values for the scales of FACT-G and FACT-L described in several studies of reliability and cultural adaptation into other languages.

The time spent by patients in answering the questionnaire was measured at both visits (Table 4). The response time on the second application was significantly lower (p = 0.001).

DISCUSSION

The focus of this study was to analyze the reliability of the FACT-L and the FLSI, a specific instrument for assessing the quality of life of lung cancer patients in the Brazilian population. It was observed that the Brazilian version shows excellent reliability for this population.

The FACT-L is an instrument that has been widely used in phase I, II, and III clinical trials. It has been translated and adapted into several languages and cultures.^{2,3,7,22,24-27} A feature of this instrument is the nonlinearity of the scores of its scales, a factor that complicates the interpretation of isolated study data. To facilitate the explanation of the results, the authors of the general questionnaire (FACT-G) have developed normative values from two reference groups, one from normal adults and another from adults with cancer in general.²² However, these normative values are only for the general questionnaire (FACT-G) and its scales. When comparing the results obtained in our study with the reference values, we observe that the score was similar in all scales and for the total value. A possible explanation for the fact that our patients have quality of life similar to patients with other cancer types is that, in the study for the establishment of benchmarks, besides including patients with various types of cancer, such as breast cancer, colon and rectum cancer, and cancer of the head and neck, they also included patients with lung cancer. Furthermore, 76.7% of the sample comprised patients treated and in remission from the underlying disease and, therefore, with better quality of life. When our FACT-L results are compared with those from other studies using the same questionnaire, we find that there is great variability between countries and different cul-tures,^{2,3,7,22,24-27} which may be due to differing perceptions of the questions according to each culture and also differences in patient characteristics, such as staging, age, socioeconomic status, among others.

The FLSI is an index designed to identify the presence of the major symptoms related to lung cancer, including dyspnea, pain, fatigue, cough, and weight loss.²⁸ These symptoms can negatively influence quality of life. In this study, in addition to the medical evaluation, FLSI was also used to assess the patient's clinical stability.

The reliability for all scores of the FACT-L showed ICC values greater than 0.75, ranging from 0.78 (SWB) to 0.96 (FACT-L TOI). These values show excellent reliability and are similar to those found in other studies. In the validation study of the Korean version of the FACT-L,²⁵ the ICC ranged from 0.52 to 0.84. The Chinese version³ varied from 0.76 to 0.82. In the reliability study of the original version, the ICC ranged from 0.56 (SWB) to 0.89 (FACT-L TOI).⁷ The FLSI also showed high reliability, which confirms the stability of the sample. Most of the FACT-L questions showed adequate reliability, analyzed by the kappa coefficient.

In this study, the reliability analyses were conducted with a convenience sample similar to other studies evaluating the reliability and cultural adaptation of other questionnaires to the Portuguese language.^12-15

In our sample, males predominated, in agreement with the worldwide prevalence of lung cancer.¹ The mean age was 61.3 years, which is consistent with most studies that include patients with lung cancer.^1,5 Regarding histological type, adenocarcinoma was the most prevalent, consistent with several epidemiological studies in developed coun-tries.¹ Unfortunately, regarding staging, there was a predominance of stage III and IV, stages with less chance of survival after treatment.²⁹ The mean FEV₁ (% predicted) and FEV₁/FVC ratio in our study were similar to the results reported by Young et al., who observed a FEV₁ (% predicted) mean of 73% and FEV₁/FVC mean of 64% in smokers with lung cancer.³⁰ In our study, there was no correlation between the questionnaire and the analyzed lung function parameters, consistent with other studies that found no significant correlation when investigating the effects of altered pulmonary function on the quality of life of cancer patients.^31,32

The process of translating the FACT-L questionnaire and FLSI into the Portuguese language (Brazil) was performed by the FACIT group. Only a few doubts were reported by the patients, which warrants its use in the current form.

Few patients had difficulty in interpreting the word "muitíssimo"; however, many of the patients interviewed understood the meaning of the term not because it is a familiar word, but because they realized that it was a scale with a progressive score in which the numerical value assigned to the word ''muitíssimo'' yielded the highest score. The suggested changes were sent to the FACIT group.

Alterations to this tool were proposed only for question Q1 ''Independentemente do seu nível a(c)tual de a(c)tivi-dade sexual, favor de responder a pergunta a seguir. Se preferir não responder, assinale o quadrículo □ e passe para a próxima seçao''. Despite not raising doubts, the words ''atual'' and ''atividade'' do not require the letter ''(c)'', and there is no need to use the preposition ''de'' after the word ''favor'', both grammatical constructions used in the Portuguese language in Portugal.

We conclude that the Brazilian version of the FACT-L questionnaire and FLSI is reproducible, fast, and of simple application, and that they are capable of measuring the quality of life in lung cancer patients in Brazil.

Received for publication on August 12, 2010

First review completed on August 23, 2010

Accepted for publication on September 7, 2010

• 1. Landi MT, Consonni D, Rotunno M, Bergen AW, Goldstein AM, Lubin JH, et al. Environment and Genetics in Lung cancer Etiology (EAGLE) study: an integrative population-based case-control study of lung cancer. BMC Public Health. 2008;8:203, doi: 10.1186/1471-2458-8-203.
• 2. Browning KK, Ferketich AK, Otterson GA, Reynolds NR, Wewers ME. A psychometric analysis of quality of life tools in lung cancer patients who smoke. Lung Cancer. 2009;66:134-9, doi: 10.1016/j.lungcan.2008.12.018.
• 3. Wan C, Zhang C, Cai L, Tu X, Feng C, Luo J, et al. Psychometric properties of the Chinese version of the FACT-L for measuring quality of life in patients with lung cancer. Lung Cancer. 2007;56: 415-21, doi: 10.1016/j.lungcan.2007.01.004.
• ⁴
  Brasil. Ministério da Saúde. Instituto Nacional de Câncer I. Estimativa 2010: Incidência de Câncer no Brasil. Rio de Janeiro: INCA; 2009.
• 5. Franceschini J, Santos AA, El Mouallem I, Jamnik S, Uehara C, Fernandes AL, et al. [Assessment of the quality of life of patients with lung cancer using the Medical Outcomes Study 36-item Short-Form Health Survey]. J Bras Pneumol. 2008;34:387-93, doi: 10.1590/S1806-37132008000600009.
• 6. Butt Z, Webster K, Eisenstein AR, Beaumont J, Eton D, Masters GA, et al. Quality of life in lung cancer: the validity and cross-cultural applicability of the Functional Assessment of Cancer Therapy-Lung scale. Hematol Oncol Clin North Am. 2005;19:389-420, viii, doi: 10.1016/j.hoc.2005.02.009.
• 7. Cella DF, Bonomi AE, Lloyd SR, Tulsky DS, Kaplan E, Bonomi P. Reliability and validity of the Functional Assessment of Cancer Therapy-Lung (FACT-L) quality of life instrument. Lung Cancer. 1995;12:199-220, doi: 10.1016/0169-5002(95)00450-F.
• 8. Montazeri A, Gillis CR, McEwen J. Quality of life in patients with lung cancer: a review of literature from 1970 to 1995. Chest. 1998;113:467-81, doi: 10.1378/chest.113.2.467.
• 9. Webster K, Cella D, Yost K. The Functional Assessment of Chronic Illness Therapy (FACIT) measurement system: properties, applications, and interpretation. Health Qual Life Outcomes. 2003; 1:79, doi: 10.1186/1477-7525-1-79.
• 10. Folstein MF, Folstein SE, McHugh PR. ''Mini-mental state''. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189-98, doi: 10.1016/0022-3956(75)90026-6.
• 11. Almeida OP. [Mini mental state examination and the diagnosis of dementia in Brazil]. Arq Neuropsiquiatr. 1998;56:605-12.
• 12. Camelier A, Rosa FW, Salim C, Nascimento OA, Cardoso F, Jardim JR. Using the Saint George's Respiratory Questionnaire to evaluate quality of life in patients with chronic obstructive pulmonary disease: validating a new version for use in Brazil. J Bras Pneumol. 2006;32:114-22, doi: 10. 1590/S1806-37132006000200006.
• 13. Carpes MF, Mayer AF, Simon KM, Jardim JR, Garrod R. The Brazilian Portuguese version of the London Chest Activity of Daily Living scale for use in patients with chronic obstructive pulmonary disease. J Bras Pneumol. 2008;34:143-51, doi: 10.1590/S1806-37132008000300004.
• 14. Sousa T, Jardim J, Jones P. Validação do Questionário do Hospital Saint George na Doenca Respiratória (SGRQ) em pacientes portadores de doenca pulmonar obstrutiva crônica no Brasil. J Pneumol. 2000;26:119-28.
• 15. Kovelis D, Segretti NO, Probst VS, Lareau SC, Brunetto AF, Pitta F. Validation of the Modified Pulmonary Functional Status and Dyspnea Questionnaire and the Medical Research Council scale for use in Brazilian patients with chronic obstructive pulmonary disease. J Bras Pneumol. 2008;34:1008-18.
• 16. Uehara C, Santoro I, Ferreira R. Cancer de pulmão: diagnóstico e estadiamento. In: Nery L, Fernandes A, Perfeito J, eds. Pneumologia. Barueri: Manole; 2006. p. 495-509.
• 17. Mountain CF. Revisions in the International System for Staging Lung Cancer. Chest. 1997;111:1710-17, doi: 10.1378/chest.111.6.1710.
• 18. Karnofsky DA, Golbey RB, Pool JL. Preliminary studies on the natural history of lung cancer. Radiology. 1957;69:477-88.
• 19. Pereira C. Espirometria. J Pneumol. 2002;28(Suppl. 3):S1-S82.
• 20. Arnold BJ, Eremenco E, Chang C-H, Odom L, Ribaudo JM, Cella D. Development of a single Portuguese language version of the Functional Assessment of Cancer Therapy - General (FACT-G) Scale. Qual Life Res. 2000;9:316.
• 21. Arnold BJ, Eremenco S, Chang CH, CellaD, Riberiro JLP, Doro MP et al. How much is ''very much''? Developing a rating scale for Portuguese speaking countries. Qual Life Res. 2001; 10:264.
• 22. Brucker PS, Yost K, Cashy J, Webster K, Cella D. General population and cancer patient norms for the Functional Assessment of Cancer Therapy-General (FACT-G). Eval Health Prof. 2005;28:192-211, doi: 10.1177/0163278705275341.
• 23. Rodriguez-Roisin R, Anzueto A, Bourbeau J, Calverley P, DeGuia T, Fukuchi Y, et al. GOLD - Global Initiative for Chronic Obstructive Pulmonary Disease - Pocket Guide to COPD Diagnoses, Management and Prevention. A Guide for Healthcare Professionals. Medical Communications Resources, Inc.; 2009.
• 24. Saitoh E, Yokomizo Y, Chang C-H, Eremenco S, Kaneko H, Kobayashi K. Cross-cultural validation of the Japanese version of the lung cancer subscale on the Functional Assessment of Cancer Therapy-Lung. J Nippon Med Sch. 2007;74:402-8, doi: 10.1272/jnms.74.402.
• 25. Yoo H, Suh C, Kim S, Eremenco S, Kim H, Kim S. Korean translation and validation of the Functional Assessment of Cancer Therapy-Lung (FACT-L) version 4. Qual Life Res. 2006;15:161-6, doi: 10.1007/s11136-005-8752-x.
• 26. Cella D, Peterman A, Hudgens S, Webster K, Socinski MA. Measuring the side effects of taxane therapy in oncology: the Functional Assessment of Cancer Therapy-Taxane (FACT-taxane). Cancer. 2003;98:822-31, doi: 10.1002/cncr.11578.
• 27. Dapueto JJ, Francolino C, Servente L, Chang CH, Gotta I, Levin R, et al. Evaluation of the Functional Assessment of Cancer Therapy-General (FACT-G) Spanish version 4 in South America: classic psychometric and item response theory analyses. Health Qual Life Outcomes. 2003;1:32, doi: 10.1186/1477-7525-1-32.
• 28. Eton DT, Cella D, Yount SE, Davis KM. Validation of the Functional Assessment of Cancer Therapy-Lung Symptom Index-12 (FLSI-12). Lung Cancer. 2007;57:339-47, doi: 10.1016/j.lungcan.2007.03.021.
• 29. Hammerschmidt S, Wirtz H. Lung cancer: current diagnosis and treatment. Dtsch Arztebl Int. 2009;106:809-18; quiz 819-20.
• 30. YoungRP,HopkinsRJ,HayBA,EptonMJ,MillsGD,BlackPN,etal. Lung cancer susceptibility model based on age, family history and genetic variants. PLoS One. 2009;4:e5302, doi: 10.1371/journal.pone.0005302.
• 31. Ozturk A, Sarihan S, Ercan I, Karadag M. Evaluating quality of life and pulmonary function of long-term survivors of non-small cell lung cancer treated with radical or postoperative radiotherapy. Am J Clin Oncol. 2009;32:65-72, doi: 10.1097/COC.0b013e31817e6ec2.
• 32. Sarna L, Evangelista L, Tashkin D, Padilla G, Holmes C, Brecht ML, et al. Impact of respiratory symptoms and pulmonary function on quality of life of long-term survivors of non-small cell lung cancer. Chest. 2004;125:439-45, doi: 10.1378/chest.125.2.439.

Publication Dates

• Publication in this collection
  21 Mar 2011
• Date of issue
  2010

History

• Accepted
  07 Sept 2010
• Reviewed
  23 Aug 2010
• Received
  12 Aug 2010