Acessibilidade / Reportar erro

Translation and cultural adaptation of the Shame and Stigma Scale (SSS) into Portuguese (Brazil) to evaluate patients with head and neck cancer Please cite this article as: Pirola WE, Paiva BS, Barroso EM, Kissane DW, Serrano CV, Paiva CE. Translation and cultural adaptation of the Shame and Stigma Scale (SSS) into Portuguese (Brazil) to evaluate patients with head and neck cancer. Braz J Otorhinolaryngol. 2017;83:697-704.

Abstract

Introduction:

Head and neck cancer is the sixth leading cause of death from cancer worldwide and its treatment may involve surgery, chemotherapy and/or radiation therapy. The surgical procedure may cause mutilating sequelae, that can alter patient self-image. Thus, head and neck cancer is often connected to the negative stigma with decreased quality of life. Few studies assess the social stigma and shame perceived by patients with head and neck cancer.

Objective:

To perform the translation and cultural adaptation of the Shame and Stigma Scale (SSS) into Portuguese (Brazil).

Methods:

Two independent translations (English into Portuguese) were carried out by two professionals fluent in the English language. After the synthesis of the translations, two independent back-translations (from Portuguese into English) were performed by two translators whose native language is English. All translations were critically assessed by a committee of experts consisting of five members. A sample of 15 patients answered the Brazilian Portuguese version of the SSS to carry out the pretest. At this step, the patients were able to suggest modifications and evaluate the understanding of the items.

Results:

There was no need to change the scale after this step. Based on the previous steps, we obtained the Portuguese (Brazil) version of the SSS, which was called "Escala de Vergonha e Estigma".

Conclusion:

The Portuguese (Brazil) version of the SSP was shown to be adequate to be applied to the population with HNC and, therefore, the psychometric properties of the tool will be evaluated during following steps.

Keywords:
Quality of life; Shame; Social stigma; Head and neck cancer

Resumo

Introdução:

O câncer de cabeça e pescoço corresponde à sexta causa de morte por câncer no mundo; seu tratamento pode envolver cirurgia, quimio e/ou radioterapia, a cirurgia pode acarretar sequelas mutiladoras, pode alterar a autoimagem do paciente. Assim, o câncer de cabeça e pescoço é muitas vezes ligado ao estigma negativo, com diminuição da qualidade de vida. Poucos instrumentos avaliam o estigma social e a vergonha percebidos por pacientes com câncer de cabeça e pescoço.

Objetivo:

Traduzir e adaptar culturalmente a Shame and Stigma Scale (SSS) para o português/Brasil.

Método:

Fizeram-se duas traduções independentes (do inglês para o português) por dois profissionais fluentes na língua inglesa. Após a síntese das traduções, duas retrotraduções independentes (do português para o inglês) foram feitas por dois tradutores cuja língua materna é o inglês. Todas as traduções foram analisadas criticamente por um comitê de especialistas composto por cinco membros. Uma amostra de 15 pacientes respondeu à versão em português/Brasil da SSS para o pré-teste. Nessa etapa, os pacientes puderam sugerir modificações e avaliar o entendimento dos itens.

Resultados:

Não houve necessidade de alteração da escala após essa fase. A partir das etapas anteriores, obteve-se a versão em português/Brasil da SSS, denominada de Escala de Vergonha e Estigma.

Conclusão:

A versão em português/Brasil da SSS se mostrou apta para ser aplicada na população com câncer de cabeça e pescoço; portanto, as propriedades psicométricas do instrumento serão avaliadas na etapa seguinte.

Palavras-chave:
Qualidade de vida; Vergonha; Estigma social; Neoplasias de cabeça e pescoço

Introduction

Head and Neck Cancer (HNC) corresponds to neoplasms in the anatomical-topographic region of the upper aerodigestive tract; among them, approximately 90% are squamous cell carcinoma (SCC).11 Casati MFM, Vasconcelos JA, Vergnhanini JA. Epidemiologia do câncer de cabeça e pescoço no Brasil: estudo transversal de base populacional. Rev Bras Cir Cabeça Pescoço. 2012;41:186-91. Of the 580,000 new cancer cases estimated in Brazil in 2016, more than 15,000 cases are located in the oral cavity, whereas more than 7000 new cases are located in the larynx. Thus, considering these two locations together, HNC occupies the second and ninth places in terms of incidence among men and women, respectively.22 INCA. Estimativa 2016: incidência de câncer no Brasil/Instituto Nacional de Câncer José Alencar da Silva, Coordenação Geral de Ações estratégicas, Coordenação de Prevenção e Vigilância Rio de Janeiro 2012 [accessed in 08.02.16.]. Available in: http://www.inca.gov.br/estimativa/2016/estimativa-2016-v11.pdf.
http://www.inca.gov.br/estimativa/2016/e...

The main risk factors associated with HNC are smoking and alcohol intake. Among other factors, the Human Papillomavirus (HPV) is directly related to oropharyngeal tumors,33 Rettig EM, D'Souza G. Epidemiology of head and neck cancer. Surg Oncol Clin N Am. 2015;24:379-96. while the Epstein-Barr virus is associated with nasopharyngeal neoplasms.44 Pezzuto F, Buonaguro L, Caponigro F, Ionna F, Starita N, Annunziata C, et al. Update on head and neck cancer: current knowledge on epidemiology, risk factors, molecular features and novel therapies. Oncology. 2015;89:125-36. The incidence rate of these neoplasms has declined in countries where smoking also decreased.44 Pezzuto F, Buonaguro L, Caponigro F, Ionna F, Starita N, Annunziata C, et al. Update on head and neck cancer: current knowledge on epidemiology, risk factors, molecular features and novel therapies. Oncology. 2015;89:125-36. However, 5-30% of patients diagnosed with HNC never smoked.55 Hashibe M, Brennan P, Benhamou S, Castellsague X, Chen C, Curado MP, et al. Alcohol drinking in never users of tobacco, cigarette smoking in never drinkers, and the risk of head and neck cancer: pooled analysis in the International Head and Neck Cancer Epidemiology Consortium. J Natl Cancer Inst. 2007;99:777-89.

HNC is an aggressive, debilitating condition, associated with pain and weight loss. The treatment can be carried out by surgical and/or radiation therapy, systemic treatment with chemotherapy and/or new chemotherapeutic drugs. To define the type of treatment, it is mandatory to assess the tumor biological characteristics and perform a correct clinical staging. Moreover, it is important to assess the patient's clinical condition and critically discuss with patients the complications that treatment may entail. Whenever possible, the patient should actively participate in shared decisions on the decision-making of their treatment.66 Rathod S, Livergant J, Klein J, Witterick I, Ringash J. A systematic review of quality of life in head and neck cancer treated with surgery with or without adjuvant treatment. Oral Oncol. 2015;51:888-900.

The adverse events caused by chemotherapy and radiotherapy, in addition to the potential mutilations resulting from surgery, may negatively impact the quality of life reported by patients.77 Zhang SM, Wu XF, Li JJ, Zhang GH. Management of lymph node metastases from an unknown primary site to the head and neck (review). Mol Clin Oncol. 2014;2:917-22.

The surgical procedures can cause alterations in patient body image, whether due to changes in the skin or the resulting scars.88 Moss TP. The relationships between objective and subjective ratings of disfigurement severity, and psychological adjustment. Body Image. 2005;2:151-9. However, when patients require some type of surgical intervention on the face, the self-image impact changes significantly, as the face is the main body part that makes eye contact with people. Physical changes cause patients to define their body image through new experiences, changing their feelings and attitudes. Individuals who suffered facial mutilations have traumatic experiences that may cause a negative impact on quality of life and decrease self-esteem.88 Moss TP. The relationships between objective and subjective ratings of disfigurement severity, and psychological adjustment. Body Image. 2005;2:151-9.

Studies have shown a significant decrease in the quality of life of cancer patients after treatment, especially regarding socialization with others outside their usual contacts, or within their own families. Such social interactions can be affected by several factors, such as depression, shame due to voice alterations, or shame due to one's physical appearance.99 Babin E, Sigston E, Hitier M, Dehesdin D, Marie JP, Choussy O. Quality of life in head and neck cancers patients: predictive factors, functional and psychosocial outcome. European archives of otorhinolaryngology. Eur Arch Otorhinolaryngol. 2008;265:265-70.,1010 Nalbadian M, Nikolaou A, Nikolaidis V, Petridis D, Themelis C, Daniilidis I. Factors influencing quality of life in laryngectomized patients. European archives of oto-rhino-laryngology. Eur Arch Otorhinolaryngol. 2001;258:336-40.

HNC and its treatment sequelae are mainly associated with the negative stigmata related to deterioration, death and suffering. Thus, both patients and their families go through a readaptation process, mainly regarding body image.1111 Fingeret MC, Teo I, Goettsch K. Body image: a critical psychosocial issue for patients with head and neck cancer. Curr Oncol Rep. 2015;17:22. The stigma feeling can be defined as a sense of shame, the result of a large negative impact on physical appearance, such as mutilation caused by surgical procedures. Patients with these symptoms may experience depression and social isolation.1212 Kissane DW, Patel SG, Baser RE, Bell R, Farberov M, Ostroff JS, et al. Preliminary evaluation of the reliability and validity of the shame and stigma scale in head and neck cancer. Head Neck. 2013;35:172-83.

Therefore, it becomes necessary to objectively identify how interventions related to treatment and the disease itself may interfere with the life of patients with HNC. Through a literature review, we found a tool that objectively evaluates the sense of shame and stigma reported by the patient. The Shame and Stigma Scale (SSS) consists of 20 items, divided into four domains. Eight items are related to shame and appearance, three are related to social isolation, six to the feeling of stigma and three items to regret. Responses are graded on a Likert scale ranging from 0 to 4, where 0 corresponds to "never"; 1 to "seldom"; 2 to "sometimes"; 3 to "often" and 4 to "all the time". The SSS has been originally developed in English and demonstrated adequate psychometric properties in the original study.1212 Kissane DW, Patel SG, Baser RE, Bell R, Farberov M, Ostroff JS, et al. Preliminary evaluation of the reliability and validity of the shame and stigma scale in head and neck cancer. Head Neck. 2013;35:172-83.

The aim of this study was to perform the translation and cultural adaptation of the SSS scale into the Portuguese language spoken in Brazil.

Methods

Study design

This study is part of a larger project, of which the objective is to validate the SSS to be applied in Brazil. In this article, we will describe in detail the translation and adaptation steps, whereas the evaluation of the psychometric properties is still undergoing. This study is considered a methodological study, aimed to validate a health care assessment tool.

Ethical aspects

This study was approved by the Research Ethics Committee of the hospital where the study was carried out (Opinion N. 914/2015). All participants were invited to participate in the study and signed the free and informed consent form. Patients with functional and/or esthetic sequelae from the treatment of head and neck tumors, aged 18 years and older, who were aware of the cancer diagnosis were invited to participate in the study. Patients with neuropsychiatric disorders that hindered the interpretation of the scales used in the study, according to the investigator's assessment, were excluded.

Patients were recruited by convenience from the Dentistry Department of an Oncological Hospital. All interviews were carried out by a single interviewer in a private room, where only the patient and the interviewer were present, to maintain the confidentiality of responses and decrease the patient's inhibition when answering the questionnaire. The interviewer did not participate in the patients' treatment, being responsible only for data collection. Fifteen patients were invited to participate in the study and there were no refusals.

Translation and cultural adaptation process

The SSS was submitted to the translation and cultural adaptation process according to Beaton et al.1313 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila PA 1976). 2000;25:3186-91. The translation process takes into account the performance of five phases, which comprise translation, synthesis of translations, back-translation, committee of experts and pretest.

  • - Translation: performed by at least two translators, whose native language is the one into which the tool will be translated, and who are fluent in the original language of the tool.

  • - Synthesis of translations: carried out in partnership with the translators and researchers responsible for the study. The aim of this step is to finalize a new version of the tool in the language proposed for the study.

  • - Back translation: reverse translation by translators fluent in the language into which the tool is being translated and in the language of the original tool. For this step, the translators should not have prior knowledge of the original tool, so that the translation process is not induced. In this study, the back-translated versions were compared to the original tool through collaboration with one of the authors who originally developed the scale.

  • - Committee of experts: it analyzes all versions according to semantic-idiomatic, conceptual and cultural parameters of the language, and further consolidates a pre-final version to be applied on a smaller sample of patients. It has the autonomy to modify, maintain or delete items that are ambiguous or irrelevant. In this study, the committee members used scores for all versions of the scale, with scores ranging from 1 (not representative item) to 4 (representative item). For all items of the scale and their respective answers, three categories were assessed: semantic/idiomatic, conceptual and cultural.1414 Fayers PM, Machin D. Introduction. In: Fayers PM, Machin D, editors. Quality of life: the assessment, analysis and interpretation of patient-reported outcomes. England: John Wiley & Sons Ltd.; 2007. p. 3-30. Based on these assessments, we calculated the Content Validity Index (CVI) considering the answers with scores 3 and 4. Thus, the CVI of each item corresponds to the sum of the number of responses 3 and 4, divided by the total number of responses. For the evaluated item to be considered appropriate, a minimum value of 0.80 was accepted.1515 Alexandre NMC, Coluci MZO. Content validity in the development and adaptation processes of measurement instruments. Ciênc Saude Col. 2011;16:3061-8.

  • - Pretest: at this phase, patients were invited to participate and answered the pre-final version of the tool. All of them were asked about possible suggestions that could improve the scale understanding. Additionally, the researcher responsible for applying the pre-test objectively assessed, according to his opinion, whether the patients appropriately understand the items and answers. Patients were also asked if any of the items seemed embarrassing to them.

Fig. 1 shows all phases of the translation and cultural adaptation process.

Figure 1
Flowchart of the translation and cultural adaptation process.

Results

Translation and cultural adaptation process

Two bilingual translators (Portuguese-English), natives of Brazil, were invited to translate the SSS version for the translation process from the English language into Portuguese (Brazil); the new versions of the scale were called V1 and V2. None of the translators had prior knowledge of the scale. Both versions in Portuguese were analyzed by a group consisting of three authors of this study, which aimed to synthesize the translated versions into a new version (V12).

Subsequently, the result of the first version of the scale in Portuguese (Brazil) was submitted to back-translation into English by two native English speakers, an American and an Australian translator; both were fluent in Portuguese (these versions were called B1 and B2).

In this study, the Committee of Experts consisted of five members: (1) Clinical Oncologist, with a Post-doctoral degree in Oncology, with more than 10 years of clinical experience in oncology, with prior experience in the validation of assessment tools; (2) Nurse, with a Post-doctoral degree in Oncology, with more 15 years of clinical experience, with prior experience in the validation of assessment tools; (3) Dental Surgeon, with a Ph.D. in Oncology, with more than 10 years of clinical experience in oncology and prior experience in the validation of assessment tools; (4) Dental Surgeon, Specialist in Oncology, with 5 years of clinical experience; (5), a professional translator, with a degree in Portuguese Language and Literature, with prior experience in the validation of assessment tools.

Regarding the CVI, all items showed adequate results (CVI ≥ 0.8). Of all the assessed items, six language parameters in four of the scale items, had a score of 0.80; the remainder were equal to 1.0. Table 1 shows the four items that obtained CVI = 0.80.

Table 1
Items of the scale that had CVI scores = 0.80.

One of the study authors, who originally developed the scale, evaluated the back-translated versions and considered the process appropriate. Moreover, he was available to help throughout the entire translation process.

Pretest

For the pretest, 15 patients diagnosed with HNC after appearance-altering surgical treatment and who were treated at the Dentistry Department of an oncological hospital for creation and/or maintenance of a maxillofacial prosthesis and palate obturator prosthesis were included. No patient refused to participate in the study.

The mean age of patients was 63.2 years (SD = 15.37); 8 (53.3%) were males; 12 (80.1%) patients had low family income and 9 (60%) had not finished elementary school, i.e., had low level of schooling.

Patients were given the option to either self-administer the tool or to have it applied by the interviewer. Only 1 (6.7%) chose to self-administer it. In all other interviews, the SSS was applied by the interviewer.

All patients answered a questionnaire with questions related to the understanding of each SSS item and their respective answers. Table 2 shows the results about the scale understanding and the changes suggested by the patients interviewed in the pretest. The only suggestion for change (replacing the word "cancer" by "treatment") (Table 2) was sent to the committee of experts who decided there was no need to make the change, keeping the items in the original form.

Table 2
Results of the SSS understanding by patients interviewed during the pre-test phase.

From the translation process to the pre-test, the SSS remained similar to the original scale. Table 3 shows the translated and culturally adapted version of scale in the Portuguese language (Brazil).

Table 3
Shame and Stigma Scale (SSS) in Portuguese (Brazil), final version - 20 items. Find below a list of statements. Please circle one (1) number per line which best indicates how well this statement applied to you during the past 7 days.

Discussion

The present study carried out the translation and cultural adaptation into Portuguese (Brazil) of the SSS. Throughout all the study phases, we used a consolidated systematic methodology and internationally accepted norm for the effectiveness of the process of translation and cultural adaptation of health assessment tools. This step is one of the most important in the validation process and must be very carefully performed so that future studies to evaluate the psychometric properties can confirm the scale validity.1313 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila PA 1976). 2000;25:3186-91.,1616 Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46:1417-32.

Ideally, we seek to validate existing tools, so that the development of a new one is not necessary. The validation of an existing tool helps to use the same data pattern in different populations, when carrying out further studies and international comparisons. This process also saves time and money, when compared to the complex process of developing new tools.1414 Fayers PM, Machin D. Introduction. In: Fayers PM, Machin D, editors. Quality of life: the assessment, analysis and interpretation of patient-reported outcomes. England: John Wiley & Sons Ltd.; 2007. p. 3-30.

After the translations are performed, it is important that the tool be sent to the committee of experts, so the first phase of cultural adaptation can be carried out, before it is submitted to the pretest. This step, which has been sometimes neglected, assists in the way the patient understands and answers the tool questions.1313 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila PA 1976). 2000;25:3186-91.,1616 Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46:1417-32.

As expected, the Brazilian population still has problems regarding education. Therefore, considering that the hospital where the study was performed is a reference center in public oncological care in Brazil, we identified a sample in the pretest with low level of education. In a study performed in São Paulo, from 2000 to 2006, more than 40% of patients with HNC were illiterate or had not finished Elementary School.1717 Bergamasco VDB, Marta GN, Kowalski LP, Carvalho AL. Epidemiological profile of the head and neck cancer in the State of São Paulo. Rev Bras Cir Cabeça Pescoço. 2008;37:159. For this reason, it is important for assessment scales to be concise and well-understood by responders.

The SSS has 20 items comprising short statements, which can be self-applied or applied by the interviewer. All patients were asked about their preferences for the scale response method (applied by the interviewer or self-applied). Although the original scale was developed to be self-applied, only one patient chose to do it so, whereas all the other 14 chose to have the scale applied by the interviewer. Although this may be considered a study limitation, the authors believe that the inclusion only of patients able to appropriately answer the scale when it was self-applied would not represent the population being studied (which often has low level of schooling). Interestingly, a previous Brazilian study found that 77% of patients prefer that health assessment tools be applied by an interviewer.1818 Franceschini J, Jardim JR, Fernandes AL, Jamnik S, Santoro IL. Reproducibility of the Brazilian Portuguese version of the European Organization for Research and treatment of Cancer Core Quality of Life Questionnaire used in conjunction with its lung cancers pecific module. J Bras Pneumol. 2010;36:595-602.

This study was prompted by the scarcity of tools to assess body self-image of patients with HNC, and especially tools already validated for the Portuguese language. Tools such as the Quality of life - Head and Neck Cancer Module EORTC H&N35, FACT-HN and University of Washington UWQOL are available for use in the Portuguese language, but none of them include specific items related to shame and/or stigma.

Conclusion

The Portuguese version of the SSS was considered adequate and culturally adapted for use in Brazil. Therefore, the tool can be applied to the assessment of its psychometric properties in the future.

  • Peer Review under the responsibility of Associação Brasileira de Otorrinolaringologia e Cirurgia Cérvico-Facial.
  • Please cite this article as: Pirola WE, Paiva BS, Barroso EM, Kissane DW, Serrano CV, Paiva CE. Translation and cultural adaptation of the Shame and Stigma Scale (SSS) into Portuguese (Brazil) to evaluate patients with head and neck cancer. Braz J Otorhinolaryngol. 2017;83:697-704.

References

  • 1
    Casati MFM, Vasconcelos JA, Vergnhanini JA. Epidemiologia do câncer de cabeça e pescoço no Brasil: estudo transversal de base populacional. Rev Bras Cir Cabeça Pescoço. 2012;41:186-91.
  • 2
    INCA. Estimativa 2016: incidência de câncer no Brasil/Instituto Nacional de Câncer José Alencar da Silva, Coordenação Geral de Ações estratégicas, Coordenação de Prevenção e Vigilância Rio de Janeiro 2012 [accessed in 08.02.16.]. Available in: http://www.inca.gov.br/estimativa/2016/estimativa-2016-v11.pdf
    » http://www.inca.gov.br/estimativa/2016/estimativa-2016-v11.pdf
  • 3
    Rettig EM, D'Souza G. Epidemiology of head and neck cancer. Surg Oncol Clin N Am. 2015;24:379-96.
  • 4
    Pezzuto F, Buonaguro L, Caponigro F, Ionna F, Starita N, Annunziata C, et al. Update on head and neck cancer: current knowledge on epidemiology, risk factors, molecular features and novel therapies. Oncology. 2015;89:125-36.
  • 5
    Hashibe M, Brennan P, Benhamou S, Castellsague X, Chen C, Curado MP, et al. Alcohol drinking in never users of tobacco, cigarette smoking in never drinkers, and the risk of head and neck cancer: pooled analysis in the International Head and Neck Cancer Epidemiology Consortium. J Natl Cancer Inst. 2007;99:777-89.
  • 6
    Rathod S, Livergant J, Klein J, Witterick I, Ringash J. A systematic review of quality of life in head and neck cancer treated with surgery with or without adjuvant treatment. Oral Oncol. 2015;51:888-900.
  • 7
    Zhang SM, Wu XF, Li JJ, Zhang GH. Management of lymph node metastases from an unknown primary site to the head and neck (review). Mol Clin Oncol. 2014;2:917-22.
  • 8
    Moss TP. The relationships between objective and subjective ratings of disfigurement severity, and psychological adjustment. Body Image. 2005;2:151-9.
  • 9
    Babin E, Sigston E, Hitier M, Dehesdin D, Marie JP, Choussy O. Quality of life in head and neck cancers patients: predictive factors, functional and psychosocial outcome. European archives of otorhinolaryngology. Eur Arch Otorhinolaryngol. 2008;265:265-70.
  • 10
    Nalbadian M, Nikolaou A, Nikolaidis V, Petridis D, Themelis C, Daniilidis I. Factors influencing quality of life in laryngectomized patients. European archives of oto-rhino-laryngology. Eur Arch Otorhinolaryngol. 2001;258:336-40.
  • 11
    Fingeret MC, Teo I, Goettsch K. Body image: a critical psychosocial issue for patients with head and neck cancer. Curr Oncol Rep. 2015;17:22.
  • 12
    Kissane DW, Patel SG, Baser RE, Bell R, Farberov M, Ostroff JS, et al. Preliminary evaluation of the reliability and validity of the shame and stigma scale in head and neck cancer. Head Neck. 2013;35:172-83.
  • 13
    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila PA 1976). 2000;25:3186-91.
  • 14
    Fayers PM, Machin D. Introduction. In: Fayers PM, Machin D, editors. Quality of life: the assessment, analysis and interpretation of patient-reported outcomes. England: John Wiley & Sons Ltd.; 2007. p. 3-30.
  • 15
    Alexandre NMC, Coluci MZO. Content validity in the development and adaptation processes of measurement instruments. Ciênc Saude Col. 2011;16:3061-8.
  • 16
    Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46:1417-32.
  • 17
    Bergamasco VDB, Marta GN, Kowalski LP, Carvalho AL. Epidemiological profile of the head and neck cancer in the State of São Paulo. Rev Bras Cir Cabeça Pescoço. 2008;37:159.
  • 18
    Franceschini J, Jardim JR, Fernandes AL, Jamnik S, Santoro IL. Reproducibility of the Brazilian Portuguese version of the European Organization for Research and treatment of Cancer Core Quality of Life Questionnaire used in conjunction with its lung cancers pecific module. J Bras Pneumol. 2010;36:595-602.

Publication Dates

  • Publication in this collection
    Nov-Dec 2017

History

  • Received
    30 June 2016
  • Accepted
    14 Oct 2016
Associação Brasileira de Otorrinolaringologia e Cirurgia Cérvico-Facial. Sede da Associação Brasileira de Otorrinolaringologia e Cirurgia Cérvico Facial, Av. Indianópolia, 1287, 04063-002 São Paulo/SP Brasil, Tel.: (0xx11) 5053-7500, Fax: (0xx11) 5053-7512 - São Paulo - SP - Brazil
E-mail: revista@aborlccf.org.br