Acessibilidade / Reportar erro

Voice- and swallowing-related symptoms after total thyroidectomy: evidence from a Brazilian national survey

ABSTRACT

Purpose:

to estimate the prevalence of voice- and swallowing-related symptoms in women submitted to total thyroidectomy.

Methods:

a population-based, observational, cross-sectional, analytical study, based on a Brazilian national survey. A total of 252 women, aged 18 to 58 years, submitted to total thyroidectomy, residing in the five geographical regions of the country participated in the study. All of them answered the version of the Thyroidectomy-Related Voice Questionnaire translated and adapted into Brazilian Portuguese, besides questions on demographic and clinical issues. A descriptive analysis of the categorical and quantitative variables was conducted. The relationship between the total TVQ score and the independent variables was analyzed with the Mann-Whitney and Kruskal-Wallis tests. The significance level used was 5%.

Results:

the most prevalent symptoms were, tired voice, after talking for a long time (50%), and dry mouth/thirst (43.3%). The voice-related symptoms were more prevalent than those related to swallowing. The total TVQ score was not related to age group (p=0.141), profession (p=0.213), region of residence (p=0.303), time since surgery (p=0.955), and radiotherapy/radioiodine therapy (p=0.666).

Conclusion:

Brazilian women submitted to total thyroidectomy have a high prevalence of voice- and swallowing-related symptoms, the former being predominant.

Keywords:
Thyroidectomy; Dysphonia; Deglutition Disorders; Surveys and Questionnaires; Signs and Symptoms

RESUMO

Objetivo:

estimar a prevalência de sintomas relacionados à voz e deglutição em mulheres submetidas à tireoidectomia total.

Métodos:

estudo de base populacional, observacional, transversal e analítico, baseado em um survey nacional brasileiro. Participaram do estudo 252 mulheres submetidas à tireoidectomia total, com idades entre 18 e 58 anos, residentes nas cinco regiões geográficas do país. Todas responderam a versão traduzida e adaptada para o português brasileiro do Thyroidectomy-Related Voice Questionnaire (TVQ), além de questões demográficas e clínicas. Foi realizada análise descritiva das variáveis categóricas e quantitativas. A relação entre escore total do TVQ e variáveis independentes foi analisada por meio dos testes de Mann-Whitney e Kruskal-Wallis. O nível de significância foi de 5%.

Resultados:

os sintomas mais prevalentes foram sensação de voz cansada depois de conversar por muito tempo (50%) e percepção de boca seca/sede (43,3%). Sintomas vocais foram mais prevalentes que os relacionados à deglutição. O escore total do TVQ não se relacionou com faixa etária (p=0,141), profissão (p=0,213), região de residência (p=0,303), tempo de cirurgia (p=0,955) e radioterapia/radioiodoterapia (p=0,666).

Conclusão:

mulheres brasileiras submetidas à tireoidectomia total possuem alta prevalência de sintomas relacionados à voz e deglutição, com predomínio dos sintomas vocais seguidos dos sintomas relacionados à deglutição.

Descritores:
Tireoidectomia; Disfonia; Transtornos de Deglutição; Inquéritos e Questionários; Sinais e Sintomas

Introduction

Total thyroidectomy is the most performed endocrine surgery in the world11. Grover G, Sadler GP, Mihai R. Morbidity after thyroid surgery: patient perspective. Laryngoscope. 2013;123(9):2319-23. and the most indicated treatment for thyroid cancer22. Kletzien H, Macdonald CL, Orne J, Francis DO, Leverson G, Wendt E et al. Comparison between patient-perceived voice changes and quantitative voice measures in the first postoperative year after thyroidectomy: a secondary analysis of a randomized clinical trial. JAMA Otolaryngol Head Neck Surg. 2018;144(11):995-1003.. In the United States, the incidence of this type of cancer increased from 7.1/100,000 inhabitants in 2000 to 17.6/100,000 in 201333. Olson E, Wintheiser G, Wolfe KM, Droessler J, Silberstein PT. Epidemiology of thyroid cancer: a review of the National Cancer Database, 2000-2013. Cureus. 2019;11(2): e4127.. In Brazil, the proportion of cases of thyroid cancer informed by the Hospital Cancer Records increased from 1.1% in 2000 to 11.0% in 201444. Borges AKM, Ferreira JD, Koifman S, Koifman RJ. Thyroid cancer in Brazil: a descriptive study of cases held on hospital-based cancer registries, 2000-2016. Epidemiol. Serv. Saúde. 2020;29(4):e2019503.. Also, between 2008 and 2015, the money spent on thyroid cancer diagnosis and treatment in Brazil increased 120%, costing in this period approximately 230 million reais to the Sistema Único de Saúde (the Brazilian Public Healthcare System)55. Janovsky CCPS, Bittencourt MS, Novais MAPD, Maciel R, Biscolla RPM, Zucchi P. Thyroid cancer burden and economic impact on the Brazilian Public Health System. Arch. Endocrinol. Metab. 2018;62(5):537-44.. Considering that the number of people submitted to total thyroidectomy is growing in Brazil, it is necessary to give attention to the morbidity conditions to which they are exposed.

Dysphonia and dysphagia are two of the most common sequelae of thyroidectomy. However, these conditions are diagnosed with instrumental examinations that demand time, money, and availability, which is not always possible due to the high demands of the services66. Nam IC, Bae JS, Shim MR, Hwang YS, Kim MS, Sun D Il. The importance of preoperative laryngeal examination before thyroidectomy and the usefulness of a voice questionnaire in screening. World J Surg. 2012;36(2):303-9.,77. Park JO, Bae JS, Chae BJ, Kim CS, Nam IC, Chun BJ et al. How can we screen voice problems effectively in patients undergoing thyroid surgery? Thyroid. 2013;23(11):1437-44.. Self-reported questionnaires have been used as an alternative to overcome these limitations and screen the patients that need more specific examinations to confirm the diagnosis based on the identification of symptoms related to changes in voice and swallowing66. Nam IC, Bae JS, Shim MR, Hwang YS, Kim MS, Sun D Il. The importance of preoperative laryngeal examination before thyroidectomy and the usefulness of a voice questionnaire in screening. World J Surg. 2012;36(2):303-9.,77. Park JO, Bae JS, Chae BJ, Kim CS, Nam IC, Chun BJ et al. How can we screen voice problems effectively in patients undergoing thyroid surgery? Thyroid. 2013;23(11):1437-44..

The occurrence of voice symptoms after thyroidectomy ranges from 16%88. Sahli Z, Canner JK, Najjar O, Schneider EB, Prescott JD, Russell JO et al. Association between age and patient-reported changes in voice and swallowing after thyroidectomy. Laryngoscope. 2019;129(2):519-24. to 36%99. Banach R, Bartès B, Farnell K, Rimmele H, Shey J, Singer S et al. Results of the Thyroid Cancer Alliance International Patient/Survivor Survey: psychosocial/informational support needs, treatment side effects and international differences in care. Hormones (Athens). 2013;12(3):428-38., while that of swallowing symptoms ranges from 20% to 58%1010. Galluzzi F, Garavello W. Dysphagia following uncomplicated thyroidectomy: a systematic review. Eur Arch Otorhinolaryngol. 2019;276(10):2661-71.. Immediately after surgery, these proportions are even higher and may reach 69.2% and 80.8%, respectively1111. Martins NMDS, Novalo-Goto ES, Diz-Leme ICM, Goulart T, Ranzatti RP, Leite AKN et al. Patient perception of swallowing after thyroidectomy in the absence of laryngeal nerve injury. ORL J Otorhinolaryngol Relat Spec. 2020;82(5):274-84.. The symptoms are possibly caused by laryngeal manipulation1212. Nam IC, Park YH. Pharyngolaryngeal symptoms associated with thyroid disease. Curr Opin Otolaryngol Head Neck Surg. 2017;25(6):469-74., surgery time88. Sahli Z, Canner JK, Najjar O, Schneider EB, Prescott JD, Russell JO et al. Association between age and patient-reported changes in voice and swallowing after thyroidectomy. Laryngoscope. 2019;129(2):519-24.,1313. Nam IC, Cho YJ, Bae JS, Lee SH, Park JO, Shim MR et al. Female sex, central lymph node metastasis and dissection are causes of globus symptom after thyroidectomy. Eur Arch Oto-Rhino-Laryngology. 2016;273(6):1607-13., type of surgical technique used1414. Lee JS, Kim JP, Ryu JS, Woo SH. Effect of wound massage on neck discomfort and voice changes after thyroidectomy. Surg (United States). 2018;164(5):965-71., dissection of the cervical muscles1313. Nam IC, Cho YJ, Bae JS, Lee SH, Park JO, Shim MR et al. Female sex, central lymph node metastasis and dissection are causes of globus symptom after thyroidectomy. Eur Arch Oto-Rhino-Laryngology. 2016;273(6):1607-13.,1515. Iyomasa RM, Tagliarini JV, Rodrigues SA, Tavares ELM, Martins RHG. Laryngeal and vocal alterations after thyroidectomy. Braz J Otorhinolaryngol. 2019;85(1):3-10., orotracheal intubation, hematoma, stretching and fixing the cervical muscles, lesions in the superior and inferior laryngeal nerves1515. Iyomasa RM, Tagliarini JV, Rodrigues SA, Tavares ELM, Martins RHG. Laryngeal and vocal alterations after thyroidectomy. Braz J Otorhinolaryngol. 2019;85(1):3-10., besides the post-thyroidectomy syndrome, which occurs when there are complaints even in the absence of postoperative complications1212. Nam IC, Park YH. Pharyngolaryngeal symptoms associated with thyroid disease. Curr Opin Otolaryngol Head Neck Surg. 2017;25(6):469-74.,1616. Park KN, Mok JO, Chung CH, Lee SW. Does postthyroidectomy syndrome really exist following thyroidectomy? Prospective comparative analysis of open vs. endoscopic thyroidectomy. Clin Exp Otorhinolaryngol. 2015;8(1):76-80..

The most common symptoms are reduced voice pitch, vocal fatigue, hoarseness, weak loudness, globus sensation, dry throat, and phlegm22. Kletzien H, Macdonald CL, Orne J, Francis DO, Leverson G, Wendt E et al. Comparison between patient-perceived voice changes and quantitative voice measures in the first postoperative year after thyroidectomy: a secondary analysis of a randomized clinical trial. JAMA Otolaryngol Head Neck Surg. 2018;144(11):995-1003.,77. Park JO, Bae JS, Chae BJ, Kim CS, Nam IC, Chun BJ et al. How can we screen voice problems effectively in patients undergoing thyroid surgery? Thyroid. 2013;23(11):1437-44.,88. Sahli Z, Canner JK, Najjar O, Schneider EB, Prescott JD, Russell JO et al. Association between age and patient-reported changes in voice and swallowing after thyroidectomy. Laryngoscope. 2019;129(2):519-24.,1010. Galluzzi F, Garavello W. Dysphagia following uncomplicated thyroidectomy: a systematic review. Eur Arch Otorhinolaryngol. 2019;276(10):2661-71.

11. Martins NMDS, Novalo-Goto ES, Diz-Leme ICM, Goulart T, Ranzatti RP, Leite AKN et al. Patient perception of swallowing after thyroidectomy in the absence of laryngeal nerve injury. ORL J Otorhinolaryngol Relat Spec. 2020;82(5):274-84.

12. Nam IC, Park YH. Pharyngolaryngeal symptoms associated with thyroid disease. Curr Opin Otolaryngol Head Neck Surg. 2017;25(6):469-74.
-1313. Nam IC, Cho YJ, Bae JS, Lee SH, Park JO, Shim MR et al. Female sex, central lymph node metastasis and dissection are causes of globus symptom after thyroidectomy. Eur Arch Oto-Rhino-Laryngology. 2016;273(6):1607-13.,1717. Araújo LF, Lopes LW, Silva POC, Perrusi VJF, Farias VL de L, Azevedo EHM. Sensory symptoms in patients undergoing thyroidectomy. CoDAS. 2017;29(3):10-5.

18. Silva IC, Netto IDP, Vartanian JG, Kowalski LP, Angelis ECD. Prevalence of upper aerodigestive symptoms in patients who underwent thyroidectomy with and without the use of intraoperative laryngeal nerve monitoring. Thyroid. 2012;22(8):814-9.

19. Costa BOID, Rodrigues DSB, Magalhães DDD, Santos AS, Santos RV, Azevedo EHM et al. Quantitative Ultrasound Assessment of hyoid bone displacement during swallowing following thyroidectomy. Dysphagia. In Press 2020.

20. Senise AT, Queija DS, Degani C, Corrêa LAC, Dedivitis RA, Lehn CL et al. Sintomas e sinais de alterações da deglutição após a tireoidectomia. Rev bras cir cabeça pescoço. 2009;38(2):67-71.

21. Koga MRV, Soares VMN, Lacerda ABM. Caracterização de pacientes e dos distúrbios de comunicação associados às patologias da tireoide. Tuiuti: Ciência e Cultura. 2013;4(47):91-105.
-2222. Kuhn MA, Bloom G, Myssiorek D. Patient perspectives on dysphonia after thyroidectomy for thyroid cancer. J Voice. 2013;27(1):111-4.. Although these are temporary complications with a progressive improvement2323. Park YM, Oh KH, Cho JG, Baek SK, Kwon SY, Jung KY et al. Changes in voice- and swallowing-related symptoms after thyroidectomy: one-year follow-up study. Ann Otol Rhinol Laryngol. 2018;127(3):171-7., there is evidence of persistence of the symptoms through time2323. Park YM, Oh KH, Cho JG, Baek SK, Kwon SY, Jung KY et al. Changes in voice- and swallowing-related symptoms after thyroidectomy: one-year follow-up study. Ann Otol Rhinol Laryngol. 2018;127(3):171-7.,2424. Pereira JA, Girvent M, Sancho JJ, Parada C, Sitges-Serra A. Prevalence of long-term upper aero-digestive symptoms after uncomplicated bilateral thyroidectomy. Surgery. 2003;133(3):318-22. in up to 50% of the patients22. Kletzien H, Macdonald CL, Orne J, Francis DO, Leverson G, Wendt E et al. Comparison between patient-perceived voice changes and quantitative voice measures in the first postoperative year after thyroidectomy: a secondary analysis of a randomized clinical trial. JAMA Otolaryngol Head Neck Surg. 2018;144(11):995-1003., with a significant impact on their quality of life1010. Galluzzi F, Garavello W. Dysphagia following uncomplicated thyroidectomy: a systematic review. Eur Arch Otorhinolaryngol. 2019;276(10):2661-71.

11. Martins NMDS, Novalo-Goto ES, Diz-Leme ICM, Goulart T, Ranzatti RP, Leite AKN et al. Patient perception of swallowing after thyroidectomy in the absence of laryngeal nerve injury. ORL J Otorhinolaryngol Relat Spec. 2020;82(5):274-84.
-1212. Nam IC, Park YH. Pharyngolaryngeal symptoms associated with thyroid disease. Curr Opin Otolaryngol Head Neck Surg. 2017;25(6):469-74..

In Brazil, the results of previous studies that investigated post-thyroidectomy symptoms related to voice and swallowing do not agree. Also, they were conducted only in hospital services in the Southeast1111. Martins NMDS, Novalo-Goto ES, Diz-Leme ICM, Goulart T, Ranzatti RP, Leite AKN et al. Patient perception of swallowing after thyroidectomy in the absence of laryngeal nerve injury. ORL J Otorhinolaryngol Relat Spec. 2020;82(5):274-84.,1818. Silva IC, Netto IDP, Vartanian JG, Kowalski LP, Angelis ECD. Prevalence of upper aerodigestive symptoms in patients who underwent thyroidectomy with and without the use of intraoperative laryngeal nerve monitoring. Thyroid. 2012;22(8):814-9.,2020. Senise AT, Queija DS, Degani C, Corrêa LAC, Dedivitis RA, Lehn CL et al. Sintomas e sinais de alterações da deglutição após a tireoidectomia. Rev bras cir cabeça pescoço. 2009;38(2):67-71., Northeast1717. Araújo LF, Lopes LW, Silva POC, Perrusi VJF, Farias VL de L, Azevedo EHM. Sensory symptoms in patients undergoing thyroidectomy. CoDAS. 2017;29(3):10-5.,1919. Costa BOID, Rodrigues DSB, Magalhães DDD, Santos AS, Santos RV, Azevedo EHM et al. Quantitative Ultrasound Assessment of hyoid bone displacement during swallowing following thyroidectomy. Dysphagia. In Press 2020., or South Regions2121. Koga MRV, Soares VMN, Lacerda ABM. Caracterização de pacientes e dos distúrbios de comunicação associados às patologias da tireoide. Tuiuti: Ciência e Cultura. 2013;4(47):91-105. of Brazil, with questionnaires whose psychometric properties are unknown1717. Araújo LF, Lopes LW, Silva POC, Perrusi VJF, Farias VL de L, Azevedo EHM. Sensory symptoms in patients undergoing thyroidectomy. CoDAS. 2017;29(3):10-5.

18. Silva IC, Netto IDP, Vartanian JG, Kowalski LP, Angelis ECD. Prevalence of upper aerodigestive symptoms in patients who underwent thyroidectomy with and without the use of intraoperative laryngeal nerve monitoring. Thyroid. 2012;22(8):814-9.

19. Costa BOID, Rodrigues DSB, Magalhães DDD, Santos AS, Santos RV, Azevedo EHM et al. Quantitative Ultrasound Assessment of hyoid bone displacement during swallowing following thyroidectomy. Dysphagia. In Press 2020.

20. Senise AT, Queija DS, Degani C, Corrêa LAC, Dedivitis RA, Lehn CL et al. Sintomas e sinais de alterações da deglutição após a tireoidectomia. Rev bras cir cabeça pescoço. 2009;38(2):67-71.
-2121. Koga MRV, Soares VMN, Lacerda ABM. Caracterização de pacientes e dos distúrbios de comunicação associados às patologias da tireoide. Tuiuti: Ciência e Cultura. 2013;4(47):91-105. or not specific to this population1111. Martins NMDS, Novalo-Goto ES, Diz-Leme ICM, Goulart T, Ranzatti RP, Leite AKN et al. Patient perception of swallowing after thyroidectomy in the absence of laryngeal nerve injury. ORL J Otorhinolaryngol Relat Spec. 2020;82(5):274-84.. The Thyroidectomy-Related Voice Questionnaire (TVQ)66. Nam IC, Bae JS, Shim MR, Hwang YS, Kim MS, Sun D Il. The importance of preoperative laryngeal examination before thyroidectomy and the usefulness of a voice questionnaire in screening. World J Surg. 2012;36(2):303-9.,2525. Hwang YS, Shim MR, Kim GJ, Lee DH, Nam IC, Park JO et al. Development and validation of the Thyroidectomy-Related Voice and Symptom Questionnaire (TVSQ). J Voice. In Press 2020. has been internationally used with this purpose66. Nam IC, Bae JS, Shim MR, Hwang YS, Kim MS, Sun D Il. The importance of preoperative laryngeal examination before thyroidectomy and the usefulness of a voice questionnaire in screening. World J Surg. 2012;36(2):303-9.,77. Park JO, Bae JS, Chae BJ, Kim CS, Nam IC, Chun BJ et al. How can we screen voice problems effectively in patients undergoing thyroid surgery? Thyroid. 2013;23(11):1437-44.,2323. Park YM, Oh KH, Cho JG, Baek SK, Kwon SY, Jung KY et al. Changes in voice- and swallowing-related symptoms after thyroidectomy: one-year follow-up study. Ann Otol Rhinol Laryngol. 2018;127(3):171-7.,2525. Hwang YS, Shim MR, Kim GJ, Lee DH, Nam IC, Park JO et al. Development and validation of the Thyroidectomy-Related Voice and Symptom Questionnaire (TVSQ). J Voice. In Press 2020.

26. Kim SY, Park JO, Bae JS, Lee SH, Hwang YS, Shim MR et al. How can we predict the recovery from pitch lowering after thyroidectomy? World J Surg. In Press 2020.

27. Chun BJ, Bae JS, Chae BJ, Park JO, Nam IC, Kim CS et al. The therapeutic decision making of the unilateral vocal cord palsy after thyroidectomy using Thyroidectomy-related Voice Questionnaire (TVQ). Eur Arch Oto-Rhino-Laryngology. 2015;272(3):727-36.

28. Kim CS, Park JO, Bae JS, Lee SH, Joo YH, Park YH et al. Long-lasting voice-related symptoms in patients without vocal cord palsy after thyroidectomy. World J Surg. 2018;42(7):2109-16.
-2929. Choi YS, Joo YH, Park YH, Kim SY, Sun D Il. Factors predicting the recovery of unilateral vocal fold paralysis after thyroidectomy. World J Surg. 2018;42(7):2117-22. and already has a translated and transculturally adapted version in Brazilian Portuguese3030. Santos DHN, Soares JFR, Ugulino ACDN, Pernambuco L. Translation and cross-cultural adaptation of the Thyroidectomy-Related Voice Questionnaire (TVQ) to Brazilian Portuguese. CoDAS. 2020;32(5):1-7..

Given this context, the prevalence of post-total thyroidectomy voice and swallowing symptoms in Brazil are noticeably unknown. Understanding the most prevalent symptoms with appropriate instruments can lead to a more assertive post-thyroidectomy care and help administer the cases in the short and long run. Hence, this study, based on an unprecedented national survey, aimed to estimate the prevalence of symptoms related to voice and swallowing in Brazilian women submitted to total thyroidectomy. A secondary objective was to analyze the relationship of demographic and clinical variables with the total Brazilian Portuguese TVQ score. The hypotheses were a high prevalence of post-total thyroidectomy voice and swallowing symptoms and a significant difference in the total TVQ scores, due to the demographic and clinical variables.

Methods

This is a population-based, observational, cross-sectional, analytical study with a quantitative approach, based on data from a national survey. It is an integral part of a larger study approved by the Human Research Ethics Committee of the Department of Health Sciences at the Universidade Federal da Paraíba (Federal University of Paraíba - UFPB), Brazil, under evaluation report no. 2.190.242, complying with the ethical aspects of Resolution 466/2012. All the volunteers filled out and signed the informed consent form (ICF).

Participants

The sample size was calculated considering an estimated 45% outcome prevalence1818. Silva IC, Netto IDP, Vartanian JG, Kowalski LP, Angelis ECD. Prevalence of upper aerodigestive symptoms in patients who underwent thyroidectomy with and without the use of intraoperative laryngeal nerve monitoring. Thyroid. 2012;22(8):814-9., 99% confidence interval (z = 2.58), 10% margin of error, and adding 20% due to possible losses. The calculation resulted in a minimum number of 198 individuals. At first, people of both sexes were included, aged 18 years or more, regardless of the interval between the thyroidectomy and the filling out of the form. For the analysis in this study, the following exclusion criteria were defined: (1) being male; (2) being older than 59 years; (3) having a previous head and neck surgery, including partial thyroidectomy. Besides the small proportion of participants with these characteristics in the databank, these criteria were considered confounding factors. Thyroid diseases such as thyroid cancer are more common in females3131. Instituto Nacional do Câncer. Câncer de tireoide [accessed on 2020 Dec 7]. Available at: https://www.inca.gov.br/numeros-de-cancer
https://www.inca.gov.br/numeros-de-cance...
, advanced age is a risk factor known for the post-thyroidectomy complications88. Sahli Z, Canner JK, Najjar O, Schneider EB, Prescott JD, Russell JO et al. Association between age and patient-reported changes in voice and swallowing after thyroidectomy. Laryngoscope. 2019;129(2):519-24., and the partial thyroidectomy, besides being less indicated, causes different functional sequelae from those of total thyroidectomy3232. Ryu J, Ryu YM, Jung YS, Kim SJ, Lee YJ, Lee EK et al. Extent of thyroidectomy affects vocal and throat functions: a prospective observational study of lobectomy versus total thyroidectomy. Surgery. 2013;154(3):611-20.. Based on the eligibility criteria, 104 people were excluded from the initial databank. Thus, 252 Brazilian women, mean age 38.81±7.95 years (amplitude, 20-58), who had been submitted to total thyroidectomy were included.

Data Collection

The data were collected with an online national survey. The form was made available in the free Google Forms service and its link was posted in digital social media at regular intervals throughout 5 weeks to reach residents of all five geographical regions of Brazil who had been submitted to thyroidectomy.

The form had three stages. In the first one, the participant read and filled out the ICF. Then, they answered questions on demographic and clinical aspects. Lastly, they answered the TVQ66. Nam IC, Bae JS, Shim MR, Hwang YS, Kim MS, Sun D Il. The importance of preoperative laryngeal examination before thyroidectomy and the usefulness of a voice questionnaire in screening. World J Surg. 2012;36(2):303-9.,2525. Hwang YS, Shim MR, Kim GJ, Lee DH, Nam IC, Park JO et al. Development and validation of the Thyroidectomy-Related Voice and Symptom Questionnaire (TVSQ). J Voice. In Press 2020. version translated and adapted into Brazilian Portuguese3030. Santos DHN, Soares JFR, Ugulino ACDN, Pernambuco L. Translation and cross-cultural adaptation of the Thyroidectomy-Related Voice Questionnaire (TVQ) to Brazilian Portuguese. CoDAS. 2020;32(5):1-7.. The TVQ comprises 20 questions - 10 related to voice and 10, to swallowing. Each question has five possible answers according to the frequency of the symptom (never, almost never, sometimes, almost always, and always). They are distributed into a Likert-type scale with increasing values from 0 to 4. The total score, which can range from 0 to 80, is achieved by simply summing all the items - the higher the value, the worse the result3030. Santos DHN, Soares JFR, Ugulino ACDN, Pernambuco L. Translation and cross-cultural adaptation of the Thyroidectomy-Related Voice Questionnaire (TVQ) to Brazilian Portuguese. CoDAS. 2020;32(5):1-7.. The TVQ had not had its validation process concluded by the time the data were collected for this study; however, it was considered then the most consistent instrument and the one with the best psychometric properties for research.

Data Analysis

The categorical variables were presented in relative and absolute frequencies. The quantitative variables were analyzed with measures of central tendency and dispersion. The prevalence of each of the 20 items in the TVQ was separately analyzed. For the analysis, the age was dichotomized according to the median. As for the profession, due to the wide range of answers, the following categories were created: “higher-education professions”, “technical-level professions”, “elementary-level professions”, and “undisclosed profession”. The “almost always” and “always” answers in the TVQ indicated the presence of the symptom, while the other ones indicated its absence. The total TVQ score was compared between the categories of age group, profession, region of residence, radiotherapy/adjuvant radioiodine therapy, and time since surgery. The Shapiro-Wilk test indicated that the data did not have a normal distribution (p<0.001); therefore, the Mann-Whitney and Kruskal-Wallis nonparametric tests were used. The significance level was set at 5%.

Results

The demographic and clinical data showed that the sample profile was made predominantly of women living in the Southeast Region of the country with a higher-education profession. Most of them had undergone total thyroidectomy more than 3 years before, and a little more than half of them was submitted to radiotherapy or adjuvant radioiodine therapy (Table 1).

Table 1:
Distribution of Brazilian women submitted to total thyroidectomy, according to the demographic and clinical variables

It is observed in Figure 1 that the prevalence of post-thyroidectomy symptoms related to voice and swallowing ranged from 14.3% (discomfort to eat and drink) to 50% (tired voice after talking for a long time) - this last one was the most prevalent voice-related symptom. Dry mouth/thirst (43.3%) was the most prevalent swallowing-related symptoms. A higher prevalence of voice symptoms was noted, as eight out of the 10 most mentioned ones were voice-related.

Figure 1:
Percentage distribution of the symptoms present in Brazilian women submitted to total thyroidectomy, according to the version of the Thyroidectomy-Related Voice Questionnaire translated and adapted to Brazilian Portuguese (sum of the “always” and “almost always” answers)

The total TVQ score proved to be independent of age group, profession, region of residence, time since surgery, and radiotherapy/adjuvant radioiodine therapy (Table 2).

Table 2:
Measures of the total score of the version of the Thyroidectomy-Related Voice Questionnaire translated and adapted into Brazilian Portuguese between the categories of age group, profession, region of residence, time since surgery, and treatment with radiotherapy or radioiodine therapy

Discussion

This study showed a high prevalence of symptoms related to voice and swallowing in Brazilian women who had been submitted to total thyroidectomy, as well as a total TVQ score independent of age group, profession, region of residence, time since surgery, and radiotherapy/ adjuvant radioiodine therapy.

The demographic and clinical data showed that the sample profile was made predominantly of women living in the Southeast Region of the country and with higher-education professions. Most of them had undergone total thyroidectomy more than 3 years before, and a little more than half of them was submitted to radiotherapy or adjuvant radioiodine therapy.

The decreasing order in the percentage distribution of respondents by geographical regions of residence was similar to the distribution of the number of cases of thyroid cancer observed in a hospital survey between 2000 and 201644. Borges AKM, Ferreira JD, Koifman S, Koifman RJ. Thyroid cancer in Brazil: a descriptive study of cases held on hospital-based cancer registries, 2000-2016. Epidemiol. Serv. Saúde. 2020;29(4):e2019503. and to the distribution of the 57,872 total thyroidectomies performed in Brazil between 2014 and 2018, according to data from the Hospital Information System (SIH/SUS, in Portuguese) of the Brazilian Ministry of Health3333. Brasil, Ministério da Saúde. Banco de dados do Sistema Único de Saúde-DATASUS. [accessed on 2020 Dec 7] DATASUS. tabnet.datasus.gov.br/tabnet/tabnet.htm. Available at: http://www.datasus.gov.br.
http://www.datasus.gov.br...
. Hence, the relative distribution of this study’s sample between the geographical regions of residence reflected the distribution observed in Brazil regarding the number of cases of thyroid cancer and thyroidectomies.

The predominance of women with higher-level professions is related to the higher schooling level and greater self-care awareness, resulting in access to better diagnostic and assistance technologies - which proves to be a selection bias44. Borges AKM, Ferreira JD, Koifman S, Koifman RJ. Thyroid cancer in Brazil: a descriptive study of cases held on hospital-based cancer registries, 2000-2016. Epidemiol. Serv. Saúde. 2020;29(4):e2019503.. The proportion of little more than half of the participants with an interval greater than 3 years between the surgery and filling out the form shows these women’s interest in reporting the symptoms even a long time after the surgery. The proportion of women submitted to radiotherapy/radioiodine therapy was already expected based on international guidelines3434. Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE et al. 2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid. 2016;26(1):1-133..

The most prevalent symptoms were related to voice, a result similar to other studies with people submitted to total thyroidectomy88. Sahli Z, Canner JK, Najjar O, Schneider EB, Prescott JD, Russell JO et al. Association between age and patient-reported changes in voice and swallowing after thyroidectomy. Laryngoscope. 2019;129(2):519-24.,99. Banach R, Bartès B, Farnell K, Rimmele H, Shey J, Singer S et al. Results of the Thyroid Cancer Alliance International Patient/Survivor Survey: psychosocial/informational support needs, treatment side effects and international differences in care. Hormones (Athens). 2013;12(3):428-38.,1717. Araújo LF, Lopes LW, Silva POC, Perrusi VJF, Farias VL de L, Azevedo EHM. Sensory symptoms in patients undergoing thyroidectomy. CoDAS. 2017;29(3):10-5.. Such an occurrence may be related to the topographic nearness of the thyroid gland in relation to the laryngeal structures and peripheral innervations, which are exposed and manipulated during the surgical procedures1515. Iyomasa RM, Tagliarini JV, Rodrigues SA, Tavares ELM, Martins RHG. Laryngeal and vocal alterations after thyroidectomy. Braz J Otorhinolaryngol. 2019;85(1):3-10.. Despite the concern with the possibility of vocal fold palsy due to iatrogenic lesion of the superior and/or inferior laryngeal nerve, most of the cases have complaints even in the absence of peripheral nervous lesions1212. Nam IC, Park YH. Pharyngolaryngeal symptoms associated with thyroid disease. Curr Opin Otolaryngol Head Neck Surg. 2017;25(6):469-74.. Considering that the voice expresses the person’s identity, changes in its habitual standard may interfere with communication, socialization, and the maintenance of occupational activities, especially in the case of those who use their voice professionally. Therefore, it is understandable that voice impairments are among the greatest concerns of the people who will be or have been submitted to thyroidectomy1818. Silva IC, Netto IDP, Vartanian JG, Kowalski LP, Angelis ECD. Prevalence of upper aerodigestive symptoms in patients who underwent thyroidectomy with and without the use of intraoperative laryngeal nerve monitoring. Thyroid. 2012;22(8):814-9..

Of the various voice symptoms investigated with the TVQ, the most prevalent in Brazilian women who had been submitted to total thyroidectomy was vocal fatigue. This perception of a decrease in resistance is manifested in phonatory effort combined with an increase in vocal demand3535. Solomon NP. Vocal fatigue and its relation to vocal hyperfunction. Int J Speech-Language Pathol. 2008;10(4):254-66.. It may also be related to peripheral nervous lesions that have an impact on the activity of the intrinsic musculature of the larynx3636. Chun BJ, Bae JS, Chae BJ, Hwang YS, Shim MR, Sun D Il. Early postoperative vocal function evaluation after thyroidectomy using thyroidectomy related voice questionnaire. World J Surg. 2012;36(10):2503-8.. The observation of the other most prevalent voice symptoms in the population of this study reveals that they converge to the complaint of “tired voice after talking for a long time”. These symptoms encompass the perception of difficulties associated with pitch, loudness, roughness, pneumophonic incoordination, and the vocal effort itself - i.e., conditions that, when present, need to be overcome with hyperfunctional compensations that lead to vocal fatigue3737. Hong KH, Yang YS, Lee HD, Yoon YS, Hong YT. The effect of total thyroidectomy on the speech production. Clin Exp Otorhinolaryngol. 2015;8(2):155-60..

In general, the post-total thyroidectomy swallowing-related symptoms were less perceived than the voice symptoms - although dry mouth/thirst was the second most prevalent symptom. “Dry mouth” had already been frequently mentioned by patients submitted to thyroidectomy in other Brazilian studies1111. Martins NMDS, Novalo-Goto ES, Diz-Leme ICM, Goulart T, Ranzatti RP, Leite AKN et al. Patient perception of swallowing after thyroidectomy in the absence of laryngeal nerve injury. ORL J Otorhinolaryngol Relat Spec. 2020;82(5):274-84.,1818. Silva IC, Netto IDP, Vartanian JG, Kowalski LP, Angelis ECD. Prevalence of upper aerodigestive symptoms in patients who underwent thyroidectomy with and without the use of intraoperative laryngeal nerve monitoring. Thyroid. 2012;22(8):814-9.-1919. Costa BOID, Rodrigues DSB, Magalhães DDD, Santos AS, Santos RV, Azevedo EHM et al. Quantitative Ultrasound Assessment of hyoid bone displacement during swallowing following thyroidectomy. Dysphagia. In Press 2020., even in the preoperative period1717. Araújo LF, Lopes LW, Silva POC, Perrusi VJF, Farias VL de L, Azevedo EHM. Sensory symptoms in patients undergoing thyroidectomy. CoDAS. 2017;29(3):10-5.,3838. Cruz JSDSD, Lopes LW, Alves GADS, Rodrigues DDSB, Souza DXD, Costa BID et al. Combined frequency of patient-reported swallowing and voice complaints before thyroidectomy. Audiol - Commun Res. 2019;24:e2180.. However, no clear explanations are found for such a symptom in these patients. One hypothesis is that the vocal demand1717. Araújo LF, Lopes LW, Silva POC, Perrusi VJF, Farias VL de L, Azevedo EHM. Sensory symptoms in patients undergoing thyroidectomy. CoDAS. 2017;29(3):10-5.,3838. Cruz JSDSD, Lopes LW, Alves GADS, Rodrigues DDSB, Souza DXD, Costa BID et al. Combined frequency of patient-reported swallowing and voice complaints before thyroidectomy. Audiol - Commun Res. 2019;24:e2180. and/or inadequate hydration1717. Araújo LF, Lopes LW, Silva POC, Perrusi VJF, Farias VL de L, Azevedo EHM. Sensory symptoms in patients undergoing thyroidectomy. CoDAS. 2017;29(3):10-5.,3838. Cruz JSDSD, Lopes LW, Alves GADS, Rodrigues DDSB, Souza DXD, Costa BID et al. Combined frequency of patient-reported swallowing and voice complaints before thyroidectomy. Audiol - Commun Res. 2019;24:e2180.,3939. Monasterios FML, Llabrés XR. Etiopatogenia y diagnóstico de la boca seca. Av Odontoestomatol. 2014;30(3):121-8. is related to this symptom, as well as the hormonal deregulation characteristic of thyroid diseases4040. Syed YA, Reddy BS, Ramamurthy TK, Rajendra K, Nerella NK, Krishnan M et al. Estimation of salivary parameters among autoimmune thyroiditis patients. J Clin Diagn Res. 2017;11(7):ZC01-ZC04.. Radiotherapy/radioiodine therapy is a possible explanation for this symptom, although the parallel analysis of the data to verify this hypothesis did not confirm it.

This study also showed that age, profession, region of residence, postoperative time, and radiotherapy/adjuvant radioiodine therapy are not aspects that interfere with the total TVQ score, whose median in all the categories was higher than 20 points. This result indicates, then, that the investigation of post-thyroidectomy voice and swallowing symptoms in Brazilian women must not be restricted to specific groups and must be independent of these variables.

Despite Brazil’s continental size, great cultural diversity, and different realities of access to health services, this did not prove to be an aspect related to the result of the TVQ. It stood out that, even after three years since the surgery, their total TVQ score remained with a median similar to that of the group with a shorter postoperative period. This result ratifies the evidence of continuing symptoms even in the long run, as well as the need for better strategies to detect these morbidity conditions and more resolutive therapeutic assistance. Thus, it is highlighted the importance of incorporating the investigation of the symptoms related to voice and swallowing in the routine of the assistance health team in all the regions of Brazil. The TVQ is the most promising option of an instrument for this purpose, and its translated and adapted version in Brazilian Portuguese must be used as soon as its validity and reliability evidence is obtained.

This study has some limitations. The cross-sectional design does not allow for direct cause and effect relationships; the characteristics related to the surgical procedure could not be collected, neither could the clinical aspects such as medications used and results of the biochemical and histopathological examinations, as there was no access to the participants’ medical records; confounding variables (e.g., undergoing speech therapy after the surgery and having comorbidities such as laryngeal changes and gastroesophageal reflux) were not controlled and may have interfered with the results; the instrument used had only been translated and adapted into Brazilian Portuguese at the time of collection and is still in the validation process. At the same time, this study is the first one in Brazil to evidence the prevalence of post-total thyroidectomy voice and swallowing symptoms in a national survey with a population-based sample, with results from an internationally used instrument.

Conclusion

Symptoms related to voice and swallowing have a high prevalence in Brazilian women who had been submitted to total thyroidectomy. The two most prevalent symptoms are vocal fatigue and dry mouth/thirst. There is a predominance of voice symptoms followed by swallowing symptoms. There is no relationship between the total TVQ score in Brazilian Portuguese and the age group, profession, region of residence, time since surgery, and radiotherapy/adjuvant radioiodine therapy.

REFERENCES

  • 1
    Grover G, Sadler GP, Mihai R. Morbidity after thyroid surgery: patient perspective. Laryngoscope. 2013;123(9):2319-23.
  • 2
    Kletzien H, Macdonald CL, Orne J, Francis DO, Leverson G, Wendt E et al. Comparison between patient-perceived voice changes and quantitative voice measures in the first postoperative year after thyroidectomy: a secondary analysis of a randomized clinical trial. JAMA Otolaryngol Head Neck Surg. 2018;144(11):995-1003.
  • 3
    Olson E, Wintheiser G, Wolfe KM, Droessler J, Silberstein PT. Epidemiology of thyroid cancer: a review of the National Cancer Database, 2000-2013. Cureus. 2019;11(2): e4127.
  • 4
    Borges AKM, Ferreira JD, Koifman S, Koifman RJ. Thyroid cancer in Brazil: a descriptive study of cases held on hospital-based cancer registries, 2000-2016. Epidemiol. Serv. Saúde. 2020;29(4):e2019503.
  • 5
    Janovsky CCPS, Bittencourt MS, Novais MAPD, Maciel R, Biscolla RPM, Zucchi P. Thyroid cancer burden and economic impact on the Brazilian Public Health System. Arch. Endocrinol. Metab. 2018;62(5):537-44.
  • 6
    Nam IC, Bae JS, Shim MR, Hwang YS, Kim MS, Sun D Il. The importance of preoperative laryngeal examination before thyroidectomy and the usefulness of a voice questionnaire in screening. World J Surg. 2012;36(2):303-9.
  • 7
    Park JO, Bae JS, Chae BJ, Kim CS, Nam IC, Chun BJ et al. How can we screen voice problems effectively in patients undergoing thyroid surgery? Thyroid. 2013;23(11):1437-44.
  • 8
    Sahli Z, Canner JK, Najjar O, Schneider EB, Prescott JD, Russell JO et al. Association between age and patient-reported changes in voice and swallowing after thyroidectomy. Laryngoscope. 2019;129(2):519-24.
  • 9
    Banach R, Bartès B, Farnell K, Rimmele H, Shey J, Singer S et al. Results of the Thyroid Cancer Alliance International Patient/Survivor Survey: psychosocial/informational support needs, treatment side effects and international differences in care. Hormones (Athens). 2013;12(3):428-38.
  • 10
    Galluzzi F, Garavello W. Dysphagia following uncomplicated thyroidectomy: a systematic review. Eur Arch Otorhinolaryngol. 2019;276(10):2661-71.
  • 11
    Martins NMDS, Novalo-Goto ES, Diz-Leme ICM, Goulart T, Ranzatti RP, Leite AKN et al. Patient perception of swallowing after thyroidectomy in the absence of laryngeal nerve injury. ORL J Otorhinolaryngol Relat Spec. 2020;82(5):274-84.
  • 12
    Nam IC, Park YH. Pharyngolaryngeal symptoms associated with thyroid disease. Curr Opin Otolaryngol Head Neck Surg. 2017;25(6):469-74.
  • 13
    Nam IC, Cho YJ, Bae JS, Lee SH, Park JO, Shim MR et al. Female sex, central lymph node metastasis and dissection are causes of globus symptom after thyroidectomy. Eur Arch Oto-Rhino-Laryngology. 2016;273(6):1607-13.
  • 14
    Lee JS, Kim JP, Ryu JS, Woo SH. Effect of wound massage on neck discomfort and voice changes after thyroidectomy. Surg (United States). 2018;164(5):965-71.
  • 15
    Iyomasa RM, Tagliarini JV, Rodrigues SA, Tavares ELM, Martins RHG. Laryngeal and vocal alterations after thyroidectomy. Braz J Otorhinolaryngol. 2019;85(1):3-10.
  • 16
    Park KN, Mok JO, Chung CH, Lee SW. Does postthyroidectomy syndrome really exist following thyroidectomy? Prospective comparative analysis of open vs. endoscopic thyroidectomy. Clin Exp Otorhinolaryngol. 2015;8(1):76-80.
  • 17
    Araújo LF, Lopes LW, Silva POC, Perrusi VJF, Farias VL de L, Azevedo EHM. Sensory symptoms in patients undergoing thyroidectomy. CoDAS. 2017;29(3):10-5.
  • 18
    Silva IC, Netto IDP, Vartanian JG, Kowalski LP, Angelis ECD. Prevalence of upper aerodigestive symptoms in patients who underwent thyroidectomy with and without the use of intraoperative laryngeal nerve monitoring. Thyroid. 2012;22(8):814-9.
  • 19
    Costa BOID, Rodrigues DSB, Magalhães DDD, Santos AS, Santos RV, Azevedo EHM et al. Quantitative Ultrasound Assessment of hyoid bone displacement during swallowing following thyroidectomy. Dysphagia. In Press 2020.
  • 20
    Senise AT, Queija DS, Degani C, Corrêa LAC, Dedivitis RA, Lehn CL et al. Sintomas e sinais de alterações da deglutição após a tireoidectomia. Rev bras cir cabeça pescoço. 2009;38(2):67-71.
  • 21
    Koga MRV, Soares VMN, Lacerda ABM. Caracterização de pacientes e dos distúrbios de comunicação associados às patologias da tireoide. Tuiuti: Ciência e Cultura. 2013;4(47):91-105.
  • 22
    Kuhn MA, Bloom G, Myssiorek D. Patient perspectives on dysphonia after thyroidectomy for thyroid cancer. J Voice. 2013;27(1):111-4.
  • 23
    Park YM, Oh KH, Cho JG, Baek SK, Kwon SY, Jung KY et al. Changes in voice- and swallowing-related symptoms after thyroidectomy: one-year follow-up study. Ann Otol Rhinol Laryngol. 2018;127(3):171-7.
  • 24
    Pereira JA, Girvent M, Sancho JJ, Parada C, Sitges-Serra A. Prevalence of long-term upper aero-digestive symptoms after uncomplicated bilateral thyroidectomy. Surgery. 2003;133(3):318-22.
  • 25
    Hwang YS, Shim MR, Kim GJ, Lee DH, Nam IC, Park JO et al. Development and validation of the Thyroidectomy-Related Voice and Symptom Questionnaire (TVSQ). J Voice. In Press 2020.
  • 26
    Kim SY, Park JO, Bae JS, Lee SH, Hwang YS, Shim MR et al. How can we predict the recovery from pitch lowering after thyroidectomy? World J Surg. In Press 2020.
  • 27
    Chun BJ, Bae JS, Chae BJ, Park JO, Nam IC, Kim CS et al. The therapeutic decision making of the unilateral vocal cord palsy after thyroidectomy using Thyroidectomy-related Voice Questionnaire (TVQ). Eur Arch Oto-Rhino-Laryngology. 2015;272(3):727-36.
  • 28
    Kim CS, Park JO, Bae JS, Lee SH, Joo YH, Park YH et al. Long-lasting voice-related symptoms in patients without vocal cord palsy after thyroidectomy. World J Surg. 2018;42(7):2109-16.
  • 29
    Choi YS, Joo YH, Park YH, Kim SY, Sun D Il. Factors predicting the recovery of unilateral vocal fold paralysis after thyroidectomy. World J Surg. 2018;42(7):2117-22.
  • 30
    Santos DHN, Soares JFR, Ugulino ACDN, Pernambuco L. Translation and cross-cultural adaptation of the Thyroidectomy-Related Voice Questionnaire (TVQ) to Brazilian Portuguese. CoDAS. 2020;32(5):1-7.
  • 31
    Instituto Nacional do Câncer. Câncer de tireoide [accessed on 2020 Dec 7]. Available at: https://www.inca.gov.br/numeros-de-cancer
    » https://www.inca.gov.br/numeros-de-cancer
  • 32
    Ryu J, Ryu YM, Jung YS, Kim SJ, Lee YJ, Lee EK et al. Extent of thyroidectomy affects vocal and throat functions: a prospective observational study of lobectomy versus total thyroidectomy. Surgery. 2013;154(3):611-20.
  • 33
    Brasil, Ministério da Saúde. Banco de dados do Sistema Único de Saúde-DATASUS. [accessed on 2020 Dec 7] DATASUS. tabnet.datasus.gov.br/tabnet/tabnet.htm. Available at: http://www.datasus.gov.br
    » http://www.datasus.gov.br
  • 34
    Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE et al. 2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid. 2016;26(1):1-133.
  • 35
    Solomon NP. Vocal fatigue and its relation to vocal hyperfunction. Int J Speech-Language Pathol. 2008;10(4):254-66.
  • 36
    Chun BJ, Bae JS, Chae BJ, Hwang YS, Shim MR, Sun D Il. Early postoperative vocal function evaluation after thyroidectomy using thyroidectomy related voice questionnaire. World J Surg. 2012;36(10):2503-8.
  • 37
    Hong KH, Yang YS, Lee HD, Yoon YS, Hong YT. The effect of total thyroidectomy on the speech production. Clin Exp Otorhinolaryngol. 2015;8(2):155-60.
  • 38
    Cruz JSDSD, Lopes LW, Alves GADS, Rodrigues DDSB, Souza DXD, Costa BID et al. Combined frequency of patient-reported swallowing and voice complaints before thyroidectomy. Audiol - Commun Res. 2019;24:e2180.
  • 39
    Monasterios FML, Llabrés XR. Etiopatogenia y diagnóstico de la boca seca. Av Odontoestomatol. 2014;30(3):121-8.
  • 40
    Syed YA, Reddy BS, Ramamurthy TK, Rajendra K, Nerella NK, Krishnan M et al. Estimation of salivary parameters among autoimmune thyroiditis patients. J Clin Diagn Res. 2017;11(7):ZC01-ZC04.
  • Research conducted in the Postgraduation Program Modelos de Decisão e Saúde - PPGMDS da Universidade Federal da Paraíba - UFPB, João Pessoa, Paraíba, Brasil.

Publication Dates

  • Publication in this collection
    10 Mar 2021
  • Date of issue
    2021

History

  • Received
    08 Dec 2020
  • Accepted
    15 Jan 2021
ABRAMO Associação Brasileira de Motricidade Orofacial Rua Uruguaiana, 516, Cep 13026-001 Campinas SP Brasil, Tel.: +55 19 3254-0342 - São Paulo - SP - Brazil
E-mail: revistacefac@cefac.br