Acessibilidade / Reportar erro

Validity Evidence of an Epidemiological Oropharyngeal Dysphagia Screening Questionnaire for Older Adults

Abstract

OBJECTIVE:

This research aimed to identify evidence of validity of a self-reported Oropharyngeal Dysphagia screening questionnaire for older adults based on test content, response processes, internal structure, relations to other variables, and reliability.

METHOD:

This is a nonrandomized, cross-sectional study employing the concepts and principles of the Standards for Educational and Psychological Testing. Data were collected from 644 community-dwelling older adults (both genders, age: ≥60 years) who agreed to participate in some steps of the validation process. Statistical methods obtained the content representation of the construct, internal structure validation, discriminant and convergent evidence, and reliability, using a 5% significance level.

RESULTS:

The screening tool was re-specified in nine questions that provided the best fit and robust reliability, with proper discriminant and convergent evidence.

CONCLUSIONS:

The screening questionnaire presented valid and reliable results to identify oropharyngeal dysphagia symptoms in older adults, highlighting the importance of the validation process based on the standards to construct an epidemiological instrument.

Deglutition Disorders; Aging; Mass Screening; Epidemiology; Validation Studies


INTRODUCTION

Oropharyngeal dysphagia (OD) is a swallowing disorder that may indicate disorder in oral, pharyngeal, or oropharyngeal functioning during the swallowing process. It is associated with noticeable symptoms reported by the individual on ingesting food (11. Cook IJ, Kahrilas PJ. AGA technical review on management of oropharyngeal dysphagia. Gastroenterology. 1999;116(2):455-78. https://doi.org/10.1016/S0016-5085(99)70144-7.
https://doi.org/10.1016/S0016-5085(99)70...
), which presents issues surrounding weight loss, malnutrition, dehydration, and episodes of aspiration pneumonias. These issues are of great concern in the healthcare of older adults. OD has an impact on public health as it can increase the morbidity and mortality of older adults (22. Ortega O, Martín A, Clavé P. Diagnosis and Management of Oropharyngeal Dysphagia Among Older Persons, State of the Art. J Am Med Dir Assoc. 2017;18(7):576-82. https://doi.org/10.1016/j.jamda.2017.02.015.
https://doi.org/10.1016/j.jamda.2017.02....
).

This clinical condition can increase functional disability and frailty, hospital readmissions, mortality, and the institutionalization of older adults. OD has been recognized as a critical geriatric syndrome by two European Societies (22. Ortega O, Martín A, Clavé P. Diagnosis and Management of Oropharyngeal Dysphagia Among Older Persons, State of the Art. J Am Med Dir Assoc. 2017;18(7):576-82. https://doi.org/10.1016/j.jamda.2017.02.015.
https://doi.org/10.1016/j.jamda.2017.02....
,33. Baijens LW, Clavé P, Cras P, Ekberg O, Forster A, Kolb GF, et al. European Society for Swallowing Disorders - European Union Geriatric Medicine Society white paper: oropharyngeal dysphagia as a geriatric syndrome. Clin Interv Aging. 2016;11:1403-28. https://doi.org/10.2147/CIA.S107750.
https://doi.org/10.2147/CIA.S107750...
).

The prevalence of OD in older people who live in the community varies between 11% and 38% (44. Roy N, Stemple J, Merrill RM, Thomas L. Dysphagia in the elderly: preliminary evidence of prevalence, risk factors, and socioemotional effects. Ann Otol Rhinol Laryngol. 2007;116(11):858-65. https://doi.org/10.1177/000348940711601112.
https://doi.org/10.1177/0003489407116011...

5. Turley R, Cohen S. Impact of voice and swallowing problems in the elderly. Otolaryngol Head Neck Surg. 2009;140(1):33-6. https://doi.org/10.1016/j.otohns.2008.10.010.
https://doi.org/10.1016/j.otohns.2008.10...

6. Holland G, Jayasekeran V, Pendleton N, Horan M, Jones M, Hamdy S. Prevalence and symptom profiling of oropharyngeal dysphagia in a community dwelling of an elderly population: a self-reporting questionnaire survey. Dis Esophagus. 2011;24(7):476-80. https://doi.org/10.1111/j.1442-2050.2011.01182.x.
https://doi.org/10.1111/j.1442-2050.2011...

7. Kawashima K, Motohashi Y, Fujishima I. Prevalence of dysphagia among community-dwelling elderly individuals as estimated using a questionnaire for dysphagia screening. Dysphagia. 2004;19(4):266-71. https://doi.org/10.1007/s00455-004-0013-6.
https://doi.org/10.1007/s00455-004-0013-...
-88. Serra-Prat M, Hinojosa G, López D, Juan M, Fabré E, Voss DS, et al. Prevalence of oropharyngeal dysphagia and impaired safety and efficacy of swallow in independently living older persons. J Am Geriatr Soc. 2011;59(1):186-7. https://doi.org/10.1111/j.1532-5415.2010.03227.x.
https://doi.org/10.1111/j.1532-5415.2010...
). However, the studies that have reported prevalence did not use screening instruments for epidemiological diagnosis with validity evidence for the older adult population (99. Magalhães Junior HV, Pernambuco LA, Lima KC, Ferreira MAF. Screening for oropharyngeal dysphagia in older adults: A systematic review of self-reported questionnaires. Gerodontology. 2018;35:162-9. https://doi.org/10.1111/ger.12333.
https://doi.org/10.1111/ger.12333...
).

For a screening instrument to become both epidemiologically relevant and scientifically robust, it must be developed and psychometrically tested for its validity. It should measure what it intends to achieve and must be reliable in producing consistent and reproducible data (1010. Pernambuco Lde A, Espelt A, Magalhães Júnior HV, Cavalcanti RV, de Lima KC. Screening for Voice Disorders in Older Adults (Rastreamento de Alterações Vocais em Idosos - RAVI) - Part I: Validity Evidence Based on Test Content and Response Processes. J Voice. 2016;30(2):246.e9-17. https://doi.org/10.1016/j.jvoice.2015.04.008.
https://doi.org/10.1016/j.jvoice.2015.04...
).

Hence, this study aimed to identify the evidence of validity in constructing an epidemiological self-reported Oropharyngeal Dysphagia screening questionnaire for older adults.

MATERIAL AND METHODS

This nonrandomized and cross-sectional study evaluated the evidence of validity according to the test content, response processes, internal structure, relations to other variables and reliability (1111. American Educational Research Association (AERA). American Psychological Association (APA). National Council on Measurement in Education. Standards for Educational and Psychological Testing. New York, NY: American Educational Research Association. 2014.).

Data were collected from March 2013 to April 2017. The adjusted versions for each stage of this validation process were used. Participants of either gender aged 60-95 years with preserved cognitive functioning were included in the study. The mean age varied depending on when the data was collected.

This tool aimed to be an epidemiological screening instrument for OD in older adults with no specific diseases. This process excluded participants who were previously diagnosed with comprehensive, psychiatric, neurological, and neurodegenerative disorders or head and neck cancer, who were tracheostomized, who had moderate-to-severe hearing loss (with no hearing aids), or who used feeding tubes.

The study participants were recruited by convenience from social centers for older adults, one long-term care institution for older adults, and the waiting room of a Geriatric and Otorhinolaryngology Outpatient in the University Hospital, Natal, Rio Grande do Norte, Brazil.

Evidence of validity based on test content

An expert technical group (ETG) composed of five researchers (who are the authors of this study) created the initial version of the questionnaire through a free association of ideas based on the most common signs and symptoms of swallowing disorders.

The theoretical basis of this study defined OD as a swallowing disorder resulting from a broad spectrum of disturbances in the interaction between the oral and pharyngeal phases. This disorder can lead to complications in pulmonary and nutritional status (1212. Crary MA, Groher ME. Reinstituting oral feeding in tube-fed adult patients with dysphagia. Nutr Clin Pract. 2006;21(6):576-86. https://doi.org/10.1177/0115426506021006576.
https://doi.org/10.1177/0115426506021006...
).

The ETG considered the following qualitative aspects: the educational level of the elderly; how long it took for respondents to answer the questions; the presence of ambiguous words, vague terms, or (medical) jargon; and items with two or more questions.

The initial version of the questionnaire consisted of 17 items focusing on sensations and perceptions related to swallowing disorders of the oral and/or pharyngeal phases. This was judged by a multidisciplinary expert committee (EC) who evaluated the adequacy of the questions. The EC consisted of 22 speech pathologists (3 gerontologists, and 19 dysphagia specialists), five geriatricians, two dietitians, one nurse, one otorhinolaryngologist, and one gastroenterologist.

The analysis used the Content Validity Index by Item (CVI-I) and the Content Validity Index (CVI) to verify the level of agreement of the EC evaluations, estimated as ≥0.80 and ≥0.90, respectively. The conceptual framework refinement in a single round of consultations was considered (1010. Pernambuco Lde A, Espelt A, Magalhães Júnior HV, Cavalcanti RV, de Lima KC. Screening for Voice Disorders in Older Adults (Rastreamento de Alterações Vocais em Idosos - RAVI) - Part I: Validity Evidence Based on Test Content and Response Processes. J Voice. 2016;30(2):246.e9-17. https://doi.org/10.1016/j.jvoice.2015.04.008.
https://doi.org/10.1016/j.jvoice.2015.04...
). The ETG also considered the suggestions of the EC to modify or insert some questions (1313. Sireci S, Faulkner-Bond M. Validity evidence based on test content. Psicothema. 2014;26(1):100-7.,1414. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459-67. https://doi.org/10.1002/nur.20199.
https://doi.org/10.1002/nur.20199...
).

Evidence of validity based on response processes

After the analysis by the EC, a second version with 16 items was applied to 40 older adults from different social strata (Table 1), according to criteria from a previous study (1010. Pernambuco Lde A, Espelt A, Magalhães Júnior HV, Cavalcanti RV, de Lima KC. Screening for Voice Disorders in Older Adults (Rastreamento de Alterações Vocais em Idosos - RAVI) - Part I: Validity Evidence Based on Test Content and Response Processes. J Voice. 2016;30(2):246.e9-17. https://doi.org/10.1016/j.jvoice.2015.04.008.
https://doi.org/10.1016/j.jvoice.2015.04...
).

Table 1
Distribution Criteria of four social groups that were used to evaluate the tool based on the evidence of validity, according to response processes.

The participants were asked about the clarity of each item, followed by a request to repeat how they had understood it in a loud voice. Indirect strategies were used to observe their response time and non-verbal reactions to identify problematic sentences that had issues surrounding their meaning or interpretation (1515. Padilla JL, Benítez I. Validity evidence based on response processes. Psicothema. 2014;26(1):136-44.).

Evidence Based on Internal Structure

This version of the epidemiological screening questionnaire, with 14 questions, was applied to 211 older adults, of whom 63 (29.9%) were male and 148 (70.1%) were female (mean age=71.2; SD=7.8).

This evidence was obtained by confirmatory factorial analysis by structural equation modeling (CFA-SEM). The grouping of the questions was organized into two factors, based on highlights from the literature about what each item could mean as an outcome of deglutition disorders (Table 2). This resulted in a hypothetical model (1616. Henseler J, Ringle CM, Sarstedt M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. J Acad Mark Sci. 2015;43(1):115-35. https://doi.org/10.1007/s11747-014-0403-8.
https://doi.org/10.1007/s11747-014-0403-...
17. Chojin Y, Kato T, Rikihisa M, Omori M, Noguchi S, Akata K, et al. Evaluation of the Mann Assessment of Swallowing Ability in Elderly Patients with Pneumonia. Aging Dis. 2017;8(4):420-33. https://doi.org/10.14336/AD.2017.0102.
https://doi.org/10.14336/AD.2017.0102...
18. Govender R, Lee MT, Davies TC, Twinn CE, Katsoulis KL, Payten CL, et al. Development and preliminary validation of a patient-reported outcome measure for swallowing after total laryngectomy (SOAL questionnaire). Clin Otolaryngol. 2012;37(6):452-9. https://doi.org/10.1111/coa.12036.
https://doi.org/10.1111/coa.12036...
19. Dwivedi RC, St Rose S, Chisholm EJ, Georgalas C, Bisase B, Amen F, et al. Evaluation of swallowing by Sydney Swallow Questionnaire (SSQ) in oral and oropharyngeal cancer patients treated with primary surgery. Dysphagia. 2012;27(4):491-7. https://doi.org/10.1007/s00455-012-9395-z.
https://doi.org/10.1007/s00455-012-9395-...
20. Logemann JA, Veis S, Colangelo L. A screening procedure for oropharyngeal dysphagia. Dysphagia. 1999;14(1):44-51. https://doi.org/10.1007/PL00009583.
https://doi.org/10.1007/PL00009583...
).

Table 2
Categorization of items according to outcomes of deglutition disorders based on the literature.

Thus, a unidimensional measurement model was defined (Figure 1) with 14 observable variables, grouped into the following two factors (latent variables): non-efficiency swallowing (f1) and unsafe swallowing (f2).

Figure 1
The hypothetical, theoretical framework screening model. This unidimensional measurement model was defined with 14 observable variables: x1: Oral regurgitation; x2: Multiple swallows; x3: Swallowing with effort; x4: Longer time to eat; x5: Limit food intake; x6: liquids with meals; x7: Nasal regurgitation; x8: Throat clearing; x9: Wet voice; x10: Choking; x11: Recurrent pneumonia; x12: Weight lost; x13: Painful swallowing; and x14: Fatigability. These variables are grouped into two factors (latent variables): f1: non-efficiency swallowing; f2: unsafe swallowing.

The CFA-SEM was performed using MPlus 8.0 version software, applying the Robust Weighted Least Squares (WLSMV). This performs well with small samples (n≥200) and ordinal categorical variables (2323. Li CH. Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behav Res Methods. 2016;48(3):936-49. https://doi.org/10.3758/s13428-015-0619-7.
https://doi.org/10.3758/s13428-015-0619-...
).

Verification of the polychoric correlation matrix was initially performed. The fit indexes to evaluate the initial model included lowest and non-significant chi-square (χ2), normed chi-square (χ2/df) ≤2, Root Mean Squared Error of Approximation (RMSEA) ≤0.06, Weighted Root Mean Square Residual (WRMR) ≤1.0 (2424. Cogo-Moreira H, Jackowski AP, de Araújo TR, Vieira LH, Haidar MA, Silva I. Poor-fit indexes of Kupperman index: a psychometric analysis based on item response theory. Menopause. 2015;22(4):444-7. https://doi.org/10.1097/GME.0000000000000338.
https://doi.org/10.1097/GME.000000000000...
), Comparative Fit Index (CFI) ≥0.95, and Tucker-Lewis Index (TLI) ≥0.96 (2525. Abad FJ, Olea J, Ponsoda V, García C. Medición en Ciencias Sociales y de la Salud. Sintesis. Madrid, Spain: Sintesis; 2011.).

The quality of each factor of the model was also analyzed to evaluate the possibility to eliminate any of the variables, considering: an average variance extracted (AVE) ≥0.60, a mean of the standard factorial loads (Ẍλ) ≥0.70, and composite reliability coefficients (CR) ≥0.91 for a 10-variables-model (or close to 0.90 if the adjusted model becomes less than 10 variables) (2626. Valentini F, Damásio BF. Variância Média Extraída e Confiabilidade Composta: Indicadores de Precisão. Psic Teor Pesq. 2016;32(2):e322225.).

Evidence Based on Relations to Other Variables and Reliability

This stage considered convergent and discriminant validity. A well-fitting model with nine items was applied to 393 older people (mean age=70.4; SD=7.9), with 175 (44.5%) males, and 218 (55.5%) females.

When considering convergent validity, the Associated Factors Questionnaire was used with dichotomized responses ("yes1 or no0"). This questionnaire addressed the presence of comorbidities, discomfort symptoms, negative lifestyle, and inferior self-perception of functionality. This was measured by the sum of the total scores of the worst outcomes.

The questionnaire scores ranged from 0 to 11 and were scored according to: self-reported clinical history of stroke (44. Roy N, Stemple J, Merrill RM, Thomas L. Dysphagia in the elderly: preliminary evidence of prevalence, risk factors, and socioemotional effects. Ann Otol Rhinol Laryngol. 2007;116(11):858-65. https://doi.org/10.1177/000348940711601112.
https://doi.org/10.1177/0003489407116011...
,2727. Yang EJ, Kim MH, Lim JY, Paik NJ. Oropharyngeal Dysphagia in a community-based elderly cohort: the Korean longitudinal study on health and aging. J Korean Med Sci. 2013;28(10):1534-9. https://doi.org/10.3346/jkms.2013.28.10.1534.
https://doi.org/10.3346/jkms.2013.28.10....
), heart disease (44. Roy N, Stemple J, Merrill RM, Thomas L. Dysphagia in the elderly: preliminary evidence of prevalence, risk factors, and socioemotional effects. Ann Otol Rhinol Laryngol. 2007;116(11):858-65. https://doi.org/10.1177/000348940711601112.
https://doi.org/10.1177/0003489407116011...
), thyroid problems (44. Roy N, Stemple J, Merrill RM, Thomas L. Dysphagia in the elderly: preliminary evidence of prevalence, risk factors, and socioemotional effects. Ann Otol Rhinol Laryngol. 2007;116(11):858-65. https://doi.org/10.1177/000348940711601112.
https://doi.org/10.1177/0003489407116011...
), diabetes (2727. Yang EJ, Kim MH, Lim JY, Paik NJ. Oropharyngeal Dysphagia in a community-based elderly cohort: the Korean longitudinal study on health and aging. J Korean Med Sci. 2013;28(10):1534-9. https://doi.org/10.3346/jkms.2013.28.10.1534.
https://doi.org/10.3346/jkms.2013.28.10....
), depression (44. Roy N, Stemple J, Merrill RM, Thomas L. Dysphagia in the elderly: preliminary evidence of prevalence, risk factors, and socioemotional effects. Ann Otol Rhinol Laryngol. 2007;116(11):858-65. https://doi.org/10.1177/000348940711601112.
https://doi.org/10.1177/0003489407116011...
,66. Holland G, Jayasekeran V, Pendleton N, Horan M, Jones M, Hamdy S. Prevalence and symptom profiling of oropharyngeal dysphagia in a community dwelling of an elderly population: a self-reporting questionnaire survey. Dis Esophagus. 2011;24(7):476-80. https://doi.org/10.1111/j.1442-2050.2011.01182.x.
https://doi.org/10.1111/j.1442-2050.2011...
,2727. Yang EJ, Kim MH, Lim JY, Paik NJ. Oropharyngeal Dysphagia in a community-based elderly cohort: the Korean longitudinal study on health and aging. J Korean Med Sci. 2013;28(10):1534-9. https://doi.org/10.3346/jkms.2013.28.10.1534.
https://doi.org/10.3346/jkms.2013.28.10....
); voice problems, neck and throat tension, shoulder tension; self-reported inactivity (44. Roy N, Stemple J, Merrill RM, Thomas L. Dysphagia in the elderly: preliminary evidence of prevalence, risk factors, and socioemotional effects. Ann Otol Rhinol Laryngol. 2007;116(11):858-65. https://doi.org/10.1177/000348940711601112.
https://doi.org/10.1177/0003489407116011...
), lack of exercise (44. Roy N, Stemple J, Merrill RM, Thomas L. Dysphagia in the elderly: preliminary evidence of prevalence, risk factors, and socioemotional effects. Ann Otol Rhinol Laryngol. 2007;116(11):858-65. https://doi.org/10.1177/000348940711601112.
https://doi.org/10.1177/0003489407116011...
), and eating alone (2828. Ekberg O, Hamdy S, Woisard V, Wuttge-Hannig A, Ortega P. Social and psychological burden of dysphagia: its impact on diagnosis and treatment. Dysphagia. 2002;17(2):139-46. https://doi.org/10.1007/s00455-001-0113-5.
https://doi.org/10.1007/s00455-001-0113-...
).

Convergent validity was verified based on the assumed hypothesis that older people with more referred associated factors had worse screening results, as analyzed by the Spearman’s coefficient of correlation (ρ).

Discriminant validity was assessed by the validated and adjusted Rosenberg Self-esteem Scale (RSES) for Brazilian older adults (2929. Meurer ST, Luft CB, Benedetti TR, Mazo GZ. Validade de Construto e Consistência Interna da Escala de Autoestima de Rosenberg para uma População de Idosos Brasileiros Praticantes de Atividades Físicas. Motricidade. 2012;8(4):5-15. https://doi.org/10.6063/motricidade.8(4).1548.
https://doi.org/10.6063/motricidade.8(4)...
). This was used with part of the sample (n=110; mean age=71.8; SD=8.2), including 30 (27.3%) males and 80 (72.7%) females. The objective was to prove that there was a weak or non-correlation through the Spearman’s coefficient.

The reliability of the test-retest reproducibility was assessed using part of the sample (n=75; mean age=70.5; SD=7.1), in which 28 (37.3%) were males, and 47 (62.7%) were females. They came back to a second interview within a period of 5 to 14 days (2525. Abad FJ, Olea J, Ponsoda V, García C. Medición en Ciencias Sociales y de la Salud. Sintesis. Madrid, Spain: Sintesis; 2011.).

The statistical reliability analysis used the intraclass correlation coefficient (ICC) of the instrument (scored from 0 to 18) (3030. Gisev N, Bell JS, Chen TF. Interrater agreement and interrater reliability: key concepts, approaches, and applications. Res Social Adm Pharm. 2013;9(3):330-8. https://doi.org/10.1016/j.sapharm.2012.04.004.
https://doi.org/10.1016/j.sapharm.2012.0...
), the Standard Error of Measurement (SEM) and the Smallest Real Difference (SRD) (3131. Özgül ÖS, Maier C, Enax-Krumova EK, Vollert J, Fischer M, Tegenthoff M, et al. High test-retest-reliability of pain-related evoked potentials (PREP) in healthy subjects. Neurosci Lett. 2017;647:110-6. https://doi.org/10.1016/j.neulet.2017.03.037.
https://doi.org/10.1016/j.neulet.2017.03...
). The internal consistency was tested using Cronbach’s alpha ≥0.70 (2525. Abad FJ, Olea J, Ponsoda V, García C. Medición en Ciencias Sociales y de la Salud. Sintesis. Madrid, Spain: Sintesis; 2011.).

Ethics

The present study complies with all recommended ethical guidelines for research involving human subjects and was approved by the Institution’s Ethics and Research Committee (approval number: 1,144,297).

RESULTS

Evidence of validity based on content

The CVI was 0.72, below the considerable minimum value to affirm that the instrument has good conceptual representation, pertinence, clarity, and comprehensiveness of the questions. This allowed the verification of the CVI-I of each question (Table 3) followed by descriptions of the adjustments made.

Table 3
Validity evidence based on the test content.

The ETG eliminated four questions from the first version (2, 10, 12, and 15) for presenting low CVI-I (first column of Table 3), without providing suggestions for modifications that may improve clarity. The EC suggested restructuring other questions for being considered theoretically relevant.

Despite presenting a good CVI-I, the experts eliminated the fourth question (first column of Table 3) due to focusing on chewing. According to the authors’ understanding, chewing is a subject that involves other domains beyond screening for OD and is the study of another screening instrument (3232. Cavalcanti RVA, Magalhães Junior HV, Pernambuco LA, Lima KC. Screening for masticatory disorders in older adults (SMDOA): An epidemiological tool. J Prosthodont Res. 2019. pii: S1883-1958(19)30122-7.).

Evidence of validity based on response processes

Observing the new order of the 16 items (fourth column of Table 3), the ETG deleted two questions. The ninth question was deleted because more than 70% of the older adults misunderstood if the question was asking about poor consumption of liquid or their weak preference to drink water. The 16th question was deleted for generating confusion with the 15th question.

The questions from the second version (fourth and fifth column of Table 3) that generated the most doubt or confusion or created delay in responding among all groups were 01, 02, 05, 08, 10, 12 and 13. Due to the considerations and reflections regarding the clarity and construction of the questions, the authors decided to modify and reorder the questions based on a sequence of symptoms to facilitate their interpretation with small adjustments in the syntactic construction (Table 2).

When completing the questionnaire, the ETG decided to establish three response options: “No0,” “sometimes1,” and “always2.” However, the question related to weight loss required only two options: “No0” and “Yes1.” This resulted in the third 14-question-version screening tool.

Evidence of validity based on the internal structure

The 14-question-model with two factors had no proper adjustment for factor 1 (AVE=0.45, CR=0.86; Ẍλf1=0.58), which reflected small loads of some items, resulting in the elimination of variables x1, x4, x5, x6, and x7.

After the adjustments, a new structural model reached the well-fit model when compared to the first model (Table 4), as shown in Figure 2.

Table 4
Comparison of CFA-SEM between the hypothetical model and the well-fit model.

Figure 2
The second-order model of measurement of the constructs according to CFA. The fit model was adjusted with 9 observable variables: x2: Multiple swallows; x3: Swallowing with effort; x8: Throat clearing; x9: Wet voice; x10: Choking; x11: Recurrent pneumonia; x12: Weight lost; x13: Painful swallowing; and x14: Fatigability. These variables are confirmed into two factors (latent variables): f1: non-efficiency swallowing; f2: unsafe swallowing. Correlation between factors f1 and f2 was classified as strong (Φ=0.87; SE=0.04).

There were better index precision measures in this adjusted model with less than 10 variables (AVEf1=0.62; CRf1=0.86; Ẍλf1=0.85; AVEf2=0.65, CRf2=0.90; Ẍλf2=0.80; p<0.001), indicating good construct reliability and adequate convergent validity.

The 9-item version of the instrument showed robust results for each item as observed from test-retest reliability (ICC=0.83, CI 0.74-0.89, p<0.001, SEM=1.17, SRD=3.25) and high internal consistency (α=0.90).

Evidence Based on Relations to Other Variables

The convergent validity had a positive and moderate correlation (ρ=0.43; p<0.001) but the discriminant evidence did not demonstrate correlation (ρ=-0.06; p=0.6).

DISCUSSION

The results presented in this study are the first to investigate the evidence of validity for the OD screening questionnaire. The investigation was based on the recommended guidelines by the standards that suggest robust premises to be followed from a psychometric perspective (1111. American Educational Research Association (AERA). American Psychological Association (APA). National Council on Measurement in Education. Standards for Educational and Psychological Testing. New York, NY: American Educational Research Association. 2014.).

This self-reported OD screening questionnaire is designed for older adults living in the community with asymptomatic or initial symptoms. The questionnaire was intended to identify the initial diagnosis of this clinical condition, requiring an immediate diagnostic confirmation, leading to a therapeutic decision (3333. Magalhães Junior HV, Pernambuco LA. Screening for oropharyngeal dysphagia. CoDAS. 2015;27(2):111-2.).

Acquiring evidence of validity, based on content, was an essential step towards obtaining accurate results. The process included the quantitative and qualitative evaluation of each question, along with suggestions from the participants for modifications and further inclusion of relevant items to develop an epidemiological screening tool that could be applied in the older adult population.

The results analysis allowed for the adjustment of semantic, syntactic, and contextual aspects of the initial versions of the instrument. This was essential for the clarification and representativeness of the instrument’s relevance to screen for OD.

The quantitative and qualitative evaluations from the ETG, the data from the EC, as well as information from the sample in the response processes favored the modification of the questions. The changes resulted from integrating the given suggestions with empirical observations discussed according to the construct definition (1313. Sireci S, Faulkner-Bond M. Validity evidence based on test content. Psicothema. 2014;26(1):100-7.).

Regarding the evidence of validity related to the response processes, not one screening instrument for OD in this population described this step; therefore, comparisons of the results to other studies was not possible (99. Magalhães Junior HV, Pernambuco LA, Lima KC, Ferreira MAF. Screening for oropharyngeal dysphagia in older adults: A systematic review of self-reported questionnaires. Gerodontology. 2018;35:162-9. https://doi.org/10.1111/ger.12333.
https://doi.org/10.1111/ger.12333...
). Two studies (3434. Madhavan A, Carnaby GD, Chhabria K, Crary MA. Preliminary Development of a Screening Tool for Pre-Clinical Dysphagia in Community Dwelling Older Adults. Geriatrics. 2018;3(4). pii: E90. https://doi.org/10.3390/geriatrics3040090.
https://doi.org/10.3390/geriatrics304009...
,3535. Uhm KE, Kim M, Lee YM, Kim BR, Kim YS, Choi J, et al. The Easy Dysphagia Symptom Questionnaire (EDSQ): a new dysphagia screening questionnaire for the older adults. Eur Geriatr Med. 2019;10(1):47-52. https://doi.org/10.1007/s41999-018-0133-4.
https://doi.org/10.1007/s41999-018-0133-...
) demonstrated their screening tool validation. The first (3434. Madhavan A, Carnaby GD, Chhabria K, Crary MA. Preliminary Development of a Screening Tool for Pre-Clinical Dysphagia in Community Dwelling Older Adults. Geriatrics. 2018;3(4). pii: E90. https://doi.org/10.3390/geriatrics3040090.
https://doi.org/10.3390/geriatrics304009...
) describes a preliminary tool that requires a confirmatory factor analysis to finish its construct validation based on its internal structure. The second (3535. Uhm KE, Kim M, Lee YM, Kim BR, Kim YS, Choi J, et al. The Easy Dysphagia Symptom Questionnaire (EDSQ): a new dysphagia screening questionnaire for the older adults. Eur Geriatr Med. 2019;10(1):47-52. https://doi.org/10.1007/s41999-018-0133-4.
https://doi.org/10.1007/s41999-018-0133-...
) provided no evidence on the response processes that collected data on the reactions of the respondents when presented with the questions or the internal structure.

The results emphasize the importance of including detailed descriptions of these steps in studies that are aimed at obtaining evidence of validity from diagnostic tools. This should be considered from the external perception of experts (e.g., the EC and ETG) and the internal perception of who is under evaluation (3636. Krueger KL, Bottom DL, Hood WG, Johnson GE, Jones KK, Thom RM. An expert panel process to evaluate habitat restoration actions in the Columbia River estuary. J Environ Manage. 2017;188:337-50. https://doi.org/10.1016/j.jenvman.2016.11.028.
https://doi.org/10.1016/j.jenvman.2016.1...
).

The findings were relevant, highlighting the importance of describing how the screening tool was constructed and adjusted. This favored the perception of continuous movement in the process of obtaining evidence of validity with interpretations that generated valid and reliable arguments (1515. Padilla JL, Benítez I. Validity evidence based on response processes. Psicothema. 2014;26(1):136-44.).

Evidence of validity, related to the internal structure, well-fitted in nine questions, presented satisfactory quality of the adjustments that were based on the recommendations of the absolute fit indexes (χ2/df; RMSEA) and incremental indexes (CFI; TLI). This was confirmed by robust indexes of internal structure, consistency, and reliability (2626. Valentini F, Damásio BF. Variância Média Extraída e Confiabilidade Composta: Indicadores de Precisão. Psic Teor Pesq. 2016;32(2):e322225.,3131. Özgül ÖS, Maier C, Enax-Krumova EK, Vollert J, Fischer M, Tegenthoff M, et al. High test-retest-reliability of pain-related evoked potentials (PREP) in healthy subjects. Neurosci Lett. 2017;647:110-6. https://doi.org/10.1016/j.neulet.2017.03.037.
https://doi.org/10.1016/j.neulet.2017.03...
).

There are self-reported questionnaires in the literature that presented no clear evidence of their validation process for OD screening in older adults. One of these questionnaires is being used as a screening tool. However, the author has described that its use was to document the initial severity of dysphagia and to monitor the response to treatment in people with a wide range of swallowing disorders (2121. Belafsky PC, Mouadeb DA, Rees CJ, Pryor JC, Postma GN, Allen J, et al. Validity and reliability of the Eating Assessment Tool (EAT-10). Ann Otol Rhinol Laryngol. 2008;117(12):919-24. https://doi.org/10.1177/000348940811701210.
https://doi.org/10.1177/0003489408117012...
22. Wilkins T, Gillies RA, Thomas AM, Wagner PJ. The prevalence of dysphagia in primary care patients: a HamesNet Research Network study. J Am Board Fam Med. 2007;20(2):144-50. https://doi.org/10.3122/jabfm.2007.02.060045.
https://doi.org/10.3122/jabfm.2007.02.06...
).

Another study (3737. Miura H, Kariyasu M, Yamasaki K, Arai Y. Evaluation of chewing and swallowing disorders among frail community-dwelling elderly individuals. J Oral Rehabil. 2007;34(6):422-7. https://doi.org/10.1111/j.1365-2842.2007.01741.x.
https://doi.org/10.1111/j.1365-2842.2007...
) considered the population of older adults in the community; however, there were failures in the methodological description within the analysis parameters that were already discussed in the literature to obtain evidence of validity, reliability, and accuracy (1111. American Educational Research Association (AERA). American Psychological Association (APA). National Council on Measurement in Education. Standards for Educational and Psychological Testing. New York, NY: American Educational Research Association. 2014.).

Therefore, this OD screening questionnaire may be considered as the first and, for the time being, the only self-reported questionnaire from the epidemiological perspective that can generate information to provide valid results to identify OD in older adult residents of the community who are asymptomatic or presenting initial symptoms.

The tool’s reliability measures were consistent. This indicated that there was a small variability in the scores between the subjects, thus, resulting in adequate stability, and non-significant measurement error. Hence, there is a good homogeneity of the items concerning the construct (2525. Abad FJ, Olea J, Ponsoda V, García C. Medición en Ciencias Sociales y de la Salud. Sintesis. Madrid, Spain: Sintesis; 2011.).

The convergent validity was significant. This confirms what was found in other studies: only a few factors were associated with OD (e.g., depression (5,6,8); stroke; neck, throat and shoulder tension; limited food intake; social withdrawal; perception as inactive; and heart disease with complaints of difficulty in swallowing (4)).

There are no instruments that present valid and reliable results to establish the prevalence of OD in the older adult residents in the community. The results presented in this study reinforce the need to establish these parameters in population studies.

Regarding the discriminant validity, this screening tool does not have an association with the RSES. This highlights that its measure is empirically unique and represents a phenomenon of distinct interest from this other construct.

A limitation of the present study was the exclusion of older people with cognitive impairment, hearing loss, a history of head and neck cancer, and an absence of satisfactory verbal communication. This can compromise the analysis of the dysphagia scenario in the older adult population living in the community. As the population of older adults with dementia is increasing (3737. Miura H, Kariyasu M, Yamasaki K, Arai Y. Evaluation of chewing and swallowing disorders among frail community-dwelling elderly individuals. J Oral Rehabil. 2007;34(6):422-7. https://doi.org/10.1111/j.1365-2842.2007.01741.x.
https://doi.org/10.1111/j.1365-2842.2007...
), it is necessary to consider caregivers who can contribute to this screening tool and identify OD in those who lack verbal communication or have cognitive decline.

The final version of this epidemiological screening questionnaire was named according to its initials in the Brazilian Portuguese title: “RaDI” (Rastreamento de Disfagia Orofaríngea em idosos - Self-reported Oropharyngeal Dysphagia Screening for Older Adults) (Appendix).

CONCLUSIONS

The 9-question RaDI, developed in Brazilian Portuguese, presents evidence of validity based on the test content, response processes, internal structure, and relations to other variables.

This screening questionnaire is a simple and time-effective instrument created for epidemiological purposes to detect OD symptoms and initiate actions aimed at caring for older adults. The instrument can be used by any health professional working with older adults.

APPENDIX

SCREENING FOR OROPHARYNGEAL DYSPHAGIA IN OLDER ADULTS - FINAL VERSION* * The translation of RaDI from Portuguese to English was done for publication purposes without the steps necessary for transcultural translation and adaptation to the English language. (Rastreamento de Disfagia Orofaringea em Idosos – RaDI).

Guidelines to the interviewer about the application of the RaDI

Questions should follow the numbered order of the questionnaire. Please, when asking each question, expect the participant to answer “no” or “yes.” Only after says “yes” should you ask if the specific symptom occurs sometimes or always. It is noteworthy that the screening or screening process of this questionnaire is for epidemiological purposes; it requires diagnostic confirmation by referring the elderly respondent to a referral service.

ACKNOWLEDGMENTS

We thank the participants of social convenience centers who agreed to spend their time voluntarily answering the questionnaire for our data collection. This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001.

REFERENCES

  • 1
    Cook IJ, Kahrilas PJ. AGA technical review on management of oropharyngeal dysphagia. Gastroenterology. 1999;116(2):455-78. https://doi.org/10.1016/S0016-5085(99)70144-7
    » https://doi.org/10.1016/S0016-5085(99)70144-7
  • 2
    Ortega O, Martín A, Clavé P. Diagnosis and Management of Oropharyngeal Dysphagia Among Older Persons, State of the Art. J Am Med Dir Assoc. 2017;18(7):576-82. https://doi.org/10.1016/j.jamda.2017.02.015
    » https://doi.org/10.1016/j.jamda.2017.02.015
  • 3
    Baijens LW, Clavé P, Cras P, Ekberg O, Forster A, Kolb GF, et al. European Society for Swallowing Disorders - European Union Geriatric Medicine Society white paper: oropharyngeal dysphagia as a geriatric syndrome. Clin Interv Aging. 2016;11:1403-28. https://doi.org/10.2147/CIA.S107750
    » https://doi.org/10.2147/CIA.S107750
  • 4
    Roy N, Stemple J, Merrill RM, Thomas L. Dysphagia in the elderly: preliminary evidence of prevalence, risk factors, and socioemotional effects. Ann Otol Rhinol Laryngol. 2007;116(11):858-65. https://doi.org/10.1177/000348940711601112
    » https://doi.org/10.1177/000348940711601112
  • 5
    Turley R, Cohen S. Impact of voice and swallowing problems in the elderly. Otolaryngol Head Neck Surg. 2009;140(1):33-6. https://doi.org/10.1016/j.otohns.2008.10.010
    » https://doi.org/10.1016/j.otohns.2008.10.010
  • 6
    Holland G, Jayasekeran V, Pendleton N, Horan M, Jones M, Hamdy S. Prevalence and symptom profiling of oropharyngeal dysphagia in a community dwelling of an elderly population: a self-reporting questionnaire survey. Dis Esophagus. 2011;24(7):476-80. https://doi.org/10.1111/j.1442-2050.2011.01182.x
    » https://doi.org/10.1111/j.1442-2050.2011.01182.x
  • 7
    Kawashima K, Motohashi Y, Fujishima I. Prevalence of dysphagia among community-dwelling elderly individuals as estimated using a questionnaire for dysphagia screening. Dysphagia. 2004;19(4):266-71. https://doi.org/10.1007/s00455-004-0013-6
    » https://doi.org/10.1007/s00455-004-0013-6
  • 8
    Serra-Prat M, Hinojosa G, López D, Juan M, Fabré E, Voss DS, et al. Prevalence of oropharyngeal dysphagia and impaired safety and efficacy of swallow in independently living older persons. J Am Geriatr Soc. 2011;59(1):186-7. https://doi.org/10.1111/j.1532-5415.2010.03227.x
    » https://doi.org/10.1111/j.1532-5415.2010.03227.x
  • 9
    Magalhães Junior HV, Pernambuco LA, Lima KC, Ferreira MAF. Screening for oropharyngeal dysphagia in older adults: A systematic review of self-reported questionnaires. Gerodontology. 2018;35:162-9. https://doi.org/10.1111/ger.12333
    » https://doi.org/10.1111/ger.12333
  • 10
    Pernambuco Lde A, Espelt A, Magalhães Júnior HV, Cavalcanti RV, de Lima KC. Screening for Voice Disorders in Older Adults (Rastreamento de Alterações Vocais em Idosos - RAVI) - Part I: Validity Evidence Based on Test Content and Response Processes. J Voice. 2016;30(2):246.e9-17. https://doi.org/10.1016/j.jvoice.2015.04.008
    » https://doi.org/10.1016/j.jvoice.2015.04.008
  • 11
    American Educational Research Association (AERA). American Psychological Association (APA). National Council on Measurement in Education. Standards for Educational and Psychological Testing. New York, NY: American Educational Research Association. 2014.
  • 12
    Crary MA, Groher ME. Reinstituting oral feeding in tube-fed adult patients with dysphagia. Nutr Clin Pract. 2006;21(6):576-86. https://doi.org/10.1177/0115426506021006576
    » https://doi.org/10.1177/0115426506021006576
  • 13
    Sireci S, Faulkner-Bond M. Validity evidence based on test content. Psicothema. 2014;26(1):100-7.
  • 14
    Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459-67. https://doi.org/10.1002/nur.20199
    » https://doi.org/10.1002/nur.20199
  • 15
    Padilla JL, Benítez I. Validity evidence based on response processes. Psicothema. 2014;26(1):136-44.
  • 16
    Henseler J, Ringle CM, Sarstedt M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. J Acad Mark Sci. 2015;43(1):115-35. https://doi.org/10.1007/s11747-014-0403-8
    » https://doi.org/10.1007/s11747-014-0403-8
  • 17
    Chojin Y, Kato T, Rikihisa M, Omori M, Noguchi S, Akata K, et al. Evaluation of the Mann Assessment of Swallowing Ability in Elderly Patients with Pneumonia. Aging Dis. 2017;8(4):420-33. https://doi.org/10.14336/AD.2017.0102
    » https://doi.org/10.14336/AD.2017.0102
  • 18
    Govender R, Lee MT, Davies TC, Twinn CE, Katsoulis KL, Payten CL, et al. Development and preliminary validation of a patient-reported outcome measure for swallowing after total laryngectomy (SOAL questionnaire). Clin Otolaryngol. 2012;37(6):452-9. https://doi.org/10.1111/coa.12036
    » https://doi.org/10.1111/coa.12036
  • 19
    Dwivedi RC, St Rose S, Chisholm EJ, Georgalas C, Bisase B, Amen F, et al. Evaluation of swallowing by Sydney Swallow Questionnaire (SSQ) in oral and oropharyngeal cancer patients treated with primary surgery. Dysphagia. 2012;27(4):491-7. https://doi.org/10.1007/s00455-012-9395-z
    » https://doi.org/10.1007/s00455-012-9395-z
  • 20
    Logemann JA, Veis S, Colangelo L. A screening procedure for oropharyngeal dysphagia. Dysphagia. 1999;14(1):44-51. https://doi.org/10.1007/PL00009583
    » https://doi.org/10.1007/PL00009583
  • 21
    Belafsky PC, Mouadeb DA, Rees CJ, Pryor JC, Postma GN, Allen J, et al. Validity and reliability of the Eating Assessment Tool (EAT-10). Ann Otol Rhinol Laryngol. 2008;117(12):919-24. https://doi.org/10.1177/000348940811701210
    » https://doi.org/10.1177/000348940811701210
  • 22
    Wilkins T, Gillies RA, Thomas AM, Wagner PJ. The prevalence of dysphagia in primary care patients: a HamesNet Research Network study. J Am Board Fam Med. 2007;20(2):144-50. https://doi.org/10.3122/jabfm.2007.02.060045
    » https://doi.org/10.3122/jabfm.2007.02.060045
  • 23
    Li CH. Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behav Res Methods. 2016;48(3):936-49. https://doi.org/10.3758/s13428-015-0619-7
    » https://doi.org/10.3758/s13428-015-0619-7
  • 24
    Cogo-Moreira H, Jackowski AP, de Araújo TR, Vieira LH, Haidar MA, Silva I. Poor-fit indexes of Kupperman index: a psychometric analysis based on item response theory. Menopause. 2015;22(4):444-7. https://doi.org/10.1097/GME.0000000000000338
    » https://doi.org/10.1097/GME.0000000000000338
  • 25
    Abad FJ, Olea J, Ponsoda V, García C. Medición en Ciencias Sociales y de la Salud. Sintesis. Madrid, Spain: Sintesis; 2011.
  • 26
    Valentini F, Damásio BF. Variância Média Extraída e Confiabilidade Composta: Indicadores de Precisão. Psic Teor Pesq. 2016;32(2):e322225.
  • 27
    Yang EJ, Kim MH, Lim JY, Paik NJ. Oropharyngeal Dysphagia in a community-based elderly cohort: the Korean longitudinal study on health and aging. J Korean Med Sci. 2013;28(10):1534-9. https://doi.org/10.3346/jkms.2013.28.10.1534
    » https://doi.org/10.3346/jkms.2013.28.10.1534
  • 28
    Ekberg O, Hamdy S, Woisard V, Wuttge-Hannig A, Ortega P. Social and psychological burden of dysphagia: its impact on diagnosis and treatment. Dysphagia. 2002;17(2):139-46. https://doi.org/10.1007/s00455-001-0113-5
    » https://doi.org/10.1007/s00455-001-0113-5
  • 29
    Meurer ST, Luft CB, Benedetti TR, Mazo GZ. Validade de Construto e Consistência Interna da Escala de Autoestima de Rosenberg para uma População de Idosos Brasileiros Praticantes de Atividades Físicas. Motricidade. 2012;8(4):5-15. https://doi.org/10.6063/motricidade.8(4).1548
    » https://doi.org/10.6063/motricidade.8(4).1548
  • 30
    Gisev N, Bell JS, Chen TF. Interrater agreement and interrater reliability: key concepts, approaches, and applications. Res Social Adm Pharm. 2013;9(3):330-8. https://doi.org/10.1016/j.sapharm.2012.04.004
    » https://doi.org/10.1016/j.sapharm.2012.04.004
  • 31
    Özgül ÖS, Maier C, Enax-Krumova EK, Vollert J, Fischer M, Tegenthoff M, et al. High test-retest-reliability of pain-related evoked potentials (PREP) in healthy subjects. Neurosci Lett. 2017;647:110-6. https://doi.org/10.1016/j.neulet.2017.03.037
    » https://doi.org/10.1016/j.neulet.2017.03.037
  • 32
    Cavalcanti RVA, Magalhães Junior HV, Pernambuco LA, Lima KC. Screening for masticatory disorders in older adults (SMDOA): An epidemiological tool. J Prosthodont Res. 2019. pii: S1883-1958(19)30122-7.
  • 33
    Magalhães Junior HV, Pernambuco LA. Screening for oropharyngeal dysphagia. CoDAS. 2015;27(2):111-2.
  • 34
    Madhavan A, Carnaby GD, Chhabria K, Crary MA. Preliminary Development of a Screening Tool for Pre-Clinical Dysphagia in Community Dwelling Older Adults. Geriatrics. 2018;3(4). pii: E90. https://doi.org/10.3390/geriatrics3040090
    » https://doi.org/10.3390/geriatrics3040090
  • 35
    Uhm KE, Kim M, Lee YM, Kim BR, Kim YS, Choi J, et al. The Easy Dysphagia Symptom Questionnaire (EDSQ): a new dysphagia screening questionnaire for the older adults. Eur Geriatr Med. 2019;10(1):47-52. https://doi.org/10.1007/s41999-018-0133-4
    » https://doi.org/10.1007/s41999-018-0133-4
  • 36
    Krueger KL, Bottom DL, Hood WG, Johnson GE, Jones KK, Thom RM. An expert panel process to evaluate habitat restoration actions in the Columbia River estuary. J Environ Manage. 2017;188:337-50. https://doi.org/10.1016/j.jenvman.2016.11.028
    » https://doi.org/10.1016/j.jenvman.2016.11.028
  • 37
    Miura H, Kariyasu M, Yamasaki K, Arai Y. Evaluation of chewing and swallowing disorders among frail community-dwelling elderly individuals. J Oral Rehabil. 2007;34(6):422-7. https://doi.org/10.1111/j.1365-2842.2007.01741.x
    » https://doi.org/10.1111/j.1365-2842.2007.01741.x

Publication Dates

  • Publication in this collection
    10 Jan 2020
  • Date of issue
    2020

History

  • Received
    5 July 2019
  • Accepted
    24 Oct 2019
Creative Common - by 4.0
This is an Open Access article distributed under the terms of the Creative Commons License (https://creativecommons.org/licenses/by/4.0/) which permits unrestricted use, distribution, and reproduction in any medium or format, provided the original work is properly cited.
Faculdade de Medicina / USP Rua Dr Ovídio Pires de Campos, 225 - 6 and., 05403-010 São Paulo SP - Brazil, Tel.: (55 11) 2661-6235 - São Paulo - SP - Brazil
E-mail: clinics@hc.fm.usp.br