Validity and reliability of the hearing handicap inventory for adults

Abstracts

O questionário de Handicap Auditivo para Adultos (HHIA) traduzido para o português brasileiro vem sendo aplicado na prática clínica e pesquisas, no entanto, faltam informações sobre suas propriedades psicométricas. OBJETIVOS: Avaliar a facilidade de leitura e propriedades psicométricas deste questionário, incluindo validade e confiabilidade. MATERIAIS E MÉTODOS: Estudo prospectivo. Responderam ao questionário 30 ouvintes normais (Grupo A) e 113 deficientes auditivos (Grupo B). Foi feita reaplicação para 32 participantes do Grupo B. O índice de facilidade de leitura de Flesch foi aplicado no questionário. Foram avaliadas consistência interna, variabilidade teste-reteste e validade discriminante. RESULTADOS: De modo geral, as perguntas do questionário foram consideradas de fácil leitura. Alta consistência interna geral e dos itens foi observada por valores altos do alfa de Cronbach e correlação de Pearson. Não houve diferença significativa entre as pontuações no teste e reteste. As correlações entre estas pontuações também foram fortes e significativas. O teste t de Student indicou diferenças da pontuação do questionário entre os grupos A e B (validade discriminante). CONCLUSÃO: O questionário traduzido para o português brasileiro mantém a confiabilidade e validade da versão original. Outros estudos são necessários para determinar a validade convergente e validade de constructo deste instrumento

adulto; perda auditiva; questionários; reprodutibilidade dos testes

ORIGINAL ARTICLE

Validity and reliability of the hearing handicap inventory for adults

Camila Piccini Aiello^I; Ivanildo Inácio de Lima^II; Deborah Viviane Ferrari^III

^ISpeech and hearing therapist. MSc student in the Graduate Program of the Speech and Hearing Department of the School of Dentistry - University of São Paulo, FOB-USP, Bauru, SP, Brazil

^IISpeech and hearing therapist. MSc student in the Graduate Program of the Speech and Hearing Department of the School of Dentistry - University of São Paulo, FOB-USP, Bauru, SP, Brazil

^IIIPhD in Neurosciences and Behavior - Institute of Psychology of the University of São Paulo, Professor at the Department of Speech and Hearing Therapy of the School of Dentistry - University of São Paulo, FOB-USP, Bauru, SP, Brazil

^{Send correspondence to}

ABSTRACT

The Hearing Handicap Inventory for Adults (HHIA) translated into Brazilian Portuguese has been used for clinical practice and research purposes; however, information regarding its ease of reading and psychometric properties are still lacking.

AIM: To evaluate the ease of reading and psychometric properties of the Brazilian translation of this tool, including its validity and reliability.

MATERIALS AND METHODS: Prospective study. The questionnaire was applied to 30 normal hearing (Group A) and 113 hearing impaired (Group B) persons. Thirty two participants (group B) answered the questionnaire a second time. The Flesch readability index was calculated for each item in the questionnaire. The internal consistency, test-retest reliability and discriminant validity were evaluated.

RESULTS: Flesch's scores showed that the questionnaire was easy to read. Cronbach's alpha and Pearson's correlation showed high internal consistency. There was no significant difference between test and retest scores. Besides, correlation between these two scores was also high and significant. Student t test indicated significant difference between scores for groups A and B (discriminant validity).

CONCLUSIONS: The Hearing Handicap Inventory for Adults translated into Brazilian Portuguese maintained the reliability and validity of the English version. Further studies are needed to determine the convergent validity and construct validity for this instrument.

Keywords: adult, hearing loss, questionnaires, reproducibility of results.

INTRODUCTION

Today in health care there is a growing need to systematically and objectively measure, show and document the benefits or results from an intervention - the so-called "result assessment".

The result assessment can be used to provide data to government entities concerning the use of financial resources, to show certification agents the effectiveness of audiologic services rendered, to show patients and family members the changes which happened because of the intervention, to validate clinical decisions concerning individual hearing aid sound amplification device selection and fitting practices, to determine what is being done correctly and areas which need improvements in the service, as well as to establish good practices for the profession¹.

One of the points of interest is to assess intervention results in the fields of activity limitation and participation restriction. Activity limitation is characterized as the consequences in functional performance impairment, in other words, in the execution of a given task or action. Participation restriction (handicap) concerns the involvement in life situations and it reflects the individual's adaptation to the environment as a result of the hearing loss and the handicap². In order to do that, it is necessary to determine the difficulties the patient experiences before and after the intervention. In regards to participation restriction, different questionnaires have been developed for this purpose, including the Hearing Handicap Inventory for Adults - HHIA³. This questionnaire is based on a modified version of the Hearing Handicap Inventory for the Elderly - HHIE, to be used with individuals aged below 65 years⁴. For such, three questions from the original HHIE questionnaire have been modified in order to include the items created to identify the effects of hearing loss on occupational issues, since younger adults live through this situation more often than the elderly, who are usually already retired³. The original HHIA version, in English, has high internal consistency of its questions, test-retest reliability and low standard error^3,5,6.

The HHIA questionnaire has been going through adaptations and validations for other languages. The Italian version of the HHIA kept the validity and reliability of the original version, being considered of high relevance in order to establish the non-auditory symptoms of the hearing impaired from that country⁷.

The HHIA questionnaire was translated into Brazilian Portuguese⁸ and has been used both in the audiology clinic as well as in research in order to quantify the handicap of a population, to assess the benefits of using the ISAD or that of intervention programs for people with noise-induced hearing loss^8-12. Nonetheless, data on the validity and reliability of the HHIA translated into Brazilian Portuguese has not been reported in the literature, and this is a limiting factor in regards of the usefulness of the instrument for use in research or to document clinical interventions.

The goal of the present study was to assess the psychometric properties of the Adult Auditory Handicap questionnaire translated into the Brazilian Portuguese, including its validity and reliability, as well as its ease of reading and application in adult normal hearing and hearing impaired individuals.

MATERIALS AND METHODS

Prospective study held in the Audiology Clinic of the Dentistry School of Baurú - University of São Paulo (FOB/USP), approved by the Ethics in Research Committee of this Institution (process # 05/2009).

All 143 participants volunteered and signed the Informed Consent Form. The participants were broken down into the two groups described below.

Group A

Made up of 30 normal hearing adults (15 women and 15 men), with ages between 20 and 60 years (mean age of 38. 5 years). None of the participants had a past or complained of hearing disorders, and they also did not have any external ear or tympanic membrane disorder found upon ear inspection. All the individuals were submitted to audiometric screening (carried out in a sound-treated booth, and the 250 to 8000 Hz frequencies were studied, with a presentation level equal to 25 dB HL). All the individuals could read and they did not have previous knowledge about the Auditory Handicap Inventory for Adults.

Group B¹

Data from this group can be found on Table 1. Made up of 113 individuals (52 women and 61 men) with ages varying between 21 and 64 years (mean age of 53. 6 years), with bilateral post-lingual sensorineural hearing loss, symmetrical (n=85) or asymmetrical (n=28). The ISO mean (frequency of 500, 1k, 2k and 4k Hz) of the audiometric thresholds from the best ear varied from 26. 25 to 92. 5 dB HL (mean of 49. 7 dB HL). According to the ISO mean value from the best ear, the hearing losses were classified as mild (n=32; 28. 3%), moderate (n=62; 54. 8%); severe (n=13; 11. 5%) and profound (n=6; 5. 3%).

It must be stressed that seven participants were not able to report on the duration of the hearing loss. Six participants were not able to undergo the speech recognition threshold test because of their hearing loss severity (Table 1).

Information about educational level was obtained for 108 participants, and they had incomplete (n=47; 43. 5%) and complete (n=10; 9. 2%) basic education; incomplete (n=10; 9. 2%) and complete (n=30; 27. 7%) high school education; and complete higher education (n=8; 7. 4%). Three individuals (2. 7%) were illiterate.

Socioeconomical information was obtained for 112 participants based on the Socioeconomical Instrumental Classification protocol present in the patients' charts¹³. The following classifications were checked: low inferior (n=13; 11,6%), low superior (n=76; 67. 8%), medium inferior (n=19; 16. 9%) and medium (n=4; 3. 5%).

All Group B participants were regularly enrolled in the FOB-USP audiology clinic and did not have previous experience with the ISAD.

We used the Adult Auditory Handicap questionnaire translated into Brazilian Portuguese⁸ (^{Attachment 1}). This questionnaire is made up of 25 questions broken down into two subscales: social (12 questions, which measure the effects of hearing loss in different social situations) and emotional (13 questions, which estimate the behavior and emotional responses of the individual in relation to his hearing loss). All questions are identified according to the scale to which they belong. For each question there are three possible answers: "yes" (equal to 4 points), "sometimes" (worth 2 points) and "no" (equal to 0 points). The scoring was carried out manually, when we calculated the total score (summation of the points for the 25 questions), as well as to the emotional and social subscales, separately. The total HHIA score can vary between 0 and 100; the social scale score can vary between 0 and 48 and the emotional scale can vary between 0 and 52. Higher values indicate a greater perception of the auditory handicap.

Initially, we calculated the Flesch Reading Ease Index (FREI) for each question in the questionnaire in order to assess the level of text reading difficulty based on the length of the words and phrases¹⁴. FREI assesses the degree of ease of reading the texts in a percentage scale. The formula includes sentence size and the number of syllables in a sample of 100 words. The higher the value, the greater the ease of reading the text assessed and the lower the educational level necessary for its understanding. The scale is made up of seven levels, varying from "very easy" (score between 90 and 100%) to "very difficult " (scores between 0 and 30%)¹⁵.

For Group A, the questionnaire was applied in the form of pen and paper, and the individual was asked to read the 25 questions and check the answer he/she thought more appropriate. The time it took the participant to fill out the questionnaire was calculated. At the end of it, the examiner interviewed the participant in order to check his/her perceptions on the ease of understanding and filling out the questionnaire.

For Group B, the HHIA questionnaire was applied in the form of an interview after audiologic diagnosis. The examiner read the 25 questions together with the participant who was asked to check the answer he/she thought more adequate. For 32 individuals (13 women and 19 men) from Group B, the Hearing Handicap Inventory for Adults was applied a second time, again in the form of an interview, at least two weeks after the first application, but prior to the ISAD fitting, and this time interval was considered acceptable to minimize the issue of memory for the questionnaire items which could contribute to a strong correlation between the two applications.

The statistical analysis was carried out by means of the Stata software. In regards of reliability, for Group B participants, the internal consistence of the questionnaire was measured by the Cronbach's alpha, which was also calculated when each item was removed from the questionnaire. The Pearson's correlation coefficient was utilized in order to study the relationship between the total score and the social and emotional subscales, as well as the correlation between the two subscales.

In order to assess the questionnaire's test and retest variability, we calculated the Pearson's correlation coefficient between the total score and that of the social and emotional subscales between the first and second application of the questionnaire. The existence of a significant difference between the scores obtained in the two applications was analyzed by means of the paired t-test. We also calculated the standard error and the 95% confidence interval.

In order to check the discriminant validity, the questionnaire scores obtained for Group A and for 32 participants from Group B were compared by means of the Student t test. In all the analyses we adopted a 5% significance level.

RESULTS

The application of the Flesch Reading Ease Index showed 13 questions which were considered very easy or reasonably easy, six questions were considered standard, five were considered reasonably difficult (E-2, E-5, S-15, E-17, S-21) and one question (S-10) was considered very difficult.

The scores obtained from the questionnaire for Group A participants was 1,1. For this group, the time taken to fill out the questionnaire varied between 1. 30 and 4. 13 minutes (mean of 2. 28 minutes). When questioned about the level of difficulty found in the filling out of the questionnaire, 29 individuals (96%) reported that it was easy to understand.

For Group B participants, the mean scores and standard deviation values obtained from the HHIA questionnaire was equal to 52. 2 ± 26. 6 (total); 25. 9 ± 12. 1 (social) and 26. 3 ± 15. 3 (emotional). Figure 1 shows the mean and standard deviation for the HHIA score for Group B participants, according to the degree of hearing loss (Fig. 1).

HHIA's internal consistency using the Cronbach's alpha was 0. 92 (total score), 0. 91 (social) and 0. 84 (emotional). When each one of the items was taken off the scale, the Cronbach's alpha varied between 0. 93 and 0. 94. the Pearson's correlation coefficient and the significance level between the total score and that of the social and emotional subscales for Group B participants can be found on Table 2.

The questionnaire's test and retest variability results, calculated from a sample of 32 participants from Group B can be found on Table 3.

The discriminant validity was checked by the comparison between results from Groups A and B, as per depicted on Table 4.

DISCUSSION

In general, the results from the reading ease index of the questions which make up the HHIA questionnaire in Portuguese are of ease reading, nonetheless, it has been suggested that question S-10 be remade. One Group A participant considered the language utilized in the instrument as being too technical. The time it took to fill out the questionnaire, in the form of pen and paper, indicated that it can be used in clinical practice, without requiring much clinical time. It must be stressed that most Group A participants were individuals with high education, which not always represents the true population seeking the public health-care system.

For Group A, we obtained the lowest scores in the HHIA questionnaire (Table 4). The social subscale score varied between 0 and 4 points (mean = 0. 47) and the emotional subscale varied between 0 and 6 points (mean = 0. 67). The total score varied between 0 and 10 points (mean = 1. 13). Such results indicated that no handicap was perceived, which was expected since the participants were normal hearing people.

Reliability is defined as the degree in which the measured result reflects the true result. In the present study, reliability was measured by the internal consistency and the test-retest consistency.

The internal consistency checks the degree in which a group of observed variables is measuring a given construct. The minimum acceptable value for the Chronbach' alpha coefficient for internal consistency is equal to 0. 70³. The general reliability of the HHIA translated into Brazilian Portuguese measured by the Cronbach's alpha was 0. 92. Even when each one of the items is removed from the scale, Cronbach's alpha remained high, varying between 0. 93 and 0. 94. These results are similar to those from the original version - in English, and also from the Italian version of the instrument^5,7.

We found strong and significant correlations between the total score and that from the social and emotional subscales, as well as between the subscales (Table 2), indicating that in the translation of the HHIA into Portuguese there are associations between the constructs which were measured in each subscale with the total score of the questionnaire. In the original version in English, we observed correlations between 0. 84 and 0. 96⁵.

In regards of the test-retest consistency, it is possible to notice that the differences between the mean values obtained between the first and second times the questionnaire was applied varied between 0. 5 (social subscale) and 1. 1 (total score) and these were not significant (Table 3). We also noticed that the standard deviations found in the test and retest were very similar, indicating that the variation in score between the participants was similar from one time the questionnaire was employed to the other. And finally, strong and statistically significant correlations were found between the first and the second time the questionnaire was employed. This data is in agreement with what was found for the original version, in English and for validation in Italian, when we found correlations around 0. 9^3,7. The test-retest reliability shows the stability of an instrument in the long run. This means that the HHIA translated into Brazilian Portuguese may produce valid and consistent results from one time it is used to another. One of the HHIA' goals is to serve as criterion to document the effects of treatment, including the benefits of using an ISAD^16,17, throughout time, this result is extremely important.

In regards of the discriminant validity, the hypothesis adopted was the one that the questionnaire shows discriminant validity, the scores from individuals with hearing loss would differ from the scores from normal hearing people. As we can see on Table 4, Group B individuals had significantly higher scores in the HHIA (indicating a higher handicap) when compared to those from Group A. This happened both from the total scores and from the subscales such as those from comparing each question from the questionnaire individually. However, it must be stressed that in the present study it was not possible to match the socio-demographic data from Groups A and B participants, and this may have influenced the results.

CONCLUSION

The results from this study show that the Brazilian Portuguese version of the Hearing Handicap Inventory for Adults maintains the validity and reliability of its original version. Other studies are needed in order to establish the converging validity and that of the construct of this instrument.

Paper submitted to the BJORL-SGP (Publishing Management System - Brazilian Journal of Otorhinolaryngology) on June 04, 2010; and accepted on June 28, 2010. cod. 7142

Research Support System: Rusp Processo nº 2008.1.1949.25.9

Study carried out at the Department of Speech and Hearing Therapy - School of Dentistry - University of São Paulo, FOB-USP, Bauru, SP, Brazil.

Attachment 1 - Clique to enlarge

• 1. Abrams H, McArdle R, Hnath-Chisolm T. From outcomes to evidence: Establishing best practices for audiologists. Semin Hear. 2005;26(3):157-69.
• 2. Weinstein BE. Outcome measure in the hearing aid fitting/selection process. Trends Amplif. 1997;2(4):117-37.
• 3. Newman CW, Weinstein BE, Jacobson GP, Hug GA. Test-retest reliability of the hearing handicap inventory for adults. Ear Hear. 1991;12(5):355-7.
• 4. Ventry IM, Weinstein BE. The hearing handicap inventory for the elderly: a new tool. Ear Hear. 1982;3(3):128-34.
• 5. Newman CW, Weinstein BE, Jacobson GP, Hug GA. The Hearing Handicap Inventory for Adults: psychometric adequacy and audiometric correlates. Ear Hear. 1990;11(6):430-3.
• 6. Saccone PA, Steiger JR. Hearing handicap among adult residents of an urban homeless shelter. J Health Care Poor Underserved. 2007;18(1):161-72.
• 7. Monzani D, Genovese E, Palma S, Rovatti V, Borgonzoni M, Martini A. Measuring the psychosocial consequences of hearing loss in a working adult population: focus on validity and reliability of the Italian translation of the hearing handicap inventory. Acta Otorhinolaryngol Ital. 2007;27(4):186-91.
• 8. Almeida K. Avaliação objetiva e subjetiva do benefício de próteses auditivas em adultos [Tese Doutorado]. São Paulo (SP): Universidade Federal de São Paulo - Escola Paulista de Medicina; 1998.
• 9. Correa GF, Russo ICP. Autopercepção do handicap em deficientes auditivos adultos e idosos. Rev CEFAC. 1999:1(1):54-63.
• 10. Buzo BC, Ubrig MT, Novaes BC. Adaptação de aparelho de amplificação sonora individual: relações entre a auto-percepção do handicap auditivo e a avaliação da percepção de fala. Disturb Comun. 2004;16(1):17-25.
• 11. Freitas CD, Costa MJ. Processo de adaptação de próteses auditivas em usuários atendidos em uma instituição pública federal: parte II: resultados dos questionários de auto-avaliação. Braz J Otorhinolaryngol. 2007;73(5):660-70.
• 12. Gonçalves CGO. Análise do programa de apoio e reabilitação para trabalhadores portadores de PAIR em uma metalúrgica. Distúrb Comun. 2007;19(1):103-16.
• 13. Graciano MIG, Lehfeld NAS, Neves Filho A. Instrumental de classificação sócio-econômica - 1997. Serv Social Realid. 1999;5(1):109-28.
• 14. Flesch R. A new readability yardstick. J Appl Psychol. 1948;32:221-33.
• 15. Goldim JR. Consentimento e informação: a importância da qualidade do texto utilizado. Rev HCPA. 2006;26(3):117-22.
• 16. Amorim RMC, Almeida K. Estudo do benefício e da aclimatização em novos usuários de próteses auditivas. Pró-Fono. 2007;19(1):39-48.
• 17. Macedo LS, Pupo AC, Balieiro CR. Aplicabilidade dos questionários de auto-avaliação em adultos e idosos com deficiência auditiva. Disturb Comun. 2006;18(1):19-25.

1

This group participated in a previous study from the authors called "Audiometric correlations of the HHIA questionnaire". CEFAC journal, prelo.

Publication Dates

• Publication in this collection
  12 Aug 2011
• Date of issue
  Aug 2011

History

• Received
  04 June 2010
• Accepted
  28 June 2010