Acessibilidade / Reportar erro

Sensitivity and specificity of a low-cost screening protocol for identifying children at risk for language disorders

Abstract

OBJECTIVES:

To compare the diagnostic accuracy of a low-cost screening test for identifying children at risk for language disorders with that of a specific language assessment.

METHODS:

The study was conducted during a polio vaccination campaign in basic health units in western São Paulo, Brazil. The parents/guardians of 1000 children aged between 0 and 5 years were asked to answer questions of a specific screening test. The instrument consisted of a uniform set of questions about the main milestones in language development (from 0 to 5 years of age) with scaled scores to assess responses. There were no exclusion criteria. After the screening test, the children were referred to a specific language assessment by ABFW, following a determined flow of referrals. The results obtained in the screening were compared to those obtained in the specific language assessment; then, the sensitivity, specificity, accuracy, and positive and negative predictive values were determined for the screening test. Children who failed the screening test also underwent an audiological evaluation. The statistical significance was set at 5%.

RESULTS:

The majority of the participants were aged between 4 and 5 years (21.82%) and were male (51.6%). The sensitivity and specificity values were 82.5% and 98.93%, respectively. The area under the curve was 0.907 (0.887-0.925), and the screening test showed 96% accuracy.

CONCLUSIONS:

The screening test showed high diagnostic efficiency in determining the risk of language disorders in children aged between 0 and 5 years.

Primary Health Care; Child Language; Language Disorders; Risk Factors; Sensitivity and Specificity


INTRODUCTION

Knowledge on the prevalence, incidence, and risk factors of a particular disease in the community is important for health professionals and managers to allocate sufficient resources for managing the problems associated with that disease and to design and implement health promotion and disease prevention strategies (11. Samelli AG, Rondon S, Oliver FC, Junqueira SR, Molini-Avejonas DR. Referred speech-language and hearing complaints in the western region of São Paulo, Brazil. Clinics. 2014;69(6):413-9. https://doi.org/10.6061/clinics/2014(06)08.
https://doi.org/10.6061/clinics/2014(06)...
). In Speech-Language and Hearing Sciences (SLHS), it is known that epidemiological studies can be used for correct and early identification of the risk of communication disorders in a given population. The results of such studies allow better programing of health actions related to disease prevention and rehabilitation of the population identified to be at risk of or having communication disorders (11. Samelli AG, Rondon S, Oliver FC, Junqueira SR, Molini-Avejonas DR. Referred speech-language and hearing complaints in the western region of São Paulo, Brazil. Clinics. 2014;69(6):413-9. https://doi.org/10.6061/clinics/2014(06)08.
https://doi.org/10.6061/clinics/2014(06)...

2. Antoniadis A, Lubker BB. Epidemiology as an essential tool for establishing prevention problems and evaluating their impact and outcome. J Commun Disord. 1997;30(4):269-83. https://doi.org/10.1016/S0021-9924(97)00003-8.
https://doi.org/10.1016/S0021-9924(97)00...
-33. Lessa F, Cavalheiro MTP, Ferrite S. Fonoaudiologia e epidemiologia. In: Fernandes FDM, Mendes BCA, Navas ALPGP. Tratado de Fonoaudiologia. 2nd ed. São Paulo: Rocca, 2009:34-44.).

Regarding epidemiological studies, the SLHS literature shows that speech-language delay and language disorders are the most common developmental difficulties in childhood (11. Samelli AG, Rondon S, Oliver FC, Junqueira SR, Molini-Avejonas DR. Referred speech-language and hearing complaints in the western region of São Paulo, Brazil. Clinics. 2014;69(6):413-9. https://doi.org/10.6061/clinics/2014(06)08.
https://doi.org/10.6061/clinics/2014(06)...
,44. de Andrade CR. [Speech-language idiopathic disorder prevalence in children from one to eleven years of age]. Rev Saude Publica. 1997;31(5):495-501. https://doi.org/10.1590/S0034-89101997000600008.
https://doi.org/10.1590/S0034-8910199700...

5. McLeod S, McKinnon DH. Prevalence of communication disorders compared with other learning needs in 14,500 primary and secondary school students. Int J Lang Commun Disord. 2007;42 Suppl 1:37-59. https://doi.org/10.1080/13682820601173262.
https://doi.org/10.1080/1368282060117326...

6. Samelli AG, Rabelo CM, Pereira MB, Portela MN, Sanches SG, Neves-Lobo IF. Comparison of screening methods for conductive hearing loss identification in children: low-cost proposal. J Med Screen. 2012;19(1):1-7. https://doi.org/10.1258/jms.2012.011051.
https://doi.org/10.1258/jms.2012.011051...

7. Siu AL; US Preventive Services Task Force. Screening for Speech and Language Delay and Disorders in Children Aged 5 Years or Younger: US Preventive Services Task Force Recommendation Statement. Pediatrics. 2015;136(2):e474-81. https://doi.org/10.1542/peds.2015-1711.
https://doi.org/10.1542/peds.2015-1711...

8. Garcia de Goulart BN, Chiari BM. [Prevalence of speech disorders in schoolchildren and its associated factors]. Rev Saude Publica. 2007;41(5):726-31. https://doi.org/10.1590/S0034-89102007000500006.
https://doi.org/10.1590/S0034-8910200700...

9. van Agt HM, van der Stege HA, de Ridder-Sluiter H, Verhoeven LT, de Koning HJ. A cluster-randomized trial of screening for language delay in toddlers: effects on school performance and language development at age 8. Pediatrics. 2007;120(6):1317-25. https://doi.org/10.1542/peds.2006-3145.
https://doi.org/10.1542/peds.2006-3145...

10. Prates LP, Martins VO. Distúrbios da fala e da linguagem na infância. Revista Médica de Minas Gerais. 2011;21(4 Supl 1):S54-S60.
-1111. American Speech-Language-Hearing Association. Speech-Language Pathology Medical Review Guidelines. Rockville, MD: American Speech-Language-Hearing Association. 2011. Available from: http://www. asha.org/practice/reimbursement/SLPmedical-review-guidelines/. [Accessed October 11th, 2017].
http://www. asha.org/practice/reimbursem...
). According to the American Speech-Language and Hearing Association (ASHA) (1111. American Speech-Language-Hearing Association. Speech-Language Pathology Medical Review Guidelines. Rockville, MD: American Speech-Language-Hearing Association. 2011. Available from: http://www. asha.org/practice/reimbursement/SLPmedical-review-guidelines/. [Accessed October 11th, 2017].
http://www. asha.org/practice/reimbursem...
), 10% of children have some form of language impairment, while the prevalence rates of phonological disorders and specific language impairment among preschool children is between 2 and 19% and 7%, respectively.

Considering that between 40% and 60% of language disorders go untreated and the negative effects of language impairment on an individual’s social development and education (77. Siu AL; US Preventive Services Task Force. Screening for Speech and Language Delay and Disorders in Children Aged 5 Years or Younger: US Preventive Services Task Force Recommendation Statement. Pediatrics. 2015;136(2):e474-81. https://doi.org/10.1542/peds.2015-1711.
https://doi.org/10.1542/peds.2015-1711...
,1212. Catts HW, Fey ME, Tomblin JB, Zhang X. A longitudinal investigation of reading outcomes in children with language impairments. J Speech Lang Hear Res. 2002;45(6):1142-57. https://doi.org/10.1044/1092-4388(2002/093).
https://doi.org/10.1044/1092-4388(2002/0...

13. Peterson RL, Pennington BF, Shriberg LD, Boada R. What influences literacy outcome in children with speech sound disorder? J Speech Lang Hear Res. 2009;52(5):1175-88. https://doi.org/10.1044/1092-4388(2009/08-0024).
https://doi.org/10.1044/1092-4388(2009/0...
-1414. Kasper J, Kreis J, Scheibler F, Möller D, Skipka G, Lange S, et al. Population-based screening of children for specific speech and language impairment in Germany: a systematic review. Folia Phoniatr Logop. 2011;63(5):247-63. https://doi.org/10.1159/000321000.
https://doi.org/10.1159/000321000...
), the use of specific, standardized, and validated instruments for early detection of the risk of language delay or impairment is important. However, validation studies on the sensitivity and specificity of methods of early detection of the risk of language delay are scarce (11. Samelli AG, Rondon S, Oliver FC, Junqueira SR, Molini-Avejonas DR. Referred speech-language and hearing complaints in the western region of São Paulo, Brazil. Clinics. 2014;69(6):413-9. https://doi.org/10.6061/clinics/2014(06)08.
https://doi.org/10.6061/clinics/2014(06)...
,77. Siu AL; US Preventive Services Task Force. Screening for Speech and Language Delay and Disorders in Children Aged 5 Years or Younger: US Preventive Services Task Force Recommendation Statement. Pediatrics. 2015;136(2):e474-81. https://doi.org/10.1542/peds.2015-1711.
https://doi.org/10.1542/peds.2015-1711...

8. Garcia de Goulart BN, Chiari BM. [Prevalence of speech disorders in schoolchildren and its associated factors]. Rev Saude Publica. 2007;41(5):726-31. https://doi.org/10.1590/S0034-89102007000500006.
https://doi.org/10.1590/S0034-8910200700...
-99. van Agt HM, van der Stege HA, de Ridder-Sluiter H, Verhoeven LT, de Koning HJ. A cluster-randomized trial of screening for language delay in toddlers: effects on school performance and language development at age 8. Pediatrics. 2007;120(6):1317-25. https://doi.org/10.1542/peds.2006-3145.
https://doi.org/10.1542/peds.2006-3145...
,158. Garcia de Goulart BN, Chiari BM. [Prevalence of speech disorders in schoolchildren and its associated factors]. Rev Saude Publica. 2007;41(5):726-31. https://doi.org/10.1590/S0034-89102007000500006.
https://doi.org/10.1590/S0034-8910200700...
,1616. Fox AV, Dodd B, Howard D. Risk factors for speech disorders in children. Int J Lang Commun Disord. 2002;37(2):117-31. https://doi.org/10.1080/13682820110116776.
https://doi.org/10.1080/1368282011011677...
).

Konning et al. (1717. de Koning HJ, de Ridder-Sluiter JG, van Agt HM, Reep-van den Bergh CM, van der Stege HA, Korfage IJ, et al. A cluster-randomised trial of screening for language disorders in toddlers. J Med Screen. 2004;11(3):109-16. https://doi.org/10.1258/0969141041732229.
https://doi.org/10.1258/0969141041732229...
) conducted a cluster-randomized trial to assess the screening performance of a specific language-screening instrument in a large sample of children aged between 18 and 24 months in the Netherlands. The results indicated that 55% of screening-positive children had confirmed language delay and the estimated sensitivity of the screening test ranged between 24% and 52%, depending on the severity of the language disorder.

A study conducted in Brazil investigated the risk factors of language disorders in children aged between 0 and 5 years through a specific survey and conducted follow-up with a screening test for communication disorders (1515. Silva GM, Couto MI, Molini-Avejonas DR. Risk factors identification in children with speech disorders: pilot study. Codas. 2013;25(5):456-62. https://doi.org/10.1590/S2317-17822013000500010.
https://doi.org/10.1590/S2317-1782201300...
). The authors found that the average length of time between when parents first suspected their child to have a communication disorder and the first speech-language screening was 16 months; the results also indicated that the average age of detection of risk factors was 4 years. These findings reflect the difficulties involved in early detection and intervention for preventing communication disorders.

A recent literature review that investigated the predictive validity of preschool screening tools for language and/or behavioral difficulties indicated that the language development surveys administered at 2 years of age achieved the best predictive validity, with 67% sensitivity, 94% specificity, 88% negative predictive value, and 80% positive predictive value (1818. Sim F, Thompson L, Marryat L, Ramparsad N, Wilson P. Predictive validity of preschool screening tools for language and behavioural difficulties: A PRISMA systematic review. PLoS One. 2019;14(2):e0211409. https://doi.org/10.1371/journal.pone.0211409.
https://doi.org/10.1371/journal.pone.021...
). The authors also found that language-screening tools were more effective and achieved higher sensitivity and positive predictive value than either behavior or combined screening tools (language and behavior) for identifying children with language difficulties.

There are some limitations to the studies that proposed population surveys as screening instruments, such as a generalized and superficial view of language development, low levels of sensitivity, specific focus on understanding and expressive language skills, and the use of sample populations with a small number of participants and no diversity in age groups (99. van Agt HM, van der Stege HA, de Ridder-Sluiter H, Verhoeven LT, de Koning HJ. A cluster-randomized trial of screening for language delay in toddlers: effects on school performance and language development at age 8. Pediatrics. 2007;120(6):1317-25. https://doi.org/10.1542/peds.2006-3145.
https://doi.org/10.1542/peds.2006-3145...
,1919. Goulart BN, Martins-Reis VO, Chiari BM. Household survey on self-declared communication disorders: study design and protocol. Audiol Commun Res. 2015;20(4):336-48. https://doi.org/10.1590/2317-6431-2015-1586.
https://doi.org/10.1590/2317-6431-2015-1...
). Another limitation is that although the screening tools were widely used for language development (77. Siu AL; US Preventive Services Task Force. Screening for Speech and Language Delay and Disorders in Children Aged 5 Years or Younger: US Preventive Services Task Force Recommendation Statement. Pediatrics. 2015;136(2):e474-81. https://doi.org/10.1542/peds.2015-1711.
https://doi.org/10.1542/peds.2015-1711...
,2020. Rescorla L, Alley A. Validation of the language development survey (LDS): a parent report tool for identifying language delay in toddlers. J Speech Lang Hear Res. 2001;44(2):434-45. https://doi.org/10.1044/1092-4388(2001/035).
https://doi.org/10.1044/1092-4388(2001/0...
,2121. Squires J, Bricker D. Ages & Stages Questionnaires®, Third Edition (ASQ- 3™). A parent-completed child-monitoring system. Baltimore: Paul H Brookes; 2009.), the majority were poorly validated (1818. Sim F, Thompson L, Marryat L, Ramparsad N, Wilson P. Predictive validity of preschool screening tools for language and behavioural difficulties: A PRISMA systematic review. PLoS One. 2019;14(2):e0211409. https://doi.org/10.1371/journal.pone.0211409.
https://doi.org/10.1371/journal.pone.021...
).

Recent studies suggest that there is insufficient scientific evidence on the effectiveness of screening tests and speech-language assessments for children aged up to 5 years without suspected disorders (77. Siu AL; US Preventive Services Task Force. Screening for Speech and Language Delay and Disorders in Children Aged 5 Years or Younger: US Preventive Services Task Force Recommendation Statement. Pediatrics. 2015;136(2):e474-81. https://doi.org/10.1542/peds.2015-1711.
https://doi.org/10.1542/peds.2015-1711...
,2222. Wallace IF, Berkman ND, Watson LR, Coyne-Beasley T, Wood CT, Cullen K, et al. Screening for Speech and Language Delay in Children 5 Years Old and Younger: A Systematic Review. Pediatrics. 2015;136(2):e448-62. https://doi.org/10.1542/peds.2014-3889.
https://doi.org/10.1542/peds.2014-3889...
). These studies underline the need for further research to determine the reliability, sensitivity, and specificity of specific low-cost instruments before promoting their widespread adoption (11. Samelli AG, Rondon S, Oliver FC, Junqueira SR, Molini-Avejonas DR. Referred speech-language and hearing complaints in the western region of São Paulo, Brazil. Clinics. 2014;69(6):413-9. https://doi.org/10.6061/clinics/2014(06)08.
https://doi.org/10.6061/clinics/2014(06)...
,66. Samelli AG, Rabelo CM, Pereira MB, Portela MN, Sanches SG, Neves-Lobo IF. Comparison of screening methods for conductive hearing loss identification in children: low-cost proposal. J Med Screen. 2012;19(1):1-7. https://doi.org/10.1258/jms.2012.011051.
https://doi.org/10.1258/jms.2012.011051...
,77. Siu AL; US Preventive Services Task Force. Screening for Speech and Language Delay and Disorders in Children Aged 5 Years or Younger: US Preventive Services Task Force Recommendation Statement. Pediatrics. 2015;136(2):e474-81. https://doi.org/10.1542/peds.2015-1711.
https://doi.org/10.1542/peds.2015-1711...
,2323. Warren R, Kenny M, Bennett T, Fitzpatrick-Lewis D, Ali MU, Sherifali D, et al. Screening for developmental delay among children aged 1-4 years: a systematic review. CMAJ Open. 2016;4(1):E20-7. https://doi.org/10.9778/cmajo.20140121.
https://doi.org/10.9778/cmajo.20140121...
).

It is important to consider the evidence that indicates the benefit of including a specific language-screening instrument in routine screening performed at child health centers; this can lead to early detection of language delay, enabling informed referrals to specialist services and early intervention (1717. de Koning HJ, de Ridder-Sluiter JG, van Agt HM, Reep-van den Bergh CM, van der Stege HA, Korfage IJ, et al. A cluster-randomised trial of screening for language disorders in toddlers. J Med Screen. 2004;11(3):109-16. https://doi.org/10.1258/0969141041732229.
https://doi.org/10.1258/0969141041732229...
,1818. Sim F, Thompson L, Marryat L, Ramparsad N, Wilson P. Predictive validity of preschool screening tools for language and behavioural difficulties: A PRISMA systematic review. PLoS One. 2019;14(2):e0211409. https://doi.org/10.1371/journal.pone.0211409.
https://doi.org/10.1371/journal.pone.021...
).

Therefore, the objective of this study was to compare the diagnostic accuracy of a low-cost screening test for identifying children at risk for language disorders with that of a specific gold standard language assessment.

MATERIALS AND METHODS

This study was approved by the research ethics committee of the School of Medicine at the University of São Paulo (FMUSP, acronym in Portuguese) (CAPPesq HCFMUSP 387/10).

The study was conducted during a polio vaccination campaign in basic health units in western São Paulo, Brazil. The parents/guardians of 1,000 children aged between 0 and 5 years were asked to answer the questions of a specific screening test. The children’s parents/guardians who agreed to participate were asked to sign an informed consent form. There were no exclusion criteria.

The study was conducted with 1,000 children aged between 0 and 5 years living in the micro-region Butantã/Jaguaré in the municipality of São Paulo, Brazil, and treated in health centers located in western São Paulo during a vaccination campaign.

The instrument used in the present study was a screening test for language disorders developed and validated by the ASHA (2424. American Speech-Language and Hearing Association (ASHA). “How does your child hear and talk?” 2006. Available from: http://www.asha.org/public/speech/development/chart/. Accessed: October 11th, 2017.
http://www.asha.org/public/speech/develo...
). The screening contains specific questions about language development (language production and understanding) considering the main milestones according to age - from zero to five years old (Appendix).

After obtaining the ASHA’s formal license, the process of translation and back-translation of the protocol was initiated, according to the requirement of standardization of the test and guidelines for the process of cross-cultural adaptation (translation, synthesis, back-translation, expert committee review, and pretesting) (2525. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186-91. https://doi.org/10.1097/00007632-200012150-00014.
https://doi.org/10.1097/00007632-2000121...
). The translation and back-translation were carried out by a Brazilian individual fluent in English and reviewed by two other native Brazilian individuals fluent in English, both speech-language pathologists and public university professors. These professionals not only translated but also socioculturally adapted the test for expressions, names, and adequate examples in Brazilian Portuguese.

To check the reliability of the translated questions and their format, a bilingual speech-language pathologist (fluent both in Portuguese and English) performed the back-translation of the questionnaire (English to Portuguese). Both versions were compared to ensure their equivalence. In the back-translated version, the translator carried out further adaptations for vocabulary, syntactic issues, and expressions and then compared it to the published English version. The shortcomings and errors were corrected, and the first draft was prepared.

The first draft was sent to a committee (four speech pathologists experts including two professors, one specialist, and a grammarian and linguist) that thoroughly evaluated the first version of the screening test for simplicity of the text, grammar, and use of proper terms and syntax. Four steps of equivalence, namely semantic, idiomatic, experiential, and conceptual equivalence, were evaluated for cross-cultural adaptation (2525. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186-91. https://doi.org/10.1097/00007632-200012150-00014.
https://doi.org/10.1097/00007632-2000121...
).

Finally, the judges examined the committee’s considerations, accepting pertinent suggestions and elaborating the final version to be used in the pre-test. The pre-test involved ten participants with different levels of education, from complete primary school to graduate degree. The participants were asked to read, paraphrase, and comment on their understanding of the instructions, items, and response options of the instrument. Based on their responses, no further modification was needed.

We used face-to-face interviews for data collection to avoid selection bias related to illiterate participants and to reduce the number of non-respondents. All participants were interviewed by a trained interviewer individually. To assess test-retest reliability, 30 patients completed the screening over 2 weeks; the procedure was conducted by the same interviewer.

Cronbach's alpha and intraclass correlation coefficient (ICC) were used to determine the reliability of the screening; the Cronbach's alpha coefficient was ≤0.7 and the ICC was ≥0.85.

The screening process examined the main developmental milestones across the language domain using age-specific questions. The participants were divided into the following age groups according to the ASHA criteria (2424. American Speech-Language and Hearing Association (ASHA). “How does your child hear and talk?” 2006. Available from: http://www.asha.org/public/speech/development/chart/. Accessed: October 11th, 2017.
http://www.asha.org/public/speech/develo...
):

  • - Group I: 0 to 3 months

  • - Group II: 4 to 6 months

  • - Group III: 7 months to 1 year

  • - Group IV: 1 year and 1 month to 2 years

  • - Group V: 2 years and 1 month to 3 years

  • - Group VI: 3 years and 1 month to 4 years

  • - Group VII: 4 years and 1 month to 5 years and 11 months.

The answer options for each screening question were “no,” “yes,” or “no answer” (when the child parent/guardian was unsure about the answer). Each answer was scored as per the ASHA criteria in the original version of the screening protocol (Table 1).

Table 1
Screening score attribution and pass/fail criteria.

Each interview lasted between 5 and 15 minutes. At the end of the screening process, each participant was informed of his/her final score, which was the sum of the scores obtained for each question.

All children who underwent the screening test were referred to a specific speech-language assessment in the school-clinic of the undergraduate speech therapy program of the School of Medicine at the University of São Paulo (FMUSP).

The speech-language assessment was performed using the ABFW test (2626. Andrade CRF, Befi-Lopes DM, Fernandes FDM, Wertzner HF. Teste de Language Infantil nas Áreas de Fonologia, Vocabulário, Fluência e Pragmática. 2nd ed. Barueri: Pró-Fono, 2011.). The ABFW test allows the tester to obtain quantitative data and compare them with reference values for typical speech and language development in Brazilian Portuguese-speaking children, considering four specific subareas: phonology, vocabulary, fluency, and pragmatics. The phonology area is composed of a qualitative and quantitative assessment of the child's phonetic inventory and the classification of phonological processes, when identified (14 types). The vocabulary area consists of quantitative and qualitative assessment of nine conceptual fields related to expressive vocabulary: food, transport, furniture and utensils, professions, places, shapes and colors, toys, and musical instruments. The fluency area is composed of qualitative and quantitative evaluation of three areas: typology of speech disruption, speech velocity, and frequency of speech disruption. Finally, the area of pragmatics is composed of qualitative and quantitative assessment of functional communication skills in three areas: number of communicative acts, means, and functions. It is a test that aims to draw an overall profile of the areas it covers and support the diagnosis of speech and language disorders. The average time required for the ABFW test is 90 minutes, and the time for complete data analysis is usually 6 hours.

A standardized test validated for use in Brazilian Portuguese-speaking children does not exist, and the ABFW test (2626. Andrade CRF, Befi-Lopes DM, Fernandes FDM, Wertzner HF. Teste de Language Infantil nas Áreas de Fonologia, Vocabulário, Fluência e Pragmática. 2nd ed. Barueri: Pró-Fono, 2011.) is currently the most reliable test since it provides a reference range that serves as a basis for comparison with “normality.”

The data were recorded using individual protocols and on video and analyzed by two speech-language pathologists (SLPs) specializing in speech-language assessment. They received specific training in analyzing the results of the ABFW test. The SLPs were blinded to the study objectives. Data analysis was completed in 2 months after screening and within a maximum of 2 weeks after the language assessment. Children who presented altered parameters for at least one of the four areas covered by the ABFW test were considered as to present with language development disorders.

Children who failed the screening test, independently of the results in the language assessment, also underwent a comprehensive audiological evaluation using audiometry and immitanciometry. Children who had a hearing threshold of up to 15 dB HL for all tested frequencies (250 to 8000 Hz), type A tympanogram curve, and showed acoustic reflex were considered to have normal hearing (66. Samelli AG, Rabelo CM, Pereira MB, Portela MN, Sanches SG, Neves-Lobo IF. Comparison of screening methods for conductive hearing loss identification in children: low-cost proposal. J Med Screen. 2012;19(1):1-7. https://doi.org/10.1258/jms.2012.011051.
https://doi.org/10.1258/jms.2012.011051...
). Children who failed in at least one of the two audiological tests were referred to an otolaryngological assessment. The parent/guardian was responsible for accepting the referral.

Data on the age and sex composition of the sample were analyzed using Student’s t-test, at a significance level of 5%.

The specificity and sensitivity of the instrument were determined based on the relationship between the answers obtained by the screening instrument and the results of the specific speech-language assessment (gold standard criteria).

In accordance with the definitions proposed by Agresti (2727. Agresti, A. Categorical data analysis (second ed.). New York, NY: John Wiley & Sons. 2002., doi: https://doi.org/10.1002/0471249688.
https://doi.org/10.1002/0471249688...
), sensitivity was defined as the likelihood of a given participant “failing” the screening test, where the child exhibited “delayed development” based on both the ASHA instrument criteria (at least 50% negative answers in the language production and understanding dimensions) and results of the comprehensive speech-language assessment; specificity was defined as the likelihood of a given participant “passing” the screening test, where the child was considered to exhibit “normal” development based on both the instrument criteria (at least 50% positive answers in the language production and understanding dimensions) and results of comprehensive speech-language assessment.

The positive predictive value (PPV) was based on the ratio between the number of true positives (TP) and the sum of TP and false positives (FP), where PPV=TP/TP+FP. The negative predictive value (NPV) was calculated based on the ratio between the number of true negatives (TN) and the sum of TP and false negatives (FN), where NPV=TN/TN+FN.

Accuracy (A) was calculated based on the ratio between the sum of VP and VN and the total number of cases analyzed in the study (N), where A=TP+TN/N. The area under the receiver operating characteristic (ROC) curve was also calculated.

The likelihood ratio for positive test results (PLR) was calculated based on the ratio between sensitivity (S) and one minus specificity (E), where PLR=S/1-E, while the likelihood ratio for negative test results (NLR) was calculated based on the ratio between one minus sensitivity and specificity, where NLR=1-S/E.

For the analysis of sociodemographic factors of children who failed the language assessment (gold standard, N=120), the criteria established by the Associação Brasileira de Empresas de Pesquisa (2828. ABEP. Associação Brasileira de Empresas de Pesquisa. 2009. Available from: http://www.abep.org/criterio-brasil
http://www.abep.org/criterio-brasil...
) were used. These criteria enable the classification of the families into economic classes considering the existence/absence and number of household items, such as television, radio, bathroom, automobile, domestic servant, washing machine, VCR or DVD player, refrigerator, and freezer, and family income. The corresponding family income established for each economic class was as follows: A1 (US$4991.00), A2 (US$3606.00), B1 (US$2066.00), B2 (US$1154.00), C1 (US$639.00), C2 (US$418.00), D (US$295.00) and E (US$180.00).

RESULTS

The study included 1000 children: 516 boys (51.6%) and 484 girls (48.82%). Table 2 shows the composition of the sample according to age and sex.

Table 2
Composition of the sample according to age and sex.

The 4-5-year age group had a larger number of participants than the other groups. This difference was statistically significant (n=218; p<0.009).

The reliability of the screening tool is explained in Table 3, which indicated optimal agreement between the test and retest.

Table 3
Reliability analysis of the screening tool.

The results of the screening process and referrals are presented in Figure 1. It is important to highlight that all the children were referred to a specific language assessment at a SLHS Clinic at a major university, but the majority of the children who passed the screening did not turn up (probably because the parents had no complaints). Therefore, the speech-language pathologist went to the childreńs schools to assess them. The time-interval between the screening and assessment was 1 month. These results are presented in Figure 1.

Figure 1
Results of the screening process and referrals.
Figure 2
ROC curve.

The relationship between the children who failed or passed the screening and those who failed or passed the language assessment (contingency) is presented in Table 4.

Table 4
Contingency table (N=962).

Table 5
Screening test: sensitivity, specificity, positive predictive value, negative predictive value, accuracy, and prevalence.

The sensitivity and specificity values, predictive value, and AUC (0.907 [0.887-0.925]) value may be considered high and satisfactory (2929. Hilgers RA. Distribution-free confidence bounds for ROC curves. Methods Inf Med. 1991;30(2):96-101. https://doi.org/10.1055/s-0038-1634822.
https://doi.org/10.1055/s-0038-1634822...

30. Martinez EZ, Lozada-Neto F, Pereira BB. A curva ROC para testes diagnósticos. Cad Saude Colet. 2003;11(1):7-31.
-3131. Cerda J, Cifuentes L. [Using ROC curves in clinical investigation: theoretical and practical issues]. Rev Chilena Infectol. 2012;29(2):138-41. https://doi.org/10.4067/S0716-10182012000200003.
https://doi.org/10.4067/S0716-1018201200...
) (Figure 2).

The PLR and NLR were 77 and 0.18, respectively. The fact that the PLR value was greater than 1 and the NLR value was very close to 0 indicates a high likelihood of the instrument identifying true positives and negatives (Table 5).

Using the same screening tool in a population with high disease prevalence increases its positive predictive value. Conversely, increased prevalence results in a decreased NPV. Figure 3 depicts the relationship between disease prevalence and predictive value.

Figure 3
Plot versus prevalence.

All participants who underwent an audiological evaluation presented a hearing threshold that fell within normal limits (as per criteria described in the methods section).

The sociodemographic characterization of the 120 children who failed the language assessment is presented in Table 6; 69% of the children were male.

Table 6
Sociodemographic characterization of children who failed the language assessment (gold standard criteria) (n=120).

DISCUSSION

The screening instrument tested in this study showed high sensitivity (82.5%) and specificity (98,93%) and high AUC (0.90) for detecting the risk of language delay in children aged between 0 and 5 years. An international validation study on a widely used language-screening protocol for children aged between 18 and 24 months showed that the test sensitivity ranged between 24% and 52% (acceptable) and that the specificity ranged between 97% and 98% (high) (1717. de Koning HJ, de Ridder-Sluiter JG, van Agt HM, Reep-van den Bergh CM, van der Stege HA, Korfage IJ, et al. A cluster-randomised trial of screening for language disorders in toddlers. J Med Screen. 2004;11(3):109-16. https://doi.org/10.1258/0969141041732229.
https://doi.org/10.1258/0969141041732229...
). Another study comparing five different screening instruments for language delay showed that the sensitivity of the tests ranged between 42% and 86% with AUC values between 0.75 and 0.87. The findings also show that shorter tests had higher sensitivity and accuracy (99. van Agt HM, van der Stege HA, de Ridder-Sluiter H, Verhoeven LT, de Koning HJ. A cluster-randomized trial of screening for language delay in toddlers: effects on school performance and language development at age 8. Pediatrics. 2007;120(6):1317-25. https://doi.org/10.1542/peds.2006-3145.
https://doi.org/10.1542/peds.2006-3145...
). Therefore, the short time needed for the screening test evaluated in the present study may have directly influenced the sensitivity and specificity values, demonstrating the accuracy and efficiency of this instrument in detecting the risk of language delay in the population under consideration.

The sample comprised more male children than female children. This difference was statistically significant in the 1-2-years age group. The 2-3-years age group was the only group where there were more girls than boys. This difference was statistically significant. The results also show that more boys failed the test than girls. This difference was statistically significant, corroborating the findings of previous studies where the prevalence of the risk of communication disorders was found to be greater among boys than among girls (44. de Andrade CR. [Speech-language idiopathic disorder prevalence in children from one to eleven years of age]. Rev Saude Publica. 1997;31(5):495-501. https://doi.org/10.1590/S0034-89101997000600008.
https://doi.org/10.1590/S0034-8910199700...
,55. McLeod S, McKinnon DH. Prevalence of communication disorders compared with other learning needs in 14,500 primary and secondary school students. Int J Lang Commun Disord. 2007;42 Suppl 1:37-59. https://doi.org/10.1080/13682820601173262.
https://doi.org/10.1080/1368282060117326...
,1010. Prates LP, Martins VO. Distúrbios da fala e da linguagem na infância. Revista Médica de Minas Gerais. 2011;21(4 Supl 1):S54-S60.,1515. Silva GM, Couto MI, Molini-Avejonas DR. Risk factors identification in children with speech disorders: pilot study. Codas. 2013;25(5):456-62. https://doi.org/10.1590/S2317-17822013000500010.
https://doi.org/10.1590/S2317-1782201300...
,3232. Law J, Boyle J, Harris F, Harkness A, Nye C. Prevalence and natural history of primary speech and language delay: findings from a systematic review of the literature. Int J Lang Commun Disord. 2000;35(2):165-88. https://doi.org/10.1080/136828200247133.
https://doi.org/10.1080/136828200247133...
).

The 4-5-years age group had a larger number of participants than the other groups. This difference was shown to be statistically significant. International studies have reported that the prevalence of language delay and/or language disorders among children aged between 2 and 5 years ranges between 2.4% and 12% (1717. de Koning HJ, de Ridder-Sluiter JG, van Agt HM, Reep-van den Bergh CM, van der Stege HA, Korfage IJ, et al. A cluster-randomised trial of screening for language disorders in toddlers. J Med Screen. 2004;11(3):109-16. https://doi.org/10.1258/0969141041732229.
https://doi.org/10.1258/0969141041732229...
,3333. Pinborough-Zimmerman J, Satterfield R, Miller J, Bilder D, Hossain S, McMahon W. Communication disorders: prevalence and comorbid intellectual disability, autism, and emotional/behavioral disorders. Am J Speech Lang Pathol. 2007;16(4):359-67. https://doi.org/10.1044/1058-0360(2007/039).
https://doi.org/10.1044/1058-0360(2007/0...
). Another international study showed that the prevalence of speech and language delay in children aged 8 years was 5.9% (3333. Pinborough-Zimmerman J, Satterfield R, Miller J, Bilder D, Hossain S, McMahon W. Communication disorders: prevalence and comorbid intellectual disability, autism, and emotional/behavioral disorders. Am J Speech Lang Pathol. 2007;16(4):359-67. https://doi.org/10.1044/1058-0360(2007/039).
https://doi.org/10.1044/1058-0360(2007/0...
). National studies have shown that the prevalence of communication disorders is high in the 3-8-years age group and that the most critical age is between 4 and 6 years (44. de Andrade CR. [Speech-language idiopathic disorder prevalence in children from one to eleven years of age]. Rev Saude Publica. 1997;31(5):495-501. https://doi.org/10.1590/S0034-89101997000600008.
https://doi.org/10.1590/S0034-8910199700...
,88. Garcia de Goulart BN, Chiari BM. [Prevalence of speech disorders in schoolchildren and its associated factors]. Rev Saude Publica. 2007;41(5):726-31. https://doi.org/10.1590/S0034-89102007000500006.
https://doi.org/10.1590/S0034-8910200700...
,1010. Prates LP, Martins VO. Distúrbios da fala e da linguagem na infância. Revista Médica de Minas Gerais. 2011;21(4 Supl 1):S54-S60.).

A comparison of the results of the present study with the findings of previous studies suggests that the predominance of participants aged between 4 and 5 years in the sample may reflect difficulties in the early detection of problems in children at risk of or children with language delay in the region in which the study was undertaken. Hence, there is an urgent need to evaluate suitable screening instruments and promote the wider use of validated tests from the early stages of child development to minimize the risks of language delay (1717. de Koning HJ, de Ridder-Sluiter JG, van Agt HM, Reep-van den Bergh CM, van der Stege HA, Korfage IJ, et al. A cluster-randomised trial of screening for language disorders in toddlers. J Med Screen. 2004;11(3):109-16. https://doi.org/10.1258/0969141041732229.
https://doi.org/10.1258/0969141041732229...
,2222. Wallace IF, Berkman ND, Watson LR, Coyne-Beasley T, Wood CT, Cullen K, et al. Screening for Speech and Language Delay in Children 5 Years Old and Younger: A Systematic Review. Pediatrics. 2015;136(2):e448-62. https://doi.org/10.1542/peds.2014-3889.
https://doi.org/10.1542/peds.2014-3889...
).

We found an estimated prevalence rate of language delay/disorder of 11% in the screening and a true prevalence rate of 12.5% by the gold criteria. The median prevalence of receptive language delay/disorder ranged from 2.63% to 3.59%, that of expressive language delay/disorder ranged from 2.81% to 16%, and that of combined receptive and expressive language delay/disorder ranged from 2.02% to 3.01% (3232. Law J, Boyle J, Harris F, Harkness A, Nye C. Prevalence and natural history of primary speech and language delay: findings from a systematic review of the literature. Int J Lang Commun Disord. 2000;35(2):165-88. https://doi.org/10.1080/136828200247133.
https://doi.org/10.1080/136828200247133...
,3434. Shriberg LD, Tomblin JB, McSweeny JL. Prevalence of speech delay in 6-year-old children and comorbidity with language impairment. J Speech Lang Hear Res. 1999;42(6):1461-81. https://doi.org/10.1044/jslhr.4206.1461.
https://doi.org/10.1044/jslhr.4206.1461...
). According to the ASHA (1111. American Speech-Language-Hearing Association. Speech-Language Pathology Medical Review Guidelines. Rockville, MD: American Speech-Language-Hearing Association. 2011. Available from: http://www. asha.org/practice/reimbursement/SLPmedical-review-guidelines/. [Accessed October 11th, 2017].
http://www. asha.org/practice/reimbursem...
), 10% of children have some form of language disorder. In Brazil, a recent study identified approximately 10% of complaints related to speech-language and hearing disorders in a population living in a low-income region of the city of São Paulo that was treated in primary health care units (3535. Samelli AG, Rondon-Melo S, Rabelo CM, Molini-Avejonas DR. Association between language and hearing disorders - risk identification. Clinics. 2017;72(4):213-7. https://doi.org/10.6061/clinics/2017(04)04.
https://doi.org/10.6061/clinics/2017(04)...
). Another study conducted a survey with parents/guardians of 525 children in primary health care units and identified that oral language disorders had a prevalence of 15% in children (3636. Longo IA, Tupinelli GG, Hermógenes C, Ferreira LV, Molini-Avejonas DR. Prevalence of speech and language disorders in children in the western region of São Paulo. Codas. 2017;29(6):e20160036. https://doi.org/10.1590/2317-1782/20172016036.
https://doi.org/10.1590/2317-1782/201720...
). The results of a recent British study identified that language disorders had an estimated prevalence of 9.92% in children aged 4-5 years (3737. Norbury CF, Gooch D, Wray C, Baird G, Charman T, Simonoff E, et al. The impact of nonverbal ability on prevalence and clinical presentation of language disorder: evidence from a population study. J Child Psychol Psychiatry. 2016;57(11):1247-57. https://doi.org/10.1111/jcpp.12573.
https://doi.org/10.1111/jcpp.12573...
).

Of note, the reasons for this variability in the prevalence of speech and language disorders include the definition of what constitutes a case, the severity and type of communication disorder that is included in the definition, the nature of the surveyed population, and differences in methodological procedures (3333. Pinborough-Zimmerman J, Satterfield R, Miller J, Bilder D, Hossain S, McMahon W. Communication disorders: prevalence and comorbid intellectual disability, autism, and emotional/behavioral disorders. Am J Speech Lang Pathol. 2007;16(4):359-67. https://doi.org/10.1044/1058-0360(2007/039).
https://doi.org/10.1044/1058-0360(2007/0...
,3838. Nelson HD, Nygren P, Walker M, Panoscha R. Screening for speech and language delay in preschool children: systematic evidence review for the US Preventive Services Task Force. Pediatrics. 2006;117(2):e298-319. https://doi.org/10.1542/peds.2005-1467.
https://doi.org/10.1542/peds.2005-1467...
,3939. Harrison LJ, McLeod S. Risk and protective factors associated with speech and language impairment in a nationally representative sample of 4- to 5-year-old children. J Speech Lang Hear Res. 2010;53(2):508-29. https://doi.org/10.1044/1092-4388(2009/08-0086).
https://doi.org/10.1044/1092-4388(2009/0...
).

Studies suggest that questionnaires offer an effective, rapid, and low-cost method for determining the prevalence of a given disorder in large groups (11. Samelli AG, Rondon S, Oliver FC, Junqueira SR, Molini-Avejonas DR. Referred speech-language and hearing complaints in the western region of São Paulo, Brazil. Clinics. 2014;69(6):413-9. https://doi.org/10.6061/clinics/2014(06)08.
https://doi.org/10.6061/clinics/2014(06)...
,4040. Lima-Costa MF, Peixoto SV, Firmo JO, Uchoa E. [Validity of self-reported diabetes and its determinants: evidences from the Bambuí study]. Rev Saude Publica. 2007;41(6):947-53. https://doi.org/10.1590/S0034-89102007000600009.
https://doi.org/10.1590/S0034-8910200700...

41. Olsson A, Hasselgren M, Hagquist C, Janson S. The association between medical conditions and gender, well-being, psychosomatic complaints as well as school adaptability. Acta Paediatr. 2013;102(5):550-5. https://doi.org/10.1111/apa.12174.
https://doi.org/10.1111/apa.12174...
-4242. Buckley R, Saling MM, Ames D, Rowe CC, Lautenschlager NT, Macaulay SL, et al. Factors affecting subjective memory complaints in the AIBL aging study: biomarkers, memory, affect, and age. Int Psychogeriatr. 2013;25(8):1307-15. https://doi.org/10.1017/S1041610213000665.
https://doi.org/10.1017/S104161021300066...
). The use of low-cost screening methods like the one proposed in this study can lower the demand for unnecessary procedures, thus reducing health care costs and improving the efficiency and effectiveness of service delivery (66. Samelli AG, Rabelo CM, Pereira MB, Portela MN, Sanches SG, Neves-Lobo IF. Comparison of screening methods for conductive hearing loss identification in children: low-cost proposal. J Med Screen. 2012;19(1):1-7. https://doi.org/10.1258/jms.2012.011051.
https://doi.org/10.1258/jms.2012.011051...
). In Brazil, there is no low-cost protocol for identification of the risk of language disorders similar to the one presented in this study. The current protocol is easy to apply and has high sensitivity and specificity; it can also be applied by professionals who work in primary health care settings, such as community health agents, and not just specialists. All these advantages of the instrument enable its application to large populations (3535. Samelli AG, Rondon-Melo S, Rabelo CM, Molini-Avejonas DR. Association between language and hearing disorders - risk identification. Clinics. 2017;72(4):213-7. https://doi.org/10.6061/clinics/2017(04)04.
https://doi.org/10.6061/clinics/2017(04)...

36. Longo IA, Tupinelli GG, Hermógenes C, Ferreira LV, Molini-Avejonas DR. Prevalence of speech and language disorders in children in the western region of São Paulo. Codas. 2017;29(6):e20160036. https://doi.org/10.1590/2317-1782/20172016036.
https://doi.org/10.1590/2317-1782/201720...

37. Norbury CF, Gooch D, Wray C, Baird G, Charman T, Simonoff E, et al. The impact of nonverbal ability on prevalence and clinical presentation of language disorder: evidence from a population study. J Child Psychol Psychiatry. 2016;57(11):1247-57. https://doi.org/10.1111/jcpp.12573.
https://doi.org/10.1111/jcpp.12573...

38. Nelson HD, Nygren P, Walker M, Panoscha R. Screening for speech and language delay in preschool children: systematic evidence review for the US Preventive Services Task Force. Pediatrics. 2006;117(2):e298-319. https://doi.org/10.1542/peds.2005-1467.
https://doi.org/10.1542/peds.2005-1467...

39. Harrison LJ, McLeod S. Risk and protective factors associated with speech and language impairment in a nationally representative sample of 4- to 5-year-old children. J Speech Lang Hear Res. 2010;53(2):508-29. https://doi.org/10.1044/1092-4388(2009/08-0086).
https://doi.org/10.1044/1092-4388(2009/0...
-4040. Lima-Costa MF, Peixoto SV, Firmo JO, Uchoa E. [Validity of self-reported diabetes and its determinants: evidences from the Bambuí study]. Rev Saude Publica. 2007;41(6):947-53. https://doi.org/10.1590/S0034-89102007000600009.
https://doi.org/10.1590/S0034-8910200700...
).

The adherence rate among individuals referred for comprehensive assessment was high, particularly among children who failed the screening test, thus contributing to high levels of sensitivity and specificity. One of the factors that may have contributed to the loss of participants in this stage of the study was the distance between the medical center and the patient's home and the resulting cost and traveling time required to undertake the assessment, which has been shown to affect adherence to follow-up health care (66. Samelli AG, Rabelo CM, Pereira MB, Portela MN, Sanches SG, Neves-Lobo IF. Comparison of screening methods for conductive hearing loss identification in children: low-cost proposal. J Med Screen. 2012;19(1):1-7. https://doi.org/10.1258/jms.2012.011051.
https://doi.org/10.1258/jms.2012.011051...
,4343. Manfredi AKS, Santos CB. Intervenção Fonoaudiológica junto ès mães ou responsáveis por Recém-Nascidos de Risco para Deficiência Auditiva, precocemente detectada. Medicina. 2002;35:70-7. https://doi.org/10.11606/issn.2176-7262.v35i1p70-77.
https://doi.org/10.11606/issn.2176-7262....
). We solved this issue by assessing the children in their schools.

Another limitation of this study is that the speech and language assessment used in this study was not a national or international gold standard protocol. However, a gold standard protocol for detecting speech and language disorders in Brazilian Portuguese speaking children does not exist. The lack of a gold standard protocol for this type of evaluation is a limiting factor in the development of effective screening tools for the detection of language delay in children (77. Siu AL; US Preventive Services Task Force. Screening for Speech and Language Delay and Disorders in Children Aged 5 Years or Younger: US Preventive Services Task Force Recommendation Statement. Pediatrics. 2015;136(2):e474-81. https://doi.org/10.1542/peds.2015-1711.
https://doi.org/10.1542/peds.2015-1711...
,1717. de Koning HJ, de Ridder-Sluiter JG, van Agt HM, Reep-van den Bergh CM, van der Stege HA, Korfage IJ, et al. A cluster-randomised trial of screening for language disorders in toddlers. J Med Screen. 2004;11(3):109-16. https://doi.org/10.1258/0969141041732229.
https://doi.org/10.1258/0969141041732229...
). The variable nature of language development in the first years of a child’s life and of child development as a whole means that it is difficult to develop a standardized definition of normality and delay, which ultimately results in the establishment of evaluation criteria by consensus (99. van Agt HM, van der Stege HA, de Ridder-Sluiter H, Verhoeven LT, de Koning HJ. A cluster-randomized trial of screening for language delay in toddlers: effects on school performance and language development at age 8. Pediatrics. 2007;120(6):1317-25. https://doi.org/10.1542/peds.2006-3145.
https://doi.org/10.1542/peds.2006-3145...
,1717. de Koning HJ, de Ridder-Sluiter JG, van Agt HM, Reep-van den Bergh CM, van der Stege HA, Korfage IJ, et al. A cluster-randomised trial of screening for language disorders in toddlers. J Med Screen. 2004;11(3):109-16. https://doi.org/10.1258/0969141041732229.
https://doi.org/10.1258/0969141041732229...
,2222. Wallace IF, Berkman ND, Watson LR, Coyne-Beasley T, Wood CT, Cullen K, et al. Screening for Speech and Language Delay in Children 5 Years Old and Younger: A Systematic Review. Pediatrics. 2015;136(2):e448-62. https://doi.org/10.1542/peds.2014-3889.
https://doi.org/10.1542/peds.2014-3889...
). The present study proposes a rapid, low-cost screening test for the detection of language delay in Brazilian Portuguese-speaking children aged between 0 and 5 years, which was shown to have high sensitivity and specificity. Further research is recommended to confirm and generalize the results by testing the screening instrument in other regions of Brazil and adapting it for use with children who speak other languages and with children from different socioeconomic backgrounds, as suggested by previous studies. In addition, it is important to determine the sensitivity and specificity of the screening test for detecting different degrees of speech and language disorders based on the results of speech and language assessment and for early detection of risk and/or delay during the language development process (1717. de Koning HJ, de Ridder-Sluiter JG, van Agt HM, Reep-van den Bergh CM, van der Stege HA, Korfage IJ, et al. A cluster-randomised trial of screening for language disorders in toddlers. J Med Screen. 2004;11(3):109-16. https://doi.org/10.1258/0969141041732229.
https://doi.org/10.1258/0969141041732229...
,2222. Wallace IF, Berkman ND, Watson LR, Coyne-Beasley T, Wood CT, Cullen K, et al. Screening for Speech and Language Delay in Children 5 Years Old and Younger: A Systematic Review. Pediatrics. 2015;136(2):e448-62. https://doi.org/10.1542/peds.2014-3889.
https://doi.org/10.1542/peds.2014-3889...
).

CONCLUSION

Our findings show that the screening test proposed in this study has high sensitivity (82,5%) and specificity (98,93%) for detecting the risk of language delay in children aged between 0 and 5 years. The true prevalence was 12.47%. The screening test is an easy-to-use, rapid, low-cost method for screening large numbers of children in primary health care settings.

Further research with larger samples consisting of children from different regions of Brazil and involving the adaptation of the instrument for use in children who speak other languages is recommended to determine the level of sensitivity and specificity of the instrument and generalizability of the results.

ACKNOWLEDGMENTS

The research received financial support from Fundação de Amparo è Pesquisa do Estado de São Paulo - FAPESP (process number: 2010/12073-4), a state foundation for research support.

REFERENCES

  • 1
    Samelli AG, Rondon S, Oliver FC, Junqueira SR, Molini-Avejonas DR. Referred speech-language and hearing complaints in the western region of São Paulo, Brazil. Clinics. 2014;69(6):413-9. https://doi.org/10.6061/clinics/2014(06)08
    » https://doi.org/10.6061/clinics/2014(06)08
  • 2
    Antoniadis A, Lubker BB. Epidemiology as an essential tool for establishing prevention problems and evaluating their impact and outcome. J Commun Disord. 1997;30(4):269-83. https://doi.org/10.1016/S0021-9924(97)00003-8
    » https://doi.org/10.1016/S0021-9924(97)00003-8
  • 3
    Lessa F, Cavalheiro MTP, Ferrite S. Fonoaudiologia e epidemiologia. In: Fernandes FDM, Mendes BCA, Navas ALPGP. Tratado de Fonoaudiologia. 2nd ed. São Paulo: Rocca, 2009:34-44.
  • 4
    de Andrade CR. [Speech-language idiopathic disorder prevalence in children from one to eleven years of age]. Rev Saude Publica. 1997;31(5):495-501. https://doi.org/10.1590/S0034-89101997000600008
    » https://doi.org/10.1590/S0034-89101997000600008
  • 5
    McLeod S, McKinnon DH. Prevalence of communication disorders compared with other learning needs in 14,500 primary and secondary school students. Int J Lang Commun Disord. 2007;42 Suppl 1:37-59. https://doi.org/10.1080/13682820601173262
    » https://doi.org/10.1080/13682820601173262
  • 6
    Samelli AG, Rabelo CM, Pereira MB, Portela MN, Sanches SG, Neves-Lobo IF. Comparison of screening methods for conductive hearing loss identification in children: low-cost proposal. J Med Screen. 2012;19(1):1-7. https://doi.org/10.1258/jms.2012.011051
    » https://doi.org/10.1258/jms.2012.011051
  • 7
    Siu AL; US Preventive Services Task Force. Screening for Speech and Language Delay and Disorders in Children Aged 5 Years or Younger: US Preventive Services Task Force Recommendation Statement. Pediatrics. 2015;136(2):e474-81. https://doi.org/10.1542/peds.2015-1711
    » https://doi.org/10.1542/peds.2015-1711
  • 8
    Garcia de Goulart BN, Chiari BM. [Prevalence of speech disorders in schoolchildren and its associated factors]. Rev Saude Publica. 2007;41(5):726-31. https://doi.org/10.1590/S0034-89102007000500006
    » https://doi.org/10.1590/S0034-89102007000500006
  • 9
    van Agt HM, van der Stege HA, de Ridder-Sluiter H, Verhoeven LT, de Koning HJ. A cluster-randomized trial of screening for language delay in toddlers: effects on school performance and language development at age 8. Pediatrics. 2007;120(6):1317-25. https://doi.org/10.1542/peds.2006-3145
    » https://doi.org/10.1542/peds.2006-3145
  • 10
    Prates LP, Martins VO. Distúrbios da fala e da linguagem na infância. Revista Médica de Minas Gerais. 2011;21(4 Supl 1):S54-S60.
  • 11
    American Speech-Language-Hearing Association. Speech-Language Pathology Medical Review Guidelines. Rockville, MD: American Speech-Language-Hearing Association. 2011. Available from: http://www. asha.org/practice/reimbursement/SLPmedical-review-guidelines/ [Accessed October 11th, 2017].
    » http://www. asha.org/practice/reimbursement/SLPmedical-review-guidelines/
  • 12
    Catts HW, Fey ME, Tomblin JB, Zhang X. A longitudinal investigation of reading outcomes in children with language impairments. J Speech Lang Hear Res. 2002;45(6):1142-57. https://doi.org/10.1044/1092-4388(2002/093)
    » https://doi.org/10.1044/1092-4388(2002/093)
  • 13
    Peterson RL, Pennington BF, Shriberg LD, Boada R. What influences literacy outcome in children with speech sound disorder? J Speech Lang Hear Res. 2009;52(5):1175-88. https://doi.org/10.1044/1092-4388(2009/08-0024)
    » https://doi.org/10.1044/1092-4388(2009/08-0024)
  • 14
    Kasper J, Kreis J, Scheibler F, Möller D, Skipka G, Lange S, et al. Population-based screening of children for specific speech and language impairment in Germany: a systematic review. Folia Phoniatr Logop. 2011;63(5):247-63. https://doi.org/10.1159/000321000
    » https://doi.org/10.1159/000321000
  • 15
    Silva GM, Couto MI, Molini-Avejonas DR. Risk factors identification in children with speech disorders: pilot study. Codas. 2013;25(5):456-62. https://doi.org/10.1590/S2317-17822013000500010
    » https://doi.org/10.1590/S2317-17822013000500010
  • 16
    Fox AV, Dodd B, Howard D. Risk factors for speech disorders in children. Int J Lang Commun Disord. 2002;37(2):117-31. https://doi.org/10.1080/13682820110116776
    » https://doi.org/10.1080/13682820110116776
  • 17
    de Koning HJ, de Ridder-Sluiter JG, van Agt HM, Reep-van den Bergh CM, van der Stege HA, Korfage IJ, et al. A cluster-randomised trial of screening for language disorders in toddlers. J Med Screen. 2004;11(3):109-16. https://doi.org/10.1258/0969141041732229
    » https://doi.org/10.1258/0969141041732229
  • 18
    Sim F, Thompson L, Marryat L, Ramparsad N, Wilson P. Predictive validity of preschool screening tools for language and behavioural difficulties: A PRISMA systematic review. PLoS One. 2019;14(2):e0211409. https://doi.org/10.1371/journal.pone.0211409
    » https://doi.org/10.1371/journal.pone.0211409
  • 19
    Goulart BN, Martins-Reis VO, Chiari BM. Household survey on self-declared communication disorders: study design and protocol. Audiol Commun Res. 2015;20(4):336-48. https://doi.org/10.1590/2317-6431-2015-1586
    » https://doi.org/10.1590/2317-6431-2015-1586
  • 20
    Rescorla L, Alley A. Validation of the language development survey (LDS): a parent report tool for identifying language delay in toddlers. J Speech Lang Hear Res. 2001;44(2):434-45. https://doi.org/10.1044/1092-4388(2001/035)
    » https://doi.org/10.1044/1092-4388(2001/035)
  • 21
    Squires J, Bricker D. Ages & Stages Questionnaires®, Third Edition (ASQ- 3™). A parent-completed child-monitoring system. Baltimore: Paul H Brookes; 2009.
  • 22
    Wallace IF, Berkman ND, Watson LR, Coyne-Beasley T, Wood CT, Cullen K, et al. Screening for Speech and Language Delay in Children 5 Years Old and Younger: A Systematic Review. Pediatrics. 2015;136(2):e448-62. https://doi.org/10.1542/peds.2014-3889
    » https://doi.org/10.1542/peds.2014-3889
  • 23
    Warren R, Kenny M, Bennett T, Fitzpatrick-Lewis D, Ali MU, Sherifali D, et al. Screening for developmental delay among children aged 1-4 years: a systematic review. CMAJ Open. 2016;4(1):E20-7. https://doi.org/10.9778/cmajo.20140121
    » https://doi.org/10.9778/cmajo.20140121
  • 24
    American Speech-Language and Hearing Association (ASHA). “How does your child hear and talk?” 2006. Available from: http://www.asha.org/public/speech/development/chart/ Accessed: October 11th, 2017.
    » http://www.asha.org/public/speech/development/chart/
  • 25
    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186-91. https://doi.org/10.1097/00007632-200012150-00014
    » https://doi.org/10.1097/00007632-200012150-00014
  • 26
    Andrade CRF, Befi-Lopes DM, Fernandes FDM, Wertzner HF. Teste de Language Infantil nas Áreas de Fonologia, Vocabulário, Fluência e Pragmática. 2nd ed. Barueri: Pró-Fono, 2011.
  • 27
    Agresti, A. Categorical data analysis (second ed.). New York, NY: John Wiley & Sons. 2002., doi: https://doi.org/10.1002/0471249688
    » https://doi.org/10.1002/0471249688
  • 28
    ABEP. Associação Brasileira de Empresas de Pesquisa. 2009. Available from: http://www.abep.org/criterio-brasil
    » http://www.abep.org/criterio-brasil
  • 29
    Hilgers RA. Distribution-free confidence bounds for ROC curves. Methods Inf Med. 1991;30(2):96-101. https://doi.org/10.1055/s-0038-1634822
    » https://doi.org/10.1055/s-0038-1634822
  • 30
    Martinez EZ, Lozada-Neto F, Pereira BB. A curva ROC para testes diagnósticos. Cad Saude Colet. 2003;11(1):7-31.
  • 31
    Cerda J, Cifuentes L. [Using ROC curves in clinical investigation: theoretical and practical issues]. Rev Chilena Infectol. 2012;29(2):138-41. https://doi.org/10.4067/S0716-10182012000200003
    » https://doi.org/10.4067/S0716-10182012000200003
  • 32
    Law J, Boyle J, Harris F, Harkness A, Nye C. Prevalence and natural history of primary speech and language delay: findings from a systematic review of the literature. Int J Lang Commun Disord. 2000;35(2):165-88. https://doi.org/10.1080/136828200247133
    » https://doi.org/10.1080/136828200247133
  • 33
    Pinborough-Zimmerman J, Satterfield R, Miller J, Bilder D, Hossain S, McMahon W. Communication disorders: prevalence and comorbid intellectual disability, autism, and emotional/behavioral disorders. Am J Speech Lang Pathol. 2007;16(4):359-67. https://doi.org/10.1044/1058-0360(2007/039)
    » https://doi.org/10.1044/1058-0360(2007/039)
  • 34
    Shriberg LD, Tomblin JB, McSweeny JL. Prevalence of speech delay in 6-year-old children and comorbidity with language impairment. J Speech Lang Hear Res. 1999;42(6):1461-81. https://doi.org/10.1044/jslhr.4206.1461
    » https://doi.org/10.1044/jslhr.4206.1461
  • 35
    Samelli AG, Rondon-Melo S, Rabelo CM, Molini-Avejonas DR. Association between language and hearing disorders - risk identification. Clinics. 2017;72(4):213-7. https://doi.org/10.6061/clinics/2017(04)04
    » https://doi.org/10.6061/clinics/2017(04)04
  • 36
    Longo IA, Tupinelli GG, Hermógenes C, Ferreira LV, Molini-Avejonas DR. Prevalence of speech and language disorders in children in the western region of São Paulo. Codas. 2017;29(6):e20160036. https://doi.org/10.1590/2317-1782/20172016036
    » https://doi.org/10.1590/2317-1782/20172016036
  • 37
    Norbury CF, Gooch D, Wray C, Baird G, Charman T, Simonoff E, et al. The impact of nonverbal ability on prevalence and clinical presentation of language disorder: evidence from a population study. J Child Psychol Psychiatry. 2016;57(11):1247-57. https://doi.org/10.1111/jcpp.12573
    » https://doi.org/10.1111/jcpp.12573
  • 38
    Nelson HD, Nygren P, Walker M, Panoscha R. Screening for speech and language delay in preschool children: systematic evidence review for the US Preventive Services Task Force. Pediatrics. 2006;117(2):e298-319. https://doi.org/10.1542/peds.2005-1467
    » https://doi.org/10.1542/peds.2005-1467
  • 39
    Harrison LJ, McLeod S. Risk and protective factors associated with speech and language impairment in a nationally representative sample of 4- to 5-year-old children. J Speech Lang Hear Res. 2010;53(2):508-29. https://doi.org/10.1044/1092-4388(2009/08-0086)
    » https://doi.org/10.1044/1092-4388(2009/08-0086)
  • 40
    Lima-Costa MF, Peixoto SV, Firmo JO, Uchoa E. [Validity of self-reported diabetes and its determinants: evidences from the Bambuí study]. Rev Saude Publica. 2007;41(6):947-53. https://doi.org/10.1590/S0034-89102007000600009
    » https://doi.org/10.1590/S0034-89102007000600009
  • 41
    Olsson A, Hasselgren M, Hagquist C, Janson S. The association between medical conditions and gender, well-being, psychosomatic complaints as well as school adaptability. Acta Paediatr. 2013;102(5):550-5. https://doi.org/10.1111/apa.12174
    » https://doi.org/10.1111/apa.12174
  • 42
    Buckley R, Saling MM, Ames D, Rowe CC, Lautenschlager NT, Macaulay SL, et al. Factors affecting subjective memory complaints in the AIBL aging study: biomarkers, memory, affect, and age. Int Psychogeriatr. 2013;25(8):1307-15. https://doi.org/10.1017/S1041610213000665
    » https://doi.org/10.1017/S1041610213000665
  • 43
    Manfredi AKS, Santos CB. Intervenção Fonoaudiológica junto ès mães ou responsáveis por Recém-Nascidos de Risco para Deficiência Auditiva, precocemente detectada. Medicina. 2002;35:70-7. https://doi.org/10.11606/issn.2176-7262.v35i1p70-77
    » https://doi.org/10.11606/issn.2176-7262.v35i1p70-77

APPENDIX

Threshold (to fail the screening) Hearing and understanding (Language reception) Talking (Language expression)
Birth–3 Months
Two or more negative answers in language reception or language expression
• Startles at loud sounds.
• Becomes quiet or smiles when you talk.
• Seems to recognize your voice. Becomes quiet if crying.
• Makes cooing sounds.
• Cries change for different needs.
• Smiles at people.
4–6 Months
Three or more negatives answer in language reception or language expression
• Moves eyes in the direction of sounds.
• Responds to changes in the tone of your voice.
• Notices toys that make sounds.
• Pays attention to music.
• Coos and babbles when playing alone or with you.
• Makes speech-like babbling sounds, like pa, ba, and mi.
• Giggles and laughs.
• Makes sounds when happy or upset.
7 Months–1 Year
Four or more negatives answers in language reception or language expression
• Turns and looks in the direction of sounds.
• Looks when you point.
• Turns when you call her name.
• Understands words for common items and people—words like cup, truck, juice, and daddy.
• Starts to respond to simple words and phrases, like “No,” “Come here,” and “Want more?”
• Plays games with you, like peek-a-boo and pat-a-cake.
• Listens to songs and stories for a short time.
• Babbles long strings of sounds, like mimi upup babababa.
• Uses sounds and gestures to get and keep attention.
• Points to objects and shows them to others.
• Uses gestures like waving bye, reaching for “up,” and shaking their head no.
• Imitates different speech sounds.
• Says 1 or 2 words, like hi, dog, dada, mama, or uh-oh. This will happen around the first birthday, but sounds may not be clear.
1–2 Years
Three or more negative answers in language reception or language expression
• Points to a few body parts when asked.
• Follows one-part directions, like “Roll the ball” or “Kiss the baby.”
• Responds to simple questions, like “Who's that?” or “Where's your shoe?”
• Listens to simple stories, songs, and rhymes.
• Points to pictures in a book when you name them.
• Uses a lot of new words.
• Uses p, b, m, n, t, d, k, g, f, and v in words.
• Starts to name pictures in books.
• Asks questions, like “What's that?”, “Who's that?”, and “Where's kitty?”
• Puts two words together, like “more apple,” “no bed,” and “mommy book.”
2–3 Years
Two or more negative answers in language receptionorFive or more negative answers in language expression
• Understands opposites, like go–stop, big–little, and up–down.
• Follows two-part directions, like “Get the spoon and put it on the table.”
• Understands new words quickly.
• Has a word for almost everything.
• Talks about things that are not in the room.
• Uses s, z, ch, j, l, and nh in words.
• Uses words like in, on, and under.
• Uses two or three words to talk about and ask for things.
• People who know your child can understand him/her.
• Asks “Why?”
• Puts three words together to talk about things. May repeat some words and sounds.
3–4 Years
Three or more negative answers in language receptionorFive or more negatives answers in language expression
• Responds when you call from another room.
• Understands words for some colors, like red, blue, and green.
• Understands words for some shapes, like circle and square.
• Understands words for family, like brother, grandmother, and aunt.
• Answers simple who, what, and where questions.
• Uses lh, r, and rr
• Uses pronouns, like I, you, me, we, and they.
• Uses some plural words, like toys, birds, and buses.
• Most people understand what your child says.
• Asks when and how questions.
• Puts four words together. May make some mistakes, like “I goed to school.”
• Talks about what happened during the day. Uses about four sentences at a time
4–5 Years
Three or more negative answers in language receptionorFive or more negative answers in language expression
• Understands words for order, like first, next, and last.
• Understands words for time, like yesterday, today, and tomorrow.
• Follows longer directions, like “Put your pajamas on, brush your teeth, and then pick out a book.”
• Follows classroom directions, like “Draw a circle on your paper around something you eat.”
• Hears and understands most of what is heard at home and in school
• Says all speech sounds in words. May make mistakes on sounds that are harder to say, like l and r in consonant clusters and r and s in final word position.
• Responds to “What did you say?”
• Talks without repeating sounds or words most of the time.
• Names letters and numbers.
• Uses sentences that have more than one action word, like jump, play, and get. May make some mistakes, like “Zach gots 2 video games, but I got one.”
• Tells a short story.
• Keeps a conversation going.
• Talks in different ways, depending on the listener and place. Your child may use short sentences with younger children. He may talk louder outside than inside.

Publication Dates

  • Publication in this collection
    09 Apr 2020
  • Date of issue
    2020

History

  • Received
    30 July 2019
  • Accepted
    18 Dec 2019
Creative Common - by 4.0
This is an Open Access article distributed under the terms of the Creative Commons License (https://creativecommons.org/licenses/by/4.0/) which permits unrestricted use, distribution, and reproduction in any medium or format, provided the original work is properly cited.
Faculdade de Medicina / USP Rua Dr Ovídio Pires de Campos, 225 - 6 and., 05403-010 São Paulo SP - Brazil, Tel.: (55 11) 2661-6235 - São Paulo - SP - Brazil
E-mail: clinics@hc.fm.usp.br