Acessibilidade / Reportar erro

Reading comprehension and receptive vocabulary in Elementary School students with typical development

ABSTRACT

Purpose

Prepare an instrument to evaluate reading comprehension and verify the influence of receptive vocabulary on the reading comprehension of 3rd to 5th-grade Elementary School students with typical development.

Methods

All ethical precepts were accomplished. Study participants were 69 3rd-, 4th- and 5th-grade students (35 girls) with mean ages of 8.2, 9.2, and 10 years, respectively, with typical development in the School Performance Test. Half of the sample underwent the reading comprehension test using the question-and-answer method and the other half took the test using the Cloze technique. All students completed the Teste de Vocabulário por Figuras USP (TVFUSP) with 139 stimuli.

Results

The schoolchildren presented good performance in receptive vocabulary despite their low socioeconomic level. Better performance was observed in explicit questions compared with that in implicit questions. Students demonstrated more homogeneous and similar performance between the school years in the Cloze technique. No conclusive results were found regarding the correlation between receptive vocabulary and reading comprehension by the two methods.

Conclusion

There is evidence of the influence of receptive vocabulary on the reading comprehension of texts, mainly in the question-and-answer method. The prepared instrument, including both assessment methods of reading comprehension, is efficient to investigate and characterize the reading comprehension of 3rd to 5th-grade Elementary School students, and both methods significantly differentiated students in the 3rd and 5th grades.

Keywords
Comprehension; Vocabulary; Education; Evaluation; Child

RESUMO

Objetivo

Elaborar um instrumento para avalição de compreensão de leitura textual e verificar a influência do vocabulário receptivo na compreensão de leitura de escolares típicos de 3º, 4º e 5º anos do ensino fundamental.

Método

Todos os preceitos éticos foram realizados. Participaram do estudo 69 estudantes de 3º, 4º e 5º anos, com média de idade de 8,2, 9,2 e 10 anos, respectivamente, sendo 35 meninas, que tiveram classificação típica no Teste de Desempenho Escolar. Metade da amostra realizou a prova de compreensão de leitura pelo método de perguntas e respostas, e a outra metade fez a prova com a técnica de Cloze. Todos os escolares realizaram o Teste de Vocabulário de Figuras USP com 139 estímulos.

Resultados

Os escolares apresentaram bom desempenho em vocabulário receptivo, apesar do nível socioeconômico baixo. Os escolares tiveram melhor desempenho em perguntas explícitas do que em implícitas. Demonstraram desempenho mais homogêneo e semelhante entre os anos escolares na técnica de Cloze . Não foram observados resultados conclusivos quanto à correlação entre vocabulário receptivo e compreensão de leitura pelos dois métodos.

Conclusão

Há indícios da influência do vocabulário sobre a compreensão de leitura textual, principalmente no método de perguntas e respostas. O instrumento elaborado, incluindo dois métodos avaliativos da compreensão de leitura, é eficiente para investigação e caracterização da compreensão de leitura textual em escolares típicos do 3º, 4º e 5º anos, sendo que ambos os métodos diferenciaram de forma significativa os escolares de 3º e 5º anos.

Descritores
Compreensão; Vocabulário; Educação; Avaliação; Criança

INTRODUCTION

Reading comprehension is a complex process that includes both cognitive and metacognitive skills and enables acquisition of new knowledge, lexical growth and academic achievement, and mastery of the written code assists with its development(11 Landi N. An examination of the relationship between reading comprehension, higher-level and lower-level reading sub-skills in adults. Read Writ. 2010;23(6):701-17. http://dx.doi.org/10.1007/s11145-009-9180-z. PMid:21691452.
http://dx.doi.org/10.1007/s11145-009-91...
,22 Gilakjani AP, Sabouri NB. How can students improve their reading comprehension skill? J Stud Int Educ. 2016;6(2):229-40. ).

There are several theoretical models that explain the process of reading. In this study, we highlight the Construction-Integration Model of Textual Understanding prepared by Kintsch e van Dijk (33 Kintsch W, van Dijk TA. Toward a model of text comprehension and production. Psychol Rev. 1978;85(5):363-94. http://dx.doi.org/10.1037/0033-295X.85.5.363.
http://dx.doi.org/10.1037/0033-295X.85....
), which advocates that reading comprehension occurs at three levels: 1. Surface structure: at this level, the words and sentences undergo decoding, consisting in the construction of the microstructure of the text; 2. Representation of the text base: at this level, the reader is already able to construct the macrostructure of the text from its microstructure; 3. Situation model: at this level, the macrostructure formed at the previous level is associated with the reader's previous knowledge about the world, enabling mental representation of the text.

With the increase in speed and accuracy of reading decoding, readers focus their attention on cognitive features for constructing meanings of recognized words as well as inference processes (44 Kida ASB, Chiari BM, Ávila CRB. Escala de leitura: proposta de avaliação das competências leitoras. Rev Soc Bras Fonoaudiol. 2010;15(4):546-53. http://dx.doi.org/10.1590/S1516-80342010000400012.
http://dx.doi.org/10.1590/S1516-8034201...
,55 Kendeou P, Papadopoulos TC, Spanoudis G. Processing demands of reading comprehension tests in young readers. Learn Instr. 2012;22(5):354-67. http://dx.doi.org/10.1016/j.learninstruc.2012.02.001.
http://dx.doi.org/10.1016/j.learninstru...
).

Thus, the vocabulary acquired during reading and the previous knowledge of the reader contribute to reading comprehension, and have effects mediated by the ability to make inferences, and are closely associated with language development(22 Gilakjani AP, Sabouri NB. How can students improve their reading comprehension skill? J Stud Int Educ. 2016;6(2):229-40. ,66 Razza RA, Martin A, Brooks-Gunn J. Associations among family environment, sustained attention, and school readiness for low-income children. Dev Psychol. 2010;46(6):1528-42. http://dx.doi.org/10.1037/a0020389. PMid:20677860.
http://dx.doi.org/10.1037/a0020389 ...
,77 Rowe ML, Raudenbush SW, Goldin-Meadow S. The pace of vocabulary growth helps predict later vocabulary skill. Child Dev. 2012;83(2):508-25. PMid:22235920. ). Therefore, assessing the receptive and emissive vocabulary of Elementary School students is relevant to predict their reading and writing performance(88 Santos MT, Befi-Lopes DM. Vocabulário, consciência fonológica e nomeação rápida: contribuições para a ortografia e elaboração escrita. J Soc Bras Fonoaudiol. 2012;24(3):269-75. http://dx.doi.org/10.1590/S2179-64912012000300013. PMid:23128176.
http://dx.doi.org/10.1590/S2179-6491201...

9 Medeiros VP, Valença RKL, Guimarães JATL, Costa RCC. Vocabulário expressivo e variáveis regionais em uma amostra de escolares de Maceió. ACR. 2013;18(2):71-7.
-1010 Piccolo LR, Salles JF. Vocabulário e memória de trabalho predizem desempenho em leitura de crianças. Revista Psicologia: Teoria e Prática. 2013;15(2):180-91. ).

Although there are studies addressing vocabulary and other language skills in the Brazilian scientific literature(88 Santos MT, Befi-Lopes DM. Vocabulário, consciência fonológica e nomeação rápida: contribuições para a ortografia e elaboração escrita. J Soc Bras Fonoaudiol. 2012;24(3):269-75. http://dx.doi.org/10.1590/S2179-64912012000300013. PMid:23128176.
http://dx.doi.org/10.1590/S2179-6491201...
,99 Medeiros VP, Valença RKL, Guimarães JATL, Costa RCC. Vocabulário expressivo e variáveis regionais em uma amostra de escolares de Maceió. ACR. 2013;18(2):71-7. ), few of them evaluate the relationship between vocabulary and reading comprehension (1010 Piccolo LR, Salles JF. Vocabulário e memória de trabalho predizem desempenho em leitura de crianças. Revista Psicologia: Teoria e Prática. 2013;15(2):180-91. ,1111 Nalom AFO, Soares AJC, Cárnio MS. A relevância do vocabulário receptivo na compreensão leitora. CoDAS. 2015;27(4):333-8. http://dx.doi.org/10.1590/2317-1782/20152015016. PMid:26398255.
http://dx.doi.org/10.1590/2317-1782/201...
).

Investigating the comprehension of textual reading is not an easy task, considering that it is not directly observable. Care should be taken with respect to the meaning and validity of each test and/or technique used, as well as to the age group, schooling, social factors, and type of text(1212 Capellini SA, Pinto CAR, Cunha VLO. Reading comprehension intervention program for teachers from 3rd grade’students. Procedia Soc Behav Sci. 2015;174:1339-45. http://dx.doi.org/10.1016/j.sbspro.2015.01.756.
http://dx.doi.org/10.1016/j.sbspro.2015...

13 Corso HV, Piccolo LR, Miná CS, Salles JF. Normas de desempenho em compreensão de leitura textual para crianças DE 1º ano a 6ª série. Psico, Porto Alegre. 2015;46(1):68-78.

14 Abbott RD, Fayol M, Zorman M, Casalis S, Nagy W, Berninger VW. Relationships of French and English morphophonemic orthographies to word reading, spelling, and reading comprehension during early and middle childhood. Can J Sch Psychol. 2016;31(4):305-21. http://dx.doi.org/10.1177/0829573516640336. PMid:27818573.
http://dx.doi.org/10.1177/0829573516640...

15 Aro M, Lyytinen H. Training reading skills in finnish: from reading acquisition to fluency and comprehension. Reading Fluency. 2016;12:125-40.
-1616 Wigfield A, Gladstone JR, Turci L. Beyond cognition: reading motivation and reading comprehension. Child Dev Perspect. 2016;10(3):190-6. PMid:27617030. ).

One of the methods most commonly applied to assess the comprehension of textual reading is the question-and-answer method directed to evaluate the reader's understanding of the contents of the text read(1212 Capellini SA, Pinto CAR, Cunha VLO. Reading comprehension intervention program for teachers from 3rd grade’students. Procedia Soc Behav Sci. 2015;174:1339-45. http://dx.doi.org/10.1016/j.sbspro.2015.01.756.
http://dx.doi.org/10.1016/j.sbspro.2015...

13 Corso HV, Piccolo LR, Miná CS, Salles JF. Normas de desempenho em compreensão de leitura textual para crianças DE 1º ano a 6ª série. Psico, Porto Alegre. 2015;46(1):68-78.

14 Abbott RD, Fayol M, Zorman M, Casalis S, Nagy W, Berninger VW. Relationships of French and English morphophonemic orthographies to word reading, spelling, and reading comprehension during early and middle childhood. Can J Sch Psychol. 2016;31(4):305-21. http://dx.doi.org/10.1177/0829573516640336. PMid:27818573.
http://dx.doi.org/10.1177/0829573516640...

15 Aro M, Lyytinen H. Training reading skills in finnish: from reading acquisition to fluency and comprehension. Reading Fluency. 2016;12:125-40.

16 Wigfield A, Gladstone JR, Turci L. Beyond cognition: reading motivation and reading comprehension. Child Dev Perspect. 2016;10(3):190-6. PMid:27617030.
-1717 Dellisa PR, Navas AL. Avaliação do desempenho de leitura em estudantes do 3º ao 7º anos, com diferentes tipos de texto. CoDAS. 2013;25(4):342-50. http://dx.doi.org/10.1590/S2317-17822013000400008. PMid:24408485.
http://dx.doi.org/10.1590/S2317-1782201...
).

The method of guided questions presents variations depending on the goal to be achieved. Some studies use questions with multiple-choice answers because of the objectivity in correcting the responses(1818 Cunha VLO, Capellini SA. PROCOMLE: protocolo de avaliação de leitura para escolares do 3º ao 5º ano do ensino fundamental. Ribeirão Preto: Book Toy; 2014. ), whereas other surveys(1313 Corso HV, Piccolo LR, Miná CS, Salles JF. Normas de desempenho em compreensão de leitura textual para crianças DE 1º ano a 6ª série. Psico, Porto Alegre. 2015;46(1):68-78. ) direct the questions and individuals respond to them orally, and some others request that answers be given in writing(1919 Chang EM, Ávila CRB. Compreensão leitora nos últimos anos dos ciclos I e II do Ensino Fundamental. CoDAS. 2014;26(4):276-85. http://dx.doi.org/10.1590/2317-1782/201420130069. PMid:25211686.
http://dx.doi.org/10.1590/2317-1782/201...
).

The Cloze technique, initially proposed by Taylor in 1953, is another method used for assessing the reading comprehension of texts. This procedure consists in organizing a text of approximately 200 words leaving the first and last sentences intact and deleting, in the rest of the text, the fifth, seventh or tenth functional words and/or lexically deleting words from the same grammatical category. Empty spaces (blanks) are inserted in the places of the deleted words. These blanks should be filled by the reader in order to restore the full meaning of the sentence and of the text as a whole(2020 Cárnio MS. Leitura e desenvolvimento da estrutura frasal a nível da escrita em deficientes auditivos: estudos com a técnica do Cloze [dissertação]. São Paulo: Pontifícia Universidade Católica de São Paulo; 1986. ).

The Cloze technique has been applied mainly because it facilitates the bottom-up and top-down reading processes owing to the characteristics of the texts, and it has proved to be an effective instrument for both the evaluation and remediation of reading, mainly in readers with atypical development(2020 Cárnio MS. Leitura e desenvolvimento da estrutura frasal a nível da escrita em deficientes auditivos: estudos com a técnica do Cloze [dissertação]. São Paulo: Pontifícia Universidade Católica de São Paulo; 1986.

21 Mostafazadeh N, Chambers N, He X, Parikh D, Batra D, Vanderwende L, Kohli P, Allen J. A corpus and cloze evaluation for deeper understanding of commonsense stories. In: NAACL-HLT; 2016 June 12-17; San Diego, California. Proceedings. San Diego: Association for Computational Linguistics; 2016. http://dx.doi.org/10.18653/v1/N16-1098.
http://dx.doi.org/10.18653/v1/N16-1098 ...
-2222 Zou D. Vocabulary acquisition through cloze exercises, sentence-writing and composition-writing: extending the evaluation component of the involvement load hypothesis. Lang Teach Res. 2017;21(1):54-75. http://dx.doi.org/10.1177/1362168816652418.
http://dx.doi.org/10.1177/1362168816652...
).

Based on these two methods to assess the reading comprehension of texts, and questioning the influence of receptive vocabulary in this process, the objectives of this study were to prepare an instrument to evaluate reading comprehension and verify the influence of receptive vocabulary on the reading comprehension of 3rd to 5th-grade Elementary School students with typical development.

The following guiding hypotheses were adopted: 1. Will the prepared instrument (Cloze technique and question-and-answer method) enable objective evaluation of the reading comprehension of texts in 3rd to 5th-grade students with typical development? 2. Is there a relationship between receptive vocabulary and reading comprehension of texts as schooling progresses, that is, will 5th grade students present better performance in receptive vocabulary and, consequently, in reading comprehension?

METHODS

This study was approved by the Research Ethics Committee of the aforementioned Institution under protocol no. 155/15.

Initially, a search was conducted in textbooks for texts indicated for each school year, which could be used to evaluate textual reading comprehension. However, the texts found did not vary in extent and vocabulary, and were very similar to each other. Thus, one text was selected for each school year according to the criteria of level of vocabulary complexity and number of words. After that, an instrument was prepared to evaluate reading comprehension of texts using the question-and-answer method and the Cloze technique. This instrument was analyzed by three speech-language pathologists with experience in reading and writing. Next, reformulations were made and the instrument was analyzed by a linguist, who first reviewed the material and then, together with the authors of this study, reached a consensus about its suitability.

Finally, a pilot study was conducted to verify the efficiency of this instrument, and the results demonstrated that it was ready to be applied.

Therefore, the instrument prepared for the present research was composed of three texts selected from the same book translated into Portuguese - Aesop's Fables(2323 Ash R, Higton B, editores. Fábulas de Esopo. Tradução Heliosa Jahn. São Paulo: Companhia das Letrinhas, 1994. ), with the purpose of maintaining the vocabulary and structuring of texts similar.

For evaluation of reading comprehension using the Cloze technique, these three texts were prepared according to the Cloze structure, that is, the first and last sentences of the texts were left intact. As of the second sentence, one every five words was deleted, and only proper names or onomatopoeic expressions were not removed. In addition, below each of the blanks in the texts adapted to the Cloze technique, two supporting words were placed in parentheses, one correct and the other of the same grammatical class, so that reading the texts with the Cloze technique was a task with a demand for syntactic and lexical choice for the reading comprehension of the textual structure.

The text used with the 3rd grade students, “The fox and the stork”, has 193 words and 25 gaps to be filled. The text used with the 4th grade students, “The man, the boy, and the donkey”, has 233 words and 30 gaps to be completed. The text used with the 5th grade students, “The donkey and the lapdog”, has 244 words and 35 gaps to be filled.

For assessment of reading comprehension using the question-and-answer method, the same texts were used, but in their original structure. Two criteria were developed to evaluate reading comprehension by this method, namely, explicit and implicit understanding, which are defined ahead based on the theories of van Dijk and Kintsch(2424 van Dijk TA, Kintsch W. Strategies of discourse comprehension. New York: Academic Press; 1983. ). Explicit Comprehension: it is the understanding that occurs based on the explicit contents of the text, that is, information is extracted from linguistic facts specified in the textual structure, deductible from the textual context, as main information (character, place, action). The answer is based on linguistic facts present in the textual structure, in the recovery of ideas within the text. Implicit Comprehension: it is the understanding that occurs based on information retrieved from the production condition of the text, and which are not explicit in the textual structure. It is necessary that knowledge about the world and linguistic (semantic, syntactic, and phonological) knowledge interact to establish relationships between main and secondary ideas, and cause-effect relationships. Thus, manipulation and correlation of the text with knowledge acquired by the reader enable formulation of hypotheses and predictions, and recognition of intertextuality, ambiguities, and arguments about the contents read.

Therefore, all questions of the texts were made based on these two criteria, totaling eight questions - four for each type of comprehension.

All 3rd, 4th and 5th grade students, whose parents and/or legal guardians signed an Informed Consent Form (ICF) authorizing their participation, were informed and clarified verbally and individually about the procedures, and those who agreed to participate in the study signed an Assent Term with figures.

In addition, the participating schoolchildren’s parents and teachers were asked to complete questionnaires that provided relevant information on the socioeconomic level of the families, as well as on the inclusion criteria of the study, which are described ahead: regular attendance in the 3rd, 4th and 5th grades of the selected Elementary School; ICF signed by parents and/or legal guardians; absence of signs of hearing and/or visual impairments and neurological, behavioral or cognitive disorders; not undergoing speech-language therapy at the time of the study; handing in of the ICF to the teachers of each class; signing of the Assent Term by the participants; scores in the Teste de Desempenho Escolar (TDE)(2525 Stein LM. Teste de Desempenho Escolar (TDE). São Paulo: Casa do Psicólogo; 1994. ) demonstrating absence of signs of reading and writing impairments according to the criteria established by the author of the SPT for each school year: 3rd grade, ≥20 in writing and ≥58 in reading; 4th grade, ≥24 in writing and ≥66 in reading ; 5th grade, ≥27 in writing and ≥66 in reading, classifying the students in the middle or upper range of the test.

Afterwards, the SPT was applied for selection of the individuals. The test was applied to 42 3 rd grade, 41 4th grade, and 47 5th grade students; however, there was a sample loss due to the below-expected performance of some students. This is a relevant aspect, considering that most of the individuals eliminated did not meet the inclusion criteria of the research. This fact demonstrates that many of the schoolchildren were not considered with typical development, and suggests failures in the schooling process.

Thus, study participants were 69 schoolchildren (34 boys and 35 girls) with mean ages of 8.2 years in the 3rd grade, 9.2 years in the 4th grade, and 10 years in the 5 th grade.

Study participants were first submitted to a test of receptive vocabulary by means of the Teste de Vocabulário por Figuras USP (TVFUSP)(2626 Capovilla FC, Seabra AG. O desenvolvimento ontogenético de leitura e escrita e a importância do vocabulário auditivo (léxico fonológico). In: Capovilla FC, editor. Teste de vocabulário por Figuras Usp (TVfusp). São Paulo: Memnon; 2010. p. 59-72. ), which aims to verify children's ability to understand words and consists of 139 items. The 139-item test was selected following the orientation contained in the TVFUSP manual, which indicates it for populations of low socioeconomic level - the case of the participants of this study. In this test, the child hears a word and selects the corresponding figure out of four alternatives. The means established by the test authors for children of low socioeconomic level are as follows: 109.58 points for the 3rd grade; 116.65 points for the 4 th grade; 120.73 points for the 5th grade.

The reading comprehension assessment tests were applied as follows: half of the individuals in the sample had their reading comprehension of texts evaluated using the Cloze technique and the other half using the question-and-answer method. This procedure was chosen because a learning effect could occur if the student underwent both evaluation methods, which would compromise the assessment reliability.

Aiming to make the sample homogeneous for the reading comprehension tests, it was decided to match the individuals for school year considering their performances in the SPT and using sample distribution by means of an equiprobabilistic table.

For assessment of reading comprehension using the Cloze technique, groups of no more than four students were summoned. They were instructed to read the whole text silently and then read it again filling in the blanks with a pencil with one of the words in the parenthesis.

For assessment of reading comprehension using the question-and-answer method, students were summoned individually. They were instructed to read the text twice - first aloud and then silently. After that, the texts were taken away and they responded orally to eight questions about it.

After data collection, the scores were tabulated according to standardized test instructions and statistically analyzed using descriptive and inferential analysis by a professional of the area, who discussed all the relevant points with the authors of this study in order to interpret the results obtained for each proposed objective. After the statistical analysis, another meeting was scheduled to discuss and interpret the results obtained from the statistical point of view and from the scientific standpoint of the research theme.

The following statistical tests were used: Analysis of Variance (ANOVA), Repeated Measures ANOVA; Tukey’s test; Residual Analysis; Likelihood Ratio Test.

RESULTS

Table 1 shows that, in the three school years investigated, most individuals obtained above-average scores in receptive vocabulary.

Table 1
Performance classification of 3rd to 5th-grade students in the Teste de Vocabulário por Figuras USP (TVFUSP)

The mean percentages of correct responses in the Cloze technique were higher both for the type of question (explicit and implicit) and the total percentages of correct responses in the question-and-answer method in the three school years analyzed.

The standard deviations of the percentage of correct responses observed in the Cloze technique ( Table 2 ) were lower than those obtained in the question-and-answer method ( Table 3 ) in the three school years.

Table 2
Percentage of correct responses in the reading comprehension of texts using the Cloze technique according to school year
Table 3
Total percentage of correct responses according to school year

These results can also be observed in Figure 1 , which presents the total comparison of correct responses in the two evaluation methods of reading comprehension of texts in the three school years.

Figure 1
Individual and mean values of total percentage of correct responses in the reading comprehension of texts using the Cloze technique and the question-and-answer (explicit and implicit) method according to school year

Comparison between the means of the percentages of correct responses in the Cloze technique and the question-and-answer method, per school year, showed that:

  • The mean percentage of correct responses in the Cloze technique was higher than that in the explicit questions (p<0.001), and this result was valid for the three school years (p=0.150);

  • The mean percentage of correct responses in the Cloze technique was higher than that in the implicit questions (p<0.001), and this result was valid for the three school years (p=0.324);

  • The mean percentage of correct responses in the Cloze technique was higher than the mean of the total percentage of correct responses in the question-and-answer method ( p<0.001), and this result was valid for the three school years (p =0.159).

Table 4 shows that all 4th grade students assessed by the question-and-answer method were classified as above-average in the Teste de Vocabulário por Figuras USP (TVFUSP). In the 5th grade, only one student was rated as below-average.

Table 4
Total percentage of correct responses in the reading comprehension of texts using the question-and-answer method in each category of the Teste de Vocabulário por Figuras USP (TVFUSP) according to school year

In the 3rd and 5th grades, the means of the total percentage of correct responses in question-and-answer method observed in the groups classified as above-average in TVFUSP were higher than those observed in the below-average category, suggesting a correlation between the total percentage of correct responses and the TVFUSP classification.

Table 5 shows that of all the schoolchildren evaluated by the Cloze technique only one 3rd grade student was classified as below-average in the TVFUSP; the same occurred for the 5 th grade.

Table 5
Total percentage of correct responses in the reading comprehension of texts using the Cloze technique in each category of the Teste de Vocabulário por Figuras USP (TVFUSP) according to school year

In the 3th and 5th grades, the means of percentages of correct responses in the Cloze technique of individuals classified as above-average in the TVFUSP were higher than those observed for the below-average category, suggesting correlation between the two tests in those school years.

DISCUSSION

The objective of this study was to prepare an instrument to assess reading comprehension and verify the influence of receptive vocabulary on the reading comprehension of 3rd to 5th-grade Elementary School students with typical development.

Most of the schoolchildren investigated presented above-average performance in receptive vocabulary in the Teste de Vocabulário por Figuras USP (TVFUSP) at the three school years analyzed, confirming that the individuals in this school have typical performance on vocabulary regardless of their low socioeconomic level.

This finding contradicts those of other studies(66 Razza RA, Martin A, Brooks-Gunn J. Associations among family environment, sustained attention, and school readiness for low-income children. Dev Psychol. 2010;46(6):1528-42. http://dx.doi.org/10.1037/a0020389. PMid:20677860.
http://dx.doi.org/10.1037/a0020389 ...
,77 Rowe ML, Raudenbush SW, Goldin-Meadow S. The pace of vocabulary growth helps predict later vocabulary skill. Child Dev. 2012;83(2):508-25. PMid:22235920. ) which have reported that socioeconomic level proved to be a positive predictor of vocabulary growth, that is, children with higher socioeconomic level had superior performance in receptive vocabulary.

Moreover, the percentage of individuals with above-average scores increased with schooling progress, that is, 5th graders presented better performance in receptive vocabulary compared with those of 3rd and 4th graders; however, significant difference was observed between the percentages of above-average students in the three years ( p=0.204) assessed. This occurred because of the small sample size of the study, which was not sufficient to consider the differences between the observed percentages as significant. Sixty-one students from each school year would be necessary for the difference between the percentages observed in the 3rd and 5th grades be considered significant. Nevertheless, as observed in the both methods employed, the instrument used in the selection of individuals - the Teste de Desempenho Escolar (TDE), showed that many students from the three analyzed school years did not obtain typical performance, which considerably reduced the study sample.

Comparative performance results in the two methods used to evaluate the textual reading comprehension of students showed that, in the three school years, performance in the Cloze technique was superior to that in the question-and-answer (explicit and implicit) method, with Cloze technique presenting performance variability smaller than that obtained in the question-and-answer method. Thus, students responded more homogeneously when the Cloze technique was applied.

It should be considered that the better performance observed in the Cloze technique may be associated with the fact that two words were provided below each blank, that is, support for reading comprehension was offered(2020 Cárnio MS. Leitura e desenvolvimento da estrutura frasal a nível da escrita em deficientes auditivos: estudos com a técnica do Cloze [dissertação]. São Paulo: Pontifícia Universidade Católica de São Paulo; 1986. ,2121 Mostafazadeh N, Chambers N, He X, Parikh D, Batra D, Vanderwende L, Kohli P, Allen J. A corpus and cloze evaluation for deeper understanding of commonsense stories. In: NAACL-HLT; 2016 June 12-17; San Diego, California. Proceedings. San Diego: Association for Computational Linguistics; 2016. http://dx.doi.org/10.18653/v1/N16-1098.
http://dx.doi.org/10.18653/v1/N16-1098 ...
). Thus, higher scores were expected for this method of evaluation than in the question-and-answer method when implicit responses were considered, especially for 5th grade students. However, due to the proximity of the semantic categories of the words provided, it was assumed that individuals would have to make a lexical choice that would require some degree of knowledge about the functioning of grammatical structures - a fact that could differentiate individuals with regards to reading comprehension even within the same educational level(2727 Mizumoto A, Ikeda M, Takeuchi O. A comparasion of cognitive processing during cloze and multiple-choice reading tests using brain activation. ARELE. 2016;27:65-80. ).

It was also expected that the question-and-answer method, when only the explicit responses were analyzed, would produce high degree of assertion because it did not require comprehensive understanding of the text contents. This assumption was confirmed in the findings of this study, which corroborate those of another national study(2828 Soriano-Ferrer M, Sánchez-López P, Soriano-Ayala E, Nievas-Cazorla F. Instrucción en estrategias de comprensión lectora mediante enseñanza recíproca: efectos del agrupamiento de los estudiantes. An Psicol. 2013;29(3):848-54. http://dx.doi.org/10.6018/analesps.29.3.158401.
http://dx.doi.org/10.6018/analesps.29.3...
). However, the students presented inferior performance in this type of question (explicit) compared with that in the Cloze technique.

These findings were surprising, firstly because of the great familiarity that students have with assessments through explicit questions and answers - a method widely used by teachers and often found in textbooks; secondly, due to the fact that explicit questions are easier to answer because they do not require highly complex skills, considering that the answers are practically described in the text, demanding greater memory activation than in processes of textual reading comprehension(2828 Soriano-Ferrer M, Sánchez-López P, Soriano-Ayala E, Nievas-Cazorla F. Instrucción en estrategias de comprensión lectora mediante enseñanza recíproca: efectos del agrupamiento de los estudiantes. An Psicol. 2013;29(3):848-54. http://dx.doi.org/10.6018/analesps.29.3.158401.
http://dx.doi.org/10.6018/analesps.29.3...
,2929 Li L, Wu X. Effects of metalinguistic awareness on reading comprehension and the mediator role of reading fluency from grades 2 to 4. PLoS One. 2015;10(3):e0114417. http://dx.doi.org/10.1371/journal.pone.0114417. PMid:25799530.
http://dx.doi.org/10.1371/journal.pone....
).

Even though the mean percentage of correct responses in the Cloze technique was higher than the mean of the total percentage of correct responses in the question-and-answer method, it cannot be stated that one method is more effective than the other in assessing reading comprehension, because a gold standard method was not included among those selected for this research.

Because the Cloze technique requires reading the whole text and then filling the blanks, it draws the attention of readers to the phrasal structures and thus seems to facilitate reading decoding; readers place more attention in the linguistic elements that compose the sentences and develop morphosyntactic and lexical knowledge, considering that it is necessary to make a mental selection of the words that will be inserted to complete the meaning of the text sentences(2020 Cárnio MS. Leitura e desenvolvimento da estrutura frasal a nível da escrita em deficientes auditivos: estudos com a técnica do Cloze [dissertação]. São Paulo: Pontifícia Universidade Católica de São Paulo; 1986. ). Furthermore, because it is not a technique commonly used in regular teaching, it facilitated the reading comprehension of texts, motivating the participation of individuals and matching their performances according to school year. Thus, it is assumed that the Cloze technique can be a very useful instrument in the remediation of reading comprehension (2727 Mizumoto A, Ikeda M, Takeuchi O. A comparasion of cognitive processing during cloze and multiple-choice reading tests using brain activation. ARELE. 2016;27:65-80. ,3030 Mostow J, Huang Y, Jang H, Weinstein A, Valeri J, Gates D. Developing, evaluating, and refining an automatic generator of diagnostic multiple choice cloze questions to assess children’s comprehension while Reading. Nat Lang Eng. 2017;23(2):245-94. http://dx.doi.org/10.1017/S1351324916000024.
http://dx.doi.org/10.1017/S135132491600...
).

The question-and-answer method, especially when implicit questions were used, seemed to select the students better, because it differentiated students more accurately according to grade and educational level, proving to be a precise instrument to evaluate reading comprehension. However, the care in the preparation, number, and balance in the types of questions used, as well as in the application of this method should be emphasized(22 Gilakjani AP, Sabouri NB. How can students improve their reading comprehension skill? J Stud Int Educ. 2016;6(2):229-40. ,1717 Dellisa PR, Navas AL. Avaliação do desempenho de leitura em estudantes do 3º ao 7º anos, com diferentes tipos de texto. CoDAS. 2013;25(4):342-50. http://dx.doi.org/10.1590/S2317-17822013000400008. PMid:24408485.
http://dx.doi.org/10.1590/S2317-1782201...
).

It can be stated that the instrument prepared for this study to assess reading comprehension of texts was efficient and corroborated the first hypothesis of this research, considering that both tests, with their specificities, differentiated the participants according to educational level.

Correlation between receptive vocabulary and the total percentage of correct responses regarding reading comprehension in the question-and-answer method and in the Cloze technique could not be verified due to the small sample size and because of the study procedure adopted, which did not apply both methods to all individuals to avoid possible learning bias of the text. Thus, it was possible to conduct an association test between the percentages of correct responses in both methods with the TVFUSP by school year.

Correlation between the total percentage of correct responses in the question-and-answer method and performance in the TVFUSP showed that most of the study sample presented above-average performance in receptive vocabulary, with 100% above-average performance for 4th grade students. Results showed that above-average individuals also had mean performance superior to the total mean for the school year in this method of reading comprehension assessment. It is worth noting that the fact that all 4th grade students presented above-average performance in receptive vocabulary probably produced a superior result for that school year compared with those of the other years.

Correlation between the percentage of correct responses in the Cloze technique and performance in the TVFUSP showed that, except for 3rd grade students, individuals with above-average classification presented high reading comprehension performance means in this method. Interestingly, among the 3rd grade students, the only individual with a below-average mean on receptive vocabulary presented mean performance superior to that for his school year.

Regarding comparison of receptive vocabulary between the reading comprehension evaluation methods, no conclusive results were observed, considering that most students presented performance above the expected in the TVF-USP, but those classified as below-average in this test did not present equally poor performance in the reading comprehension assessment methods. However, consistency was observed in the performance pattern between the students' results in the question-and-answer method and in the TVFUSP, with 3rd and 5th grade students presenting similar performance and 4th grade students showing the best performance. Consistency was observed in the performance pattern between the students' results in the Cloze technique and in the TVFUSP, which presented an upward performance curve according to schooling. However, this is a descriptive analysis that cannot be generalized due to the small sample size of this study.

Nevertheless, results suggest a possible correlation between receptive vocabulary and the instrument developed to evaluate the reading comprehension of texts, partially corroborating the second hypothesis of this survey. In addition, it corroborates the findings of a national study(1111 Nalom AFO, Soares AJC, Cárnio MS. A relevância do vocabulário receptivo na compreensão leitora. CoDAS. 2015;27(4):333-8. http://dx.doi.org/10.1590/2317-1782/20152015016. PMid:26398255.
http://dx.doi.org/10.1590/2317-1782/201...
) that showed that, in the absence of changes indicative of reading and writing impairment, presence of a good vocabulary significantly contributes to the reading comprehension of texts.

CONCLUSION

Correlation between receptive vocabulary and reading comprehension of texts could not be verified, but the data indicate that there is influence of vocabulary on the comprehension of textual reading, mainly regarding the question-and-answer method.

Assessment using the question-and-answer method confirms that, as schooling progresses, individuals present higher scores of correct responses in implicit questions, with significant difference between 3rd and 5th grade students, evidencing evolution in the reading comprehension of texts.

The Cloze technique demonstrates more homogeneous results among the school years, and is relevant for evaluation both in the 3rd and 5th grades, with significant results in these two segments.

The instrument prepared to evaluate the reading comprehension of texts in this study is efficient, considering that both methods are equally accurate in investigating and characterizing comprehension of textual reading in 3rd, 4th and 5th-grade Elementary School students, and differentiated 3rd and 5th grade students. By comparing two assessment methods of reading comprehension of texts with receptive vocabulary in Elementary School children with typical development, this study provides an unprecedented contribution both to professionals inserted in the educational context and those who work in clinics in the area of reading and writing.

ACKNOWLEDGEMENTS

To the Pro-rectory of USP, and to CAPES. To the judges who assisted in the elaboration of the necessary material for this research.

  • Study conducted at Departamento de Fisioterapia, Fonoaudiologia e Terapia Ocupacional, Faculdade de Medicina, Universidade de São Paulo – USP - São Paulo (SP), Brasil.
  • Financial support: CAPES.

REFERÊNCIAS

  • 1
    Landi N. An examination of the relationship between reading comprehension, higher-level and lower-level reading sub-skills in adults. Read Writ. 2010;23(6):701-17. http://dx.doi.org/10.1007/s11145-009-9180-z. PMid:21691452.
    » http://dx.doi.org/10.1007/s11145-009-9180-z
  • 2
    Gilakjani AP, Sabouri NB. How can students improve their reading comprehension skill? J Stud Int Educ. 2016;6(2):229-40.
  • 3
    Kintsch W, van Dijk TA. Toward a model of text comprehension and production. Psychol Rev. 1978;85(5):363-94. http://dx.doi.org/10.1037/0033-295X.85.5.363.
    » http://dx.doi.org/10.1037/0033-295X.85.5.363
  • 4
    Kida ASB, Chiari BM, Ávila CRB. Escala de leitura: proposta de avaliação das competências leitoras. Rev Soc Bras Fonoaudiol. 2010;15(4):546-53. http://dx.doi.org/10.1590/S1516-80342010000400012.
    » http://dx.doi.org/10.1590/S1516-80342010000400012
  • 5
    Kendeou P, Papadopoulos TC, Spanoudis G. Processing demands of reading comprehension tests in young readers. Learn Instr. 2012;22(5):354-67. http://dx.doi.org/10.1016/j.learninstruc.2012.02.001.
    » http://dx.doi.org/10.1016/j.learninstruc.2012.02.001
  • 6
    Razza RA, Martin A, Brooks-Gunn J. Associations among family environment, sustained attention, and school readiness for low-income children. Dev Psychol. 2010;46(6):1528-42. http://dx.doi.org/10.1037/a0020389. PMid:20677860.
    » http://dx.doi.org/10.1037/a0020389
  • 7
    Rowe ML, Raudenbush SW, Goldin-Meadow S. The pace of vocabulary growth helps predict later vocabulary skill. Child Dev. 2012;83(2):508-25. PMid:22235920.
  • 8
    Santos MT, Befi-Lopes DM. Vocabulário, consciência fonológica e nomeação rápida: contribuições para a ortografia e elaboração escrita. J Soc Bras Fonoaudiol. 2012;24(3):269-75. http://dx.doi.org/10.1590/S2179-64912012000300013. PMid:23128176.
    » http://dx.doi.org/10.1590/S2179-64912012000300013
  • 9
    Medeiros VP, Valença RKL, Guimarães JATL, Costa RCC. Vocabulário expressivo e variáveis regionais em uma amostra de escolares de Maceió. ACR. 2013;18(2):71-7.
  • 10
    Piccolo LR, Salles JF. Vocabulário e memória de trabalho predizem desempenho em leitura de crianças. Revista Psicologia: Teoria e Prática. 2013;15(2):180-91.
  • 11
    Nalom AFO, Soares AJC, Cárnio MS. A relevância do vocabulário receptivo na compreensão leitora. CoDAS. 2015;27(4):333-8. http://dx.doi.org/10.1590/2317-1782/20152015016. PMid:26398255.
    » http://dx.doi.org/10.1590/2317-1782/20152015016
  • 12
    Capellini SA, Pinto CAR, Cunha VLO. Reading comprehension intervention program for teachers from 3rd grade’students. Procedia Soc Behav Sci. 2015;174:1339-45. http://dx.doi.org/10.1016/j.sbspro.2015.01.756.
    » http://dx.doi.org/10.1016/j.sbspro.2015.01.756
  • 13
    Corso HV, Piccolo LR, Miná CS, Salles JF. Normas de desempenho em compreensão de leitura textual para crianças DE 1º ano a 6ª série. Psico, Porto Alegre. 2015;46(1):68-78.
  • 14
    Abbott RD, Fayol M, Zorman M, Casalis S, Nagy W, Berninger VW. Relationships of French and English morphophonemic orthographies to word reading, spelling, and reading comprehension during early and middle childhood. Can J Sch Psychol. 2016;31(4):305-21. http://dx.doi.org/10.1177/0829573516640336. PMid:27818573.
    » http://dx.doi.org/10.1177/0829573516640336
  • 15
    Aro M, Lyytinen H. Training reading skills in finnish: from reading acquisition to fluency and comprehension. Reading Fluency. 2016;12:125-40.
  • 16
    Wigfield A, Gladstone JR, Turci L. Beyond cognition: reading motivation and reading comprehension. Child Dev Perspect. 2016;10(3):190-6. PMid:27617030.
  • 17
    Dellisa PR, Navas AL. Avaliação do desempenho de leitura em estudantes do 3º ao 7º anos, com diferentes tipos de texto. CoDAS. 2013;25(4):342-50. http://dx.doi.org/10.1590/S2317-17822013000400008. PMid:24408485.
    » http://dx.doi.org/10.1590/S2317-17822013000400008
  • 18
    Cunha VLO, Capellini SA. PROCOMLE: protocolo de avaliação de leitura para escolares do 3º ao 5º ano do ensino fundamental. Ribeirão Preto: Book Toy; 2014.
  • 19
    Chang EM, Ávila CRB. Compreensão leitora nos últimos anos dos ciclos I e II do Ensino Fundamental. CoDAS. 2014;26(4):276-85. http://dx.doi.org/10.1590/2317-1782/201420130069. PMid:25211686.
    » http://dx.doi.org/10.1590/2317-1782/201420130069
  • 20
    Cárnio MS. Leitura e desenvolvimento da estrutura frasal a nível da escrita em deficientes auditivos: estudos com a técnica do Cloze [dissertação]. São Paulo: Pontifícia Universidade Católica de São Paulo; 1986.
  • 21
    Mostafazadeh N, Chambers N, He X, Parikh D, Batra D, Vanderwende L, Kohli P, Allen J. A corpus and cloze evaluation for deeper understanding of commonsense stories. In: NAACL-HLT; 2016 June 12-17; San Diego, California. Proceedings. San Diego: Association for Computational Linguistics; 2016. http://dx.doi.org/10.18653/v1/N16-1098.
    » http://dx.doi.org/10.18653/v1/N16-1098
  • 22
    Zou D. Vocabulary acquisition through cloze exercises, sentence-writing and composition-writing: extending the evaluation component of the involvement load hypothesis. Lang Teach Res. 2017;21(1):54-75. http://dx.doi.org/10.1177/1362168816652418.
    » http://dx.doi.org/10.1177/1362168816652418
  • 23
    Ash R, Higton B, editores. Fábulas de Esopo. Tradução Heliosa Jahn. São Paulo: Companhia das Letrinhas, 1994.
  • 24
    van Dijk TA, Kintsch W. Strategies of discourse comprehension. New York: Academic Press; 1983.
  • 25
    Stein LM. Teste de Desempenho Escolar (TDE). São Paulo: Casa do Psicólogo; 1994.
  • 26
    Capovilla FC, Seabra AG. O desenvolvimento ontogenético de leitura e escrita e a importância do vocabulário auditivo (léxico fonológico). In: Capovilla FC, editor. Teste de vocabulário por Figuras Usp (TVfusp). São Paulo: Memnon; 2010. p. 59-72.
  • 27
    Mizumoto A, Ikeda M, Takeuchi O. A comparasion of cognitive processing during cloze and multiple-choice reading tests using brain activation. ARELE. 2016;27:65-80.
  • 28
    Soriano-Ferrer M, Sánchez-López P, Soriano-Ayala E, Nievas-Cazorla F. Instrucción en estrategias de comprensión lectora mediante enseñanza recíproca: efectos del agrupamiento de los estudiantes. An Psicol. 2013;29(3):848-54. http://dx.doi.org/10.6018/analesps.29.3.158401.
    » http://dx.doi.org/10.6018/analesps.29.3.158401
  • 29
    Li L, Wu X. Effects of metalinguistic awareness on reading comprehension and the mediator role of reading fluency from grades 2 to 4. PLoS One. 2015;10(3):e0114417. http://dx.doi.org/10.1371/journal.pone.0114417. PMid:25799530.
    » http://dx.doi.org/10.1371/journal.pone.0114417
  • 30
    Mostow J, Huang Y, Jang H, Weinstein A, Valeri J, Gates D. Developing, evaluating, and refining an automatic generator of diagnostic multiple choice cloze questions to assess children’s comprehension while Reading. Nat Lang Eng. 2017;23(2):245-94. http://dx.doi.org/10.1017/S1351324916000024.
    » http://dx.doi.org/10.1017/S1351324916000024

Publication Dates

  • Publication in this collection
    23 July 2018
  • Date of issue
    2018

History

  • Received
    21 July 2017
  • Accepted
    03 Nov 2017
Sociedade Brasileira de Fonoaudiologia Al. Jaú, 684, 7º andar, 01420-002 São Paulo - SP Brasil, Tel./Fax 55 11 - 3873-4211 - São Paulo - SP - Brazil
E-mail: revista@codas.org.br