Noun phrase dictation as a writing assessment instrument: a psychometric analysis

Abstract

Purpose

Prepare a list of noun phrases able to characterize the writing performance of schoolchildren according to school year.

Methods

A list of 25 noun phrases intended for dictation was prepared and applied to 275 Elementary School students (2^nd to 5^thgrades). The unidimensionality underlying the proposed items was analyzed using Item Response Theory.

Results

The list enabled differentiation between the performance of schoolchildren attending the 2^nd and 3^rd years and that of students attending the 4 ^th and 5^th years. Items on the list presented moderate difficulty level and medium discrimination capacity.

Conclusion

The model showed good fit and was able to differentiate the performance of 2^nd to 3^rd grade students from that of 4^th to 5^thgrade students. The list of noun phrases assessed writing in 4^th to 5^th grade students more accurately.

Keywords,
Writing; Students; Learning; Evaluation; Speech; Language and Hearing Sciences

Resumo

Objetivo

Construir uma lista de sintagmas nominais capaz de caracterizar desempenhos segundo o ano escolar.

Método

Uma lista de 25 sintagmas nominais foi elaborada para ditado, aplicada a 275 estudantes típicos, do 2^o ao 5^o ano do Ensino Fundamental I. A unidimensionalidade subjacente aos itens propostos foi analisada por meio da Teoria de Resposta ao Item.

Resultados

A lista diferenciou o desempenho dos dois anos iniciais do apresentado pelos finais. Em geral, seus itens mostraram grau moderado de dificuldade e médio poder de discriminação.

Conclusão

As análises mostraram ajuste ao modelo proposto e diferenciaram desempenhos quando os anos escolares foram agrupados. A lista avaliou com mais precisão crianças de 4º e 5º anos.

Descritores
Escrita; Estudantes; Aprendizagem; Avaliação; Fonoaudiologia

INTRODUCTION

Learning of orthographically correct writing is usually assessed through dictation tasks or analysis of spontaneous handwriting of words, phrases, or texts. A survey of the writing evaluation studies published between 1996 and 2005 showed that 28.1% of the 32 analyzed articles presented validity evidence of the material applied and 59.4% of them were conducted by means of dictations, mostly of isolated words⁽¹⁾. Assessment evidences the hypotheses that children raise about writing, as well as the spelling mistakes they make; however, some types of errors are not identified in the dictation of isolated items.

In addition to orthographic information, which is learned since the beginning of Elementary School, there are other aspects equally relevant to be considered, especially in the beginning of the learning process^(2-4). Throughout this initial period, schoolchildren perceive that words are represented graphically by letters and delimited by blanks, and that they can be combined with others to form sentences⁽⁵⁾. This is the first step to represent connected speech. To this end, it is also necessary to know how to analyze and neutralize certain conflicting aspects: in Brazilian Portuguese, as well as in other languages, syllables present varying duration that adjust at relatively constant intervals; the salience of this information is the stressed syllable, which has louder volume or longer duration than unstressed syllables, characterizing an accentual and non-syllabic rhythm^(6,7).

Therefore, in connected speech, syllables are pronounced in tonal groups, which do not necessarily correspond to a word^(8-11), and may not coincide with the graphic spaces that mark the boundaries of words. When these tonal groups are formed by two or more words, the coarticulation phenomenon occurs. In writing, this phenomenon is known as intervocabulary junction⁽¹²⁾.

Just as they can determine the emergence of word junctions, the phonological representation and processing of tonal groups⁽¹³⁾ based on auditory perceptions^(14,15) can also lead to undue segmentation of written words. Both are considered inaccuracies that should, along with other types of spelling mistakes, disappear throughout schooling. Evidently, the writing of sentences or text, spontaneous or under dictation, will demand abilities other than the orthographic one, namely, bias, semantic, morphosyntactic and memory skills, which also influence this production^(3,16-19). Moreover, it should not be forgotten that the number of errors decreases throughout schooling. This decrease is most significantly observed between the 3^rd and 4 ^th grades, which is a period that corresponds to the passage from alphabetic writing to the beginning of orthographic writing^(3,20).

Writing under dictation of isolated words does not enable analysis of possible segmentations or junctions. The conception and analysis of a list of noun phrases aiming to evaluate the writing of schoolchildren in the early years of Elementary School have proven interesting, considering that such list provides not only orthographic evaluation of error at the word level, but also analysis of the writing of tonal groups. Noun phrases are units of meaning that are larger than words and smaller than sentences⁽¹¹⁾. Because they are short, they require minimum working memory, present simple morphosyntactic structure, and are easy to understand - characteristics that contribute to the application of dictation to different school years.

Some orthographic writing assessments present evidence of construct validation. However, it is necessary to collect direct psychometric measures on test scores, in the form of validation, reliability and analysis of the items, which is not often found in Brazilian studies^(21,22).

In this study, in order to ensure quality of the written evaluation items, the Item Response Theory (TRI) was used to identify the best test items in the dictation of noun phrases according to the levels of discrimination and difficulty shown in the analysis of writing of students in early Elementary School. This study was guided by the hypothesis that analysis of dictation would demonstrate that noun phrases constitute a good writing evaluation procedure and would show difference in performance between school years. Presentation of the preparation steps of a list of noun phrases for assessment of the writing of Brazilian children attending 2^nd to 5^th grades of Elementary School and verification of the fit of this instrument to the selected school years should confirm this hypothesis. The list of noun phrases also intends to be a clinical instrument of simple application, able to identify developmental characteristics of writing during the first school years, which will enable structured and reliable reproducibility of the orthographic evaluation.

METHODS

Sample selection

Study participants were 275 schoolchildren (150 girls; 54.54%) aged 6 years and 8 months to 11 years regularly enrolled from2^nd to 5^th grades at eight Elementary Schools in the city of Sao Paulo, randomly selected respecting the proportion of 85% of public schools (4 municipal and 3 state schools) and 15% of private schools (1 school). After selecting and contacting the eight schools, an Informed Consent Form was signed by the respective principals, and teachers were then requested to indicate the children eligible for the study, i.e., those who did not present complaints or indicators of school difficulties, behavioral, neurological and/or sensory disorders. The children were not selected based on their school grades, but on reading task performance. From the teachers' indication, the children were screened using an oral reading test, which enabled calculation of text reading rate values, with the purpose of ensuring a certain level of automatic word recognition and knowledge of orthographic writing, according to the school year. Using this procedure, those that presented reading rate below the following values for the respective school years were excluded from the survey: 2 ^nd grade = 47 words per minute (w.p.m.); 3^rd grade = 66 w.p.m.; 4^th grade = 71 w.p.m.; 5^th grade = 91 w.p.m⁽²³⁾. The sample was distributed as follows: 66 students from 2^nd grade (mean age = 7y and 9m); 76 from 3^rd grade (mean age = 8y and 10m); 59 from 4^th grade (mean age = 9y and 9m), and 74 from 5^th grade (mean age = 10y and 6m).

Procedures

Pilot study

Focusing on the graphic representations of all the phonemes and types of syllables of Brazilian Portuguese, a panel composed of a speech-language pathologist and a linguist prepared a list of 34 noun phrases comprising sequences from three to seven words selected from word banks^(24,25). In a pilot study conducted with 80 students from 2^nd to 5 ^th grades of Elementary School (20 from each school year, 10 from each school network), this list was dictated to gather information on evaluation of the instructions, calculation of the time spent on the test, and ideal number of children per application. From the dictation, statistical analysis of the corpus collected was conducted with application of the Item Response Theory (TRI). This analysis resulted in the exclusion of nine noun phrases that presented very low values of discrimination power or difficulty for the sample⁽²⁶⁾.

Actual study

The list containing the 25 remaining noun phrases was dictated to the 275 study participants throughout the second school term. According to the results of the Pilot Study, participants were divided into groups of maximum 10 children per school year for the application. The dictation was performed in two stages for children attending the 2^nd and 3 ^rd grades and in a single stage for those attending the 4^th and 5 ^th grades. Each participant received a pencil and a lined paper sheet (with space to register their names, date, name of school, and school grade). The following instruction was given prior to dictation commencement:

I will say a small phrase out loud and you will write it down on your sheet of paper. If needed, I will repeat it. If you make a mistake, cross the word and write it again on the side. You must not erase any word.

Errors were identified and computed. Correctness (1 point) and mistake (zero point) were assigned per word. When more than one mistake was found in the same word, they were all considered. The study was approved by the Research Ethics Committee of Universidade Federal de São Paulo – Escola Paulista de Medicina (no.1768/11). All participating schoolchildren signed an Informed Consent Form (ICF) prior to study commencement.

Statistical analysis

Each item on the list of noun phrases was analyzed. For statistical analysis, the Item Response Theory (TRI)⁽²⁶⁾ was applied in order to verify the discrimination capacity (very high = 1,69; high = 1,69 to 1,34; medium = 1,33 to 0,65; low = 0,64 to 0,35; very low = 0,34 to 0,01) and difficulty level (extremely difficult = >3,0; very difficult = 3,0 to 2,1 ; difficult = 2,0 to+1,01; moderate = 1,0 to -1,0; easy = -1,01 to -2,0; very easy = -2,01 to -3,0; extremely easy = <-3,0) of each item. Noun phrases that presented extreme response values, i.e., ≥ 95% and ≤ 5% of discrimination and difficulty, respectively, were eliminated.

In order to assess whether discrimination and difficulty levels were invariant throughout the school years, Multi-group Confirmatory Factor Analysis (Invariance Test) was conducted considering the items common to all school years, performed by root mean square error approximation (RMSEA) (>0.06); comparative fit index (CFI)(>0.95); and Tucker-Lewis index (TLI) (<0.90). To test the invariance for the variable “school year”, Group 1 was formed by the grouping of the 2^nd and 3^rd grades, whereas Group 2 formed by the grouping of the 4^th and 5^th grades, because the sample of each year alone was not large enough to conduct separate analyses. All statistical analyses were processed using the MPlus 7.11 software.

RESULTS

Results were obtained from the collection of the dictation of noun phrases applied to the randomized sample of 275 Elementary School students.

By means of the item exclusion procedure, eight noun phrases that presented extreme responses were withdrawn from the list, resulting in 17 noun phrases ( Table 1 ).

Table 1
Levels of discrimination and difficulty of the list of noun phrases for the sample of children attending 2^nd to 5^th grades of Elementary School

	Discrimination	Discrimination Standard error	Difficulty	Difficulty Standard error
A festa do dia das mães (Mother’s Day party)	0.540	0.125	-2.068	0.434
O ladrão de trens (Train thief)	0.423	0.097	-0.749	0.249
Essa roda da carroça de bois (Ox wagon wheel)	0.659	0.112	-0.220	0.141
A mesa de vidro transparente (Transparent glass table)	0.676	0.125	-0.880	0.183
O caldo de cana gelado (Iced sugar cane juice)	0.671	0.121	-0.942	0.189
Uma chuteira de futebol vermelha (Red football boots)	0.658	0.135	-1.531	0.280
A gangorra quebrada (Broken seasaw)	0.784	0.126	-0.489	0.135
O canto do sabiá do campo (Mermaid song)	0.676	0.129	1.365	0.246
Meus óculos com dois graus (Two-degree glasses)	0.675	0.139	0.975	0.203
Qualquer bicicleta preta (Any Black bike)	0.984	0.177	-0.921	0.147
O perfume natural do jardim florido (Flowery garden's natural scent)	1.013	0.203	-1.201	0.176
As portas iguais da cozinha (Same kitchen doors)	0.879	0.144	-0.876	0.151
O esquilo apressado (Rushed squirrel)	0.791	0.125	-0.090	0.123
A receita da empada (Patty recipe)	0.845	0.138	-0.173	0.120
Brigas entre certas cabras (Fights between certain goats)	0.991	0.158	0.106	0.109
Iscas de filé na tigela do inglês (Fillet baits in the Englishman bowl)	0.753	0.121	0.649	0.151
Raposas com sono e quietas (Sleepy quiet foxes)	0.760	0.122	0.530	0.142

Of the 17 remaining noun phrases, 15 (88.23%) showed medium and two (11.6%) presented low discrimination capacity. Analysis of the level of difficulty revealed the following numbers of noun phrases and values: one (5.8%), difficult; 13 (76.47%), moderate; two (11.6%), easy; one (5.8%), very difficult.

Distribution of the noun phrases according to level of discrimination was restricted to medium and low discrimination power, whereas the level of difficulty varied along difficult, moderate, easy, and very easy ( Table 2 ).

Table 2
Percentage summary measures of the 17 noun phrases distributed according to levels of discrimination and difficulty

		N	%
Discrimination	Very high	-	-
	High	-	-
	Medium	15	88.23
	Low	2	11.76
	Very low	-	-
Difficulty	Very difficult	-	-
	Difficult	1	5.88
	Moderate	13	76.47
	Easy	2	11.06
	Very easy	1	5.88
	Extremely easy	-	-

In the analysis of configurational and scalar invariance of the list of noun phrases, TLI and CFI showed good fit of the model to the sample. Groups 1 and 2 could be compared because the model presented stability ( Table 3 ).

Table 3
Analysis of the configurational and scalar invariance of noun phrases according to the school year

	Model	Parameter number	Chi-squared	Degree of freedom	p-value	RMSEA	CFI	TLI
Groups 1 and 2	Configurational	68	253.744	238	0.2307	0.022	0.983	0.981
	Scalar	53	269.708	253	0.2247	0.022	0.982	0.981
	Scalar vs. Configurational		16.801	15	0.3309

• Captions: RMSEA - root mean square error of approximation (>0.06); CFI - comparative fit index (>0.95); TLI Tucker-Lewis index (>0.90); Group 1: 2^nd and 3^rd grades; Group 2: 4^th and 5^th grades

Figure 1 depicts the skills closest to +3 (more difficult) and closest to -3 (easier) on the abscissa axis. Higher levels of information indicate the most accurate measure of the construct. The two groups determined by schooling were compared. In this way, the Total Information Curves (TIC) were constructed. Two points can be highlighted in both graphs: 1) the peak of information was reached by children with moderate skills (close to zero on the abscissa axis); 2) the amount of information is nearly twice as much for schoolchildren in Group 2 (4^th and 5^th grades) compared with that for students in Group 1 (2^nd and 3^rd grades).

Figure 1
Total Information Curves on the construct obtained through analysis of noun phrase dictation

DISCUSSION

Assessment of writing is a fundamental procedure to know the conditions and pace of learning. This study sought to prepare an instrument that could invariably evaluate the writing of Elementary School children and be easily applied, clinically or educationally, and enable reproducibility of the procedure in research.

Writing of noun phrases enables observation of whether schoolchildren perceive the boundaries between words^(9-11). It is true that other skills such as vocabulary development and morphosyntactic awareness play a role in this process⁽⁴⁾; however, it is considered that more basic issues, such as phonological and auditory processing, underlie undue junctions and segmentations, and should be identified^(13,15). Emergence of undue junctions or segmentations may indicate, therefore, the presence of deficits of primary abilities for the learning of reading and writing⁽²⁷⁾.

Analysis of the items on the list of noun phrases determined the exclusion of some of them, which showed extreme values of discrimination and difficulty. Thus, most of the 17 remaining noun phrases, whose words maintained the graphical representation of all the phonemes of Brazilian Portuguese and most types of syllables, showed medium discrimination capacity, and only two presented low capacity. Regarding the level of difficulty, most noun phrases showed moderate level, and the others were distributed as follows: one with difficult, two with easy, and one with very easy level ( Tables 1 and 2 ).

The syllables with VV and VVC structures were eliminated with the removal of the noun phrases analyzed by IRT. However, these syllabic structures composed more complex syllables and could, therefore, be assessed somehow (for example, in the words chuteira (football boot) and bois (oxes), respectively).

It should be emphasized that performance assessment tools should present, as important characteristic, strength or robustness to discriminate or differentiate responses of the individuals evaluated ⁽²⁶⁾. The more robust the instrument, the more balanced the analysis of discrimination capacity and difficulty level of the items that compose such instrument. The results of the analysis corroborated this idea, in that it showed predominance of noun phrases with characteristics of medium discrimination power and moderate difficulty level ( Tables 1 and 2 ).

The list of noun phrases was adequate for the evaluation of the writing of the total sample, which was confirmed by the configurational and scalar invariance analyses ( Table 3 ), whose TLI and CFI showed good fit of the model to the sample (X²₍₁₅₎ =16.801 (p=0.3309)⁽²¹⁾. Although it was expected that the list would evaluate the same writing abilities of each investigated school year, it was necessary to group the initial (2^nd and 3^rd grades) and the final (4^th and 5^th grades) years. In addition to the statistical procedure (and sample size), grouping was probably determined by similarities of learning level between 2^nd and 3^rd, and 4^th and 5^th grades. In fact, it is expected that the alphabetical phase of writing learning will be completed by the end of 3^rd grade, and will lead to learning and mastery of orthographic writing at the end of 5^th grade⁽²⁸⁾.

To evaluate the amount of information underlying the construct that can be explained by their respective items as a whole divided into several levels, a Total Information Curve (TIC) was drawn, in which the highest levels of information indicate the most precise measure of the construct. This TIC reinforces the standard found in IRT. Peak of information on the TIC was around zero for children with average development, and the amount of information obtained is almost twofold that of older schoolchildren, in Group 2. These students are already in the final stages of literacy and, therefore, imprecision is no longer expected in the writing of a corpus prepared with high frequency words, either in spontaneous writing or dictation^(25,29).

Some hypotheses could explain the results and variations found in the dictation application, such as characteristics associated with short-term memory skills, phonological information, and metalinguistic development, which would certainly contribute to distinguish between efficient learners and those who present writing impairments.

CONCLUSION

After analysis of the items, a list of 17 noun phrases with medium discrimination and moderate difficulty values was obtained, considering the random sample of 2^nd to 5 ^th grade Elementary School students. Analysis of the writing of noun phrases showed fit and adequacy of the proposed model and indicated that the instrument can be used to perform invariable assessment of school year groupings – 2^nd and 3^rd grades; 4 ^th and 5^th grades -, especially when considering that the noun phrases can provide junctions and segmentations, promoting investigation of this characteristic of writing as well.

ACKNOWLEDGEMENTS

The authors are grateful to Adriana Kida, professor at the Departamento de Fonoaudiologia - UNIFESP-EPM), for her collaboration in the preparation of the list of noun phrases, and to Hugo Cogo-Moreira, professor at the Departamento de Psiquiatria - UNIFESP-EPM, for the statistical analysis.

• Study conducted at Departamento de Fonoaudiologia, Universidade Federal de São Paulo – UNIFESP - São Paulo (SP), Brazil.
• Financial support: Bolsa de Doutorado Sanduíche - CAPES-PDSE – 10557/13-0 e CNPq (Conselho Nacional de Desenvolvimento Científico e Tecnológico), processo nº 313645/2014.

REFERÊNCIAS

• ¹
  Suehiro ACB, Cunha NB, Santos APA. Avaliação da escrita no contexto escolar entre 1996 e 2005. Psic. 2007;8(1):61-70.
• ²
  Batista AO. Desempenho ortográfico de escolares do 2º ao 5º ano: proposta de elaboração de um protocolo de avaliação de ortografia [tese]. Marília: Universidade Estadual Paulista; 2011. 233 p.
• ³
  Rosa CC, Gomes E, Pedroso FS. Aquisição do sistema ortográfico: desempenho na expressão escrita e classificação dos erros ortográficos. Rev CEFAC. 2011;12(8):281-8.
• ⁴
  Teberosky A, Jarque M. Interação e continuidade entre a aquisição da linguagem e a aprendizagem da leitura e da escrita. Cadernos CENPEC. 2014;4(1):1-11. http://dx.doi.org/10.18676/cadernoscenpec.v4i1.276.
  » http://dx.doi.org/10.18676/cadernoscenpec.v4i1.276
• ⁵
  Rowe DW. Development of writing abilities in childhood. In: Bazerman C, editor. Handbook of research on writing. Nova York: Lawrence Erbaum Associates; 2008. p. 401-20.
• ⁶
  Migliorini L, Massini-Cagliari G. Sobre o ritmo do Português Brasileiro: evidências de um padrão acentual. ReVel. 2010;8(15):310-29.
• ⁷
  Barbosa BA. Ritmo da escrita e ritmo da fala: congruências e não congruências. Domínios de Lingu@gem 2013;7(2):41-64.
• ⁸
  Chacon L. Constituintes prosódicos e letramento em segmentações não convencionais. Let Hoje. 2004;39(3):223-32.
• ⁹
  Cunha APN, Miranda ARM. A influência da hierarquia prosódica em hipossegmentações da escrita de crianças de séries iniciais. ReVEL. 2007;1:1-19.
• ¹⁰
  Arnaut MA, Hackerott MMS, Bueno GJ, Nepomuceno PF, Avila CRB. Erros de base fonológica na escrita: codificação de surdas e sonoras, segmentação e juntura vocabular. CoDAS. 2014;14(3):13-25.
• ¹¹
  Cagliari LC. Aspectos teóricos da ortografia. In: Silva M, organizador. Ortografia da língua portuguesa. São Paulo: Editora Contexto; 2014. p. 17-52.
• ¹²
  Wauquier S. Acquisition de La liaison en L1 et L2- strategies phonologiques ou lexicales? Aile.... LIA (Amst). 2009;2:93-130.
• ¹³
  Mesquita F, Correa J, Mousinho R. Influência de habilidades de processamento fonológico na aprendizagem de narrativa escrita por crianças no 2º e no 3º ano do Ensino Fundamental. Revista Veredas. 2016;16(9):152-70.
• ¹⁴
  Chacon L, Vaz S. Relações entre aquisição da percepção auditiva e aprendizagem da ortografia: consoantes soantes em questão. Ling (dis)curso. 2013;13(3):695-719.
• ¹⁵
  Santos TSL, Câmara CC, Moreira DR, Borges LL. Processamento auditivo central em crianças com dificuldades acadêmicas: revisão bibliográfica. Estudos Vida e Saúde. 2015;42(3):327-43.
• ¹⁶
  Gonçalves BAG, Capellini AS. Desempenho de escolares de 1ª série na bateria de identificação de erros de reversão e inversão na escrita: estudo preliminar. Rev CEFAC. 2010;12(6):998-1008. http://dx.doi.org/10.1590/S1516-18462010005000060.
  » http://dx.doi.org/10.1590/S1516-18462010005000060
• ¹⁷
  Cardoso AMS, Silva MM, Pereira MMB. Consciência fonológica e a memória de trabalho de crianças com e sem dificuldades na alfabetização. CoDAS. 2013;25(2):110-4. http://dx.doi.org/10.1590/S2317-17822013000200004. PMid:24408238.
  » http://dx.doi.org/10.1590/S2317-17822013000200004
• ¹⁸
  Gafoor KA, Remia KR. Influence of phonological awareness, morphological awareness and non-verbal ability on reading comprehension in Malayalam. Guru Journal of Behavioral and Social Sciences. 2013. 1(3):128-38.
• ¹⁹
  Silva C, Capellini SA. Desempenho de escolares com e sem transtorno de aprendizagem em leitura, escrita, consciência fonológica, velocidade de processamento e memória de trabalho fonológica. Revista Psicopedagogia. 2013;30(91):3-11.
• ²⁰
  Bigarelli JPF, Avila CRB. Habilidades ortográficas e de narrativa escrita no ensino fundamental: características e correlações. J Soc Bras Fonoaudiol. 2011;23(3):237-47.
• ²¹
  Caliatto SG, Fernandes DC. Análise pelo modelo de Rasch do ditado ADAPE. PSICO. 2014;45(2):270-80. http://dx.doi.org/10.15448/1980-8623.2014.2.16820.
  » http://dx.doi.org/10.15448/1980-8623.2014.2.16820
• ²²
  Pawlowski J, Remor E, Salles JF, Parente MAMP, Fonseca RF, Bandeira DF. Evidência de validade de construto do NEUPSILIN utilizando Análise Fatorial Confirmatória. Actual Psicol. 2014;28(117):37-52. http://dx.doi.org/10.15517/ap.v28i117.14097.
  » http://dx.doi.org/10.15517/ap.v28i117.14097
• ²³
  Avila CRB, Kida ASB, Carvalho CAF, Cogo-Moreira H, Lúcio PS. Construção de uma bateria para avaliação da compreensão leitora para escolares do Ciclo I do Ensino Fundamental. São Paulo: FAPESP; 2014. Relatório Científico Projeto de Pesquisa Regular – FAPESP.
• ²⁴
  Pinheiro AMV. Contagem de frequência de ocorrência de palavras expostas a crianças na faixa pré-escolar e séries iniciais do 1º grau. São Paulo: ABD; 1996.
• ²⁵
  Christófaro-Silva TC, Almeida LS, Oliveira-Guimarães DML, Martins RMF. Corpus do e-Labore. Belo Horizonte: Universidade Federal de Minas Gerais; 2009. [citado em 2009 Ago 23]. Disponível em: www.projetoaspa.org/elabore
  » www.projetoaspa.org/elabore
• ²⁶
  Backer FB. The basics of item response theory. Washington: ERIC; 2001.
• ²⁷
  Batista AO, Capellini SA. Desempenho ortográfico de escolares do 2º ao 5º ano do ensino privado do município de Londrina. Psicol Argum. 2011;29(67):411-25.
• ²⁸
  Brasil. Ministério da Educação – MEC. Secretaria de Educação Fundamental – SEF. BNCC - Base Nacional Comum Curricular – 3ª versão. Brasília: MEC/SEF; 2017. [citado em 2017 Jun 1]. Disponível em: http://basenacionalcomum.mec.gov.br/images/BNCC_publicacao.pdf
  » http://basenacionalcomum.mec.gov.br/images/BNCC_publicacao.pdf
• ²⁹
  Huback A. A interferência da frequência em fenômenos linguísticos. DELTA Doc Estud Lingüíst Teór Apl. 2014;29(1):79-94.

Publication Dates

• Publication in this collection
  18 June 2018
• Date of issue
  2018

History

• Received
  23 Aug 2017
• Accepted
  04 Dec 2017