Portuguese adaptation of Shulman ’ s test of pragmatic skills Adaptação para o português do teste de habilidades pragmáticas de Shulman

Accepted: August 17, 2017 Study carried out at Universidade de São Paulo – USP São Paulo (SP), Brasil. 1 Universidade de São Paulo – USP São Paulo (SP), Brazil. Financial support: Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP), Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) and Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES). Conflict of interests: nothing to declare. ABSTRACT


INTRODUCTION
In recent years, the models of understanding the pragmatic aspects of language (1)(2)(3) have had a major impact on the study of language disorders.Within a broad perspective, these models attempt to characterize the individual's communicative competence by reflecting a complex dynamic between concepts: knowledge of the structural language (knowledge of the linguistic code), presuppositional knowledge (ability to make correct judgments about how a statement should be, to be appropriate to the speaker's intention) and conversational knowledge (understanding conversational rules within an interactive society).This functional perspective provides the basis for understanding how language is determinant for communicative success (4) .
For an individual to succeed in communication, he should not only be able to use language in a given situation appropriately, but he must also be able to understand the social cues used by the interlocutors (5) .This kind of pragmatic competence may include verbal, paralinguistic and non-verbal communication skills, as well as social understanding and communicative context (6) .
Using the context as a premise and thinking about its variety related to the use of language, the listener's interpretation of the speaker's intentions is of extreme importance (7) , so it is possible to handle like other aspects of language (phonology, semantics, morphology, and syntax) are used in conversational contexts (8,9) , highlighting the important intersection between language development and social interactions (10) .
Pragmatics analyses the function of language in communication (11) and refers to a series of rules that explain or regulate the intentional use of language (12) .Communication skills are related to an individual's ability to participate in an interactive sequence of speech acts with the goal of communicative exchange.Thus, communicative competence is the ability to use language as an effective tool for interacting in other social contexts.This competence involves the speaker's communicative intent, regardless of the means used for communication.
The communicative act is the minimum unit of analysis of the pragmatic aspects, focusing on each communicative shift, regardless of the general organization of the dialogue (13) .They can be studied in their language structure, the intentions they convey (this is the general focus of the analysis) and their effects on the listener.However, the acts analyzed are necessarily those that fit into a certain idea of assertiveness.The communicative intention is the overlapping point of the intention to communicate, to want to be understood and to understand the social mechanisms necessary to accomplish the task.Therefore, these initiatives are the privileged meeting point between one individual and the other.
However, the communicative exchanges are double.On one side, there is an initiative and, on the other hand, there is the responsiveness (14) .The exchange will only be effective if participants share a common core of interaction (15) .During a dialogue, there must be an effective adjustment between speech and silent segments as well as non-verbal elements (16) .An unanswered statement is considered to be a communicative failure by the initiator, and therefore most responses have a very important value in maintaining the communicative flow.Some authors (13,16) have studied the question of responsiveness in children.The authors proposed four kinds of adjustment between the preceding discourse and the response.In this way, they aimed to understand the degree of harmony determined between the interlocutors.Answering means understanding the previous discourse, being interested in continuing to speak, providing new information and ensuring a turnaround.In this way, responding is -as well as initiatives -another privileged meeting place between one individual and the other.
Other authors (17) considered responsiveness as a new proposal for pragmatic analysis and concluded that considering responses from the perspective of the functional profile of communication, relevant information on the overall structure of communicative intentions and on broader communicative skills are provided, is very important for language evaluation.
The Test of Pragmatic Skills (18) (ToPS) is a traditional test that, for its ease of application, it has been used in several studies.It is composed of four sets of simple activities, with the common material, applicable in a short time (about 15 minutes).It has normal data for American and Greek children and it is being applied in some countries in the East.
The possibility of expanding resources for speech-language diagnosis using instruments that can be shared internationally represents a significant contribution to science and relevant to clinical practice.Thus, the purpose of this study is to apply the translated version of the ToPS-R.
There is a need for internationally recognized instruments that are applicable nationally.Thus, the proposal to adapt the Portuguese ToPS-R began to be conducted by translating the test manual into Portuguese, its back-translation by two people fluent in English (a speech therapist and a non-speech therapist) and the author's approval of the Brazilian Portuguese version.The purpose of this article is to apply the protocol with typical Brazilian children.

METHODS
This study was approved by the Research Ethics Committee of the institution under number 366/13.Those responsible for all study participants signed the Informed Consent Form agreeing with the children's participation in the research.

Casuistry
The criteria considered for the inclusion of the participants in the research were: • Do not have history of serious developmental changes; • Do not have sensory losses; • Be regularly enrolled in the public education network in São Paulo; • Did not perform speech and/or psychotherapeutic treatment; • Have the Portuguese language as the only language.
From these criteria, there were 60 children selected from 3:0 to 8:11 years old, with five girls and five boys in each age group.
The test was applied to each participant's school in a reserved room.Participants were divided into four groups, according to their age.The G1 consisted of five girls and five boys aged between 3:00 and 3:11 years old, from the kindergarten 1; the G2, was composed of five girls and five boys between 4:00 and 4:11 years old, from the kindergarten 2; the G3 was composed of five girls and five boys aged between 5:00 and 5:11 years old, from the preschool; the G4 was composed of five girls and five boys between 6:00 and 6:11 years old from the 1 st grade; the G5 was composed of five girls and five boys between 7:00 and 7:11 years old from the 2 nd grade; and the G6 consisted of five girls and five boys aged 8:00 to 8:11 years old from the 3 rd grade.

Material
The objects proposed by the original test were used: • Two medium-sized cloth puppets, one male, and one female; • Two toy telephones; • 10 colored cubic blocks of MDF; • A worksheet containing three printed geometric shapes; • Pencil.Also, the material used in this study included the test task guide and a camera, for filming the test.

Procedures
After the definition of the participants, each student was presented with a prior presentation to the groups and the classroom activities were followed for two weeks to familiarize the children with them.Also, prior to the application of the test, they would talk informally with each child to create a friendly situation.
The tasks were proposed exactly as described in the task guide.If the child failed or did not respond after the first attempt, it was repeated only once.The time of the test application varied between seven and 25 minutes.The details of the evaluative tasks and the possibilities of communicative intentions are shown in Table 1.

Data analysis
Once applied, each task of the test is scored according to linguistic sophistication and how appropriate the response is.The scoring scale ranges from 0 to 5 and is described in Chart 1.
After the score of each task, the Average Composite Score (ACS) is calculated, which is defined by the sum of the score of the four tasks divided by four (average).From this score, it is possible to determine the percentile of each child's performance from the normative table according to the age group (18) .

RESULTS
Data were analyzed according to the groups in relation to the age groups.The minimum and maximum scores, mean, median and standard deviation of each of the tasks are presented below.Task 1 consists of two puppets talking about their favorite television shows.Task 2 involves the child copying drawings in lines in three different formats.The use of communicative intentions by the child is the most important in this task and not the drawings.The drawings are only meant to facilitate the desired actions.Task 3 is intermediated by toy telephones and the examiner and the child talk.Task 4 involves 10 blocks of wood and the examiner and the child talk, a task is performed with the blocks whose goal is not the correctness of the task, but the possibility of presenting communicative initiative from the interaction.The score that reflects the performance of the groups in the 4 tasks is shown in Table 2.
The ACM was obtained from the simple mean of the scores of the four tasks and the data are presented below in Table 3, which synthesizes the score data obtained in each of the groups.
ACM data generated the percentile of each individual's performance from the normative table.The figure below (Figure 1) shows the performance in relation to the groups divided by the percentiles.
Student's t-test with a 95% confidence interval was performed to determine if the most frequent percentile was significant for each of the groups.The 99 percentile was the most frequent for G1 and G2, is significant for these age groups (p=0.001 and p<0.0001, respectively).
G3 presented the highest variability in percentiles distribution, with the percentile <10, being the most frequent, but this data was not significant (p=0156).For G4, the most frequent percentile was 50, is significant (p=0.0003) for this age group.The percentile <10 was also the most frequent in G5 and, for this age group, it was significant (p=0.005).For G6, the most frequent percentile was 25, is significant for this age group (p=0.0001).

DISCUSSION
The Test of Pragmatic Skills is able to describe the pragmatic abilities of children between 3 and 8 years old due to changes in communicative contexts.This assessment instrument was designed with the purpose of being used in several clinical conditions with suspected language alterations related to the inappropriate use or lack of communicative intention.
The objective of this research was to apply the Portuguese version of TOPS developed by Shulman (18) in 1986 in Brazilian children.The standardization of the test was performed with middle-class American children with the numerical balance  between genders and those based on American census data of the time and diversified among the geographic regions of the USA.Therefore, the objective of this work does not involve standardization and nor definition of norms of normality for the Brazilian population, but a possibility of evaluation and characterization of the pragmatic aspects of the studied population.
The performance in the tasks and in the ACM was better in the participants of groups 1 and 2 and worse in the older children (from 5 years old).Considering the date of development of the test -1986 -it is congruent to assume that the tests performed in the tasks may be directly related to the lack of interest of the older children, as observed in the application.
Also, authors suggest (19) that some pragmatic aspects are not measurable only in small samples, but rather need richer and broader moments of conversation.
When comparing the mean data obtained in the studied population with the mean data obtained in the normalization, we can see that the participants of groups 1 and 2 present average performance in the tasks and, in ACM, better than those obtained with American children, but the participants of groups 3, 4, 5 and 6 present worse performance than those presented in the American data.
A study by Chakrabarty et al. (20) suggested that education is an important variable that interferes with individuals' pragmatic abilities.Another study (21) found that children with learning difficulties presented lower scores than children of typical development in a test that investigates pragmatic abilities, mainly regarding the amount of speech acts, inadequate maintenance of the topic, change of shift, limitation of strategies for repairing communicative breaks, and coherence and cohesion.
Considering the educational issue and relating it to the social positioning of the individuals in this study, we are led to conclude that the educational abilities and school performance of older Brazilian children (from 5 years old) are more dissimilar than American children.This fact seems to be determinant, not exactly in the pragmatic development of language, but rather within an evaluative perspective of the pragmatic aspects, perhaps as regards sensitivity (or lack of it) in standardized instruments.
A study carried out in 2016 by Spanoudis (22) also concluded that the tasks presented by them did not effectively measure the intended evaluation constructs, often due to the difficulties of the tasks, and also associates with the possibility of diversification linguistic issues, which are more interfering with pragmatic skills.

CONCLUSION
Standardized and validated tests in other languages and widely used to evaluate children's language are extremely important for clinical research and definition of specific parameters for diagnostic criteria within Brazilian Speech-Language Pathology.However, understanding the limitations and possibilities of these protocols when applied from a translation proposal is part of the process of investigating the sensitivity of the instrument to the language before its correct validation and diffusion.
When tested with TOPS, Brazilian children tend to perform better when they are younger.Several qualitative factors may be related to this performance, the interest in the activities seems to be determinant since the younger children became more interested in the materials and tests proposed by the test.On the other hand, this test seems to be more sensitive to identify the variability of the performance of children between 5 and 6 years old, but more studies are necessary to increase the number of participants in the age groups studied so these statements can be better substantiated.
Also, one of the limitations found in this study was regarding the studied population.Perhaps, expanding the sample in relation to the different social levels may be an important strategy to better characterize the Brazilian population evaluated by TOPS.

Table 1 .
Detailed evaluation tasks

Table 3 .
TOPS PCM group performance Figure 1.Performance of the groups in the age group according to the percentiles