Acessibilidade / Reportar erro

Clinical validation of the Preterm Oral Feeding Readiness Assessment Scale

La validación clínica del Instrumento de Evaluación de la Prontitud de los Prematuros para Iniciación de la Alimentación por Vía Oral

Abstracts

INTRODUCTION: Health professionals have great difficulties to establish the adequate and safe time to start breast feeding in preterm infants. There is a need to develop a standardized tool to help health professionals to comprehensively evaluate preterm infant readiness to transition preterm infants´ feeding from gastric to oral, and encourage breast feeding practice in neonatal units. Aims: To clinical validate the accuracy of a Preterm Oral Feeding Readiness Assessment Scale with 60 clinically stable preterm infants. METHODS: Global accuracy, sensitivity and specificity of Preterm Oral Feeding Readiness Assessment Scale cut-offs, compared to milk intake through translactation, were estimated through ROC curves (Receiver Operating Characteristic Curves). RESULTS: The global accuracy of Preterm Oral Feeding Readiness Assessment Scale was 74.38%. The highest sensitivity and specificity were obtained for three cut-offs: 28, 29 and 30. Since higher specificity (75.68%) for the Preterm Oral Feeding Readiness Assessment Scale was found at a score cut-off=of 30 showed higher specificity (75.68%), it should be used as a cut-off score to select initiate breastfeeding the preterm newborns' oral feeding readiness. CONCLUSION: The Preterm Oral Feeding Readiness Assessment Scale is considered valid to assist health professionals to initiate preterm feeding in view of promoting safe and objective breastfeeding.

Infant, Premature; Feeding Behavior; Breast Feeding; ROC Curve


INTRODUCCIÓN: Profesionales de la salud tienen grandes dificultades para establecer el momento adecuado y seguro para iniciar la lactancia en prematuros. Hay una necesidad de se desarrollar un instrumento para ayudar a estos profesionales en la transición de la alimentación gástrica para oral en prematuros mediante el fomento de la lactancia en las unidades neonatales. Objetivo: Evaluar la precisión de el Instrumento de Evaluación de la Prontitud de los Prematuros para Iniciación de la Alimentación por Vía Oral. MÉTODO: Participaron 60 prematuros clínicamente estables y que no recibieron alimentación oral. La precisión global, la sensibilidad y la especificidad del instrumento, en comparación con la ingestión de leche por translactancia se estimaron mediante curvas ROC. RESULTADOS: La precisión global del instrumento fue del 74,38%. La mayor sensibilidad y especificidad se obtuvieron para tres puntos de corte: 28, 29 y 30. Como el punto de corte=30 del instrumento mostró mayor especificidad (75,68%), sugerimos que debe utilizarse para seleccionar los prematuros con prontitud para la alimentación oral. CONCLUSIÓN: El Instrumento se valida para ayudar a los profesionales de la salud en la iniciación de la alimentación en los prematuros, con vistas a la lactancia de manera segura y objetiva.

Prematuro; Conducta Alimentaria; Lactancia Materna; Curva ROC


INTRODUÇÃO: profissionais de saúde têm grande dificuldade para estabelecer o momento adequado e seguro para iniciar a amamentação em prematuros. Há necessidade de desenvolver um instrumento padronizado para auxiliar esses profissionais, na transição da alimentação gástrica para via oral do prematuro, incentivando a prática da amamentação nas unidades neonatais. Objetivo: avaliar a acurácia do Instrumento de Avaliação da Prontidão do Prematuro para Início da Alimentação Oral. MÉTODO: participaram do estudo 60 prematuros clinicamente estáveis e que não haviam recebido alimentação oral. A acurácia global, sensibilidade e especificidade do instrumento, em comparação à ingestão de leite por meio da translactação, foram estimadas através de curvas ROC (Receiver Operating Characteristic Curves). RESULTADOS: a acurácia global do instrumento foi de 74,38%. A maior sensibilidade e especificidade foram obtidas para três pontos de corte: 28, 29 e 30. Como o ponto de corte=30 do instrumento apresentou maior especificidade (75,68%), sugere-se, aqui, que deverá ser usado para selecionar os prematuros com prontidão para início da alimentação oral. CONCLUSÃO: o Instrumento de Avaliação da Prontidão do Prematuro para Início da Alimentação Oral está validado para assistir os profissionais de saúde a iniciar a alimentação do prematuro, com vistas ao aleitamento materno, de forma segura e objetiva.

Prematuro; Comportamento Alimentar; Aleitamento Materno; Curva ROC


ORIGINAL ARTICLE

Clinical validation of the Preterm Oral Feeding Readiness Assessment Scale1 1 Paper extracted from Doctoral Dissertation "Prontidão do prematuro para início da alimentação oral: confiabilidade e validação clínica de um instrumento de avaliação" presented to Escola de Enfermagem de Ribeirão Preto, Universidade de São Paulo, WHO Collaborating Centre for Nursing Research Development, Brazil. This research was supported by Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), process # 303519/2010-0 and Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP), process # 2011/04236-3

La validación clínica del Instrumento de Evaluación de la Prontitud de los Prematuros para Iniciación de la Alimentación por Vía Oral

Cristina Ide FujinagaI; Suzana Alves de MoraesII; Nelma Ellen Zamberlan-AmorimIII; Thaíla Corrêa CastralIV; Andreara de Almeida e SilvaV; Carmen Gracinda Silvan ScochiVI

IPhD, Adjunct Professor, Universidade Estadual do Centro-Oeste do Paraná, Brazil

IIPhD, Associate Professor, Escola de Enfermagem de Ribeirão Preto, Universidade de São Paulo, WHO Collaborating Centre for Nursing Research Development, Brazil

IIIPhD, Audiologist

IVPhD, Adjunct Professor, Universidade de Goiás, Brazil

VMaster's student, Escola de Enfermagem de Ribeirão Preto, Universidade de São Paulo, WHO Collaborating Centre for Nursing Research Development, Brazil

VIPhD, Full Professor, Escola de Enfermagem de Ribeirão Preto, Universidade de São Paulo, WHO Collaborating Centre for Nursing Research Development, Brazil

Corresponding Author Corresponding Author: Cristina Ide Fujinaga Universidade Estadual do Centro-Oeste do Paraná Rodovia PR153, s/n Bairro Riozinho CEP: 84500-000, Irati, PR, Brasil E-mail: cifujinaga@gmail.com

ABSTRACT

INTRODUCTION: Health professionals have great difficulties to establish the adequate and safe time to start breast feeding in preterm infants. There is a need to develop a standardized tool to help health professionals to comprehensively evaluate preterm infant readiness to transition preterm infants´ feeding from gastric to oral, and encourage breast feeding practice in neonatal units. Aims: To clinical validate the accuracy of a Preterm Oral Feeding Readiness Assessment Scale with 60 clinically stable preterm infants.

METHODS: Global accuracy, sensitivity and specificity of Preterm Oral Feeding Readiness Assessment Scale cut-offs, compared to milk intake through translactation, were estimated through ROC curves (Receiver Operating Characteristic Curves).

RESULTS: The global accuracy of Preterm Oral Feeding Readiness Assessment Scale was 74.38%. The highest sensitivity and specificity were obtained for three cut-offs: 28, 29 and 30. Since higher specificity (75.68%) for the Preterm Oral Feeding Readiness Assessment Scale was found at a score cut-off=of 30 showed higher specificity (75.68%), it should be used as a cut-off score to select initiate breastfeeding the preterm newborns' oral feeding readiness.

CONCLUSION: The Preterm Oral Feeding Readiness Assessment Scale is considered valid to assist health professionals to initiate preterm feeding in view of promoting safe and objective breastfeeding.

Descriptors: Infant, Premature; Feeding Behavior; Breast Feeding; ROC Curve.

RESUMEN

INTRODUCCIÓN: Profesionales de la salud tienen grandes dificultades para establecer el momento adecuado y seguro para iniciar la lactancia en prematuros. Hay una necesidad de se desarrollar un instrumento para ayudar a estos profesionales en la transición de la alimentación gástrica para oral en prematuros mediante el fomento de la lactancia en las unidades neonatales. Objetivo: Evaluar la precisión de el Instrumento de Evaluación de la Prontitud de los Prematuros para Iniciación de la Alimentación por Vía Oral.

MÉTODO: Participaron 60 prematuros clínicamente estables y que no recibieron alimentación oral. La precisión global, la sensibilidad y la especificidad del instrumento, en comparación con la ingestión de leche por translactancia se estimaron mediante curvas ROC.

RESULTADOS: La precisión global del instrumento fue del 74,38%. La mayor sensibilidad y especificidad se obtuvieron para tres puntos de corte: 28, 29 y 30. Como el punto de corte=30 del instrumento mostró mayor especificidad (75,68%), sugerimos que debe utilizarse para seleccionar los prematuros con prontitud para la alimentación oral.

CONCLUSIÓN: El Instrumento se valida para ayudar a los profesionales de la salud en la iniciación de la alimentación en los prematuros, con vistas a la lactancia de manera segura y objetiva.

Descriptores: Prematuro; Conducta Alimentaria; Lactancia Materna; Curva ROC.

Introduction

Preterm infants have not managed to coordinate sucking and swallowing with breathing. The transition from gavage to full oral feeding is important to obtain adequate nutritional intake for growth, maintain physiologic regulation and remain engaged in the feeding process(1). Breast feeding is the recommended feeding method for preterm infants due to its countless nutritional, immunological, psychological and emotional benefits, favoring maternal bonding(2).

In clinical practice, health professionals (e.g. physicians, nurses and speech-language pathologists) have difficult to establish the adequate time to start breast feeding in preterm infants. Gestational age and weight are the most common indicators used by these professionals to assess oral feeding readiness in preterm infants. Gestational age is a criterion that indicates the preterm infant's maturity. On the other hand, weight does not indicate the maturity of the infant or oral skills, especially in cases of very low birth weight neonates. These preterm infants suffer prolonged multisensory deprivation, hence take time to gain weight but do not necessarily present delays in neurodevelopment and oral-motor maturity(1). Thus, these are not objective criteria to indicate breast feeding for preterm infants. Maturity should also be considered associated with other variables, such as clinical stability, state of consciousness, oral-motor skills and coordination of sucking, swallowing and breathing functions(3).

Current available oral feeding assessment scales for preterm infants were developed only for transition to bottle-feeding(1,3-7). The World Health Organization (WHO) promotes breast feeding as the best practice worldwide; however it poses a challenge for those health professionals who have to decide when to initiate breast feeding for a preterm infant. Due to the lack of standardized evidenced-based methods to evaluate preterm readiness to breast feeding we developed the Preterm Oral Feeding Readiness Assessment Scale (POFRAS)(8-9) to help health professionals to systematically establish the adequate time to safely initiate breast feeding in preterm infants and encourage breast feeding practice in neonatal units. The current study aimed to evaluate the accuracy of POFRAS in preterm newborns.

Methods

The study sample consisted of 60 preterm infants who had ≤ 36 weeks and 6 days of corrected gestational age; no facial deformities; absence of respiratory, cardiovascular, gastrointestinal and neurological disorders or syndromes; and no oral feeding intake.

The study was conducted at the neonatal intermediate care unit of a university hospital at Ribeirão Preto-SP, Brazil. At this unit breast feeding and kangaroo care are encourage for all stable preterm infant and a human milk bank is available to assist the mothers in maintain lactation(10). The present study was approved by the Research Ethics Committee (protocol n. 6225/2003) at the institution and informed consent was obtained from all mothers.

POFRAS is comprised of five main categories with a total of 18 items that consist of: 1) corrected gestational age (≤ 32 weeks; 32-34 weeks and ≥ 34 weeks); 2) behavioral organization (behavioral state, global posture and global tonus); 3) oral posture (lips and tongue posture); 4) oral reflexes (rooting, sucking, biting and gag reflexes) and 5) non-nutritive sucking (tongue movement, tongue cupping, jaw movement, sucking strain, sucking and pause, maintenance of sucking/pause, maintenance of alert state and stress signs). The preterm infant's performance in each item is assessed from 0 (zero) to 2 (two), with total score ranging from 0 to 36(8-9). It was previously assessed by fifteen judges for content and face validation, with an inter-rater agreement level of 0.85 or higher(8). In other study, inter-rater reliability reached excellent agreement scores for behavioral state, global posture and tonus, lips and tongue posture, gag reflex and maintenance of alert state categories (K ≥ 0.75); satisfactory for rooting reflex, sucking and biting and jaw movement, sucking strain and sucking and pause (K = 0.40 - 0.75) and unsatisfactory for tongue cupping, maintenance of sucking/pause and stress signs (K ≤ 0.40)(9).

In order to assess infant's oral feeding readiness all participants were assessed with POFRAS by the main researcher (C.I.F.) 15 minutes before preterm infants have initiated gavage feeding.

The researcher first positioned the infant in lateral decubitus inside the incubator and stimulated the infant to wake up by audio (e.g. call baby's name), visual (e.g. eye-to-eye contact) and tactile stimuli (e.g. extension of limbs movements). Then, the researcher assessed infant's behavioral organization and oral posture. Next, the researcher observed infant's oral reflexes and nonnutritive sucking using a gloved little finger.

After POFRAS application, the researcher placed the infant at the mother's breast for breast feeding. To objectively quantify the milk volume intake by the infant we used the translactation technique. Translactation is an adaptation of the relactation technique(11) and represents an alternative feeding method for prematures(12-13). The researcher offered 5ml of breast milk pumped from the mother through a tube connected to a syringe, fixed between the mother's breasts, with the other end of the tube fixed next to the mother's nipple. The syringe milk flow was controlled by the preterm's suction with pauses for breathing while breast feeding(12). Thus, the milk only flows into the preterm's oral cavity when sucking is present.

The following criteria were adopted to interrupt the breastfeeding session: absence of suction for more than 5 minutes and/or presence of clinical signs interfering with the preterm infant's stability (e.g. apnea or cough).

Few studies address preterm infants’ breast feeding performance(14-16). In the present study, we considered as the “gold standard” when the infant was able to feed 5ml of breast milk. This decision was based on previous studies that considered efficient sucking at the maternal breast as either milk intake of 5ml with the presence of sucking movements upon the preterm’s initial contact with the mother, or the presence of oral milk intake, independently of the device used (bottle, cup or bottle with fine nipple)(7).

Global accuracy, sensitivity and specificity of POFRA cut-offs, compared to the gold standard (ingestion of 5ml of breast milk by the infant), were estimated through ROC curves (Receiver Operating Characteristic Curves) using Stata vs. 8.2.

Results

Infant´s mean birth weight was 1418g (±326g), mean gestational age of 32 weeks and 3 days determined by Ballard, mean Apgar score at 1st minute was 6 and at 5th minute was 9. On the day of data collection, infant´s mean postnatal age was 13 days, mean corrected gestational age of 34 weeks and 3 days and a mean weight of 1484g.

The distribution of POFRAS total scores for the assessed infants was normal. Minimum score was 14 and maximum 36, with an average score of 27 (±4.58).

The area under the ROC curve (global accuracy) was 74.38% (Figure 1).


Three cut-offs: 28, 29 and 30 showed the highest values for sensitivity and specificity (Table 1).

Discussion

POFRAS is the first scale that includes objective criteria to assess preterm infants' readiness to start breast feeding. Few studies describe preterm infants' behavior at the mother's breast. A protocol to assess the development of the preterm's behavior at the mother's breast is being validated(17).

Although other assessment scales are current available, they were developed mainly for bottle feeding(4,18) and only one has been validated. Two studies tested the validity and reliability of The Neonatal Oral–Motor Assessment Scale (NOMAS) in term and preterm infants(18-19). Two of the three categories of NOMAS, normal and disorganized, have soundly psychometric properties and have demonstrated to be useful in the clinical setting. However, the dysfunction category needs further validation(19). NOMAS should be re-adjusted in order to improve inter-rater agreement and, at the same time, current insights into the development of sucking and swallowing should be incorporated in the method(18).

In the present study, three cut-offs presented sensitivity and specificity values > 60%. Although, we recommend 30 the best cut-off point to select preterm oral feeding readiness assessment, since the correspondent specificity (75.68%) indicated a lesser proportion of false-positives.

The translactation technique was the method of choice to objectively measure the quantity of milk the infant consumed. In this technique, the preterm's movements are similar to what occurs during breast feeding(12-13). Studies have used the weight difference before and after breast feeding to verify the milk volume ingested by the preterm(3,17). However, this difference is questionable(20-21), mainly when considering the small quantity ingested and the low-weight of these infants(22). Specialists consider video fluoroscopy a gold standard to assess suction and swallowing. But this exam requires the intake of food with barium, involving risk for the preterm infant's health. Moreover, it is expensive and available at few hospitals only. Another disadvantage is that it does not permit verifying suction at the maternal breast.

We consider the POFRAS an easily applicable instrument in clinical practice to assist health professionals to decide when to initiate breast feeding and encourage breast feeding practice in neonatal units. Early initiation of breast feeding has several beneficial effects to the preterm such as physiological, affective, social and developmental advantages and improves quality of life(2-3,23). Additionally, it increases milk production, reducing hypogalactia and early weaning among preterms(24).

For a long time, breast feeding was considered more demanding for preterm infants, due to the belief that breastfeeding would lead to greater energy consumption and, hence, greater weight loss. Studies demonstrate, however, that breast feeding, in comparison to bottle feeding, result in less variation in oxygen saturation and put the infant in a lower risk of adverse effects(25). Cup feeding is another method used in the transition from gastric to oral feeding but, in this technique infants practice a different oral-motor pattern than what is used for breast or bottle feeding(2). Other alternative techniques to support the preterm infants to make a transition from oral feeding to breast feeding are relactation, translactation and the breast-orogastric tube. These techniques contribute to a more physiological feeding transition and an earlier hospital discharge in full breast feeding, besides having mother in an active role(13).

Conclusions

POFRAS has demonstrated to be a precise and comprehensive instrument to help health professionals (e.g. physicians, nurses and speech-language pathologists) to assess preterm oral feeding readiness to start breast feeding, without risks for the infant. An advantage of POFRAS is that it consist of a comprehensive instrument that assess different factors, including maturity, oral-motor skills, oral-motor, neural and sucking development in the preterm infant.

One limitation of this study is the small sample size. The researchers are currently validating a brief version of POFRAS with a larger number of infants.

Received: July 31st 2012

Accepted: Oct. 1st 2012

Erratum

Issue v21nSpec, Page 143

For

Few studies address preterm infants’ breast feeding performance(14-15). In the present study, we considered as the "gold standard" when the infant was able to feed 5ml of breast milk. This decision was based on previous studies that considered efficient sucking at the maternal breast as either milk intake of 5ml with the presence of sucking movements upon the preterm’s initial contact with the mother(16), or the presence of oral milk intake, independently of the device used (bottle, cup or bottle with fine nipple)(7).

Read

Few studies address preterm infants’ breast feeding performance(14-16). In the present study, we considered as the “gold standard” when the infant was able to feed 5ml of breast milk. This decision was based on previous studies that considered efficient sucking at the maternal breast as either milk intake of 5ml with the presence of sucking movements upon the preterm’s initial contact with the mother, or the presence of oral milk intake, independently of the device used (bottle, cup or bottle with fine nipple)(7).

Page 144

For

Studies have used the weight difference before and after breast feeding to verify the milk volume ingested by the preterm(3,16-17).

Read

Studies have used the weight difference before and after breast feeding to verify the milk volume ingested by the preterm(3,17).

  • 1. Thoyre SM. Developmental transition from gavage to oral feeding in the preterm infant. Annu Rev Nurs Res. 2003;21:61-92.
  • 2. Nascimento MB, Isller H. Breast feeding in premature infant in hospital clinical management. J Pediatr. 2004;80:S163-72.
  • 3. Lemons PK, Lemons JA. Transition to breast/bottle feedings the premature infant. J Am Coll Nutr. 1996;15:126-35.
  • 4. Palmer MM, Crawley K, Blanco IA. Neonatal Oral-Motor Assessment Scale: a reability study. J Perinatol. 1993;13:28-35.
  • 5. Xavier C. Avaliação de alimentação de recém-nascidos em fase de hospitalização (Escala de avaliação motora oral da Irmandade Santa Casa de Misericórdia de São Paulo). Pro Fono. 1995;7:69-74.
  • 6. Neiva FCB. Proposta de um formulário de avaliação da sucção de recém-nascidos. Pro Fono. 2000;12:113-9.
  • 7. Neiva FN, Leone C, Leone CR. Non-nutritive sucking scoring system for preterm newborns. Acta Paediatr. 2008;97:1370-5.
  • 8. Fujinaga CI, Scochi CGS, Santos CB, Zamberlan NE, Leite AL. Validação de um instrumento de avaliação da prontidão do prematuro para início da alimentação oral. Rev Bras Saude Matern Infant. 2008;8:391-9.
  • 9. Fujinaga CI, Zamberlan NE, Rodarte MDO, Scochi CGS. Confiabilidade do instrumento de avaliação da prontidão do prematuro para início da alimentação oral. Pro Fono. 2007;19:143-50.
  • 10. Scochi CGS, Kokuday MLP, Riul MJS, Rossanez LSS, Fonseca LMM, Leite AM. Encouraging mother-child attachment in prematurity situations: nursing interventions at the Ribeirao Preto Clinical Hospital. Rev. Latino-Am. Enfermagem. 2003;11(4):539-43.
  • 11. Rogers IS. Relactation. Early Hum Dev. 1997;49:S75-81.
  • 12
    Ministério da Saúde (BR). Secretaria de Políticas Públicas. Área Técnica de Saúde da Criança. Atenção humanizada ao recém-nascido de baixo peso: método canguru. Manual técnico. Brasília: Ministério da Saúde; 2011.
  • 13. Aquino RR, Osório MM. Relactation, translactation and breast-orogastric tube as transition methods in feeding preterm babies. J Hum Lact. 2009;25(4):420-6.
  • 14. Thoyre SM, Shaker CS, Pridham KF. The early feeding skills assessment for preterm infants. Neonatal Netw. 2005;24:7-16.
  • 15. Furman L, Minich NM. Evaluation of breastfeeding of very low birth weight infants: can we use the breastfeeding assessment tool? J Human Lact. 2006;22:175-81.
  • 16. Nyqvist KH, Sjödén PO, Ewald U. The development of preterm infants' breastfeeding behavior. Early Hum Dev. 1999;55:247-64.
  • 17. Nyqvist KH, Rubertsson C, Ewald U, Sjödén PO. Development of the preterm infant breastfeeding behavior scale: a study of nurse-mother agreement. J Human Lact. 1996;12:207-18.
  • 18. Costa SP, Schans CPVD. The reliability of the Neonatal Oral-Motor Assessment Scale. Acta Paediatr. 2008;97:216.
  • 19. Howe TH, Sheu CF, Hsieh YW, Hsieh CL. Psychometric characteristics of the Neonatal OralMotor Assessment Scale in healthy preterm infants. Dev Med Child Neurol. 2007;49:9159.
  • 20. Daley HK, Kennedy CM. Meta analysis: effects of interventions on prematures infants feeding. J Perinat Neonatal Nurs. 2000;14:62-77.
  • 21. Savenije OE, Brand PL. Accuracy and precision of test weighing to assess milk intake in newborn infants. Arch Dis Child Fetal Neonatal. 2007;92:F155-6.
  • 22. Martinez FE, Araújo R, Tavares RS, Moyses JS. Pesar antes e depois é uma boa medida do volume de leite ingerido? J Pediatr. 1992;68:258-61.
  • 23. Cattaneo A, Davanzo R, Uxa F, Tanburlini G. Recomendations for the implementation of Kangaroo Mother Care for low birthweight infants. Acta Paediatr. 1998;87:440-5.
  • 24. Silvestre PK, Carvalhaes MABL, Venâncio SI, Tonete VLP, Parada CMGL. Breastfeeding knowledge and practice of health professionals in public health care services. Rev. Latino-Am. Enfermagem. 2009;17(6):953-60.
  • 25. Meier P, Anderson GC. Responses of small preterm infants to bottle-and breast-feeding. MCN Am J Matern Child Nurs. 1987;12:97-105.
  • Corresponding Author:

    Cristina Ide Fujinaga
    Universidade Estadual do Centro-Oeste do Paraná
    Rodovia PR153, s/n
    Bairro Riozinho
    CEP: 84500-000, Irati, PR, Brasil
    E-mail:
  • 1
    Paper extracted from Doctoral Dissertation "Prontidão do prematuro para início da alimentação oral: confiabilidade e validação clínica de um instrumento de avaliação" presented to Escola de Enfermagem de Ribeirão Preto, Universidade de São Paulo, WHO Collaborating Centre for Nursing Research Development, Brazil. This research was supported by Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), process # 303519/2010-0 and Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP), process # 2011/04236-3
  • Publication Dates

    • Publication in this collection
      01 Mar 2013
    • Date of issue
      Feb 2013

    History

    • Received
      31 July 2012
    • Accepted
      01 Oct 2012
    Escola de Enfermagem de Ribeirão Preto / Universidade de São Paulo Av. Bandeirantes, 3900, 14040-902 Ribeirão Preto SP Brazil, Tel.: +55 (16) 3315-3451 / 3315-4407 - Ribeirão Preto - SP - Brazil
    E-mail: rlae@eerp.usp.br