Acessibilidade / Reportar erro

Content validation of the Self-perception of Family Health Status scale using the Delphi technique

Abstracts

OBJECTIVE:

To ascertain the content validity of the Self-perception of Family Health Status scale.

METHOD:

A validation study of an instrument with an online Delphi panel using the consensus technique. Eighteen experts in the subject were intentionally selected, with a multidisciplinary origin and representing different professional fields. Each of the proposed items was assessed using a five-point scale, and open-ended questions, to modify or propose items. Descriptive analysis was performed of the sample and the items, applying criteria of validation/elimination.

RESULTS:

The first round had a response rate of 83.3% and validated 75 of the 96 proposed items; the second had a response rate of 80%, and validated the 21 newly created items, concluding the panel of experts.

CONCLUSIONS:

We present an instrument to measure self-perception of family health status, from a nursing perspective. This may be an advance in scientific knowledge, to facilitate the assessment of the state of health of the family unit, enabling detection of alterations, and to facilitate interventions to prevent consequences to the family unit and its members. It can be used in clinical care, research or teaching.

Scales; Validation Studies; Family; Family Health; Delphi


OBJETIVO:

Verificar a validade de conteúdo da escala Auto-percepção da Família sobre o estado de saúde.

MÉTODO:

Um estudo de validação de um instrumento com um painel Delphi on-line, utilizando a técnica de consenso. Dezoito especialistas no assunto, selecionados intencionalmente, de origem multidisciplinar e representando diferentes áreas profissionais. Cada um dos itens propostos foi avaliado usando uma escala de cinco pontas, e perguntas abertas, para modificação ou propostas de itens. Realizada análise descritiva da amostra e os itens, aplicando critérios de validação / eliminação.

RESULTADOS:

A primeira rodada teve uma taxa de resposta de 83,3% e validados 75 dos 96 itens propostos; a segunda teve uma taxa de resposta de 80%, e validou os 21 itens recém-criados, concluindo o painel de especialistas.

CONCLUSÕES:

Apresentamos um instrumento para medir a auto-percepção do estado de saúde da família, a partir de uma perspectiva de enfermagem. Este pode ser um avanço no conhecimento científico, a fim de facilitar a avaliação do estado de saúde da unidade familiar, permitindo a detecção de alterações, e facilitando as intervenções para evitar consequências para a unidade da família e seus membros. Ela pode ser usado em pesquisa clínica de cuidados, ou de ensino.

Escalas; Validação Estudo; Família; Saúde família; Técnica Delphi


OBJETIVO:

Comprobar la validez de contenido de la escala de Autopercepción del Estado de Salud Familiar.

MÉTODO:

Estudio de validación de instrumento con panel Delphi on-line como técnica de consenso. Se seleccionaron intencionalmente 18 expertos/as en el tema, de origen multidisciplinar y de diferentes ámbitos profesionales. Cada uno de los ítems propuestos fue valorado mediante una escala de cinco puntos, y mediante preguntas abiertas, para modificar o proponer ítems. Se realizó análisis descriptivo de la muestra y de los ítems, aplicando criterios de estimación/desestimación.

RESULTADOS:

La primera ronda tuvo una tasa de respuesta del 83,3% y se estimaron 75 ítems de los 96 propuestos; la segunda tuvo una tasa de respuesta de 80%, y se estimaron los 21 ítems de nueva creación, concluyendo el panel de expertos/as.

CONCLUSIONES:

Se presenta un instrumento para medir la Autopercepción del Estado de Salud Familiar, desde una perspectiva enfermera. Este puede suponer un avance en el conocimiento científico, al facilitar la valoración del estado de salud de la unidad familiar, permitir detectar sus alteraciones, y facilitar las intervenciones para prevenir las consecuencias de estas sobre la propia unidad familiar y sus miembros. Puede ser usado en la asistencia, investigación o docencia.

Escalas; Estudio de Validación; Familia; Salud de la Familia; Técnica Delphi


Introduction

The family is considered to be the principal nucleus of socialization of its members. It is the place where values ​​are transmitted, where ideas are learned and adopted, and beliefs and norms of conduct are acquired. Its members are grouped into subsystems separated by symbolic boundaries, each contributing to family functioning through an exercise of roles and tasks necessary for the whole(1).

With the development of systems theory, adapted to living systems, the concept of family nursing has been defined as nursing care delivered to any system or household(22. Rocha SM, Nascimento LC, Lima RA. Enfermagem pediátrica e abordagem da família: subsídios para o ensino de graduação. Rev. Latino-Am. Enfermagem. 2002;10(5):709-14.). It is necessary to be present and in intimate contact with the family, to discover ways that can fortify, mobilize, and propel it to achieve balance and well-being, going beyond the biological aspect of its members(33. Barbosa SM, Costa P, Vieria NF. Etapas de cambios de los padres en las conversaciones con los hijos sobre la prevención de HIV/SIDA. Rev. Latino-Am. Enfermagem. 2008;16(6):1019-24. ). Nurses need to conduct research to recognize the needs of families, sources of support and social networks available to promote the health of its members(44. Paula ES, Nascimento LC, Rocha SM. The influence of social support on strengthening families of children with chronic renal failure. Rev. Latino-Am. Enfermagem. 2008;16(4):692-9. ).

All of this requires a change in clinical practice, to move from an individual to a group approach, including the social context in which the family group is immersed. To achieve this change, it is necessary to have a conceptual basis, an explanatory model, and an organization capable of implementing this process(55. Balón E, De la Revilla L. La atención familiar la asignatura pendiente. Atención Primaria. 2011;43(2):55-7.).

At present, several theorists have participated in different concepts of family and nursing care of the family(66. Lima J, Lima M, Saéz A. Intervenciones enfermeras orientadas a la familia. Enferm Clín. 2009;19(5):280-3. ), which is necessary to assume the challenge of developing the concept of family health and its dimensions, from a nursing perspective that allows its valuing.

For the World Health Organization (WHO), family health describes its function as a unit of structure, in relation to the family as the primary social agent, to promote health and well-being. This is related to satisfying the needs of its members, the interactions between the individual, the family and society, the solution to problems, or the ability to adapt to crisis situations.

Family health builds on the internal dynamics of the family, in decision making, in the education and socialization of its members, and in the availability and access to resources necessary for meeting its needs(77. Mejías LD, López L. La familia y la cultura: una conexión innovadora para el cuidado de la salud. Index Enferm. 2010;19(2-3):138-42. ). It is not static, it is a continuous and dynamic process that is undergoing continuous equilibrium and change, in response to events characteristic of the life cycle and those accidental events or situations that affect them.

Family health is intimately related to the family environment, the integrity of its members, the organization and operation of the unit, the capacity for resilience when faced with problems affecting it, and ways to address those problems(66. Lima J, Lima M, Saéz A. Intervenciones enfermeras orientadas a la familia. Enferm Clín. 2009;19(5):280-3. ).

One of the difficulties in determining family health status is due to limitations that exist in the delimitation of the concept and the lack of consensus as to which indicators are needed to measure it, creating conceptual and methodological difficulties at the time of its evaluation. The Nursing Outcomes Classification (NOC) contains a set of indicators that can provide utility for overcoming these difficulties. The family health domain and family well-being class, contain the outcomes that describe the state of family health and social competence of the family as a unit in the overall family environment, including indicators of coping with family problems, family support during treatment, social climate of the family, health status of the family, family functioning, family integrity, standardization of the family, family participation in health care, and professional and family resistance(88. Moorhead S, Jonson M, Maas ML, Swanson E. Clasificación de Resultados de Enfermeria (NOC). 4ª ed. Barcelona: Elsevier; 2009. ).

From a systemic perspective of the family and a nursing approach that takes the NOC as its reference, Lima Rodriguez and colleagues, in their study of the dimensions of family health, proposed a rating system of family health which contemplated, along with the demographic aspects, the composition, structure, family life cycle and stress agents that may be impacting the family(66. Lima J, Lima M, Saéz A. Intervenciones enfermeras orientadas a la familia. Enferm Clín. 2009;19(5):280-3. ). They considered that these were: the family climate, family integrity, the function of family dynamics, family resistance, and family coping. Furthermore, when there was a family member with special needs or who required professional assistance, it was necessary to add family support, family normalization, and family participation in the care process.

To operationalize this proposal it is necessary to develop a series of instruments that, together with interviews and observation, enable the gathering of data necessary to evaluate the health of the family. Although some instruments exist that are applicable to the study of the family, for example the Family Apgar to evaluate family dynamics, the MOS questionnaire for social support, the Social Readjustment Scale for stressful life agents(99. Bellón JA, Delgado A, Luna JD, Lardelli P. Validez y fiabilidad del cuestionario de función familiar Apgar-familiar. Atención Primaria. 1996;18(6):289-95.

10. De la Revilla L, Luna J, Bailón E, Medina I. Validación del cuestionario MOS de apoyo social en Atención Primaria. Med Familia. 2005;6(1):10-8.

11. González JL, Morera A. La valoración de sucesos vitales: Adaptación española de la escala de Holmes y Rahe. Psiquis. 1983;4(1):7-11.
-1212. Moraes CL. Reichenheim ME. Cross - cultural measurement equivalence of the Revised Conflict Tactics Scales. Portuguese version used to identify violence within couples. Cad Saúde Publica. 2002 [acesso 2 nov 2011]; 18:783-96. Disponivel em: http://www.scielosp.org/pdf/csp/v18n3/9306.pdf.
Disponivel em: http://www.scielosp.org/p...
), several authors emphasize the urgent need for efforts to develop and validate new measurement instruments(1212. Moraes CL. Reichenheim ME. Cross - cultural measurement equivalence of the Revised Conflict Tactics Scales. Portuguese version used to identify violence within couples. Cad Saúde Publica. 2002 [acesso 2 nov 2011]; 18:783-96. Disponivel em: http://www.scielosp.org/pdf/csp/v18n3/9306.pdf.
Disponivel em: http://www.scielosp.org/p...
-1313. García DeYébenes MJ, Rodríguez F, Carmona L. Validación de cuestionarios. Reumatol Clín. 2009;5(4):171-7.), adapted to the objectives of the discipline that needs them.

This article presents the design and content validation of an instrument intended to assess self-perception of family health status, inspired by the criteria of the Nursing Outcome Classification. This can present an advance in nursing knowledge, to allow us to identify family health situations that may require nursing interventions to improve or prevent the consequences they may have on the family system and also on its members, as in the family that may have an economic risk factors for its members(11. Cid-Monckton P, Pedrão LJ. Factores familiares protectores y de riesgo relacionados al consumo de drogas en adolescentes. Rev. Latino-Am. Enfermagem. 2011;19(Spe):738-45. ,1414. Medina N, Ferrini, MG. Factores protectores de las familias para prevenir el consumo de drogas en un municipio de Colombia. Rev. Latino-Am. Enfermagem. 2010,18(Spe):504.).

Method

The study was conducted in two phases: design of the scale and validation of its content.

Phase I. Scale design

This was performed in two stages: a) literature review, b) brainstorming and consensus of a small group of health professionals, teachers, managers and researchers, related to the care of the family, for item selection and preparation of the scale.

1) Definition of dimensions and attributes

Following previous authors, the NOC outcome criteria were used as a reference framework for designing the scale(1515. Porcel AM, Villaverde C, Morales JM. Medida del nivel de dependencia en cuidados enfermeros. Preliminares de una propuesta metodológica. Scentia: Rev Multidisciplinar Cienc Salud. 2008(13):131-6.). We drew from outcome criteria proposed for the family health domain and the family wellbeing class, such as the family climate, family integrity, family functioning, family resistance, and family coping. In addition, for families in which one of its members has impaired health or necessitates health care, family support, family normalization, and family participation in the care process were added.

A literature review was conducted to identify the dimensions of family health and the instruments used to measure it from the user perspective. The search was conducted in PubMed, SCOPUS, Cuiden Plus; the keywords used in Spanish and English were health, family, assessment or evaluation, scales, indices, test. Articles were included with any methodology (quantitative, qualitative) and whose objective was clearly related to the research problem, or that made reference to aspects of interest for the work. We reviewed the bibliographies of the located articles.

2) Selection of items and developing the scale

The research group, through brainstorming and consensus, adopted a set of items, which were classified according to the dimension of family health to which they referred(99. Bellón JA, Delgado A, Luna JD, Lardelli P. Validez y fiabilidad del cuestionario de función familiar Apgar-familiar. Atención Primaria. 1996;18(6):289-95.

10. De la Revilla L, Luna J, Bailón E, Medina I. Validación del cuestionario MOS de apoyo social en Atención Primaria. Med Familia. 2005;6(1):10-8.

11. González JL, Morera A. La valoración de sucesos vitales: Adaptación española de la escala de Holmes y Rahe. Psiquis. 1983;4(1):7-11.
-1212. Moraes CL. Reichenheim ME. Cross - cultural measurement equivalence of the Revised Conflict Tactics Scales. Portuguese version used to identify violence within couples. Cad Saúde Publica. 2002 [acesso 2 nov 2011]; 18:783-96. Disponivel em: http://www.scielosp.org/pdf/csp/v18n3/9306.pdf.
Disponivel em: http://www.scielosp.org/p...
,1616. Sandín B, Chorot P. Cuestionario de Afrontamiento al Estrés (CAE): Desarrollo y validación preliminar. Rev Psicol Psicopatol Clín. 2003;1(8):39-54.). Subsequently, items were designed specifically for those attributes not represented, and the first version of the scale was constructed (Figure 1).

Figure 1
Initial scale items sent to experts

In order to measure responses a Likert scale was chosen, because it allows a subject to respond, giving a degree of intensity to the statement of the item. Regarding the number of items necessary as a starting point, there is no rule, but obviously a higher the number of items will make it easier to make a good final selection(1717. Morales P. Medición de actitudes en psicología y educación. 3ª ed. Madrid: Universidad Pontificia de Comillas; 2008.).

Phase II. Validation of the scale content

Type of Design

We conducted a validation study of an instrument through the use of an on-line Delphi panel, with expert judges, with a consensus technique. This technique attempts to obtain consensus of expert opinions on a subject through a series of structured questionnaires, referred to as phases. The responses to each questionnaire are considered for subsequent reformulation(1818. Perroca MG. Desarrollo y validación de contenido de la nueva versión de un instrumento para clasificación de pacientes. Rev. Latino-Am. Enfermagem. 2011,19(1):58-66.). This method allowed the purification and refinement of the initial scale.

Study Population

Through purposive sampling, 18 experts were selected. Given the difficulty of characterizing the sample, and to define the criteria for inclusion in validation studies, due to the lack of consensus on these(1919. Seganfredo DH, Almeida, MA. Validación de contenido de resultados de enfermería según la Clasificación de los Resultados de Enfermería (NOC) para pacientes clínicos, quirúrgicos y críticos. Rev. Latino-Am. Enfermagem. 2011;9(1):34-41. ), we chose to have experts of a multidisciplinary origin (nurses, physicians and psychologists) belonging to different professional fields (healthcare, manager, teacher, researcher). To determine their inclusion, their knowledge and professional experience in relation to the topic of the instrument under validation were previously evaluated.

Procedure

Employing the web application "e-survey", information about the study objectives and the notions and theoretical considerations adopted for each of the dimensions of the scale was sent to participants. They were invited to participate voluntarily, ensuring the confidentiality and privacy of their input. After consent, the instrument was sent with instructions for completion. The study was approved by the Committee on Research Ethics of the Universidad de Sevilla, which reported favorably on the fulfillment of the requirements for human experimentation.

The degree of adequacy of each item must be established, according to a score of 1 to 5 (1 = minor adequacy, 5 = higher adequacy). Initially 96 items were proposed, grouped into eight subscales, in functions of the dimensions considered family health. They were also offered the opportunity to suggest new items or propose amendments to those proposed.

Following the analysis of the data obtained in each round, the items were validated and eliminated according to the criteria: Validate: Mean ≥ 3.5 and Median ≥ 3 and high ratings (4-5) ≥ 80% and / or standard deviation ≤ 0.90. Eliminated: Mean <3.5 and Median <3. The eliminated items were reviewed and modified according to proposals obtained, and moved through to the next round(20).

After each round, as a measure of feedback, a report was sent to each expert describing the item analysis, results obtained, and items validated, eliminated, or that should be assessed again.

Demographic variables were collected, to characterize the sample of experts: age, gender, place of residence, level of schooling and area of professional dedication.

Data analysis

A descriptive analysis of the sociodemographic and study variables was conducted, supported by SPSS 18.0.

Results

Phase I. Questionnaire design

The scale was constructed to measure self-perception of family health status, initially consisting of 96 items grouped into eight subscales, one for each dimension of family health. These were: family environment, family integrity, family functioning, family resistence, family coping, family support, family normalization, and family involvement in the care process. For each dimension, 12 items were established. Three possible answers were identified: almost never (AN), at times (AT), almost always (AA).

Phase 2 Validation of the content of the scale

The questionnaire was administered to 18 experts, and it took a total of two rounds to reach the necessary level of consensus.

There was an initial response rate of 83.3% (15 experts), and 80% (12 experts) in the second round. The mean age was 48 years, standard deviation of 10.7, 77.8% were female (n=14) and 22.2% male (n=4), 88.8% of participants were from Seville (n=16), 5.6% (n=1) from Mexico, and 5.6% (n=1) from Israel. Regarding the level of education, 33.4% were university graduates (n=6), 39% had completed a master's degree (n=7), and 27.6% had a doctoral degree (PhD) (n=5); 50.0% were dedicated to teaching and research (n=9), 44.4% to clinical practice (n=8) and 5.6% (n=1) to management.

It took a total of two rounds to reach the necessary level of consensus. In the first, 75 items were validated (78.1%) and 21 items were eliminated (21.9%). Taking into account the contributions of the experts, modifications were made and these 21 items were subjected to another round of assessment, which were finally validated in their entirety, closing the panel of experts for the content validation (Tables 1 to 4).

Table 1
Items validated for Family Social Environment and Family Integrity

Table 2
Estimated items for Family Functioning and Family Resistance

Table 3
Items estimated for Family Coping, and Family Support

Table 4
Family standardization and family involvement in the care process

Discussion

Several authors agree on the need to design and validate new measurement instruments when no others exist that measure what we really intend to measure, as is the case of the scale presented here(1212. Moraes CL. Reichenheim ME. Cross - cultural measurement equivalence of the Revised Conflict Tactics Scales. Portuguese version used to identify violence within couples. Cad Saúde Publica. 2002 [acesso 2 nov 2011]; 18:783-96. Disponivel em: http://www.scielosp.org/pdf/csp/v18n3/9306.pdf.
Disponivel em: http://www.scielosp.org/p...
-1313. García DeYébenes MJ, Rodríguez F, Carmona L. Validación de cuestionarios. Reumatol Clín. 2009;5(4):171-7.).

Nursing outcome criteria describe the state, behaviors, reactions and feelings of the patient and, although they initially were developed to measure these responses to care administered(1919. Seganfredo DH, Almeida, MA. Validación de contenido de resultados de enfermería según la Clasificación de los Resultados de Enfermería (NOC) para pacientes clínicos, quirúrgicos y críticos. Rev. Latino-Am. Enfermagem. 2011;9(1):34-41. ), they can become evaluation criteria that allow us to determine status, in the case at hand, related to family health.

The Delphi technique is widely used for the validation of scales and questionnaires by expert opinion(1212. Moraes CL. Reichenheim ME. Cross - cultural measurement equivalence of the Revised Conflict Tactics Scales. Portuguese version used to identify violence within couples. Cad Saúde Publica. 2002 [acesso 2 nov 2011]; 18:783-96. Disponivel em: http://www.scielosp.org/pdf/csp/v18n3/9306.pdf.
Disponivel em: http://www.scielosp.org/p...
,2020. Martínez-Piñeiro E. La Técnica Delphi como estrategia de consulta a los implicados en la evaluación de programas. Revista de investigación educativa. RIE. 2003;21(2):449-64.

21. Ballesteros-Pérez AM, Saturno P, Ortega P, Mínguez R, Molina F, Martínez MT, et al. Construcción y validación de una escala de actitudes hacia la atención primaria de salud. Atención Primaria. 1996;18(4):168-75.

22. Carretero-Dios H, Pérez C. Standards for the development and review of instrumental studies. Int J Clin Health Psychol. 2007;7(3):863-82.
-2323. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008-15.), making explicit criteria important for the selection thereof and ensuring that such experts are appropriate for the subject matter of the study to validate the instrument, thus avoiding bias(2424. Argimón JM, Jiménez J. Métodos de investigación clínica y epidemiológica. Madrid: Harcourt; 2000.). Other measures proposed to avoid bias are standardizing the definitions of each dimension of the scale, and its principal subcomponents, to make them available to the expert group to unify knowledge on the field of study and to be critical when evaluating and scoring the items, with positive repercussion on the validity of the instrument(2525. Yañer R, Cuadra R. La técnica Delphi y la investigación en los servicios de salud. Cienc Enferm. 2008;14(1):9-15.).

The performance of the technique on-line promoted speed in completion and facilitated the opportunity for participation of international experts. Also, the sample size used in the validation process was consistent with the proposed number in previous studies to stabilize the responses of each of the items. A response rate of over ten members in the first round is considered suitable according to the recommended proposals for the application of the Delphi technique(2424. Argimón JM, Jiménez J. Métodos de investigación clínica y epidemiológica. Madrid: Harcourt; 2000.). Compliance with these aspects gives more power and strength to the validation process.

Quantitative values ​​provided by the Delphi panel were very high. Furthermore, the introduction of a system that allowed experts to make qualitative contributions, through open responses, improved the validation process, as their proposals alluded to improved understanding of the items and the elimination or inclusion of new items(2323. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008-15.-2424. Argimón JM, Jiménez J. Métodos de investigación clínica y epidemiológica. Madrid: Harcourt; 2000.).

One limitation in the design of the instrument could be not having conducted focus groups or interviews with the population to obtain these items. However, to the extent that to construct a test should be clearly defined from the construct and its theoretical conceptualization and should find items that represent it, we conducted a comprehensive review of the literature and previously validated instruments were used for selection.

One limitation of the Delphi technique is that it does not generate a real consensus among experts, but forces them to choose, without any opportunity for discussion or analysis of each of the participants' ideas. In exchange, avoiding direct confrontation slows the induction of precipitous judgments and inhibition of new ideas, by helping with gradual formation of an opinion. Controlled feedback stimulates the generation of ideas and facilitates the removal of irrelevant information, and can be stimulating and productive for participants(2525. Yañer R, Cuadra R. La técnica Delphi y la investigación en los servicios de salud. Cienc Enferm. 2008;14(1):9-15.).

Conclusions

We present an instrument to measure Self-Perception of Family Health Status, which has demonstrated adequate content validity. This identifies eight dimensions for this theme, which can be studied independently. This instrument provides specific indicators to measure family health, and permits the identification of the perception that members have of the health of their family. This gives it a wide applicability in clinical practice, completing the necessary information to assess the family.

This scale can be useful for epidemiological studies and other types of research, in the field of management, planning, follow-up care, and the health care setting.

From the methodological point of view, to be based on outcome criteria, the data is easily combined with the proposed evaluation system and nursing taxonomies.

In future research it would be advisable to apply a pilot sample to analyze its psychometric properties, proving its reliability, construct and criterion validity.

References

  • 1
    Cid-Monckton P, Pedrão LJ. Factores familiares protectores y de riesgo relacionados al consumo de drogas en adolescentes. Rev. Latino-Am. Enfermagem. 2011;19(Spe):738-45.
  • 2
    Rocha SM, Nascimento LC, Lima RA. Enfermagem pediátrica e abordagem da família: subsídios para o ensino de graduação. Rev. Latino-Am. Enfermagem. 2002;10(5):709-14.
  • 3
    Barbosa SM, Costa P, Vieria NF. Etapas de cambios de los padres en las conversaciones con los hijos sobre la prevención de HIV/SIDA. Rev. Latino-Am. Enfermagem. 2008;16(6):1019-24.
  • 4
    Paula ES, Nascimento LC, Rocha SM. The influence of social support on strengthening families of children with chronic renal failure. Rev. Latino-Am. Enfermagem. 2008;16(4):692-9.
  • 5
    Balón E, De la Revilla L. La atención familiar la asignatura pendiente. Atención Primaria. 2011;43(2):55-7.
  • 6
    Lima J, Lima M, Saéz A. Intervenciones enfermeras orientadas a la familia. Enferm Clín. 2009;19(5):280-3.
  • 7
    Mejías LD, López L. La familia y la cultura: una conexión innovadora para el cuidado de la salud. Index Enferm. 2010;19(2-3):138-42.
  • 8
    Moorhead S, Jonson M, Maas ML, Swanson E. Clasificación de Resultados de Enfermeria (NOC). 4ª ed. Barcelona: Elsevier; 2009.
  • 9
    Bellón JA, Delgado A, Luna JD, Lardelli P. Validez y fiabilidad del cuestionario de función familiar Apgar-familiar. Atención Primaria. 1996;18(6):289-95.
  • 10
    De la Revilla L, Luna J, Bailón E, Medina I. Validación del cuestionario MOS de apoyo social en Atención Primaria. Med Familia. 2005;6(1):10-8.
  • 11
    González JL, Morera A. La valoración de sucesos vitales: Adaptación española de la escala de Holmes y Rahe. Psiquis. 1983;4(1):7-11.
  • 12
    Moraes CL. Reichenheim ME. Cross - cultural measurement equivalence of the Revised Conflict Tactics Scales. Portuguese version used to identify violence within couples. Cad Saúde Publica. 2002 [acesso 2 nov 2011]; 18:783-96. Disponivel em: http://www.scielosp.org/pdf/csp/v18n3/9306.pdf
    » Disponivel em: http://www.scielosp.org/pdf/csp/v18n3/9306.pdf
  • 13
    García DeYébenes MJ, Rodríguez F, Carmona L. Validación de cuestionarios. Reumatol Clín. 2009;5(4):171-7.
  • 14
    Medina N, Ferrini, MG. Factores protectores de las familias para prevenir el consumo de drogas en un municipio de Colombia. Rev. Latino-Am. Enfermagem. 2010,18(Spe):504.
  • 15
    Porcel AM, Villaverde C, Morales JM. Medida del nivel de dependencia en cuidados enfermeros. Preliminares de una propuesta metodológica. Scentia: Rev Multidisciplinar Cienc Salud. 2008(13):131-6.
  • 16
    Sandín B, Chorot P. Cuestionario de Afrontamiento al Estrés (CAE): Desarrollo y validación preliminar. Rev Psicol Psicopatol Clín. 2003;1(8):39-54.
  • 17
    Morales P. Medición de actitudes en psicología y educación. 3ª ed. Madrid: Universidad Pontificia de Comillas; 2008.
  • 18
    Perroca MG. Desarrollo y validación de contenido de la nueva versión de un instrumento para clasificación de pacientes. Rev. Latino-Am. Enfermagem. 2011,19(1):58-66.
  • 19
    Seganfredo DH, Almeida, MA. Validación de contenido de resultados de enfermería según la Clasificación de los Resultados de Enfermería (NOC) para pacientes clínicos, quirúrgicos y críticos. Rev. Latino-Am. Enfermagem. 2011;9(1):34-41.
  • 20
    Martínez-Piñeiro E. La Técnica Delphi como estrategia de consulta a los implicados en la evaluación de programas. Revista de investigación educativa. RIE. 2003;21(2):449-64.
  • 21
    Ballesteros-Pérez AM, Saturno P, Ortega P, Mínguez R, Molina F, Martínez MT, et al. Construcción y validación de una escala de actitudes hacia la atención primaria de salud. Atención Primaria. 1996;18(4):168-75.
  • 22
    Carretero-Dios H, Pérez C. Standards for the development and review of instrumental studies. Int J Clin Health Psychol. 2007;7(3):863-82.
  • 23
    Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008-15.
  • 24
    Argimón JM, Jiménez J. Métodos de investigación clínica y epidemiológica. Madrid: Harcourt; 2000.
  • 25
    Yañer R, Cuadra R. La técnica Delphi y la investigación en los servicios de salud. Cienc Enferm. 2008;14(1):9-15.

Publication Dates

  • Publication in this collection
    Mar-Apr 2013

History

  • Received
    29 Mar 2012
  • Accepted
    07 Jan 2013
Escola de Enfermagem de Ribeirão Preto / Universidade de São Paulo Av. Bandeirantes, 3900, 14040-902 Ribeirão Preto SP Brazil, Tel.: +55 (16) 3315-3451 / 3315-4407 - Ribeirão Preto - SP - Brazil
E-mail: rlae@eerp.usp.br