Acessibilidade / Reportar erro

Secondary prevention in coronary artery disease: development and content validity of educational messages for mobile phones

Prevenção secundária na doença arterial coronariana: desenvolvimento e validade de conteúdo de mensagens educativas para celulares

Prevención secundaria en la enfermedad de las arterias coronarias: desarrollo y validez de contenido de mensajes educativos para teléfonos móviles

ABSTRACT

Objective:

To identify information needs of patients with coronary artery disease and develop and validate the content of educational messages for mobile phones for these patients.

Method:

The study was carried out in three phases: 1) Identification of information needs in relation to coronary artery disease of patients hospitalized for an acute coronary event; 2) Development of templates containing text and pictures about the disease and treatment; 3) Content validity analysis of template evidence through the assessment of 10 experts. Templates were considered validated when the Content Validity Ratio (CVR) was equal to or greater than 0.80.

Results:

A total of 67 patients were included, and all the information that emerged about the disease was classified as important to very important. Thirty templates were developed (heart function, recommendations on nutrition and exercise, treatments and medications, and clinical signs related to the disease and risk factor control), and the CVR obtained was greater than 0.80.

Conclusion:

All information needs were categorized by patients as important or very important. The templates were developed and validated considering content and design.

DESCRIPTORS
Coronary Diseas; Health Educatio; Validation Stud; Text Messaging

RESUMO

Objetivo:

Identificar as informações sobre necessidades de pacientes com doença arterial coronariana e desenvolver e validar o conteúdo de mensagens educativas para celulares para esses pacientes.

Método:

O estudo foi realizado em três fases: 1) Identificação das informações sobre necessidades em relação à doença arterial coronariana de pacientes internados por evento coronariano agudo; 2) Desenvolvimento de templates contendo textos e imagens sobre a doença e tratamento; 3) Análise da validade de conteúdo das evidências do template por meio da avaliação de 10 especialistas. Os templates foram considerados validados quando a Razão de Validade de Conteúdo (RVC) foi igual ou superior a 0,80.

Resultados:

Foram incluídos 67 pacientes, e todas as informações que surgiram sobre a doença foram classificadas como importantes a muito importantes. Foram desenvolvidos 30 templates (função cardíaca, recomendações de nutrição e exercícios, tratamentos e medicamentos, sinais clínicos relacionados à doença e controle de fatores de risco), e a RVC obtida foi superior a 0,80.

Conclusão

Todas as necessidades de informação foram categorizadas pelos pacientes como importantes ou muito importantes. Os templates foram desenvolvidos e validados considerando conteúdo e design.

DESCRITORES
Doença das Coronárias; Educação em Saúde; Estudo de Validação; Envio de Mensagens de Texto

RESUMEN

Objetivo:

Identificar las necesidades de información de los pacientes con enfermedad de las arterias coronarias y desarrollar y validar el contenido de mensajes educativos para teléfonos celulares para estos pacientes.

Método:

El estudio se realizó en tres fases: 1) Identificación de necesidades de información sobre enfermedad de las arterias coronarias en pacientes hospitalizados por evento coronario agudo; 2) Desarrollo de templates que contienen textos e imágenes sobre la enfermedad y el tratamiento; 3) Análisis de la validez de contenido de la evidencia del template a través de la evaluación de 10 expertos. Los templates se consideraron validadas cuando el Razón de Validez de Contenido (RVC) fue igual o superior a 0,80.

Resultados:

Se incluyeron 67 pacientes y toda la información que surgió sobre la enfermedad se clasificó como importante a muy importante. Se desarrollaron 30 templates (función cardiaca, recomendaciones de nutrición y ejercicio, tratamientos y medicamentos, signos clínicos relacionados con la enfermedad y control de factores de riesgo), y la RVC obtenida fue superior a 0,80.

Conclusión:

Todas las necesidades de información fueron categorizadas por los pacientes como importantes o muy importantes. Los templates fueron desarrollados y validados considerando contenido y diseño.

DESCRIPTORES
Enfermedad Coronaria; Educación en Salud; Estudio de Validación; Envío de Mensajes de Texto

INTRODUCTION

Cardiovascular diseases are the main cause of morbidity, disability and death in the world(11. Virani SS, Alonso A, Benjamin EJ, Bittencourt MS, Callaway CW, Carson AP, et al. Heart disease and stroke statistics-2020 update: a report from the American Heart Association. Circulation. 2020;141(9):e139-596. doi: http://dx.doi.org/10.1161/CIR.0000000000000757. PMid:31992061.
http://dx.doi.org/10.1161/CIR.0000000000...
). Among cardiovascular diseases, coronary artery disease (CAD) stands out. This is a chronic disease that has resulted in a constant increase in hospital admission rates for acute events, such as acute myocardial infarction (AMI) or other ischemic heart diseases(11. Virani SS, Alonso A, Benjamin EJ, Bittencourt MS, Callaway CW, Carson AP, et al. Heart disease and stroke statistics-2020 update: a report from the American Heart Association. Circulation. 2020;141(9):e139-596. doi: http://dx.doi.org/10.1161/CIR.0000000000000757. PMid:31992061.
http://dx.doi.org/10.1161/CIR.0000000000...
,22. Urbinati S, Tonet E. Cardiac rehabilitation after STEMI. Minerva Cardioangiol. 2018;66(4):464-70. doi: http://dx.doi.org/10.23736/S0026-4725.18.04674-1. PubMed PMID: 29589673.
http://dx.doi.org/10.23736/S0026-4725.18...
). In this context, it is necessary that individuals with CAD carry out self-management of pharmacological and non-pharmacological treatment in order to ensure the reduction of atherosclerotic progression, preventing new coronary events, stenosis or thrombosis of coronary stents or vascular grafts(22. Urbinati S, Tonet E. Cardiac rehabilitation after STEMI. Minerva Cardioangiol. 2018;66(4):464-70. doi: http://dx.doi.org/10.23736/S0026-4725.18.04674-1. PubMed PMID: 29589673.
http://dx.doi.org/10.23736/S0026-4725.18...
,33. Piepoli MF, Corrà U, Dendale P, Frederix I, Prescott E, Schmid JP, et al. Challenges in secondary prevention after acute myocardial infarction: a call for action. Eur J Cardiovasc Nurs. 2017;16(5):369-80. doi: http://dx.doi.org/10.1177/1474515117702594. PubMed PMID: 28565965.
http://dx.doi.org/10.1177/14745151177025...
,44. Kim HY, Kim SH, Jung HJ, Kim HS. Development and evaluation of self-management program for patients with coronary artery disease. J Multimed Inf Syst. 2019;6(4):317-22. doi: http://dx.doi.org/10.33851/JMIS.2019.6.4.317.
http://dx.doi.org/10.33851/JMIS.2019.6.4...
,55. Farias MS, Silva LF, Brandão MAG, Guedes MVC, Pontes KMA, Lopes ROP. Medium reach theory for nursing in cardiovascular rehabilitation. Rev Bras Enferm. 2021;74(3):e20190718. doi: http://dx.doi.org/10.1590/0034-7167-2019-0718. PubMed PMID: 34161494.
http://dx.doi.org/10.1590/0034-7167-2019...
).

To support patient self-management, health professionals can implement various educational interventions aimed at controlling cardiovascular risk factors, correct use of medications and incorporation of a healthy lifestyle(33. Piepoli MF, Corrà U, Dendale P, Frederix I, Prescott E, Schmid JP, et al. Challenges in secondary prevention after acute myocardial infarction: a call for action. Eur J Cardiovasc Nurs. 2017;16(5):369-80. doi: http://dx.doi.org/10.1177/1474515117702594. PubMed PMID: 28565965.
http://dx.doi.org/10.1177/14745151177025...
66. Visseren FLJ, Mach F, Smulders YM, Carballo D, Koskinas KC, Bäck M, et al. 2021 ESC Guidelines on cardiovascular disease prevention in clinical practice. Eur Heart J. 2021;42(34):3227-37. doi: http://dx.doi.org/10.1093/eurheartj/ehab484. PubMed PMID: 34458905.
http://dx.doi.org/10.1093/eurheartj/ehab...
) through periodic telephone consultations, face-to-face multidisciplinary consultations, use of educational messages for mobile phones, educational games and applications for mobile devices(33. Piepoli MF, Corrà U, Dendale P, Frederix I, Prescott E, Schmid JP, et al. Challenges in secondary prevention after acute myocardial infarction: a call for action. Eur J Cardiovasc Nurs. 2017;16(5):369-80. doi: http://dx.doi.org/10.1177/1474515117702594. PubMed PMID: 28565965.
http://dx.doi.org/10.1177/14745151177025...
66. Visseren FLJ, Mach F, Smulders YM, Carballo D, Koskinas KC, Bäck M, et al. 2021 ESC Guidelines on cardiovascular disease prevention in clinical practice. Eur Heart J. 2021;42(34):3227-37. doi: http://dx.doi.org/10.1093/eurheartj/ehab484. PubMed PMID: 34458905.
http://dx.doi.org/10.1093/eurheartj/ehab...
). For individuals with CAD, the use of short messages for smartphones has been associated with an improvement in LDLc levels, blood pressure levels, Body Mass Index (BMI), physical activity levels, smoking, knowledge levels, depressive symptoms and compliance with pharmacological treatment(77. Schwaab B. Cardiac rehabilitation. Rehabilitation (Stuttg). 2018;57(2):117-26. doi: http://dx.doi.org/10.1055/s-0043-120904. PubMed PMID: 29216666.
http://dx.doi.org/10.1055/s-0043-120904...
,88. Hamilton SJ, Mills B, Birch EM, Thompson SC. Smartphones in the secondary prevention of cardiovascular disease: a systematic review. BMC Cardiovasc Disord. 2018;18(1):25. doi: http://dx.doi.org/10.1186/s12872-018-0764-x. PubMed PMID: 29415680.
http://dx.doi.org/10.1186/s12872-018-076...
,99. Shariful Islam SM, Farmer AJ, Bobrow K, Maddison R, Whittaker R, Pfaeffli Dale LA, et al. Mobile phone text-messaging interventions aimed to prevent cardiovascular diseases (Text2PreventCVD): systematic review and individual patient data meta-analysis. Open Heart. 2019;6(2):e001017. doi: http://dx.doi.org/10.1136/openhrt-2019-001017. PubMed PMID: 31673381.
http://dx.doi.org/10.1136/openhrt-2019-0...
,1010. Indraratna P, Tardo D, Yu J, Delbaere K, Brodie M, Lovell N, et al. Mobile phone technologies in the management of ischemic heart disease, heart failure, and hypertension: systematic review review and meta-analysis. JMIR Mhealth Uhealth. 2020;8(7):e16695. doi: http://dx.doi.org/10.2196/16695. PubMed PMID: 32628615.
http://dx.doi.org/10.2196/16695...
,1111. Shariful Islam SM, Chow CK, Redfern J, Kok C, Rådholm K, Stepien S, et al. Effect of text messaging on depression in patients with coronary heart disease: a substudy analysis from the TEXT ME randomised controlled trial. BMJ Open. 2019;9(2):e022637. doi: http://dx.doi.org/10.1136/bmjopen-2018-022637. PubMed PMID: 30787075.
http://dx.doi.org/10.1136/bmjopen-2018-0...
).

As much as we already have national and international guidelines on secondary prevention of CAD, the development of educational messages demands awareness of information needs on the disease and its prevention, considering the educational and cultural differences in Brazil and in the world. However, in Brazil, to the best of our knowledge, there are no studies that assessed the need for information on secondary prevention for individuals with CAD, considering the regional differences around the world. This study aimed to identify information needs of patients with CAD, in addition to developing and validating the content of educational messages for mobile phones for these patients.

METHODS

Study Design

This study was conducted in three phases: 1) Assessment of information needs of patients with CAD regarding secondary prevention; 2) Elaboration of educational text messages; 3) Message content validity. The first phase consisted of an observational, analytical and cross-sectional study. The second and third phases consisted of a methodological study of content development and educational material validity.

PHASE 1: ASSESSMENT OF INFORMATION NEEDS OF PATIENTS WITH CORONARY ARTERY DISEASE REGARDING SECONDARY PREVENTION

Study Location

Data collection was performed in cardiac units (Cardiac Unit, Cardiac Intensive Care Unit) and in the hemodynamic service of a large public university hospital in the city of São Paulo, SP, Brazil, from December 2019 to March 2020.

Population and Sample

The study population consisted of all patients hospitalized for any manifestation of CAD (acute coronary syndrome or stable angina) in the institutions. Patients over 18 years of age, without a previous diagnosis of dementia or neuropsychiatric diseases and without clinical signs of severe acute ventricular dysfunction (acute pulmonary edema or cardiogenic shock) or who, at the time of data collection, presented and/or ejection fraction at hospitalization less than or equal to 40%, were included.

Variables of Interest and Data Collection

Potentially eligible patients were approached and received an explanation about the research objectives. Upon acceptance and signing of the Informed Consent Form, sociodemographic (gender, age, religion, education, monthly income and race) and clinical characteristics (medical admission diagnosis and comorbidities) were extracted from the medical records.

The CAD information needs assessment considered the Information Needs in Cardiac Rehabilitation (INCR)(1212. Ghisi GLM, Grace SL, Thomas S, Evans MF, Oh P. Development and psychometric validation of a scale to assess information needs in cardiac rehabilitation: the INCR Tool. Patient Educ Couns. 2013;91(3):337-43. doi: http://dx.doi.org/10.1016/j.pec.2013.01.007. PubMed PMID: 23433734.
http://dx.doi.org/10.1016/j.pec.2013.01....
) instrument, validated for Brazilian Portuguese(1313. Ghisi GLM, Santos RZ, Bonin CBD, Roussenq S, Grace SL, Oh P, et al. Validation of a Portuguese version of the Information Needs in Cardiac Rehabilitation (INCR) scale in Brazil. Heart Lung J Acute Crit Care. 2014;43(3):192-7. doi: https://doi.org/10.1016/j.hrtlng.2014.01.009.
https://doi.org/10.1016/j.hrtlng.2014.01...
). The Brazilian version of INCR contains 55 questions, arranged in ten subscales representing information needs: The heart (physiology, symptoms, surgical treatments), Nutrition, Exercise/physical activity, Medication, Work/vocational/social, Stress/psychological factors, General/social concerns, Emergency/safety, Diagnosis and treatment, Risk factors. For each question, patients assessed the level of importance in having the information, ranging from 1 (completely not important), 2 (not important), 3 (neutral), 4 (important) and 5 (very important)(1212. Ghisi GLM, Grace SL, Thomas S, Evans MF, Oh P. Development and psychometric validation of a scale to assess information needs in cardiac rehabilitation: the INCR Tool. Patient Educ Couns. 2013;91(3):337-43. doi: http://dx.doi.org/10.1016/j.pec.2013.01.007. PubMed PMID: 23433734.
http://dx.doi.org/10.1016/j.pec.2013.01....
,1313. Ghisi GLM, Santos RZ, Bonin CBD, Roussenq S, Grace SL, Oh P, et al. Validation of a Portuguese version of the Information Needs in Cardiac Rehabilitation (INCR) scale in Brazil. Heart Lung J Acute Crit Care. 2014;43(3):192-7. doi: https://doi.org/10.1016/j.hrtlng.2014.01.009.
https://doi.org/10.1016/j.hrtlng.2014.01...
). The total score ranges from 55 points to 275 points. The higher the score, the greater the need for information. To understand the specific need for information, each item should be individually assessed.

The original instrument was submitted to psychometric validity(1212. Ghisi GLM, Grace SL, Thomas S, Evans MF, Oh P. Development and psychometric validation of a scale to assess information needs in cardiac rehabilitation: the INCR Tool. Patient Educ Couns. 2013;91(3):337-43. doi: http://dx.doi.org/10.1016/j.pec.2013.01.007. PubMed PMID: 23433734.
http://dx.doi.org/10.1016/j.pec.2013.01....
) with 20 experts, 20 patients in pre-test and 203 participants, demonstrating an internal consistency assessed by Cronbach’s alpha of 0.80 for each area of information needs. In the study of psychometric validity in Portuguese(1313. Ghisi GLM, Santos RZ, Bonin CBD, Roussenq S, Grace SL, Oh P, et al. Validation of a Portuguese version of the Information Needs in Cardiac Rehabilitation (INCR) scale in Brazil. Heart Lung J Acute Crit Care. 2014;43(3):192-7. doi: https://doi.org/10.1016/j.hrtlng.2014.01.009.
https://doi.org/10.1016/j.hrtlng.2014.01...
), an internal consistency assessed by Cronbach’s alpha of 0.71 to 0.91 was also obtained, depending on the subscale assessed.

PHASE 2: ELABORATION OF EDUCATIONAL TEXT MESSAGES

After identifying information needs, text and image messages were developed addressing the issues considered most important in the previous phase. The messages were developed based on the main international guidelines(22. Urbinati S, Tonet E. Cardiac rehabilitation after STEMI. Minerva Cardioangiol. 2018;66(4):464-70. doi: http://dx.doi.org/10.23736/S0026-4725.18.04674-1. PubMed PMID: 29589673.
http://dx.doi.org/10.23736/S0026-4725.18...
,33. Piepoli MF, Corrà U, Dendale P, Frederix I, Prescott E, Schmid JP, et al. Challenges in secondary prevention after acute myocardial infarction: a call for action. Eur J Cardiovasc Nurs. 2017;16(5):369-80. doi: http://dx.doi.org/10.1177/1474515117702594. PubMed PMID: 28565965.
http://dx.doi.org/10.1177/14745151177025...
,66. Visseren FLJ, Mach F, Smulders YM, Carballo D, Koskinas KC, Bäck M, et al. 2021 ESC Guidelines on cardiovascular disease prevention in clinical practice. Eur Heart J. 2021;42(34):3227-37. doi: http://dx.doi.org/10.1093/eurheartj/ehab484. PubMed PMID: 34458905.
http://dx.doi.org/10.1093/eurheartj/ehab...
) on secondary prevention for patients with CAD by a nursing student, under the supervision of a nurse who specializes in cardiology, PhD, with 20 years of practical experience, teaching, and research experience.

These messages were constructed using informal language, with short sentences, and illustrations were developed by a professional illustrator to improve the understanding of the elaborated sentences. To develop the messages, we used a software, Canva®, with Arial 23-point font, 1.5 line spacing, white background, borders simulating a whiteboard. In all messages there were two fictitious characters named Nurse Julia and Cardiolino, an anthropomorphized heart with the logo of the extension project in which this study was developed.

The messages developed were divided into 8 domains that were based on the instrument used in phase 1(1212. Ghisi GLM, Grace SL, Thomas S, Evans MF, Oh P. Development and psychometric validation of a scale to assess information needs in cardiac rehabilitation: the INCR Tool. Patient Educ Couns. 2013;91(3):337-43. doi: http://dx.doi.org/10.1016/j.pec.2013.01.007. PubMed PMID: 23433734.
http://dx.doi.org/10.1016/j.pec.2013.01....
,1313. Ghisi GLM, Santos RZ, Bonin CBD, Roussenq S, Grace SL, Oh P, et al. Validation of a Portuguese version of the Information Needs in Cardiac Rehabilitation (INCR) scale in Brazil. Heart Lung J Acute Crit Care. 2014;43(3):192-7. doi: https://doi.org/10.1016/j.hrtlng.2014.01.009.
https://doi.org/10.1016/j.hrtlng.2014.01...
), but Risk factors, Psychosocial factors and General/social concerns domains were gathered in only one domain.

PHASE 3 ANALYSIS OF CONTENT VALIDITY EVIDENCE OF EDUCATIONAL TEXT MESSAGES

Ten professionals were invited to assess the messages developed: seven nurses and one nutritionist with experience of at least 2 years in cardiology, and two linguists (Portuguese teachers). Data were collected from April to December 2020.

Experts were selected based on the researchers’ prior knowledge. An invitation to participate in the study was sent by email. Upon signing the Informed Consent Form, a second email was sent with the link to fill in the data collection instruments through Google Forms®.

Experts were asked to assess the messages for clarity of sentences, practical relevance, font size and type, images distinctness and relationship of images to the text, using a four-point Likert-type scale: 1 = totally inadequate, 2 = partially inadequate, 3 = partially adequate, and 4 = completely adequate.

Ethical Aspects

The project was submitted and approved by the local Research Ethics Committee on Human Beings, under Opinion 3.343.733, in 2019. The study met all scientific requirements according Resolution 466/2012 and the Declaration of Helsinki.

Data Analysis

Descriptive statistics were used to characterize the sample of patients and experts. Categorical measures were expressed as absolute (n) and relative (%), and frequencies and continuous variables, as means and standard deviation (SD).

The Content Validity Ratio (CVR) was calculated in relation to experts’ opinions through the agreement of items. The CVR was calculated as follows: CVR: ne- (N/2)/ N/2 (CVR is the Content Validity Ratio; ne is the number of panel members indicating an item “adequate”; and N is the number of panel members). Considering the sample of 10 experts, for the critical CVR to be considered ideal, the values must be above 0.80 considering a significance level of 0.011(1414. Ayre C, Scally AJ. Critical values for lawshe’s content validity ratio: revisiting the original methods of calculation. Meas Eval Couns Dev. 2014;47(1):79-86. doi: http://dx.doi.org/10.1177/0748175613513808.
http://dx.doi.org/10.1177/07481756135138...
).

RESULTS

In total, 67 patients were included in phase 1 of the study, whose sociodemographic and clinical characteristics are shown in Table 1.

Table 1.
Sociodemographic and clinical characteristics of patients with coronary artery disease, n = 67 – São Paulo, SP, Brazil, 2020.

Table 2 shows that all INCR domains were considered important to very important, especially The heart, Emergency/safety, General/social concerns and Diagnosis and treatment domains. The most important information needs were: “What medications do I need to help my heart?”; “When should I call the doctor?”; “What happens when someone has a heart attack (infarction)?”; “How does a healthy heart work?”; “What should I do if I feel angina or chest pain?”; and “How can cholesterol and diabetes mellitus affect my heart?” (Table 2).

Table 2.
Assessment of information needs of patients with coronary artery disease by Information Needs in Cardiac Rehabilitation (INCR) – São Paulo, SP, Brazil, 2020.

Based on patients’ information needs, 30 templates were developed, divided into 8 domains, containing text messages and images to guide and motivate patients with CAD (Supplementary File 1). The messages were built with two fictional characters: the nurse Julia and the caricature Cardiolino (an anthropomorphized heart). Figure 1 shows the two templates containing the presentation of the characters.

Figure 1.
Examples of developed and validated templates.

In the domain related to knowledge of the heart and its functioning, two messages were constructed that aim to guide patients in relation to the heart’s physiological process and CAD repercussions for the heart muscle. In the Nutrition domain, two messages were developed with guidance on the most suitable foods for patients with CAD and the method of preparation. In this domain, there were suggestions by experts for changes in relation to the images, as some of them contained foods not suitable for this population.

Regarding the Physical activity domain, six messages were developed. These messages provide guidelines regarding safe practice in performing the exercises, such as the clothing to be used, types of exercises, indications for stretching, minimum time to perform exercises and what symptoms patients should notice when performing physical exercises. This domain also included a message related to sexual activities to guide patients on the safe return to sexual practice (Figure 2).

Figure 2.
Template related to sexual activities.

For the Medication domain, four messages were developed, guiding patients on the main medications they are normally prescribed for their possible side effects, medication use duration and the main ways to remember to take them. In the Work domain, a message was constructed that addresses the time indicated for returning to work activities and the importance of discussion with a health team regarding this return. In the Emergency domain, two messages were constructed focusing on the possible symptoms of myocardial ischemia that patients must be aware of, what symptoms may appear during physical activities and procedures to be followed.

For the Diagnosis domain, four messages were elaborated, which provide guidance on therapeutic possibilities for patients with CAD, detailing clinical treatment, percutaneous coronary intervention and surgical myocardial revascularization. In the Risk factors and General/social concerns domains, eight templates were built related to changes in lifestyle, mainly in relation to tobacco control and alcohol consumption. The developed templates were sent and answered by 10 experts. Table 3 shows the mean of CVR values for each domain. All CVRs for each domain were presented with values equal to or greater than those recommended in relation to the number of experts.

Table 3.
Content Validity Ratio of each domain and the global score in relation to assessed indicators – São Paulo, SP, Brazil, 2020.

DISCUSSION

Knowing patients’ information needs is the first step in health education(1515. Murdaugh CL, Parsons MA, Pender NJ. Health promotion in nursing practice. 8th ed. New Jersey: Pearson; 2018.,1616. Ferreira PBP, Porto IS, Santo FHDE, Figueiredo NMA, Enders BC, Cameron LE, et al. Health education for hospitalized patient in nursing care: a conceptual analysis. Rev Bras Enferm. 2021;75(2):e20200459. doi: http://dx.doi.org/10.1590/0034-7167-2020-0459. PubMed PMID: 34669897.
http://dx.doi.org/10.1590/0034-7167-2020...
). This educational process is characterized by a systematic, sequential, logical, planned and scientifically based course of action. It consists of two main interdependent operations, teaching and learning, which, together play their roles, the result of which leads to changes in mutually desired behaviors. This educational process aims to achieve changes in individuals’ attitudes and skill, something that is only possible with adequate instrumentalization of patients and families(1515. Murdaugh CL, Parsons MA, Pender NJ. Health promotion in nursing practice. 8th ed. New Jersey: Pearson; 2018.).

Given the need to identify patients’ main doubts, this study was initially conducted to know the main information needs of coronary patients to guide the development of text and image messages.

To analyze information needs of patients in relation to CAD, the instrument called “Information Needs in Cardiac Rehabilitation” was used. It was developed in English(1212. Ghisi GLM, Grace SL, Thomas S, Evans MF, Oh P. Development and psychometric validation of a scale to assess information needs in cardiac rehabilitation: the INCR Tool. Patient Educ Couns. 2013;91(3):337-43. doi: http://dx.doi.org/10.1016/j.pec.2013.01.007. PubMed PMID: 23433734.
http://dx.doi.org/10.1016/j.pec.2013.01....
) and validated in Portuguese(1313. Ghisi GLM, Santos RZ, Bonin CBD, Roussenq S, Grace SL, Oh P, et al. Validation of a Portuguese version of the Information Needs in Cardiac Rehabilitation (INCR) scale in Brazil. Heart Lung J Acute Crit Care. 2014;43(3):192-7. doi: https://doi.org/10.1016/j.hrtlng.2014.01.009.
https://doi.org/10.1016/j.hrtlng.2014.01...
), Spanish(1717. Ghisi GLM, Anchique CV, Fernandez R, Quesada-Chaves D, Gordillo MX, Acosta S, et al. Validation of a spanish version of the information needs in cardiac rehabilitation scale to assess information needs and preferences in cardiac rehabilitation. J Cardiovasc Nurs. 2018;33(5):E29-34. doi: http://dx.doi.org/10.1097/JCN.0000000000000505. PubMed PMID: 30024487.
http://dx.doi.org/10.1097/JCN.0000000000...
) and Chinese(1818. Ma C, Yang Q, Huang S. Translation and psychometric evaluation of the chinese version of the information needs in cardiac rehabilitation tool. J Cardiopulm Rehabil Prev. 2019;39(5):331-7. doi: http://dx.doi.org/10.1097/HCR.0000000000000411. PubMed PMID: 31464885.
http://dx.doi.org/10.1097/HCR.0000000000...
). The construction of this instrument(1212. Ghisi GLM, Grace SL, Thomas S, Evans MF, Oh P. Development and psychometric validation of a scale to assess information needs in cardiac rehabilitation: the INCR Tool. Patient Educ Couns. 2013;91(3):337-43. doi: http://dx.doi.org/10.1016/j.pec.2013.01.007. PubMed PMID: 23433734.
http://dx.doi.org/10.1016/j.pec.2013.01....
) was carried out after reviewing the literature and submitting it to content validity with 10 experts. Its psychometric properties were assessed with 203 patients, obtaining a Cronbach’s alpha value above 0.70 and valid for Brazil. This study was submitted to 300 patients and adequate validity evidence was obtained regarding internal consistency.

The mean scores of importance attributed to information about cardiac rehabilitation in our study were higher when compared to the means obtained in the original study(1212. Ghisi GLM, Grace SL, Thomas S, Evans MF, Oh P. Development and psychometric validation of a scale to assess information needs in cardiac rehabilitation: the INCR Tool. Patient Educ Couns. 2013;91(3):337-43. doi: http://dx.doi.org/10.1016/j.pec.2013.01.007. PubMed PMID: 23433734.
http://dx.doi.org/10.1016/j.pec.2013.01....
) (4.58 vs 4.08) and in the validity study for Brazil(1313. Ghisi GLM, Santos RZ, Bonin CBD, Roussenq S, Grace SL, Oh P, et al. Validation of a Portuguese version of the Information Needs in Cardiac Rehabilitation (INCR) scale in Brazil. Heart Lung J Acute Crit Care. 2014;43(3):192-7. doi: https://doi.org/10.1016/j.hrtlng.2014.01.009.
https://doi.org/10.1016/j.hrtlng.2014.01...
) (4.58 vs 4.08), but in all these studies patients considered indicators as important to very important.

In the study on the Chinese questionnaire translation(1818. Ma C, Yang Q, Huang S. Translation and psychometric evaluation of the chinese version of the information needs in cardiac rehabilitation tool. J Cardiopulm Rehabil Prev. 2019;39(5):331-7. doi: http://dx.doi.org/10.1097/HCR.0000000000000411. PubMed PMID: 31464885.
http://dx.doi.org/10.1097/HCR.0000000000...
), with a population of 296 participants, similar findings to ours were identified, except in the Stress/psychological factors and General/social concerns domains, in which the means of the importance attributed to these domains were 4.55 and 4.66 (important to very important), respectively. In our study and in the Chinese one, it was less than 4 points, considering it does not matter to important(1818. Ma C, Yang Q, Huang S. Translation and psychometric evaluation of the chinese version of the information needs in cardiac rehabilitation tool. J Cardiopulm Rehabil Prev. 2019;39(5):331-7. doi: http://dx.doi.org/10.1097/HCR.0000000000000411. PubMed PMID: 31464885.
http://dx.doi.org/10.1097/HCR.0000000000...
). These comparisons reinforce the relevance of assessing the need for information in each context where professionals are inserted, because a population’s needs may not be the same as those of other individuals.

The domains with the greatest need for information were General/social concerns and Emergency/safety, which can be explained by patients’ fear of their health, lack of information about actions to be taken in view of a new CAD episode, and low socioeconomic level, given the fact they usually need information about support groups and associations.

The messages developed in response to information needs involved issues related to secondary prevention in coronary heart disease, i.e., understanding of the disease, management of precordial pain recurrence, nutritional and physical activity recommendations, including sexual activity, measures to improve medication compliance, guidelines for work activities and control of habits that impact the progression of atherosclerotic diseases such as smoking, alcohol consumption and stress.

Many of these messages, particularly those related to the adequacy or incorporation of a healthy lifestyle, are also supported by the American Heart Association’s health checklist recommendations, which include 7 essential health behaviors for the general population (smoking, physical activity, diet and weight) and health factors (cholesterol control, blood pressure and glucose control) that contribute to cardiovascular health(1919. American Heart Association. My Life Check – Life’s Simple 7 [Internet]. Dallas: American Heart Association; 2022 [cited 2022 Feb 12]. Available from: https://playbook.heart.org/lifes-simple-7/#:∼:text=These%20include%20the%20seven%20risk,inactivity%2C%20poor%20diet%20and%20diabetes.&text=Employers%20can%20use%20the%20science,progress%20towards%20improved%20heart%20health
https://playbook.heart.org/lifes-simple-...
).

The development of text messages for mobile phones is one of the great advances in technology for use in secondary prevention programs in CAD(2020. Taylor RS, Dalal HM, McDonagh STJ. The role of cardiac rehabilitation in improving cardiovascular outcomes. Nat Rev Cardiol. 2022;19(3):180-94. doi: http://dx.doi.org/10.1038/s41569-021-00611-7. PMid:34531576.
http://dx.doi.org/10.1038/s41569-021-006...
2424. Adler AJ, Martin N, Mariani J, Tajer CD, Owolabi OO, Free C, et al. Mobile phone text messaging to improve medication adherence in secondary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2017;4(4):CD011851. doi: http://dx.doi.org/10.1002/14651858.CD011851.pub2. PubMed PMID: 28455948.
http://dx.doi.org/10.1002/14651858.CD011...
), because direct supervision programs currently have low patient compliance due to the lack of interest in group activities, geographic distances to the program location, lack of parking at program locations and need to return to work activities(2525. Thomas RJ, Beatty AL, Beckie TM, Brewer LC, Brown TM, Forman DE, et al. Home-based cardiac rehabilitation: a scientific statement from the american association of cardiovascular and pulmonary rehabilitation, the American Heart Association, and the American College of Cardiology. J Am Coll Cardiol. 2019;74(1):133-53. doi: http://dx.doi.org/10.1016/j.jacc.2019.03.008. PubMed PMID: 31097258.
http://dx.doi.org/10.1016/j.jacc.2019.03...
).

Studies with coronary patients demonstrate that using text messages to mobile phones can increase pharmacological and non-pharmacological compliance levels(2222. Chen S, Gong E, Kazi DS, Gates AB, Bai R, Fu H, et al. Using mobile health intervention to improve secondary prevention of coronary heart diseases in China: mixed-methods feasibility study. JMIR Mhealth Uhealth. 2018;6(1):e9. doi: http://dx.doi.org/10.2196/mhealth.7849. PubMed PMID: 29371178.
http://dx.doi.org/10.2196/mhealth.7849...
2424. Adler AJ, Martin N, Mariani J, Tajer CD, Owolabi OO, Free C, et al. Mobile phone text messaging to improve medication adherence in secondary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2017;4(4):CD011851. doi: http://dx.doi.org/10.1002/14651858.CD011851.pub2. PubMed PMID: 28455948.
http://dx.doi.org/10.1002/14651858.CD011...
). The TEXT ME study included 710 patients with CAD who received messages related to smoking, exercise and diet for 6 months. The study showed that patients who received the messages had lower LDLc levels, lower blood pressure, lower BMI, higher physical activity, lower smoking rate and fewer symptoms of mild- to-moderate depression(2323. Shariful Islam SM, Chow CK, Redfern J, Kok C, Rådholm K, Stepien S, et al. Effect of text messaging on depression in patients with coronary heart disease: a substudy analysis from the TEXT ME randomised controlled trial. BMJ Open. 2019;9(2):e022637. doi: http://dx.doi.org/10.1136/bmjopen-2018-022637. PubMed PMID: 30787075.
http://dx.doi.org/10.1136/bmjopen-2018-0...
).

Significant data were also identified in the CHAT-DM study, with 502 coronary patients with DM, who received 6 messages per week for 6 months. Patients had lower glycated hemoglobin levels (p. 0.003) and there was a higher proportion of patients who achieved the recommended levels of HbA1c(2121. Huo X, Krumholz HM, Bai X, Spatz ES, Ding Q, Horak P, et al. Effects of mobile text messaging on glycemic control in patients with coronary heart disease and Diabetes Mellitus: a randomized clinical trial. Circ Cardiovasc Qual Outcomes. 2019;12(9):e005805. doi: http://dx.doi.org/10.1161/CIRCOUTCOMES.119.005805. PubMed PMID: 31474119.
http://dx.doi.org/10.1161/CIRCOUTCOMES.1...
). In the Text4Heart study, daily SMS text messages and a supporting website significantly supported compliance with healthy lifestyle behaviors of patients with coronary heart disease for up to 3 months, as measured by a self-reported composite health behavior score(2626. Pfaeffli Dale L, Whittaker R, Jiang Y, Stewart R, Rolleston A, Maddison R. Text message and internet support for coronary heart disease self-management: results from the Text4Heart randomized controlled trial. J Med Internet Res. 2015;17(10):e237. doi: http://dx.doi.org/10.2196/jmir.4944. PubMed PMID: 26490012.
http://dx.doi.org/10.2196/jmir.4944...
).

The messages developed were submitted to content validity evidence analysis by a committee of experts, in order to be reliably used in the population of coronary patients. In a recent literature review, it was shown that using valid and reliable instruments can lead to better diagnostic accuracy and implementation of preventive strategies(2727. Hanskamp-Sebregts M, Zegers M, Vincent C, van Gurp PJ, de Vet HC, Wollersheim H. Measurement of patient safety: a systematic review of the reliability and validity of adverse event detection with record review. BMJ Open. 2016;6(8):e011078. doi: http://dx.doi.org/10.1136/bmjopen-2016-011078. PubMed PMID: 27550650.
http://dx.doi.org/10.1136/bmjopen-2016-0...
). The main suggestions made by experts, which were accepted by the researchers, were related to the suggestion of the most common and cheapest types of food for the Brazilian population; changes in the writing and standardization of terms (e.g., CAD); and suggestion of some types of physical exercises to avoid doubts in reading the information.

The committee developed in this study followed the recommendations regarding expert quantity and quality, based on clinical experience in the care of coronary patients and on language expertise to improve the clarity of information(2828. Almanasreh E, Moles R, Chen TF. Evaluation of methods used for estimating content validity. Res Social Adm Pharm. 2019;15(2):214-21. doi: http://dx.doi.org/10.1016/j.sapharm.2018.03.066. PubMed PMID: 29606610.
http://dx.doi.org/10.1016/j.sapharm.2018...
). The messages in our study were based on the responses of a previously validated instrument, but data were collected in a single center, where patients in general have low income. Therefore, a limitation of our study is that we cannot infer that our messages will meet generalized needs of patients assisted in other centers in the Brazilian territory or even in the world population. Follow-up studies will be conducted to validate cognitive testing with patients with CAD and assess the effectiveness of using these messages in lifestyle modification and medication compliance.

CONCLUSIONS

Information needs related to CAD were assessed as important to very important by patients in all analyzed domains, mainly related to The heart and Emergency/safety.

In total, 30 templates were developed, covering information on the main issues related to secondary prevention of CAD. Adequate content validity evidence was obtained according to expert opinion.

  • Financial support This work was supported by the São Paulo Research Support Foundation (FAPESP – Fundação de Amparo à Pesquisa do Estado de São Paulo), under Protocol 2019/03681-5.

REFERENCES

  • 1.
    Virani SS, Alonso A, Benjamin EJ, Bittencourt MS, Callaway CW, Carson AP, et al. Heart disease and stroke statistics-2020 update: a report from the American Heart Association. Circulation. 2020;141(9):e139-596. doi: http://dx.doi.org/10.1161/CIR.0000000000000757 PMid:31992061.
    » http://dx.doi.org/10.1161/CIR.0000000000000757
  • 2.
    Urbinati S, Tonet E. Cardiac rehabilitation after STEMI. Minerva Cardioangiol. 2018;66(4):464-70. doi: http://dx.doi.org/10.23736/S0026-4725.18.04674-1 PubMed PMID: 29589673.
    » http://dx.doi.org/10.23736/S0026-4725.18.04674-1
  • 3.
    Piepoli MF, Corrà U, Dendale P, Frederix I, Prescott E, Schmid JP, et al. Challenges in secondary prevention after acute myocardial infarction: a call for action. Eur J Cardiovasc Nurs. 2017;16(5):369-80. doi: http://dx.doi.org/10.1177/1474515117702594 PubMed PMID: 28565965.
    » http://dx.doi.org/10.1177/1474515117702594
  • 4.
    Kim HY, Kim SH, Jung HJ, Kim HS. Development and evaluation of self-management program for patients with coronary artery disease. J Multimed Inf Syst. 2019;6(4):317-22. doi: http://dx.doi.org/10.33851/JMIS.2019.6.4.317
    » http://dx.doi.org/10.33851/JMIS.2019.6.4.317
  • 5.
    Farias MS, Silva LF, Brandão MAG, Guedes MVC, Pontes KMA, Lopes ROP. Medium reach theory for nursing in cardiovascular rehabilitation. Rev Bras Enferm. 2021;74(3):e20190718. doi: http://dx.doi.org/10.1590/0034-7167-2019-0718 PubMed PMID: 34161494.
    » http://dx.doi.org/10.1590/0034-7167-2019-0718
  • 6.
    Visseren FLJ, Mach F, Smulders YM, Carballo D, Koskinas KC, Bäck M, et al. 2021 ESC Guidelines on cardiovascular disease prevention in clinical practice. Eur Heart J. 2021;42(34):3227-37. doi: http://dx.doi.org/10.1093/eurheartj/ehab484 PubMed PMID: 34458905.
    » http://dx.doi.org/10.1093/eurheartj/ehab484
  • 7.
    Schwaab B. Cardiac rehabilitation. Rehabilitation (Stuttg). 2018;57(2):117-26. doi: http://dx.doi.org/10.1055/s-0043-120904 PubMed PMID: 29216666.
    » http://dx.doi.org/10.1055/s-0043-120904
  • 8.
    Hamilton SJ, Mills B, Birch EM, Thompson SC. Smartphones in the secondary prevention of cardiovascular disease: a systematic review. BMC Cardiovasc Disord. 2018;18(1):25. doi: http://dx.doi.org/10.1186/s12872-018-0764-x PubMed PMID: 29415680.
    » http://dx.doi.org/10.1186/s12872-018-0764-x
  • 9.
    Shariful Islam SM, Farmer AJ, Bobrow K, Maddison R, Whittaker R, Pfaeffli Dale LA, et al. Mobile phone text-messaging interventions aimed to prevent cardiovascular diseases (Text2PreventCVD): systematic review and individual patient data meta-analysis. Open Heart. 2019;6(2):e001017. doi: http://dx.doi.org/10.1136/openhrt-2019-001017 PubMed PMID: 31673381.
    » http://dx.doi.org/10.1136/openhrt-2019-001017
  • 10.
    Indraratna P, Tardo D, Yu J, Delbaere K, Brodie M, Lovell N, et al. Mobile phone technologies in the management of ischemic heart disease, heart failure, and hypertension: systematic review review and meta-analysis. JMIR Mhealth Uhealth. 2020;8(7):e16695. doi: http://dx.doi.org/10.2196/16695 PubMed PMID: 32628615.
    » http://dx.doi.org/10.2196/16695
  • 11.
    Shariful Islam SM, Chow CK, Redfern J, Kok C, Rådholm K, Stepien S, et al. Effect of text messaging on depression in patients with coronary heart disease: a substudy analysis from the TEXT ME randomised controlled trial. BMJ Open. 2019;9(2):e022637. doi: http://dx.doi.org/10.1136/bmjopen-2018-022637 PubMed PMID: 30787075.
    » http://dx.doi.org/10.1136/bmjopen-2018-022637
  • 12.
    Ghisi GLM, Grace SL, Thomas S, Evans MF, Oh P. Development and psychometric validation of a scale to assess information needs in cardiac rehabilitation: the INCR Tool. Patient Educ Couns. 2013;91(3):337-43. doi: http://dx.doi.org/10.1016/j.pec.2013.01.007 PubMed PMID: 23433734.
    » http://dx.doi.org/10.1016/j.pec.2013.01.007
  • 13.
    Ghisi GLM, Santos RZ, Bonin CBD, Roussenq S, Grace SL, Oh P, et al. Validation of a Portuguese version of the Information Needs in Cardiac Rehabilitation (INCR) scale in Brazil. Heart Lung J Acute Crit Care. 2014;43(3):192-7. doi: https://doi.org/10.1016/j.hrtlng.2014.01.009
    » https://doi.org/10.1016/j.hrtlng.2014.01.009
  • 14.
    Ayre C, Scally AJ. Critical values for lawshe’s content validity ratio: revisiting the original methods of calculation. Meas Eval Couns Dev. 2014;47(1):79-86. doi: http://dx.doi.org/10.1177/0748175613513808
    » http://dx.doi.org/10.1177/0748175613513808
  • 15.
    Murdaugh CL, Parsons MA, Pender NJ. Health promotion in nursing practice. 8th ed. New Jersey: Pearson; 2018.
  • 16.
    Ferreira PBP, Porto IS, Santo FHDE, Figueiredo NMA, Enders BC, Cameron LE, et al. Health education for hospitalized patient in nursing care: a conceptual analysis. Rev Bras Enferm. 2021;75(2):e20200459. doi: http://dx.doi.org/10.1590/0034-7167-2020-0459 PubMed PMID: 34669897.
    » http://dx.doi.org/10.1590/0034-7167-2020-0459
  • 17.
    Ghisi GLM, Anchique CV, Fernandez R, Quesada-Chaves D, Gordillo MX, Acosta S, et al. Validation of a spanish version of the information needs in cardiac rehabilitation scale to assess information needs and preferences in cardiac rehabilitation. J Cardiovasc Nurs. 2018;33(5):E29-34. doi: http://dx.doi.org/10.1097/JCN.0000000000000505 PubMed PMID: 30024487.
    » http://dx.doi.org/10.1097/JCN.0000000000000505
  • 18.
    Ma C, Yang Q, Huang S. Translation and psychometric evaluation of the chinese version of the information needs in cardiac rehabilitation tool. J Cardiopulm Rehabil Prev. 2019;39(5):331-7. doi: http://dx.doi.org/10.1097/HCR.0000000000000411 PubMed PMID: 31464885.
    » http://dx.doi.org/10.1097/HCR.0000000000000411
  • 19.
    American Heart Association. My Life Check – Life’s Simple 7 [Internet]. Dallas: American Heart Association; 2022 [cited 2022 Feb 12]. Available from: https://playbook.heart.org/lifes-simple-7/#:∼:text=These%20include%20the%20seven%20risk,inactivity%2C%20poor%20diet%20and%20diabetes.&text=Employers%20can%20use%20the%20science,progress%20towards%20improved%20heart%20health
    » https://playbook.heart.org/lifes-simple-7/#:∼:text=These%20include%20the%20seven%20risk,inactivity%2C%20poor%20diet%20and%20diabetes.&text=Employers%20can%20use%20the%20science,progress%20towards%20improved%20heart%20health
  • 20.
    Taylor RS, Dalal HM, McDonagh STJ. The role of cardiac rehabilitation in improving cardiovascular outcomes. Nat Rev Cardiol. 2022;19(3):180-94. doi: http://dx.doi.org/10.1038/s41569-021-00611-7 PMid:34531576.
    » http://dx.doi.org/10.1038/s41569-021-00611-7
  • 21.
    Huo X, Krumholz HM, Bai X, Spatz ES, Ding Q, Horak P, et al. Effects of mobile text messaging on glycemic control in patients with coronary heart disease and Diabetes Mellitus: a randomized clinical trial. Circ Cardiovasc Qual Outcomes. 2019;12(9):e005805. doi: http://dx.doi.org/10.1161/CIRCOUTCOMES.119.005805 PubMed PMID: 31474119.
    » http://dx.doi.org/10.1161/CIRCOUTCOMES.119.005805
  • 22.
    Chen S, Gong E, Kazi DS, Gates AB, Bai R, Fu H, et al. Using mobile health intervention to improve secondary prevention of coronary heart diseases in China: mixed-methods feasibility study. JMIR Mhealth Uhealth. 2018;6(1):e9. doi: http://dx.doi.org/10.2196/mhealth.7849 PubMed PMID: 29371178.
    » http://dx.doi.org/10.2196/mhealth.7849
  • 23.
    Shariful Islam SM, Chow CK, Redfern J, Kok C, Rådholm K, Stepien S, et al. Effect of text messaging on depression in patients with coronary heart disease: a substudy analysis from the TEXT ME randomised controlled trial. BMJ Open. 2019;9(2):e022637. doi: http://dx.doi.org/10.1136/bmjopen-2018-022637 PubMed PMID: 30787075.
    » http://dx.doi.org/10.1136/bmjopen-2018-022637
  • 24.
    Adler AJ, Martin N, Mariani J, Tajer CD, Owolabi OO, Free C, et al. Mobile phone text messaging to improve medication adherence in secondary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2017;4(4):CD011851. doi: http://dx.doi.org/10.1002/14651858.CD011851.pub2 PubMed PMID: 28455948.
    » http://dx.doi.org/10.1002/14651858.CD011851.pub2
  • 25.
    Thomas RJ, Beatty AL, Beckie TM, Brewer LC, Brown TM, Forman DE, et al. Home-based cardiac rehabilitation: a scientific statement from the american association of cardiovascular and pulmonary rehabilitation, the American Heart Association, and the American College of Cardiology. J Am Coll Cardiol. 2019;74(1):133-53. doi: http://dx.doi.org/10.1016/j.jacc.2019.03.008 PubMed PMID: 31097258.
    » http://dx.doi.org/10.1016/j.jacc.2019.03.008
  • 26.
    Pfaeffli Dale L, Whittaker R, Jiang Y, Stewart R, Rolleston A, Maddison R. Text message and internet support for coronary heart disease self-management: results from the Text4Heart randomized controlled trial. J Med Internet Res. 2015;17(10):e237. doi: http://dx.doi.org/10.2196/jmir.4944 PubMed PMID: 26490012.
    » http://dx.doi.org/10.2196/jmir.4944
  • 27.
    Hanskamp-Sebregts M, Zegers M, Vincent C, van Gurp PJ, de Vet HC, Wollersheim H. Measurement of patient safety: a systematic review of the reliability and validity of adverse event detection with record review. BMJ Open. 2016;6(8):e011078. doi: http://dx.doi.org/10.1136/bmjopen-2016-011078 PubMed PMID: 27550650.
    » http://dx.doi.org/10.1136/bmjopen-2016-011078
  • 28.
    Almanasreh E, Moles R, Chen TF. Evaluation of methods used for estimating content validity. Res Social Adm Pharm. 2019;15(2):214-21. doi: http://dx.doi.org/10.1016/j.sapharm.2018.03.066 PubMed PMID: 29606610.
    » http://dx.doi.org/10.1016/j.sapharm.2018.03.066

Edited by

ASSOCIATE EDITOR

Paulino Artur Ferreira de Sousa

Publication Dates

  • Publication in this collection
    20 Jan 2023
  • Date of issue
    2022

History

  • Received
    06 Sept 2022
  • Accepted
    28 Nov 2022
Universidade de São Paulo, Escola de Enfermagem Av. Dr. Enéas de Carvalho Aguiar, 419 , 05403-000 São Paulo - SP/ Brasil, Tel./Fax: (55 11) 3061-7553, - São Paulo - SP - Brazil
E-mail: reeusp@usp.br