Acessibilidade / Reportar erro

CONSTRUCTION AND VALIDATION OF EDUCATIONAL TECHNOLOGY ON INSULIN THERAPY: METHODOLOGICAL STUDY

ABSTRACT

Objective:

to build and validate educational technology on insulin therapy for educational practices of health professionals.

Method:

methodological study conducted in three stages: construction, between May and September 2019; and content validation and appearance validation, August 2020 to August 2021, in a Public University of Amapá, Brazil. Content validation and appearance validation were performed in single steps with 16 health professionals and with five professionals from other areas respectively.

Results:

The educational technology was named Serial Album on Insulin Therapy and was available in printed format. It presented a Content Validity Index of 0.91 and an Appearance Validity Index of 1.00.

Conclusion:

the technology was validated and can be used by primary care health professionals in health educational practices, with a view to promoting teaching-learning about the use of insulin, benefiting the process of care and communication in health care.

DESCRIPTORS:
Diabetes Mellitus; Insulin; Educational Technology; Primary Health Care; Health Promotion.

RESUMO

Objetivo:

construir e validar tecnologia educacional sobre insulinoterapia para práticas educativas de profissionais de saúde.

Método:

estudo metodológico realizado em três etapas: construção, entre os meses de maio a setembro de 2019; e validação de conteúdo e validação de aparência, agosto de 2020 a agosto de 2021, em Universidade Pública do Amapá, Brasil. A validação de conteúdo e a validação de aparências foram realizadas em etapas únicas com 16 profissionais da área da saúde e com cinco profissionais de outras áreas respectivamente.

Resultados:

a tecnologia educacional foi nomeada álbum seriado sobre Insulinoterapia, estando disponível no formato impresso. Apresentou Índice de Validade de Conteúdo de 0,91 e Índice de Validade de Aparência de 1,00.

Conclusão:

a tecnologia foi validada e pode ser utilizada por profissionais de saúde da atenção primária em práticas educativas em saúde, com vistas à promoção de ensino-aprendizagem sobre o uso de insulina, beneficiando o processo de cuidado e comunicação na atenção à saúde.

DESCRITORES:
Diabetes Mellitus; Insulina; Tecnologia Educacional; Atenção Primária à; Saúde; Promoção da Saúde.

RESUMEN

Objetivo:

construir y validar una tecnología educativa sobre la insulinoterapia para las prácticas educativas de los profesionales de la salud.

Método

estudio metodológico realizado en tres etapas: construcción, entre mayo y septiembre de 2019; y validación de contenido y validación de apariencia, agosto de 2020 a agosto de 2021, en una Universidad Pública de Amapá, Brasil. La validación del contenido y la validación de la apariencia se realizaron en un solo paso con 16 profesionales de la salud y cinco profesionales de otras áreas, respectivamente.

Resultados:

la tecnología educativa se ha convertido en un rotafolio sobre insulinoterapia, disponible en formato impreso. Presentó un Índice de Validez de Contenido de 0,91 y un Índice de Validez de Apariencia de 1,00.

Conclusión:

la tecnología fue validada y puede ser utilizada por los profesionales de salud de la atención primaria en prácticas educativas en salud, con vistas a promover la enseñanza-aprendizaje sobre el uso de la insulina, beneficiando el proceso de atención y comunicación en salud.

DESCRIPTORES:
Diabetes Mellitus; Insulina; Tecnología Educacional; Atención Primaria de Salud; Promoción de la Salud.

HIGHLIGHTS

  1. The importance of technology in Primary Care.

  2. Validation of the technology based on the needs of professionals.

  3. Technology provides essential content for insulin therapy orientation.

  4. Benefits in the care process and therapeutic communication.

HIGHLIGHTS

  1. The importance of technology in Primary Care.

  2. Validation of the technology based on the needs of professionals.

  3. Technology provides essential content for insulin therapy orientation.

  4. Benefits in the care process and therapeutic communication.

INTRODUCTION

Diabetes Mellitus-DM is a disease of growing incidence and prevalence and with chronic and devastating complications for the person, family, and society. It is a health problem of high magnitude due to its morbidity and mortality, considered a hidden epidemic and a global health emergency of the 21st century. In 2021, in the world, 537 million adults had DM; it is estimated that by 2045, the number of people with DM will be 783 million. In the Central and South American region, in 2021, there were 32.5 million, and by 2045, an estimated 48.9 million. Brazil ranks third for childhood diabetes and sixth for adult-onset diabetes in the world11 International Diabetes Federation, Atlas de la Diabetes de la FID. [Internet] 2021 [cited 2022 jan. 03]. Available from: https://diabetesatlas.org/atlas/tenth-edition/.
https://diabetesatlas.org/atlas/tenth-ed...
.

It is a progressive disease that requires treatment with continuous assessment of dosage and association of medications that are slightly insufficient to maintain glycemic control recommended as a goal for people with DM. It comprises pharmacological and non-pharmacological treatment whose objective is to control blood glucose levels, reduce complications, and improve quality of life22 Bayer M, Borba HHL. Impacto do cuidado farmacêutico nos desfechos clínicos de um paciente com diabetes mellitus tipo 2 em uso de insulina: relato de caso. Rev. Saúde. [Internet]. 2021[cited 2022 jan. 03]; 47(1):e64169. Available from: https://periodicos.ufsm.br/revistasaude/article/view/64169/pdf.
https://periodicos.ufsm.br/revistasaude/...
-33 Cunha GH da, Fontenele MSM, Siqueira LR, Lima MAC, Gomes MEC, Ramalho AKL. Insulin therapy practice performed by people with diabetes in Primary Healthcare. Rev Esc Enferm USP. [Internet]. 2020 [cited 2022 jan. 11];54:e03620. Available from: http://dx.doi.org/10.1590/S1980-220X2019002903620.
http://dx.doi.org/10.1590/S1980-220X2019...
. In the pharmacological treatment, insulin is indicated for people with DM1 as well as for people with DM244 Silva JP da, Bernardi FA, Franzon JC, Orlandin L, Ferlin GZ, Júnior GAP. Step-by-step insulin application: making educational videos for patients and caregivers. Rev Esc Anna Nery. [Internet]. 2021 [cited 2022 jan. 06];25(1). Available from: http://dx.doi.org/10.1590/2177-9465-EAN-2019-0343.
http://dx.doi.org/10.1590/2177-9465-EAN-...
as a second- or third-line treatment option when the therapeutic targets are not met with the use of oral antidiabetic drugs and their associations, or as the first option when fasting glucose is higher than 300 mg/dL at monitoring or at diagnosis22 Bayer M, Borba HHL. Impacto do cuidado farmacêutico nos desfechos clínicos de um paciente com diabetes mellitus tipo 2 em uso de insulina: relato de caso. Rev. Saúde. [Internet]. 2021[cited 2022 jan. 03]; 47(1):e64169. Available from: https://periodicos.ufsm.br/revistasaude/article/view/64169/pdf.
https://periodicos.ufsm.br/revistasaude/...
,44 Silva JP da, Bernardi FA, Franzon JC, Orlandin L, Ferlin GZ, Júnior GAP. Step-by-step insulin application: making educational videos for patients and caregivers. Rev Esc Anna Nery. [Internet]. 2021 [cited 2022 jan. 06];25(1). Available from: http://dx.doi.org/10.1590/2177-9465-EAN-2019-0343.
http://dx.doi.org/10.1590/2177-9465-EAN-...
.

In the discussion about insulin therapy and the types of insulin (ultrarapid, rapid, intermediate, prolonged, premixes) and devices with distinct characteristics and indications (syringe/needle, pen, insulin pump)33 Cunha GH da, Fontenele MSM, Siqueira LR, Lima MAC, Gomes MEC, Ramalho AKL. Insulin therapy practice performed by people with diabetes in Primary Healthcare. Rev Esc Enferm USP. [Internet]. 2020 [cited 2022 jan. 11];54:e03620. Available from: http://dx.doi.org/10.1590/S1980-220X2019002903620.
http://dx.doi.org/10.1590/S1980-220X2019...
, the steps, attention, and care to be taken have been the subject of interest and concern by both health professionals and researchers in the field of teaching and care.

The reorientation of the care model in the context of the Unified Health System-SUS care networks emphasized primary care, the gateway and organizer of health services55 Loureiro LH, Silveira-Alves A, Almeida SNH de, Silva ICM da, Tonin T. Technology in Primary Attention: a strategy to support management. Rev Práxis. [Internet]. 2017 [cited 2021out. 26]; 9(18):69-77. Available from: https://revistas.unifoa.edu.br/praxis/article/view/1418/1290.
https://revistas.unifoa.edu.br/praxis/ar...
-66 Monteiro DS, Rodrigues ILA, Souza DF de, Barbosa FKM, Farias RC, Nogueira LMV. Validação de uma tecnologia educativa em biossegurança na atenção primária. Rev Cuidarte. [Internet]. 2019 [cited 2021 jan 11];10(2). Available from: http://dx.doi.org/10.15649/cuidarte.v10i2.654.
http://dx.doi.org/10.15649/cuidarte.v10i...
, which is responsible for monitoring people with DM, aiming to reduce complications, disabilities, and hospitalizations resulting from the disease33 Cunha GH da, Fontenele MSM, Siqueira LR, Lima MAC, Gomes MEC, Ramalho AKL. Insulin therapy practice performed by people with diabetes in Primary Healthcare. Rev Esc Enferm USP. [Internet]. 2020 [cited 2022 jan. 11];54:e03620. Available from: http://dx.doi.org/10.1590/S1980-220X2019002903620.
http://dx.doi.org/10.1590/S1980-220X2019...
. The follow-up is essential, because insulin is one of the drugs classified by the Institute for Safe Medication Use Practices (ISMP) as potentially dangerous (MPP) or high surveillance (MAV). Therefore, when handled improperly, it presents catastrophic clinical outcomes of risk and therapeutic failure33 Cunha GH da, Fontenele MSM, Siqueira LR, Lima MAC, Gomes MEC, Ramalho AKL. Insulin therapy practice performed by people with diabetes in Primary Healthcare. Rev Esc Enferm USP. [Internet]. 2020 [cited 2022 jan. 11];54:e03620. Available from: http://dx.doi.org/10.1590/S1980-220X2019002903620.
http://dx.doi.org/10.1590/S1980-220X2019...
.

The availability of specific information for health professionals, family caregivers, and people with DM, to bridge the gap of inappropriate handling as well as the knowledge deficit related to the basic procedures for application, contributes greatly to reducing catastrophic outcomes related to insulin administration33 Cunha GH da, Fontenele MSM, Siqueira LR, Lima MAC, Gomes MEC, Ramalho AKL. Insulin therapy practice performed by people with diabetes in Primary Healthcare. Rev Esc Enferm USP. [Internet]. 2020 [cited 2022 jan. 11];54:e03620. Available from: http://dx.doi.org/10.1590/S1980-220X2019002903620.
http://dx.doi.org/10.1590/S1980-220X2019...
,77 Paraizo CMS, Isidoro JG, Terra F de S, Dázio LMR, Felipe AOB, Fava SMCL. Conhecimento do enfermeiro da Atenção Primária de Saúde sobre Diabetes Mellitus. Rev enferm UFPE. [Internet]. 2018 [cited 2021 jan. 11]; 12(1):179-88. Available from: https://periodicos.ufpe.br/revistas/revistaenfermagem/article/view/23087/25973.
https://periodicos.ufpe.br/revistas/revi...
.

Considering that primary care health professionals manage and/or guide people with DM to use insulin, and that there are few guidelines and published studies available to help these professionals and their patients regarding the safe use of insulin therapy, the need was felt to qualify the professionals’ guidance through a technology that could support them in their consultations, considering everything from the definition of insulin to the proper disposal of waste. The care involving insulin use is considered complex and requires committed and skilled health professionals to act in this context88 Sociedade Brasileira de Diabetes (SBD). Diretrizes 2019-2020 [Internet]. São Paulo: Clannad; 2020 [cited 2020 jan 15]. Available from: http://www.saude.ba.gov.br/wp-content/uploads/2020/02/Diretrizes-Sociedade-Brasileira-de-Diabetes-2019-2020.pdf.
http://www.saude.ba.gov.br/wp-content/up...
.

From this perspective, educational technologies are products that arise from materialized processes, either from experience or from research. As devices, they have been applied as mediators of educational practices, built, and validated for different target audiences: students; community; professionals99 Gigante VCG, Oliveira RC de, Ferreira DS, Teixeira E, Monteiro WF, Martins AL de O, et al. Construção e validação de tecnologia educacional sobre consumo de álcool entre universitários. Cogitare enferm. [Internet]. 2021[cited 2022 jan. 15]; 26:e71208. Available from: http://dx.doi.org/10.5380/ce.v26i0.71208.
http://dx.doi.org/10.5380/ce.v26i0.71208...
. Moreover, health educational practices supported by technologies enable people to live healthier life stages1010 Peres CM, Suzuki KMF, Azevedo-Marques PM de. Recursos tecnológicos de apoio ao ensino na saúde. Medicina. [Internet].2015 [cited 11 jan. 2021]; 48(3): 224-32. Available from: https://doi.org/10.11606/issn.2176-7262.v48i3p224-232.
https://doi.org/10.11606/issn.2176-7262....
. Thus, the objective of this study was to construct and validate an educational technology on insulin therapy for educational practices of health professionals.

METHOD

This is a methodological study with a quantitative approach and conducted in three stages: construction; content validation; and appearance validation. The study followed the theoretical-methodological reference model of Pasquali1111 Pasquali, L. Princípios de elaboração de escalas psicológicas. Rev. psiquiatr. clín. [Internet]. 1998 [cited 2021 jan 20]; 5(25):206-13. Available from: https://pesquisa.bvsalud.org/portal/resource/pt/lil-228044.
https://pesquisa.bvsalud.org/portal/reso...
, consisting of theoretical, empirical, and analytical poles. However, the methodological procedures focused on the theoretical and analytical poles1111 Pasquali, L. Princípios de elaboração de escalas psicológicas. Rev. psiquiatr. clín. [Internet]. 1998 [cited 2021 jan 20]; 5(25):206-13. Available from: https://pesquisa.bvsalud.org/portal/resource/pt/lil-228044.
https://pesquisa.bvsalud.org/portal/reso...
were used.

Thus, the theoretical pole related to the construct of interest is intended for semantic analysis, which ensures intelligibility, and for analysis by judges, who evaluate the technology itself, highlighting the relevance of the items. The analytical pole, on the other hand, is directed to the application of the statistical treatment of data to estimate the validity and credibility of the technology produced1212 Jesus EB de, Esteves AVF, Teixeira E, Medeiros HP, Nascimento MH do, Saboia VM. Validação de tecnologia educacional sobre fototerapia para orientar familiares de neonatos ictéricos. Rev enferm UERJ. [Internet]. 2018 [cited 2021 jan. 11]; (26):e21789. Available from: http://dx.doi.org/10.12957/reuerj.2018.21789.
http://dx.doi.org/10.12957/reuerj.2018.2...
.

The construction stage took place in the period from May to September 2019. The stages of content and appearance validation were developed online by Google Forms from August 2020 to August 2021, at the Federal University of Amapá - Unifap. The construction stage was subsidized by the integrative review method1313 Souza MT de, Silva MD da, Carvalho R de. Integrative review: what is it? How to do it? Einstein [Internet]. 2010 [cited 2021 jan. 11]. Available from: https://www.scielo.br/j/eins/a/ZQTBkVJZqcWrTT34cXLjtBx/?format=pdf⟨=en.
https://www.scielo.br/j/eins/a/ZQTBkVJZq...
, guided by the following research question in the PICo method: what is there in the scientific and non-scientific literature about educational technologies for health professionals in primary care that is related to teaching people with DM about the use of insulin? Where: P: Population (health professionals); I: Interest (educational technologies related to insulin therapy); Co: Context (Primary Health Care - PHC).

The identification and selection of material occurred in the databases/libraries: Latin American and Caribbean Literature on Health Sciences (Lilacs); Medical Literature Analysis and Retrieval System Online (Medline); Nursing Database (Bdenf), in addition to the Google Scholar tool (academic), Brazilian Diabetes Society (SBD- in Portuguese) and Ministry of Health, as they are complementary sources for this type of study1414 Pasquali, L. Psicometria: teoria dos testes na psicologia e na educação. Petrópolis: Vozes; 2003.. The search was guided by descriptors in health sciences (DECs) in combinations, namely: “type 1 diabetes mellitus”, “insulin therapy”, “type 2 diabetes mellitus”, “insulin”, “health technology”. The period of the time space extended from the year 2010 to June 2019, and the languages of the selected studies were Portuguese, English, and Spanish. A total of 1,220 potentially relevant articles were identified for the review, of these, 88 were selected for reading in full, remaining 20 articles in the final sample. Twenty technical papers were identified, including manuals, folders, cards, and prototypes of a dummy for insulin application. However, none of them offered the set of essential topics that could subsidize health professionals in PHC for safe guidance on insulin use.

According to the mapped content and the synthesis, a search on Google Images was performed to illustrate the following topics: types of insulin; preparation of insulin dose; areas for insulin application; types of needles, syringes, and pens; adequacy of the area for application rotation; insulin dispensing; insulin storage; disposal of insulin syringes and pens; and complications of inappropriate insulin use. The Power Point 2019 program was used to create the layout with text and illustrative images, subsequently, the CANVA media for the layout with verso and obverse, containing the summary of the content.

The sample size was defined by convenience, respecting the recommendations of Pasquali1414 Pasquali, L. Psicometria: teoria dos testes na psicologia e na educação. Petrópolis: Vozes; 2003., who recommends six to 20 evaluators. For the selection of judges, we adopted the recommended criteria, which were found in the literature related to validation studies in educational technologies1010 Peres CM, Suzuki KMF, Azevedo-Marques PM de. Recursos tecnológicos de apoio ao ensino na saúde. Medicina. [Internet].2015 [cited 11 jan. 2021]; 48(3): 224-32. Available from: https://doi.org/10.11606/issn.2176-7262.v48i3p224-232.
https://doi.org/10.11606/issn.2176-7262....
-1111 Pasquali, L. Princípios de elaboração de escalas psicológicas. Rev. psiquiatr. clín. [Internet]. 1998 [cited 2021 jan 20]; 5(25):206-13. Available from: https://pesquisa.bvsalud.org/portal/resource/pt/lil-228044.
https://pesquisa.bvsalud.org/portal/reso...
.

A total of 21 content and appearance judges participated in the study. The selection, which was made by judgment through a search on the Lattes Curriculum Platform, followed the following inclusion criteria: doctoral and/or master’s degrees in the health area, professional experience with DM (clinical, teaching, or research), and article published in an indexed journal around interest of the study. The judges who did not return the evaluation instrument within 30 days were excluded1515 Joventino ES, Oriá MOB, Sawada NO, Ximenes LB. Apparent and content validation of maternal self-efficiency scale for prevention of childhood diarrhea. Rev. Latino-Am. Enf. [Internet]. 2013 [cited 2021 jan. 11]; 21(1):371-9. Available from: https://doi.org/10.1590/S0104-11692013000100012.
https://doi.org/10.1590/S0104-1169201300...
-1616 Polit DF, Beck CT. Delineamento de Pesquisa em Enfermagem. In: Polit DF, Beck CT, Eds. Fundamentos de pesquisa em enfermagem: avaliação de evidências para prática de enfermagem. Artmed: Porto Alegre; 2011. p. 247-368..

A total of 39 content judges with whom contact was established by email were identified. Of these, 22 responded with the intention to participate. We found 15 appearance judges, 12 of whom responded with the intention to participate. However, only 16 content judges and five appearance judges participated by returning the instruments and suggestions.

The two groups of judges were sent, via e-mail, an invitation letter to participate in the validation process. The letter explained the characteristics and demands of the study as well as its objective. With those who responded and agreed to participate, the evaluation process was started through Google Docs. Initially, an e-mail was sent with the link to the Informed Consent Form, whose signature and confirmation allowed access to the evaluation instrument, and the PDF file with the prototype screens that simulated the usability of the “Insulin Therapy” Serial album.

The assessment instrument for the two groups of judges was composed of two parts: sociodemographic characteristics and personal data. For the content judges, the Content Validation Index (CVI) was applied, consisting of the evaluation of the domains (objectives, structure, organization, and relevance). For the appearance judges, the Health Educational Technology Appearance Validation Instrument-Ivates (in Portuguese) was applied, consisting of 12 evaluation items1717 Souza ACC de, Moreira TMM, Borges JWP. Development of an appearance validity instrument for educational technology in health. Rev Bras Enferm. [Internet]. 2020 [cited 2021 jan. 11];73. Available from: http://dx.doi.org/10.1590/0034-7167-2019-0559.
http://dx.doi.org/10.1590/0034-7167-2019...
.

The Content Validation Index (CVI) was analyzed by: Item Content Validation Index (CVI -I) which determines adequacy/agreement of the judges for each item; Judge Content Validation Index (CVI -J) which determines proportion of items that obtained adequacy/agreement of each judge; and Scale Content Validation Index (CVI -E), which determines average of the proportions of items that obtained adequacy/agreement of each judge (average of CVI -J). An index of 0.80 or higher was considered desirable for content validation1515 Joventino ES, Oriá MOB, Sawada NO, Ximenes LB. Apparent and content validation of maternal self-efficiency scale for prevention of childhood diarrhea. Rev. Latino-Am. Enf. [Internet]. 2013 [cited 2021 jan. 11]; 21(1):371-9. Available from: https://doi.org/10.1590/S0104-11692013000100012.
https://doi.org/10.1590/S0104-1169201300...
. For IVATES, CVI was considered ≥0.78 excellent; between 0.60 and 0.77 good; and <0.59 as poor1616 Polit DF, Beck CT. Delineamento de Pesquisa em Enfermagem. In: Polit DF, Beck CT, Eds. Fundamentos de pesquisa em enfermagem: avaliação de evidências para prática de enfermagem. Artmed: Porto Alegre; 2011. p. 247-368..

The analyses were carried out with MS Excel and IBM SPSS - version 26 for Windows1818 IBM Corp. Released. IBM SPSS Statistics for Windows, Version 24.0. Armonk, NY: IBM Corp; 2018.. Absolute and relative frequencies were used to characterize the judges’ responses and the Binomial Test was used to verify agreement for content and appearance validation. A significance level of five percent (5%)1616 Polit DF, Beck CT. Delineamento de Pesquisa em Enfermagem. In: Polit DF, Beck CT, Eds. Fundamentos de pesquisa em enfermagem: avaliação de evidências para prática de enfermagem. Artmed: Porto Alegre; 2011. p. 247-368. was considered.

The study was approved by the Research Ethics Committee of the Federal University of Amapá under Opinion No. 4,304,109.

RESULTS

The TE Serial album - insulin therapy was made in hard cover, with 33 pages, front and back, 297 x 420mm, printed in light blue and green colors, white background, 150g/m2 matte Couche paper, and bound with a 9mm spiral. The content was summarized in the following themes: concept of insulin therapy, types of insulin, distribution and storage, devices used for its application, insulin preparation, application sites, disposal of needles and syringes, and complications related to inappropriate use (Figure 1).

Figure 1
Serial album of insulin therapy: First Version and Final Version (Macapá, Amapá, Brazil, 2020).

The content evaluation was carried out by 16 specialists residing in Brazil, female (100%), most of them with more than 15 years of professional experience (62.5%), six (37.5%) with 16 to 26 years of experience, and four (25.0%) with more than 26 years of experience. Regarding degrees, six (37.5%) had a Specialization, four (25.0%) a Master’s, and six (37.5%) a PhD. Regarding scientific publications, 14 (87.5%) had publications around Diabetes Mellitus, six (37.5%) in Care and Educational Technology, and five (31.3%) in Content Validation.

Among the appearance judges, there were five specialists residing in Amapá, one (20%) female and four (80%) males. Regarding professional area, three (60%) are from Social Communication, one (20%) is a Pedagogue and Social Communicator, and one (20%) is from Advertising - Marketing.

Table 1 presents the Content Validity Index (CVI) of the content judges for each item of the questionnaire - CVI-I. Of the ten items related to the “Objectives”, six were considered adequate by the 16 expert judges (CVI-I = 1.00). The remaining four items were considered, by seven judges, as partially adequate (CVI-I ≥ 0.88), values above the minimum defined to consider the items valid (CVI-I > 0.80).

As for the 10 items of the “Structure and Presentation” dimension, seven were considered, by the 16 judges, as adequate (CVI-I > 0.80). Three items presented CVI-I < 0.80. Item 2.5 - “The information is well structured in concordance and spelling” - was considered adequate by half of the experts, the rest considered it inadequate or partially adequate (CVI-I = 0.50, p = 0.007). The judges suggested that this item should be corrected for spelling, which was accepted. Item 2.6 - “The illustrations are adequate” - was rated partially adequate (CVI I = 0.75) by four judges, who recommended increasing the size of some figures and improving color and text layout. These suggestions were accepted, and the recommended adjustment was made for the album. And finally, item 2.9 - “The number of pages is adequate” - was considered by four judges as partially adequate, but no changes were suggested. Therefore, the album was revised, resulting in a final version with 33 pages.

It is worth mentioning that, regarding items 2.6 and 2.9, with CVI-I = 0.75, the Binomial test indicated that this CVI -I is not significantly lower than 0.80 (p = 0.402), not interfering in the result of the validation (Table 1).

As for the four “Relevance” items, all were considered adequate by the judges (CVI -I = 1.00).

Table 1
Frequencies of answers of the expert judges for each item of the CVI-I questionnaire. Macapá-AP, Brazil, 2022 (n = 16)

Table 2 shows the percentages of items considered adequate by each judge (CVI -J) and the Scale Content Validation Index (CVI-E). Of the 16 experts, 12 considered more than 80% of the items adequate (CVI -J > 0.80), and four considered all items adequate (CVI -J = 1.00). Four experts presented ratings with CVI -J lower than 0.80 (between 0.73 and 0.79), but in this case, the Binomial test indicated that these CVI-J values are not significantly lower than 0.80 (p > 0.05). The Scale Content Validation Index (CVI -E = 0.91) obtained a value higher than the minimum acceptable (0.80). The content was validated regarding objectives; structure/presentation; and relevance.

Table 2
Percentages of items considered adequate by each specialist (CVI-J) and of the scale (CVI-E). Macapá, Amapá, Brazil, 2022. (n = 16)

Table 3 presents the Content Validity Index (CVI) of the five appearance judges regarding: drawing style; family setting; and procedural messages with album pictures for each questionnaire item - CVI-I. The 12 items related to the three dimensions were considered adequate by the judges ( CVI-I = 1.00), obtaining validation throughout.

Table 3
Distribution of the items of the Instrument for the validation of educational technology appearance in health-Ivates according to the percentage of agreement of the experts. Macapá, Amapá, Brazil, 2022, (n=5)

Table 4 illustrates the agreement per judge (CVI-J) and the Scale Content Validation Index (CVI-E). All five judges agreed with all 12 items (CVI-J = 1.00). The Scale Content Validation Index (CVI -E = 1.00) indicates that the appearance was validated for drawing style, familiar setting, and procedural messages with pictures.

Table 4
Percentages of items considered adequate by each judge (CVI-J) and CVI of the scale (CVI-E) (n=5) five. Macapá, Amapá, Brazil, 2022

DISCUSSION

This study built and validated a serialized album on insulin therapy. It is noteworthy that printed educational technologies such as serial albums can promote user awareness, encourage self-care, and consequently improve the quality of clinical care1919 Magalhães VMPR, Almeida CAPL, Santos RF, Ramos CV, Feitosa LGGC, Lago EC, et al. Validation of a serial album on domestic violence against women for primary care nurses. Cogit. Enferm. [Internet]. 2020 [cited 2021 jan. 11]; 25:e62729. Available from: http://dx.doi.org/10.5380/ce.v25i0.62729.
http://dx.doi.org/10.5380/ce.v25i0.62729...
.

Research carried out in PHC with caregivers of DM elderly individuals under insulin therapy to identify the knowledge of these caregivers found a deficit in the insulin preparation and application technique2020 Almeida DA de, Santos MS dos, Rosa W de AG, Zeferino MGM, Oliveira ISB, Lenza N de FB. Conhecimento dos cuidadores intradomiciliares de idosos com DM tipo 2 em insulinoterapia, na atenção primária. Rev Saúde. [Internet]. 2018 [cited 2021 dez 14]. 44(2):1-13. Available from: https://doi.org/10.5902/2236583431014.
https://doi.org/10.5902/2236583431014...
. Another study with people with DM being followed-up in the PHC, to analyze the steps of insulin therapy, found that most of them did not perform the steps properly33 Cunha GH da, Fontenele MSM, Siqueira LR, Lima MAC, Gomes MEC, Ramalho AKL. Insulin therapy practice performed by people with diabetes in Primary Healthcare. Rev Esc Enferm USP. [Internet]. 2020 [cited 2022 jan. 11];54:e03620. Available from: http://dx.doi.org/10.1590/S1980-220X2019002903620.
http://dx.doi.org/10.1590/S1980-220X2019...
. These data reflect the experience of part of the DM population in PHC care conditions. However, people with DM, at all levels of health care, have guidance deficits or lack of knowledge about insulin therapy2121 Lyra R, Cavalcanti N, Santos RD. Diabetes mellitus uma abordagem cardiovascular. São Paulo: Clannad; 2019.. Therefore, guidance during the consultation is a fundamental means of health promotion and prevention2222 Cunha GH da, Barbosa RVA, Fontenele MSM, Lima MAC, Franco KB, Fechine FV. Insulin therapy waste produced in the households of people with diabetes monitored in Primary Care. Rev Bras Enferm. [Internet]. 2017 [cited 2021 dez 14];70(3):618-25. Available from: http://dx.doi.org/10.1590/0034-7167-2016-0406.
http://dx.doi.org/10.1590/0034-7167-2016...
.

In this context, it is essential to teach all the steps about the use of insulin in the treatment of DM. Thus, the application of educational technologies enables the construction of knowledge, helping in daily decision making, and furthermore, when these technologies are built effectively and aimed at health promotion, they can change the reality of a population, and must be built in the context of the target audience2323 Fontenele MSM, Cunha GH da, Lopes MV de O, Siqueira LR, Lima MAC, Moreira LA. Development and evaluation of abooklet to promote healthy lifestyle in people with HIV. Rev Bras Enferm. [Internet]. 2021[cited 2022 jan. 15]. Available from: http://dx.doi.org/10.1590/0034-7167-2020-0113.
http://dx.doi.org/10.1590/0034-7167-2020...
.

The construction stage of the serialized album technology, according to the content mapped and synthesized from the review, supported the theoretical part, indicating the scarce scientific production on insulin therapy with specific topics, without addressing the necessary steps for the safe and effective use of insulin, which contributed to ensure the content to be presented in the album. This aspect is corroborated by other studies related to the production and validation of educational technologies1919 Magalhães VMPR, Almeida CAPL, Santos RF, Ramos CV, Feitosa LGGC, Lago EC, et al. Validation of a serial album on domestic violence against women for primary care nurses. Cogit. Enferm. [Internet]. 2020 [cited 2021 jan. 11]; 25:e62729. Available from: http://dx.doi.org/10.5380/ce.v25i0.62729.
http://dx.doi.org/10.5380/ce.v25i0.62729...
,2323 Fontenele MSM, Cunha GH da, Lopes MV de O, Siqueira LR, Lima MAC, Moreira LA. Development and evaluation of abooklet to promote healthy lifestyle in people with HIV. Rev Bras Enferm. [Internet]. 2021[cited 2022 jan. 15]. Available from: http://dx.doi.org/10.1590/0034-7167-2020-0113.
http://dx.doi.org/10.1590/0034-7167-2020...
.

The following technologies on insulin therapy were identified: therapeutic toy, insulin therapy booklet for children with type 1 DM, low-cost simulator, and educational manual for type 1 DM 22424 Moura D de JM, Moura N do S, Menezes LCG de, Barros AA, Guedes MVC. Development of a booklet on insulin therapy for children with diabetes mellitus type 1. Rev Bras Enferm. [Internet]. 2017 [cited 2021 jan.11];70(1):3-10. Available from: https://www.scielo.br/j/reben/a/tmGrRQRWy73RGCwNMp4j3FR/?format=pdf⟨=en.
https://www.scielo.br/j/reben/a/tmGrRQRW...

25 Pennafort VP dos S, Queiroz MVO, Gomes ILV, Rocha M de FF. Instructional therapeutic toy in the culture care of the child with diabetes type 1. Rev Bras Enferm. [Internet]. 2018 [cited 2021 jan. 11];71(Suppl 3):1334-42. Available from: http://dx.doi.org/10.1590/0034-7167-2017-0260.
http://dx.doi.org/10.1590/0034-7167-2017...

26 Salbego C, Nietsche EA, Teixeira E, Girardon-Perlini NMO, Wild CF, Ilha S. Care-educational technologies: an emerging concept of the praxis of nurses in a hospital context. Rev Bras Enferm. [Internet]. 2018 [cited 2021 jan.11];71(Suppl 6):2666-74. Available from: http://dx.doi.org/10.1590/0034-7167-2017-0753.
http://dx.doi.org/10.1590/0034-7167-2017...
-2727 Silva JP da, Pereira Junior GA, Meska MHG, Mazzo A. Construction and validation of a low-cost simulator for training patients with diabetes mellitus and/or their caregivers in insulin administration. Esc Anna Nery. [Internet]. 2018 [cited 2021 jan. 11]; 22(3):e20170387. Available from: http://dx.doi.org/10.1590/2177-9465-EAN-2017-0387.
http://dx.doi.org/10.1590/2177-9465-EAN-...
. However, none of these ETs relates the whole process for the safe use of insulin therapy in PHC. The serialized album validated in this study bridges the identified gap and offers the illustrated content of pertinent guidelines for the safe use of insulin therapy.

The validation step of the album by expert judges of content and appearance sought the production of a quality technology that could support educational practices of health professionals for people with diabetes on insulin therapy. Thus, this study had the participation of judges from different places in Brazil, whose purpose was to obtain different evaluations about the album, because different knowledge becomes essential for the construction of educational strategies that meet the needs of health education2828 Wild CF, Nietsche EA, Salbego C, Teixeira E, Favero NB. Validation of educational booklet: an educational technology in dengue prevention. Rev Bras Enferm. [Internet]. 2019 [cited 2021 jan. 11];72(0):1318-25. Available from: https://www.scielo.br/j/reben/a/n8RDQB8xP3MCtYt8LmgwpPm/?format=pdf⟨=en.
https://www.scielo.br/j/reben/a/n8RDQB8x...
. The research also contributed to bring updated information, in addition to providing a view of the Brazilian regions related to the teaching and guidance of people with DM using insulin therapy. Considering the regional specificities, it was found that in the North region, the use of insulin pen in PHC is still scarce, thus, the importance of validating ETs with orientations in accordance with the reality of the various health scenarios is evidenced2929 Sá GGM de, Santos AMR dos, Galindo Neto NMG, Carvalho KM de, Feitosa CDA, Mendes PN. Building and validating an educational video for elderly individuals about fall risks. Rev Bras Enferm. [Internet].2020 [cited 2021 jan.11];73(Suppl 3):e20200010. Available from: http://dx.doi.org/10.1590/0034-7167-2020-0010.
http://dx.doi.org/10.1590/0034-7167-2020...
.

In general, the serialized album on insulin therapy was evaluated as adequate by the expert judges, evidencing it as an ET with validated content and appearance that meet the objectives for which it was developed. Only for the structure and presentation dimension in the content evaluation instrument there were suggestions for changes presented by the experts in three items regarding: spelling and grammar correction (item 2.5), size of three figures (item 2.6), and reduction in the number of pages (item 2.9). The suggestions were heeded. We emphasize the importance of the health ET meeting the identified need and being relevant to the context in which it was developed, being essential that the researcher inserts himself in the social context of the target audience, knowing their needs and particularities3030 Leite S de S, Afio ACE, Carvalho LV de, Silva JM da, Almeida PC de, Pagliuca LMF. Construction and validation of an Educational Content Validation Instrument in Health. Rev Bras Enferm. [Internet].2018 [cited 2021 jan. 11];71, 1635-41. Available from: http://dx.doi.org/10.1590/0034-7167-2017-0648.
http://dx.doi.org/10.1590/0034-7167-2017...
.

In the evaluation of the CVI-E, the two instruments used for content and appearance validation showed the consistency and reliability of the serialized album as an ET for health professionals to use in their PHC consultations. The characteristics indicated as most attractive by the judges were: easy-to-handle tool, low cost, clear visual communication and safe information on insulin therapy, dispensability of electrical resources and internet network, and it can be used in urban and rural centers.

As a limitation of this study, we point out the difficulty in receiving the return of the evaluation instrument by the judges.

CONCLUSION

The serialized album can be used by primary care health professionals in health educational practices to promote teaching and learning about the use of insulin, thus benefiting the process of care and communication between health professionals and people with DM.

The construction and validation of a serial album, based on the real needs of professionals who assist people with DM using insulin in the PHC network, contributes, in the medium term, to the promotion of individual care in the coordination of proper care regarding the use of insulin and, in the long term, to the improvement of metabolic control, reducing the risk of complications related to the disease and promoting quality of life.

REFERÊNCIAS

  • 1
    International Diabetes Federation, Atlas de la Diabetes de la FID. [Internet] 2021 [cited 2022 jan. 03]. Available from: https://diabetesatlas.org/atlas/tenth-edition/
    » https://diabetesatlas.org/atlas/tenth-edition/
  • 2
    Bayer M, Borba HHL. Impacto do cuidado farmacêutico nos desfechos clínicos de um paciente com diabetes mellitus tipo 2 em uso de insulina: relato de caso. Rev. Saúde. [Internet]. 2021[cited 2022 jan. 03]; 47(1):e64169. Available from: https://periodicos.ufsm.br/revistasaude/article/view/64169/pdf
    » https://periodicos.ufsm.br/revistasaude/article/view/64169/pdf
  • 3
    Cunha GH da, Fontenele MSM, Siqueira LR, Lima MAC, Gomes MEC, Ramalho AKL. Insulin therapy practice performed by people with diabetes in Primary Healthcare. Rev Esc Enferm USP. [Internet]. 2020 [cited 2022 jan. 11];54:e03620. Available from: http://dx.doi.org/10.1590/S1980-220X2019002903620
    » http://dx.doi.org/10.1590/S1980-220X2019002903620
  • 4
    Silva JP da, Bernardi FA, Franzon JC, Orlandin L, Ferlin GZ, Júnior GAP. Step-by-step insulin application: making educational videos for patients and caregivers. Rev Esc Anna Nery. [Internet]. 2021 [cited 2022 jan. 06];25(1). Available from: http://dx.doi.org/10.1590/2177-9465-EAN-2019-0343
    » http://dx.doi.org/10.1590/2177-9465-EAN-2019-0343
  • 5
    Loureiro LH, Silveira-Alves A, Almeida SNH de, Silva ICM da, Tonin T. Technology in Primary Attention: a strategy to support management. Rev Práxis. [Internet]. 2017 [cited 2021out. 26]; 9(18):69-77. Available from: https://revistas.unifoa.edu.br/praxis/article/view/1418/1290
    » https://revistas.unifoa.edu.br/praxis/article/view/1418/1290
  • 6
    Monteiro DS, Rodrigues ILA, Souza DF de, Barbosa FKM, Farias RC, Nogueira LMV. Validação de uma tecnologia educativa em biossegurança na atenção primária. Rev Cuidarte. [Internet]. 2019 [cited 2021 jan 11];10(2). Available from: http://dx.doi.org/10.15649/cuidarte.v10i2.654
    » http://dx.doi.org/10.15649/cuidarte.v10i2.654
  • 7
    Paraizo CMS, Isidoro JG, Terra F de S, Dázio LMR, Felipe AOB, Fava SMCL. Conhecimento do enfermeiro da Atenção Primária de Saúde sobre Diabetes Mellitus. Rev enferm UFPE. [Internet]. 2018 [cited 2021 jan. 11]; 12(1):179-88. Available from: https://periodicos.ufpe.br/revistas/revistaenfermagem/article/view/23087/25973
    » https://periodicos.ufpe.br/revistas/revistaenfermagem/article/view/23087/25973
  • 8
    Sociedade Brasileira de Diabetes (SBD). Diretrizes 2019-2020 [Internet]. São Paulo: Clannad; 2020 [cited 2020 jan 15]. Available from: http://www.saude.ba.gov.br/wp-content/uploads/2020/02/Diretrizes-Sociedade-Brasileira-de-Diabetes-2019-2020.pdf
    » http://www.saude.ba.gov.br/wp-content/uploads/2020/02/Diretrizes-Sociedade-Brasileira-de-Diabetes-2019-2020.pdf
  • 9
    Gigante VCG, Oliveira RC de, Ferreira DS, Teixeira E, Monteiro WF, Martins AL de O, et al Construção e validação de tecnologia educacional sobre consumo de álcool entre universitários. Cogitare enferm. [Internet]. 2021[cited 2022 jan. 15]; 26:e71208. Available from: http://dx.doi.org/10.5380/ce.v26i0.71208
    » http://dx.doi.org/10.5380/ce.v26i0.71208
  • 10
    Peres CM, Suzuki KMF, Azevedo-Marques PM de. Recursos tecnológicos de apoio ao ensino na saúde. Medicina. [Internet].2015 [cited 11 jan. 2021]; 48(3): 224-32. Available from: https://doi.org/10.11606/issn.2176-7262.v48i3p224-232
    » https://doi.org/10.11606/issn.2176-7262.v48i3p224-232
  • 11
    Pasquali, L. Princípios de elaboração de escalas psicológicas. Rev. psiquiatr. clín. [Internet]. 1998 [cited 2021 jan 20]; 5(25):206-13. Available from: https://pesquisa.bvsalud.org/portal/resource/pt/lil-228044
    » https://pesquisa.bvsalud.org/portal/resource/pt/lil-228044
  • 12
    Jesus EB de, Esteves AVF, Teixeira E, Medeiros HP, Nascimento MH do, Saboia VM. Validação de tecnologia educacional sobre fototerapia para orientar familiares de neonatos ictéricos. Rev enferm UERJ. [Internet]. 2018 [cited 2021 jan. 11]; (26):e21789. Available from: http://dx.doi.org/10.12957/reuerj.2018.21789
    » http://dx.doi.org/10.12957/reuerj.2018.21789
  • 13
    Souza MT de, Silva MD da, Carvalho R de. Integrative review: what is it? How to do it? Einstein [Internet]. 2010 [cited 2021 jan. 11]. Available from: https://www.scielo.br/j/eins/a/ZQTBkVJZqcWrTT34cXLjtBx/?format=pdf⟨=en
    » https://www.scielo.br/j/eins/a/ZQTBkVJZqcWrTT34cXLjtBx/?format=pdf⟨=en
  • 14
    Pasquali, L. Psicometria: teoria dos testes na psicologia e na educação. Petrópolis: Vozes; 2003.
  • 15
    Joventino ES, Oriá MOB, Sawada NO, Ximenes LB. Apparent and content validation of maternal self-efficiency scale for prevention of childhood diarrhea. Rev. Latino-Am. Enf. [Internet]. 2013 [cited 2021 jan. 11]; 21(1):371-9. Available from: https://doi.org/10.1590/S0104-11692013000100012
    » https://doi.org/10.1590/S0104-11692013000100012
  • 16
    Polit DF, Beck CT. Delineamento de Pesquisa em Enfermagem. In: Polit DF, Beck CT, Eds. Fundamentos de pesquisa em enfermagem: avaliação de evidências para prática de enfermagem. Artmed: Porto Alegre; 2011. p. 247-368.
  • 17
    Souza ACC de, Moreira TMM, Borges JWP. Development of an appearance validity instrument for educational technology in health. Rev Bras Enferm. [Internet]. 2020 [cited 2021 jan. 11];73. Available from: http://dx.doi.org/10.1590/0034-7167-2019-0559
    » http://dx.doi.org/10.1590/0034-7167-2019-0559
  • 18
    IBM Corp. Released. IBM SPSS Statistics for Windows, Version 24.0. Armonk, NY: IBM Corp; 2018.
  • 19
    Magalhães VMPR, Almeida CAPL, Santos RF, Ramos CV, Feitosa LGGC, Lago EC, et al Validation of a serial album on domestic violence against women for primary care nurses. Cogit. Enferm. [Internet]. 2020 [cited 2021 jan. 11]; 25:e62729. Available from: http://dx.doi.org/10.5380/ce.v25i0.62729
    » http://dx.doi.org/10.5380/ce.v25i0.62729
  • 20
    Almeida DA de, Santos MS dos, Rosa W de AG, Zeferino MGM, Oliveira ISB, Lenza N de FB. Conhecimento dos cuidadores intradomiciliares de idosos com DM tipo 2 em insulinoterapia, na atenção primária. Rev Saúde. [Internet]. 2018 [cited 2021 dez 14]. 44(2):1-13. Available from: https://doi.org/10.5902/2236583431014
    » https://doi.org/10.5902/2236583431014
  • 21
    Lyra R, Cavalcanti N, Santos RD. Diabetes mellitus uma abordagem cardiovascular. São Paulo: Clannad; 2019.
  • 22
    Cunha GH da, Barbosa RVA, Fontenele MSM, Lima MAC, Franco KB, Fechine FV. Insulin therapy waste produced in the households of people with diabetes monitored in Primary Care. Rev Bras Enferm. [Internet]. 2017 [cited 2021 dez 14];70(3):618-25. Available from: http://dx.doi.org/10.1590/0034-7167-2016-0406
    » http://dx.doi.org/10.1590/0034-7167-2016-0406
  • 23
    Fontenele MSM, Cunha GH da, Lopes MV de O, Siqueira LR, Lima MAC, Moreira LA. Development and evaluation of abooklet to promote healthy lifestyle in people with HIV. Rev Bras Enferm. [Internet]. 2021[cited 2022 jan. 15]. Available from: http://dx.doi.org/10.1590/0034-7167-2020-0113
    » http://dx.doi.org/10.1590/0034-7167-2020-0113
  • 24
    Moura D de JM, Moura N do S, Menezes LCG de, Barros AA, Guedes MVC. Development of a booklet on insulin therapy for children with diabetes mellitus type 1. Rev Bras Enferm. [Internet]. 2017 [cited 2021 jan.11];70(1):3-10. Available from: https://www.scielo.br/j/reben/a/tmGrRQRWy73RGCwNMp4j3FR/?format=pdf⟨=en
    » https://www.scielo.br/j/reben/a/tmGrRQRWy73RGCwNMp4j3FR/?format=pdf⟨=en
  • 25
    Pennafort VP dos S, Queiroz MVO, Gomes ILV, Rocha M de FF. Instructional therapeutic toy in the culture care of the child with diabetes type 1. Rev Bras Enferm. [Internet]. 2018 [cited 2021 jan. 11];71(Suppl 3):1334-42. Available from: http://dx.doi.org/10.1590/0034-7167-2017-0260
    » http://dx.doi.org/10.1590/0034-7167-2017-0260
  • 26
    Salbego C, Nietsche EA, Teixeira E, Girardon-Perlini NMO, Wild CF, Ilha S. Care-educational technologies: an emerging concept of the praxis of nurses in a hospital context. Rev Bras Enferm. [Internet]. 2018 [cited 2021 jan.11];71(Suppl 6):2666-74. Available from: http://dx.doi.org/10.1590/0034-7167-2017-0753
    » http://dx.doi.org/10.1590/0034-7167-2017-0753
  • 27
    Silva JP da, Pereira Junior GA, Meska MHG, Mazzo A. Construction and validation of a low-cost simulator for training patients with diabetes mellitus and/or their caregivers in insulin administration. Esc Anna Nery. [Internet]. 2018 [cited 2021 jan. 11]; 22(3):e20170387. Available from: http://dx.doi.org/10.1590/2177-9465-EAN-2017-0387
    » http://dx.doi.org/10.1590/2177-9465-EAN-2017-0387
  • 28
    Wild CF, Nietsche EA, Salbego C, Teixeira E, Favero NB. Validation of educational booklet: an educational technology in dengue prevention. Rev Bras Enferm. [Internet]. 2019 [cited 2021 jan. 11];72(0):1318-25. Available from: https://www.scielo.br/j/reben/a/n8RDQB8xP3MCtYt8LmgwpPm/?format=pdf⟨=en
    » https://www.scielo.br/j/reben/a/n8RDQB8xP3MCtYt8LmgwpPm/?format=pdf⟨=en
  • 29
    Sá GGM de, Santos AMR dos, Galindo Neto NMG, Carvalho KM de, Feitosa CDA, Mendes PN. Building and validating an educational video for elderly individuals about fall risks. Rev Bras Enferm. [Internet].2020 [cited 2021 jan.11];73(Suppl 3):e20200010. Available from: http://dx.doi.org/10.1590/0034-7167-2020-0010
    » http://dx.doi.org/10.1590/0034-7167-2020-0010
  • 30
    Leite S de S, Afio ACE, Carvalho LV de, Silva JM da, Almeida PC de, Pagliuca LMF. Construction and validation of an Educational Content Validation Instrument in Health. Rev Bras Enferm. [Internet].2018 [cited 2021 jan. 11];71, 1635-41. Available from: http://dx.doi.org/10.1590/0034-7167-2017-0648
    » http://dx.doi.org/10.1590/0034-7167-2017-0648

Edited by

Associate editor: Dra. Luciana Nogueira

Publication Dates

  • Publication in this collection
    06 Feb 2023
  • Date of issue
    2023

History

  • Received
    28 Mar 2022
  • Accepted
    19 Sept 2022
Universidade Federal do Paraná Av. Prefeito Lothário Meissner, 632, Cep: 80210-170, Brasil - Paraná / Curitiba, Tel: +55 (41) 3361-3755 - Curitiba - PR - Brazil
E-mail: cogitare@ufpr.br