ABSTRACT
Objective:
To identify the learning outcomes and skills obtained of undergraduate nursing students involved in research projects.
Methods:
This was an integrative literature review, based on a research protocol in the CINAHL Complete databases; Cochrane Central Register of Controlled Trials; Cochrane Database of Systematic Reviews; Cochrane Methodology Register; MedicLatina; MEDLINE, Scopus and JBI, including primary and secondary studies, published between 2015 and 2020.
Results:
A total of five heterogeneous articles were included, which were categorized using Kirkpatrick's (adapted) model. Seventeen learning outcomes acquired through participation in research projects were identified, from the learning of new knowledge and skills to the development of new attitudes and behaviors.
Final considerations:
The involvement of nursing students in research projects is important to their professional development. Future investment in research on this topic can help cement the potential of this type of student involvement.
Descriptors:
Evidence-Based Practice; Learning; Students; Nursing; Research
RESUMEN
Objetivo:
Identificar aprendizajes y competencias desarrollados por estudiantes de Licenciatura en Enfermería involucrados en proyectos de investigación.
Métodos:
Revisión integrativa de la literatura, partiendo de un protocolo de investigación en las bases de datos CINAHL Complete; Cochrane Central Register of Controlled Trials; Cochrane Database of Systematic Reviews; Cochrane Methodology Register; MedicLatina; MEDLINE; Scopus y JBI, habiéndose incluido estudios primarios y secundarios publicados entre 2015 y 2020.
Resultados:
Se incluyeron cinco artículos heterogéneos, categorizados según el Modelo de Kirkpatrick (adaptado). Se identificaron diecisiete resultados de aprendizajes adquiridos por la participación en proyectos de investigación, desde el aprendizaje de nuevos conocimientos y competencias al desarrollo de nuevas actitudes y conductas.
Consideraciones Finales:
La participación de estudiantes de Licenciatura en Enfermería en proyectos de investigación se inscribe como de suma importancia para su desarrollo profesional. La inversión futura en investigación sobre esta temática podrá contribuir a cimentar el potencial de esta participación.
Descriptores:
Práctica Clínica Basada en la Evidencia; Aprendizaje; Estudiantes; Enfermaría; Investigación
RESUMO
Objetivo:
Identificar aprendizagens e competências desenvolvidas pelos estudantes da Licenciatura em Enfermagem envolvidos em projetos de investigação.
Métodos:
Revisão integrativa da literatura, a partir de um protocolo de pesquisa nas bases de dados CINAHL Complete; Cochrane Central Register of Controlled Trials; Cochrane Database of Systematic Reviews; Cochrane Methodology Register; MedicLatina; MEDLINE, Scopus e JBI, tendo sido incluídos estudos primários e secundários publicados entre 2015 e 2020.
Resultados:
Foi incluído um total de cinco artigos, heterogêneos, que foram categorizados, por meio do Modelo de Kirkpatrick's (adaptado). Identificaram-se dezessete resultados de aprendizagem adquiridos com a participação em projetos de investigação, desde a aprendizagem de novos conhecimentos e competências até o desenvolvimento de novas atitudes e comportamentos.
Considerações Finais:
O envolvimento dos estudantes da licenciatura em Enfermagem em projetos de investigação afigura-se extremamente importante para o seu desenvolvimento profissional. O investimento futuro na investigação sobre essa temática poderá contribuir para alicerçar as potencialidades desse envolvimento.
Descritores:
Prática Clínica Baseada em Evidências; Aprendizagem; Estudantes; Enfermagem; Pesquisa
INTRODUCTION
There has been growing interest in recent years in the experience of involving nursing students in research and development projects(11 Monsivais DB, Robinson K. Developing students as future researchers using QSEN competencies as a framework. Nurs Forum. 2016;51(4):238-45. https://doi.org/10.1111/nuf.12147
https://doi.org/10.1111/nuf.12147...
-22 Loura D, Bernardes R, Baixinho CL, Rafael H, Félix I, Guerreiro M. Aprender em projetos de investigação durante a licenciatura em enfermagem: revisão integrativa da literatura. NTQR. 2020;3:293-304. https://doi.org/10.36367/ntqr.3.2020.293-304
https://doi.org/10.36367/ntqr.3.2020.293...
). Some studies have shown that the participation of students in research teams can bring benefits to their learning process, to project development, and to higher education institutions(33 Hickey JE, Adam M, Elwadia I, Nasser S, Topping AE. A process-environment model for mentoring undergraduate research students. J Prof Nurs. 2019;35(4):320-4. https://doi.org/10.1016/j.profnurs.2019.02.001
https://doi.org/10.1016/j.profnurs.2019....
).
The main guiding policies for health care and undergraduate and graduate nursing education, both in Brazil and internationally, challenge higher education institutions (HEIs) to involve students in research, as this promotes learning about the process of developing scientific knowledge in nursing(44 Keighley T, World Health Organization. The European Union standards for nursing and midwifery: information for accession countries revised and updated by Thomas Keighley (No. EUR/08/5085937). Copenhagen: WHO Regional Office for Europe. 2009.-55 World Health Organization (WHO). State of the world's nursing 2020: investing in education, jobs and leadership [Internet]. World Health Organization. 2020[cited 2021 Feb 20]. Available from: https://apps.who.int/iris/handle/10665/331677
https://apps.who.int/iris/handle/10665/3...
). In particular, there are recommendations for HEIs to create and develop opportunities for collaborative research, involving students(66 Ross JG, Burrell SA. Nursing students' attitudes toward research: an integrative review. Nurs Educ Today. 2019;82:79-87. https://doi.org/10.1016/j.nedt.2019.08.006
https://doi.org/10.1016/j.nedt.2019.08.0...
).
Some studies show that the active and supervised participation of students promotes greater awareness of the object of study, simultaneously stimulating critical thinking, promoting the construction of a practice that is aware of contextual influences, and that allows for greater familiarity with the research process(77 Einarsen KA, Giske T. Nursing students' longitudinal learning outcomes after participation in a research project in a hospital. IPDJ. 2019;9(1):a4. https://doi.org/10.19043/ipdj.91.004
https://doi.org/10.19043/ipdj.91.004...
-88 Slattery MJ, Logan BL, Mudge B, Secore K, von Reyn LJ, Maue RA. An Undergraduate research fellowship program to prepare nursing students for future workforce roles. J Prof Nurs. 2016;32(6):412-20. https://doi.org/10.1016/j.profnurs.2016.03.008
https://doi.org/10.1016/j.profnurs.2016....
). These results are echoed in the schools of thought that defend that it is essential to instill among students passion and enthusiasm for research and its relevance to daily life. It is important to ensure that the knowledge obtained from these experiences is translated into evidence-based practice in clinical contexts, because when professionals are inserted in a network of interprofessional cooperation, nursing care becomes increasingly complex(99 Kim JS, Gu MO, Chang H. Effects of an evidence-based practice education program using multifaceted interventions: a quasi-experimental study with undergraduate nursing students. BMC Med Educ. 2019;19(71):1-10. https://doi.org/10.1186/s12909-019-1501-6). Therefore, these recommendations promote the involvement of nursing students as co-researchers, while also encouraging them to incorporate evidence into their practice and being more proactive in seeking graduate-level education(88 Slattery MJ, Logan BL, Mudge B, Secore K, von Reyn LJ, Maue RA. An Undergraduate research fellowship program to prepare nursing students for future workforce roles. J Prof Nurs. 2016;32(6):412-20. https://doi.org/10.1016/j.profnurs.2016.03.008
https://doi.org/10.1016/j.profnurs.2016....
).
The practical application of knowledge has the great potential to improve quality of care(99 Kim JS, Gu MO, Chang H. Effects of an evidence-based practice education program using multifaceted interventions: a quasi-experimental study with undergraduate nursing students. BMC Med Educ. 2019;19(71):1-10. https://doi.org/10.1186/s12909-019-1501-6) and, consequently, reduce the time gap between the production of knowledge and its implementation. Furthermore, the integration of students in projects led by HEIs in all phases of the research process - from the creation of research questions to the publication of results - seems to increase levels of learning motivation(1010 Kurtz CP, Kessler TA. An undergraduate collaborative team model to engage nursing students in research. Int J Nurs Pract. 2017;7(7):112-8. https://doi.org/10.5430/jnep.v7n7p112
https://doi.org/10.5430/jnep.v7n7p112...
), develop interprofessional work skills(88 Slattery MJ, Logan BL, Mudge B, Secore K, von Reyn LJ, Maue RA. An Undergraduate research fellowship program to prepare nursing students for future workforce roles. J Prof Nurs. 2016;32(6):412-20. https://doi.org/10.1016/j.profnurs.2016.03.008
https://doi.org/10.1016/j.profnurs.2016....
) and contribute to the progress of research programs of HEIs(88 Slattery MJ, Logan BL, Mudge B, Secore K, von Reyn LJ, Maue RA. An Undergraduate research fellowship program to prepare nursing students for future workforce roles. J Prof Nurs. 2016;32(6):412-20. https://doi.org/10.1016/j.profnurs.2016.03.008
https://doi.org/10.1016/j.profnurs.2016....
,1111 Jansen DA, Jadack RA, Ayoola AB, Doornbos MM, Dunn SL, Moch SD, et al. Embedding research in undergraduate learning opportunities. West J Nurs Res. 2015;37(10):1340-58. https://doi.org/10.1177/0193945915571136
https://doi.org/10.1177/0193945915571136...
).
Although several benefits have been observed as a consequence of nursing student participation in research projects led by HEIs, no studies have been identified that systematize the learning results that result from these experiences.
OBJECTIVE
To identify the learning outcomes and skills obtained by nursing students involved in research projects.
METHODS
Ethical aspects
An integrative literature review (ILR) is a type of secondary study that does not require permission from an ethics committee as it does not directly involve human beings.
When developing this study, a pre-defined protocol was used based on the recommendations of some authors(1212 Torraco RJ. Writing integrative literature reviews: using the past and present to explore the future. Hum Resour Dev Int. 2016;15(4):404-28. https://doi.org/10.1177/1534484316671606
https://doi.org/10.1177/1534484316671606...
13 Souza MT, Silva MD, Carvalho R. Integrative review: what is it? how to do it? Einstein. 2010;8(1):102-6. https://doi.org/10.1590/s1679-45082010rw1134.
https://doi.org/10.1590/s1679-45082010rw...
-1414 Mendes KDS, Silveira RCCP, Galvão CM. Revisão integrativa: método de pesquisa para a incorporação de evidências na saúde e na enfermagem. Texto Contexto Enferm. 2008;17(4):758-64. https://doi.org/10.1590/S0104-07072008000400018
https://doi.org/10.1590/S0104-0707200800...
) to ensure the rigor of the studies' different methodological procedures and ensure their validity(1414 Mendes KDS, Silveira RCCP, Galvão CM. Revisão integrativa: método de pesquisa para a incorporação de evidências na saúde e na enfermagem. Texto Contexto Enferm. 2008;17(4):758-64. https://doi.org/10.1590/S0104-07072008000400018
https://doi.org/10.1590/S0104-0707200800...
). The formulation of the research question abided by the principles of clarity, accuracy, pertinence, and objectivity.
The process of selecting, extracting, and analyzing the sample was carried out respecting the work and results obtained by the other researchers. The framework of this article is based on the best academic and scientific practices.
Type of study
The integrative literature review (ILR) is a research method that generates new knowledge on a given topic of study, presenting a review, critique, and summary of the most representative literature(1212 Torraco RJ. Writing integrative literature reviews: using the past and present to explore the future. Hum Resour Dev Int. 2016;15(4):404-28. https://doi.org/10.1177/1534484316671606
https://doi.org/10.1177/1534484316671606...
). Thus, it is the most comprehensive methodological approach, because it includes experimental and non-experimental studies(1313 Souza MT, Silva MD, Carvalho R. Integrative review: what is it? how to do it? Einstein. 2010;8(1):102-6. https://doi.org/10.1590/s1679-45082010rw1134.
https://doi.org/10.1590/s1679-45082010rw...
) to understand the chosen phenomenon. Moreover, the ILR allows for the inclusion of relevant literature to support decision-making, through the synthesis of what is already known about the studied phenomenon, helping to identify gaps that need to be clarified with new research(1414 Mendes KDS, Silveira RCCP, Galvão CM. Revisão integrativa: método de pesquisa para a incorporação de evidências na saúde e na enfermagem. Texto Contexto Enferm. 2008;17(4):758-64. https://doi.org/10.1590/S0104-07072008000400018
https://doi.org/10.1590/S0104-0707200800...
).
The choice for an ILR was based on the need for a thorough understanding of the chosen phenomenon. It is a current, pertinent, and underexplored topic that allows for recommendations in the field of nursing research and education, impacting how nursing students value and apply scientific evidence to their practice.
Methodological procedures
The pre-defined protocol consisted of six steps: 1) identifying the topic and defining the research question, 2) defining the eligibility criteria for inclusion and exclusion of studies, 3) defining the information to be extracted, 4) evaluating the included studies, 5) interpreting the results and 6) presenting the review/synthesis of knowledge(1414 Mendes KDS, Silveira RCCP, Galvão CM. Revisão integrativa: método de pesquisa para a incorporação de evidências na saúde e na enfermagem. Texto Contexto Enferm. 2008;17(4):758-64. https://doi.org/10.1590/S0104-07072008000400018
https://doi.org/10.1590/S0104-0707200800...
).
The following research question was formulated: "What are the learning outcomes and skills developed by undergraduate nursing students when they are involved in research projects?". It was created using the PICo mnemonic (population, phenomenon of interest and context), which also guided the definition of eligibility criteria (Chart 1).
Data collection and organization
Based on the research question and the definition of the inclusion criteria, the study was carried out between December 2019 and February 2020. The descriptors used in Portuguese and English and in associations (AND and OR) were: (students OR undergraduate students) and (research OR research project OR Technology and Innovation OR Activities OR R&D activities or evidence-based practice) and (learning or learning outcomes) and nurs*. The analysis of the literature and the experience of the authors contributed to the selection of descriptors.
The search was conducted in the following databases: CINAHL(r)Complete; Cochrane Controlled Trials Register; Cochrane Database of Systematic Reviews; Cochrane Methodology Register; MedicLatina; MEDLINE, Scopus, and JBI. The timeframe was restricted to the years 2015 to 2020, given the importance of describing current knowledge, an assumption associated with the potential of IRLs to produce changes in clinical practice as a consequence of research findings(1414 Mendes KDS, Silveira RCCP, Galvão CM. Revisão integrativa: método de pesquisa para a incorporação de evidências na saúde e na enfermagem. Texto Contexto Enferm. 2008;17(4):758-64. https://doi.org/10.1590/S0104-07072008000400018
https://doi.org/10.1590/S0104-0707200800...
).
Figure 1 illustrates the process of selecting the studies until the final sample was obtained.
The potential sample consisted of 107 articles. Two researchers read and analyzed the titles and abstracts, which immediately led to the elimination of 89 studies (4 duplicates and 85 that did not meet the eligibility criteria). The reading and analysis of the abstracts whittled the selection down to 18 and the analysis of the full text to 5. Thirteen articles were eliminated after reading the full text because they did not answer the research question.
Most of the screened studies were eliminated by evaluating evidence-based research or research training programs, which did not involve students in research projects. The review identified one systematic review about the involvement of students in research, but the article did not identify the specific gains for nursing students, so therefore it was not included in the sample(1515 Zuchowski I, Heyeres M, Tsey K. Students in research placements as part of professional degrees: a systematic review. Aus Soc Work. 2020;73(1):48-63. https://doi.org/10.1080/0312407X.2019.1649439
https://doi.org/10.1080/0312407X.2019.16...
).
Data analysis
A table was constructed to record the data collected based on the sample of articles, including the following data: title of the article; year; author(s), type of article; objective(s); method; level of evidence, and main outcomes/conclusions. Then a synthesized version of this table was produced, according to the guidelines of the journal, as presented in Table 2.
The nature of the studies and their outcomes enabled analysis and synthesis of their content. Categories defined a priori based on Kirkpatrick's (K) model were used to evaluate learning outcomes(1616 Steinert Y, Mann K, Anderson B, Barnett BM, Centeno A, Naismith L, et al. A systematic review of faculty development initiatives designed to enhance teaching effectiveness: a 10-year update: BEME Guide No 40. Med Teach. 2016;38(8):769-86. https://doi.org/10.1080/0142159X.2016.1181851
https://doi.org/10.1080/0142159X.2016.11...
). The model was later revised and adapted by other authors; the present study started out with the version that appeared in the article by Steinert and collaborators(1616 Steinert Y, Mann K, Anderson B, Barnett BM, Centeno A, Naismith L, et al. A systematic review of faculty development initiatives designed to enhance teaching effectiveness: a 10-year update: BEME Guide No 40. Med Teach. 2016;38(8):769-86. https://doi.org/10.1080/0142159X.2016.1181851
https://doi.org/10.1080/0142159X.2016.11...
), which was adapted to the present review. It includes four levels, represented by a K, followed by a number indicating the level: K1 (reaction); K2 (learning, knowledge, and skills, which help change attitudes and behavior); K3 (behavior change); and K4 (change in the institution/organization associated with the educational program) (1616 Steinert Y, Mann K, Anderson B, Barnett BM, Centeno A, Naismith L, et al. A systematic review of faculty development initiatives designed to enhance teaching effectiveness: a 10-year update: BEME Guide No 40. Med Teach. 2016;38(8):769-86. https://doi.org/10.1080/0142159X.2016.1181851
https://doi.org/10.1080/0142159X.2016.11...
).
RESULTS
The results obtained in this integrative review were extracted from the articles included in the sample after they were read in full. A total of five articles were included, which were heterogeneous in terms of their objectives, methodology, results, and conclusions. The five publications were classified as presenting different levels of evidence and were developed using non-similar research designs.
The articles were published between 2015 and 2020, with a wide geographical distribution - two were from Norway, one from Russia, one from the USA, and one from the Netherlands. The main results of the articles are shown in Chart 2.
In relation to Kirkpatrick's Model(1616 Steinert Y, Mann K, Anderson B, Barnett BM, Centeno A, Naismith L, et al. A systematic review of faculty development initiatives designed to enhance teaching effectiveness: a 10-year update: BEME Guide No 40. Med Teach. 2016;38(8):769-86. https://doi.org/10.1080/0142159X.2016.1181851
https://doi.org/10.1080/0142159X.2016.11...
), of a total of 17 learning outcomes, most were at the K2 level, corresponding to the learning of new knowledge and skills, as well as new skills that promote attitude change (n=10). Next, there were changes related to behavior (K3; n=5) and, finally, those related to the response regarding the importance of the phenomenon (K1; n=1) and the results of change in the institution/organization related to the educational program (K4; n=1). The main findings by category are described below.
Learning new knowledge and skills to develop new attitudes
The articles showed that the most common outcome of undergraduate nursing students' participation in research projects was learning new knowledge and developing competencies and skills relevant to the profession and society. The knowledge and skills acquired at the research level(1818 Moskvichena N, Bordovskaia N, DarinsKaya L. Role of students and supervisors' interaction in research projects: expectations and evaluations. Procedia Soc Behav Sci. 2015;171(2015):576-83. https://doi.org/10.1016/j.sbspro.2015.01.163
https://doi.org/10.1016/j.sbspro.2015.01...
), especially with regard to data analysis and interpretation and project implementation(88 Slattery MJ, Logan BL, Mudge B, Secore K, von Reyn LJ, Maue RA. An Undergraduate research fellowship program to prepare nursing students for future workforce roles. J Prof Nurs. 2016;32(6):412-20. https://doi.org/10.1016/j.profnurs.2016.03.008
https://doi.org/10.1016/j.profnurs.2016....
,1717 Børsting TE, Kristensen N, Hanssen I. Student nurses' learning outcomes through participation in a clínical nursing research project: a qualitative study. Nurs Educ Practice. 2020;43(2020):102727. https://doi.org/10.1016/j.nepr.2020.102727
https://doi.org/10.1016/j.nepr.2020.1027...
), are integrated into the clinical dimension, which enhances general and specific technical-scientific knowledge(88 Slattery MJ, Logan BL, Mudge B, Secore K, von Reyn LJ, Maue RA. An Undergraduate research fellowship program to prepare nursing students for future workforce roles. J Prof Nurs. 2016;32(6):412-20. https://doi.org/10.1016/j.profnurs.2016.03.008
https://doi.org/10.1016/j.profnurs.2016....
), and interdisciplinary(88 Slattery MJ, Logan BL, Mudge B, Secore K, von Reyn LJ, Maue RA. An Undergraduate research fellowship program to prepare nursing students for future workforce roles. J Prof Nurs. 2016;32(6):412-20. https://doi.org/10.1016/j.profnurs.2016.03.008
https://doi.org/10.1016/j.profnurs.2016....
) and relational(1717 Børsting TE, Kristensen N, Hanssen I. Student nurses' learning outcomes through participation in a clínical nursing research project: a qualitative study. Nurs Educ Practice. 2020;43(2020):102727. https://doi.org/10.1016/j.nepr.2020.102727
https://doi.org/10.1016/j.nepr.2020.1027...
) cooperation skills.
The emergence of new attitudes towards research was also highlighted. Participation in research projects molds future professionals who have the potential to constructively question clinical practice and are able to conceive it within the framework of a given organizational culture(77 Einarsen KA, Giske T. Nursing students' longitudinal learning outcomes after participation in a research project in a hospital. IPDJ. 2019;9(1):a4. https://doi.org/10.19043/ipdj.91.004
https://doi.org/10.19043/ipdj.91.004...
). This change in attitude was also revealed in the acquisition of an initiated degree of research development, which can lead to the development of scientific work in the short, medium, or long term(77 Einarsen KA, Giske T. Nursing students' longitudinal learning outcomes after participation in a research project in a hospital. IPDJ. 2019;9(1):a4. https://doi.org/10.19043/ipdj.91.004
https://doi.org/10.19043/ipdj.91.004...
).
Behavior change
Behavioral change emerges from the ability to interconnect the contexts of clinical practice and knowledge production. First, the involvement of students in research projects enhances the optimization of time management(1717 Børsting TE, Kristensen N, Hanssen I. Student nurses' learning outcomes through participation in a clínical nursing research project: a qualitative study. Nurs Educ Practice. 2020;43(2020):102727. https://doi.org/10.1016/j.nepr.2020.102727
https://doi.org/10.1016/j.nepr.2020.1027...
), and increases awareness and attention in clinical practice(77 Einarsen KA, Giske T. Nursing students' longitudinal learning outcomes after participation in a research project in a hospital. IPDJ. 2019;9(1):a4. https://doi.org/10.19043/ipdj.91.004
https://doi.org/10.19043/ipdj.91.004...
), along with self-confidence(1717 Børsting TE, Kristensen N, Hanssen I. Student nurses' learning outcomes through participation in a clínical nursing research project: a qualitative study. Nurs Educ Practice. 2020;43(2020):102727. https://doi.org/10.1016/j.nepr.2020.102727
https://doi.org/10.1016/j.nepr.2020.1027...
) and self-efficacy of participating students(1919 Jong G, Meijer E, Schout G, Abma T. Involving undergraduate nursing students in participatory health research: implications from the Netherlands. J Prof Nurs. 2018;34(6):507-13. https://doi.org/10.1016/j.profnurs.2018.04.001
https://doi.org/10.1016/j.profnurs.2018....
). Additionally, it seemed to encourage them to apply the knowledge they had acquired and continued to acquire into their practice, translating such knowledge and promoting evidence-based practices(1919 Jong G, Meijer E, Schout G, Abma T. Involving undergraduate nursing students in participatory health research: implications from the Netherlands. J Prof Nurs. 2018;34(6):507-13. https://doi.org/10.1016/j.profnurs.2018.04.001
https://doi.org/10.1016/j.profnurs.2018....
).
Response regarding the importance of the phenomenon
The recognition of the importance of student involvement in research projects appeared to be cross-sectional to the entire population mentioned in the articles. However, it was only mentioned explicitly in one article that explored the role of supervisors in fostering increased motivation in students to participate in research(1818 Moskvichena N, Bordovskaia N, DarinsKaya L. Role of students and supervisors' interaction in research projects: expectations and evaluations. Procedia Soc Behav Sci. 2015;171(2015):576-83. https://doi.org/10.1016/j.sbspro.2015.01.163
https://doi.org/10.1016/j.sbspro.2015.01...
).
Change in institutions/organizations associated with the educational program
The sample did not present a great number of outcomes that could allow for the extrapolation of the changes that took place in the institutions that hosted the research projects. However, there seemed to be several opportunities for this to happen. An example was the importance assigned to the supervisor as a strategy to monitor and guide students(1818 Moskvichena N, Bordovskaia N, DarinsKaya L. Role of students and supervisors' interaction in research projects: expectations and evaluations. Procedia Soc Behav Sci. 2015;171(2015):576-83. https://doi.org/10.1016/j.sbspro.2015.01.163
https://doi.org/10.1016/j.sbspro.2015.01...
), a figure who, contributes to the development of all phases of the research project and, as such, can cause a change in the perception of HEIs regarding the necessity of their role.
DISCUSSION
The articles included in this literature review were mostly observational, with different methods and techniques, and considering their limitations, they were able to answer the research question.
The involvement of students in research projects has been a theme prominently addressed at a global level. There are several scientific perspectives about its importance for those involved, but also for individual and collective health. The results reflect the importance of encouraging and motivating students to participate in research projects, in addition to the need to generate awareness among HEIs to promote these practices(77 Einarsen KA, Giske T. Nursing students' longitudinal learning outcomes after participation in a research project in a hospital. IPDJ. 2019;9(1):a4. https://doi.org/10.19043/ipdj.91.004
https://doi.org/10.19043/ipdj.91.004...
-88 Slattery MJ, Logan BL, Mudge B, Secore K, von Reyn LJ, Maue RA. An Undergraduate research fellowship program to prepare nursing students for future workforce roles. J Prof Nurs. 2016;32(6):412-20. https://doi.org/10.1016/j.profnurs.2016.03.008
https://doi.org/10.1016/j.profnurs.2016....
,1717 Børsting TE, Kristensen N, Hanssen I. Student nurses' learning outcomes through participation in a clínical nursing research project: a qualitative study. Nurs Educ Practice. 2020;43(2020):102727. https://doi.org/10.1016/j.nepr.2020.102727
https://doi.org/10.1016/j.nepr.2020.1027...
18 Moskvichena N, Bordovskaia N, DarinsKaya L. Role of students and supervisors' interaction in research projects: expectations and evaluations. Procedia Soc Behav Sci. 2015;171(2015):576-83. https://doi.org/10.1016/j.sbspro.2015.01.163
https://doi.org/10.1016/j.sbspro.2015.01...
-1919 Jong G, Meijer E, Schout G, Abma T. Involving undergraduate nursing students in participatory health research: implications from the Netherlands. J Prof Nurs. 2018;34(6):507-13. https://doi.org/10.1016/j.profnurs.2018.04.001
https://doi.org/10.1016/j.profnurs.2018....
).
The aspects described above are corroborated by evidence that suggests that HEIs need to invest in such programs, because most undergraduate students who complete research curricular units are not in fact competent in research methodology and research processes. In addition, in real-world learning, students often face complex situations that involve reflection and well-grounded clinical decision-making. Therefore, research skills is one of the topics that should be included in the curricula as soon as possible(2020 Vera F. Research skills in nursing undergraduate students: a case at a Chilean Private University. OSJ. 2020;5(3). https://doi.org/10.23954/osj.v5i3.2487
https://doi.org/10.23954/osj.v5i3.2487...
), so that students are able to address and solve complex health-disease situations.
There is consensus that research is important to nursing, not only at the level of education(77 Einarsen KA, Giske T. Nursing students' longitudinal learning outcomes after participation in a research project in a hospital. IPDJ. 2019;9(1):a4. https://doi.org/10.19043/ipdj.91.004
https://doi.org/10.19043/ipdj.91.004...
,2121 Aglen B. Pedagogical strategies to teach bachelor students evidence-based practice: a systematic review. Nurse Educ Today. 2016;36:255-63. https://doi.org/10.1016/j.nedt.2015.08.025
https://doi.org/10.1016/j.nedt.2015.08.0...
), but also professionally. Three articles included in the sample highlighted the importance of translating theoretical knowledge into practice and how student involvement in research activities fosters this potential(77 Einarsen KA, Giske T. Nursing students' longitudinal learning outcomes after participation in a research project in a hospital. IPDJ. 2019;9(1):a4. https://doi.org/10.19043/ipdj.91.004
https://doi.org/10.19043/ipdj.91.004...
-88 Slattery MJ, Logan BL, Mudge B, Secore K, von Reyn LJ, Maue RA. An Undergraduate research fellowship program to prepare nursing students for future workforce roles. J Prof Nurs. 2016;32(6):412-20. https://doi.org/10.1016/j.profnurs.2016.03.008
https://doi.org/10.1016/j.profnurs.2016....
,1919 Jong G, Meijer E, Schout G, Abma T. Involving undergraduate nursing students in participatory health research: implications from the Netherlands. J Prof Nurs. 2018;34(6):507-13. https://doi.org/10.1016/j.profnurs.2018.04.001
https://doi.org/10.1016/j.profnurs.2018....
). Other researchers have reinforced not only the academic importance of research, but also its relevance to clinical practice and, consequently, to the interconnection of care with the latest scientific evidence, noting that greater exploration of research activities can more effectively enable students to acquire certain core competencies for clinical care(2222 Egilsdottir HÖ, Byermoen KR, Moen A, Eide H. Revitalizing physical assessment in undergraduate nursing education: what skills are important to learn, and how are these skills applied during clinical rotation? a cohort study. BMC Nurs. 2019;18:41. https://doi.org/10.1186/s12912-019-0364-9
https://doi.org/10.1186/s12912-019-0364-...
).
Evidence-based practice is a key product of adopting strategies to engage students in research projects(77 Einarsen KA, Giske T. Nursing students' longitudinal learning outcomes after participation in a research project in a hospital. IPDJ. 2019;9(1):a4. https://doi.org/10.19043/ipdj.91.004
https://doi.org/10.19043/ipdj.91.004...
,1919 Jong G, Meijer E, Schout G, Abma T. Involving undergraduate nursing students in participatory health research: implications from the Netherlands. J Prof Nurs. 2018;34(6):507-13. https://doi.org/10.1016/j.profnurs.2018.04.001
https://doi.org/10.1016/j.profnurs.2018....
). The future and current success of the correct use of evidence seems to be related to the need to bring students closer to the contexts in which it is created(2323 Hung HY, Wang YW, Feng JY, Wang CJ, Lin ECL, Chang, YJ. Evidence-based practice curriculum development for undergraduate nursing students: the preliminary results of an action research study in Taiwan. J Nurs Healthc Res. 2019;27(4):e30. https://doi.org/10.1097/jnr.0000000000000298
https://doi.org/10.1097/jnr.000000000000...
). This study corroborates the opinion of authors who argue that, although the topic of transferring knowledge and using it in clinical settings is not a recent topic in the academic and public debate, it is an emerging practice(2424 Baixinho CL, Costa AP. Researchers' scientific credibility and knowledge transfer. Esc Anna Nery. 2020;24(3):e20200008. https://doi.org/10.1590/2177-9465-ean-2020-0008
https://doi.org/10.1590/2177-9465-ean-20...
).
The sample in this literature review suggests that the participation of students in research helps develop their professional identity and, as such, acquire new knowledge and skills. This perspective is supported by the literature, because the exercise of reflecting on and questioning issues, combined with performing tasks in various real-life contexts - activities which occur in research projects - promote the complex integration of core knowledge to the profession, such as professional judgment, skills, values, and attitudes(2525 Fukada M. Nursing competency: definition, structure and development. Yonago Acta Med. 2018;61(1):1-7. https://doi.org/10.33160/yam.2018.03.001
https://doi.org/10.33160/yam.2018.03.001...
).
Studies have also underscored the importance of supervisors as a guiding actor in the teaching-learning process. However, this should be explored in future research, because in the present study, the analysis of the evidence did not make it clear which models and strategies should be used. In fact, there is evidence that the dynamics between supervisor and supervised lacks planning that allows for the coordination of the project objectives, the supervisor's skills, and the students' monitoring needs (2626 Jong G, Meijer E, Schout G, Abma T. Involving undergraduate nursing students in participatory health research: implications from the Netherlands. J Profess Nurs. 2018;34(6):507-13. https://doi.org/10.1016/j.profnurs.2018.04.001
https://doi.org/10.1016/j.profnurs.2018....
27 Arrigoni C, Grugnetti AM, Caruso R, Gallotti ML, Borrelli P, Puci M. Nursing students' clinical competencies: a survey on clinical education objectives. Ann Ig. 2017;29(3):179-88. https://doi.org/10.7416/ai.2017.2145
https://doi.org/10.7416/ai.2017.2145...
-2828 Salman A, Fakhraldeen SA, Chun S, Jamil K, Gasana J, Al-Hunayan A. Enhancing research and development in the health sciences as a strategy to establish a knowledge-based economy in the State of Kuwait: a call for action. Healthcare. 2020;8(3):264. https://doi.org/10.3390/healthcare8030264
https://doi.org/10.3390/healthcare803026...
), which would prevent the potential loss of interest in research and its alienation from clinical practice. Therefore, knowledge about the best processes to support and monitor students is important to promote more effective learning(2727 Arrigoni C, Grugnetti AM, Caruso R, Gallotti ML, Borrelli P, Puci M. Nursing students' clinical competencies: a survey on clinical education objectives. Ann Ig. 2017;29(3):179-88. https://doi.org/10.7416/ai.2017.2145
https://doi.org/10.7416/ai.2017.2145...
) and enable a more adequate use of knowledge with health gains.
In the long term, investing in the training of nurses with research skills seems to contribute not only to the improvement of the quality of health services but also stimulates innovation industries in the health sector, improving the health level of the population and contributing to national competitiveness and economic growth(2828 Salman A, Fakhraldeen SA, Chun S, Jamil K, Gasana J, Al-Hunayan A. Enhancing research and development in the health sciences as a strategy to establish a knowledge-based economy in the State of Kuwait: a call for action. Healthcare. 2020;8(3):264. https://doi.org/10.3390/healthcare8030264
https://doi.org/10.3390/healthcare803026...
). Also in the educational sphere, there is a paradigmatic shift, with a pronounced call for the transition from research-informed education, in which students are passive consumers of knowledge, to research-based education, in which students are effectively involved in studies, thus actively assimilating knowledge(2929 Ommering BWC, van Diepen M, van Blankenstein FM, Jong PGM, Dekker FW. Twelve tips to offer a short authentic and experiential individual research opportunity to a large group of undergraduate students. Med Teach. 2020;42(10):1128-33. https://doi.org/10.1080/0142159X.2019.1695766
https://doi.org/10.1080/0142159X.2019.16...
).
Research is an essential competence for health professionals and implies that they are aware of the latest developments in the health field, are able to critically evaluate the scientific literature, and can use scientific knowledge in clinical decision-making(2929 Ommering BWC, van Diepen M, van Blankenstein FM, Jong PGM, Dekker FW. Twelve tips to offer a short authentic and experiential individual research opportunity to a large group of undergraduate students. Med Teach. 2020;42(10):1128-33. https://doi.org/10.1080/0142159X.2019.1695766
https://doi.org/10.1080/0142159X.2019.16...
30 Oh EG, Yang YL. Evidence-based nursing education for undergraduate students: a preliminary experimental study. Nurse Educ Pract. 2019;38:45-51. https://doi.org/10.1016/j.nepr.2019.05.010
https://doi.org/10.1016/j.nepr.2019.05.0...
-3131 Nehrir B, Vanaki Z, Mokhtari Nouri J, Khademolhosseini S, Ebadi A. Competency in Nursing Students: a systematic review. IJTMGH, 2016;4(1):3-11. https://doi.org/10.20286/ijtmgh-04013
https://doi.org/10.20286/ijtmgh-04013...
). Therefore, participating in research during the undergraduate programs is an emerging focus to help students develop the skills and competencies necessary for health professionals today(1515 Zuchowski I, Heyeres M, Tsey K. Students in research placements as part of professional degrees: a systematic review. Aus Soc Work. 2020;73(1):48-63. https://doi.org/10.1080/0312407X.2019.1649439
https://doi.org/10.1080/0312407X.2019.16...
,1919 Jong G, Meijer E, Schout G, Abma T. Involving undergraduate nursing students in participatory health research: implications from the Netherlands. J Prof Nurs. 2018;34(6):507-13. https://doi.org/10.1016/j.profnurs.2018.04.001
https://doi.org/10.1016/j.profnurs.2018....
).
Study limitations
The observational design of the studies included in the sample weakens the demonstration of the importance of the involvement of undergraduate students in research projects because causability cannot be attributed to the intervention in question.
In addition to this factor, the use of internal and/or non-validated measuring instruments by the authors of the articles included in this ILRto assess the extent of student involvement and its impact also represents a limitation. This may have compromised the accuracy of the outcomes, generating greater uncertainty about the translation of the study phenomenon and hindering the dissemination of the instruments used for similar purposes.
Although two studies were qualitative and three were quali-quantitative, which allows for a more in-depth investigation of reality(3232 Baixinho CL, Presado MH, Ribeiro J. Qualitative research and the transformation of public health. Cienc Saude Colet. 2019;24(5):1583-3. https://doi.org/10.1590/1413-81232018245.05962019
https://doi.org/10.1590/1413-81232018245...
), the small number of articles included in the sample and their level of evidence (level 4), makes it difficult to systematize the evidence about the phenomenon. Although the literature states that the "synthesis of knowledge of the studies included in the review reduces the uncertainty about the recommendations, practices, and [allows] (...) an accurate generalization about the phenomenon based on the available information (...)"(1414 Mendes KDS, Silveira RCCP, Galvão CM. Revisão integrativa: método de pesquisa para a incorporação de evidências na saúde e na enfermagem. Texto Contexto Enferm. 2008;17(4):758-64. https://doi.org/10.1590/S0104-07072008000400018
https://doi.org/10.1590/S0104-0707200800...
), more research is needed in the area with more solid designs to better clarify the implications involving nursing students in research projects.
Contributions to the field of nursing
The results of this integrative literature review suggest that the participation of undergraduate nursing students in research projects contributes positively to their learning outcomes and the development of attitudes and scientific skills. Students can be involved in all phases of the research process, with benefits to their learning, motivation, and the development of their own research projects. This pedagogical practice enables learning, reflection and integration of knowledge, development of communication skills, scientific writing, time management, critical judgment, while increasing satisfaction with the learning process.
If these results are corroborated, there are numerous gains to be gained for nursing. It would allow for the training of more qualified professionals, who are aware of the importance of evidence-based practice and health research as a driver of great advances that make a difference in people's lives. The key to a competent health workforce lies in the quality of the training of future professionals.
This area should receive more investment and be further explored, with studies designed to demonstrate causality between the benefits addressed here and the involvement of undergraduate students in research projects. The construction of validated measurement instruments can add value to these same projects and maximize the potential of this topic and its operationalization.
FINAL CONSIDERATIONS
Based on the available evidence, this study presented an overview of the learning outcomes and skills developed by nursing students involved in research projects, promoting greater awareness about the topic. Additionally, it listed benefits that seem inherent to this participation and suggested implications for future professional exercise.
Participation in research projects seems to influence student development in different domains. This includes the acquisition of knowledge and skills, defining new attitudes that promote research culture, and behavior change, which translates knowledge into the practice of health care.
The results point to the importance of creating opportunities from now on to promote the participation of students in research activities during the degree in nursing. Aligned with the main guiding policies, curricular restructuring is a strategy that can bring students and research closer together, fostering its potential benefits. Higher education institutions have a double role: to promote the restructuring of their curricula and "top-down" organizational changes, and promoting changes led by researchers, who within the scope of their activities create the structure, resources, and incentives for students to explore the challenges inherent to research projects.
-
FUNDING AND ACKNOWLEDGMENTThis work was developed as part of students’ engagement in the Train4Health project. The project has received funding from the Erasmus+ Programme of the European Union under the grant agreement no. 2019-1-PT01-KA203-061389. The Funder had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript. The European Commission’s support for the production of this publication does not constitute an endorsement of the contents, which reflect the views only of the authors, and the Commission cannot be held responsible for any use which may be made of the information contained therein.We would also like to thank Nursing School of Lisbon for all the support in the production and publication of this article.
REFERENCES
-
1Monsivais DB, Robinson K. Developing students as future researchers using QSEN competencies as a framework. Nurs Forum. 2016;51(4):238-45. https://doi.org/10.1111/nuf.12147
» https://doi.org/10.1111/nuf.12147 -
2Loura D, Bernardes R, Baixinho CL, Rafael H, Félix I, Guerreiro M. Aprender em projetos de investigação durante a licenciatura em enfermagem: revisão integrativa da literatura. NTQR. 2020;3:293-304. https://doi.org/10.36367/ntqr.3.2020.293-304
» https://doi.org/10.36367/ntqr.3.2020.293-304 -
3Hickey JE, Adam M, Elwadia I, Nasser S, Topping AE. A process-environment model for mentoring undergraduate research students. J Prof Nurs. 2019;35(4):320-4. https://doi.org/10.1016/j.profnurs.2019.02.001
» https://doi.org/10.1016/j.profnurs.2019.02.001 -
4Keighley T, World Health Organization. The European Union standards for nursing and midwifery: information for accession countries revised and updated by Thomas Keighley (No. EUR/08/5085937). Copenhagen: WHO Regional Office for Europe. 2009.
-
5World Health Organization (WHO). State of the world's nursing 2020: investing in education, jobs and leadership [Internet]. World Health Organization. 2020[cited 2021 Feb 20]. Available from: https://apps.who.int/iris/handle/10665/331677
» https://apps.who.int/iris/handle/10665/331677 -
6Ross JG, Burrell SA. Nursing students' attitudes toward research: an integrative review. Nurs Educ Today. 2019;82:79-87. https://doi.org/10.1016/j.nedt.2019.08.006
» https://doi.org/10.1016/j.nedt.2019.08.006 -
7Einarsen KA, Giske T. Nursing students' longitudinal learning outcomes after participation in a research project in a hospital. IPDJ. 2019;9(1):a4. https://doi.org/10.19043/ipdj.91.004
» https://doi.org/10.19043/ipdj.91.004 -
8Slattery MJ, Logan BL, Mudge B, Secore K, von Reyn LJ, Maue RA. An Undergraduate research fellowship program to prepare nursing students for future workforce roles. J Prof Nurs. 2016;32(6):412-20. https://doi.org/10.1016/j.profnurs.2016.03.008
» https://doi.org/10.1016/j.profnurs.2016.03.008 -
9Kim JS, Gu MO, Chang H. Effects of an evidence-based practice education program using multifaceted interventions: a quasi-experimental study with undergraduate nursing students. BMC Med Educ. 2019;19(71):1-10. https://doi.org/10.1186/s12909-019-1501-6
-
10Kurtz CP, Kessler TA. An undergraduate collaborative team model to engage nursing students in research. Int J Nurs Pract. 2017;7(7):112-8. https://doi.org/10.5430/jnep.v7n7p112
» https://doi.org/10.5430/jnep.v7n7p112 -
11Jansen DA, Jadack RA, Ayoola AB, Doornbos MM, Dunn SL, Moch SD, et al. Embedding research in undergraduate learning opportunities. West J Nurs Res. 2015;37(10):1340-58. https://doi.org/10.1177/0193945915571136
» https://doi.org/10.1177/0193945915571136 -
12Torraco RJ. Writing integrative literature reviews: using the past and present to explore the future. Hum Resour Dev Int. 2016;15(4):404-28. https://doi.org/10.1177/1534484316671606
» https://doi.org/10.1177/1534484316671606 -
13Souza MT, Silva MD, Carvalho R. Integrative review: what is it? how to do it? Einstein. 2010;8(1):102-6. https://doi.org/10.1590/s1679-45082010rw1134
» https://doi.org/10.1590/s1679-45082010rw1134 -
14Mendes KDS, Silveira RCCP, Galvão CM. Revisão integrativa: método de pesquisa para a incorporação de evidências na saúde e na enfermagem. Texto Contexto Enferm. 2008;17(4):758-64. https://doi.org/10.1590/S0104-07072008000400018
» https://doi.org/10.1590/S0104-07072008000400018 -
15Zuchowski I, Heyeres M, Tsey K. Students in research placements as part of professional degrees: a systematic review. Aus Soc Work. 2020;73(1):48-63. https://doi.org/10.1080/0312407X.2019.1649439
» https://doi.org/10.1080/0312407X.2019.1649439 -
16Steinert Y, Mann K, Anderson B, Barnett BM, Centeno A, Naismith L, et al. A systematic review of faculty development initiatives designed to enhance teaching effectiveness: a 10-year update: BEME Guide No 40. Med Teach. 2016;38(8):769-86. https://doi.org/10.1080/0142159X.2016.1181851
» https://doi.org/10.1080/0142159X.2016.1181851 -
17Børsting TE, Kristensen N, Hanssen I. Student nurses' learning outcomes through participation in a clínical nursing research project: a qualitative study. Nurs Educ Practice. 2020;43(2020):102727. https://doi.org/10.1016/j.nepr.2020.102727
» https://doi.org/10.1016/j.nepr.2020.102727 -
18Moskvichena N, Bordovskaia N, DarinsKaya L. Role of students and supervisors' interaction in research projects: expectations and evaluations. Procedia Soc Behav Sci. 2015;171(2015):576-83. https://doi.org/10.1016/j.sbspro.2015.01.163
» https://doi.org/10.1016/j.sbspro.2015.01.163 -
19Jong G, Meijer E, Schout G, Abma T. Involving undergraduate nursing students in participatory health research: implications from the Netherlands. J Prof Nurs. 2018;34(6):507-13. https://doi.org/10.1016/j.profnurs.2018.04.001
» https://doi.org/10.1016/j.profnurs.2018.04.001 -
20Vera F. Research skills in nursing undergraduate students: a case at a Chilean Private University. OSJ. 2020;5(3). https://doi.org/10.23954/osj.v5i3.2487
» https://doi.org/10.23954/osj.v5i3.2487 -
21Aglen B. Pedagogical strategies to teach bachelor students evidence-based practice: a systematic review. Nurse Educ Today. 2016;36:255-63. https://doi.org/10.1016/j.nedt.2015.08.025
» https://doi.org/10.1016/j.nedt.2015.08.025 -
22Egilsdottir HÖ, Byermoen KR, Moen A, Eide H. Revitalizing physical assessment in undergraduate nursing education: what skills are important to learn, and how are these skills applied during clinical rotation? a cohort study. BMC Nurs. 2019;18:41. https://doi.org/10.1186/s12912-019-0364-9
» https://doi.org/10.1186/s12912-019-0364-9 -
23Hung HY, Wang YW, Feng JY, Wang CJ, Lin ECL, Chang, YJ. Evidence-based practice curriculum development for undergraduate nursing students: the preliminary results of an action research study in Taiwan. J Nurs Healthc Res. 2019;27(4):e30. https://doi.org/10.1097/jnr.0000000000000298
» https://doi.org/10.1097/jnr.0000000000000298 -
24Baixinho CL, Costa AP. Researchers' scientific credibility and knowledge transfer. Esc Anna Nery. 2020;24(3):e20200008. https://doi.org/10.1590/2177-9465-ean-2020-0008
» https://doi.org/10.1590/2177-9465-ean-2020-0008 -
25Fukada M. Nursing competency: definition, structure and development. Yonago Acta Med. 2018;61(1):1-7. https://doi.org/10.33160/yam.2018.03.001
» https://doi.org/10.33160/yam.2018.03.001 -
26Jong G, Meijer E, Schout G, Abma T. Involving undergraduate nursing students in participatory health research: implications from the Netherlands. J Profess Nurs. 2018;34(6):507-13. https://doi.org/10.1016/j.profnurs.2018.04.001
» https://doi.org/10.1016/j.profnurs.2018.04.001 -
27Arrigoni C, Grugnetti AM, Caruso R, Gallotti ML, Borrelli P, Puci M. Nursing students' clinical competencies: a survey on clinical education objectives. Ann Ig. 2017;29(3):179-88. https://doi.org/10.7416/ai.2017.2145
» https://doi.org/10.7416/ai.2017.2145 -
28Salman A, Fakhraldeen SA, Chun S, Jamil K, Gasana J, Al-Hunayan A. Enhancing research and development in the health sciences as a strategy to establish a knowledge-based economy in the State of Kuwait: a call for action. Healthcare. 2020;8(3):264. https://doi.org/10.3390/healthcare8030264
» https://doi.org/10.3390/healthcare8030264 -
29Ommering BWC, van Diepen M, van Blankenstein FM, Jong PGM, Dekker FW. Twelve tips to offer a short authentic and experiential individual research opportunity to a large group of undergraduate students. Med Teach. 2020;42(10):1128-33. https://doi.org/10.1080/0142159X.2019.1695766
» https://doi.org/10.1080/0142159X.2019.1695766 -
30Oh EG, Yang YL. Evidence-based nursing education for undergraduate students: a preliminary experimental study. Nurse Educ Pract. 2019;38:45-51. https://doi.org/10.1016/j.nepr.2019.05.010
» https://doi.org/10.1016/j.nepr.2019.05.010 -
31Nehrir B, Vanaki Z, Mokhtari Nouri J, Khademolhosseini S, Ebadi A. Competency in Nursing Students: a systematic review. IJTMGH, 2016;4(1):3-11. https://doi.org/10.20286/ijtmgh-04013
» https://doi.org/10.20286/ijtmgh-04013 -
32Baixinho CL, Presado MH, Ribeiro J. Qualitative research and the transformation of public health. Cienc Saude Colet. 2019;24(5):1583-3. https://doi.org/10.1590/1413-81232018245.05962019
» https://doi.org/10.1590/1413-81232018245.05962019
Edited by
Publication Dates
-
Publication in this collection
29 Sept 2021 -
Date of issue
2022
History
-
Received
02 Mar 2021 -
Accepted
13 Apr 2021