Evaluation of the virtual learning object “ Diagnostic reasoning in nursing applied to preterm newborns ”

The potential use of computer technology in teaching and continuous education for nursing motivated the development of this study to evaluate the virtual learning object, “Diagnostic Reasoning in Nursing Applied to Preterm Newborns” at an intermediate neonatal care unit. This descriptive study evaluates the appearance and content of the virtual object concerning aspects related to presentation, organization, usability and overall impression. Experts from the fields of computer technology (12) and nursing (31) participated in the evaluation process. Each sub-item of the instrument was assessed on a Likert scale and blank space was provided for comments/ suggestions. All items were positively evaluated by over 80% of the experts, except for the ‘informational density’ criterion in the evaluation performed by computer technology experts. The developed product is considered adequate to be used for teaching for nursing students and in continuous education of diagnostic reasoning in the development of Nursing Diagnoses for preterm newborns, in the problem-posing pedagogical framework.


Introduction
Understanding Nursing Diagnoses as a phase of the nursing process that involves clinical judgment that corresponds to the intellectual endeavor in which collected information is analyzed, judged and gathered to define a diagnosis, is often a difficult task for nursing professionals (1) .
There are many definitions in the health field for the process of making a diagnosis, such as judgment, clinical reasoning and diagnostic reasoning (2) , which can be defined as the process of clinically reasoning to recognize relevant diagnoses, that is, a type of clinical reasoning aimed to establish the diagnosis that best Rev. Latino-Am.Enfermagem 2011 July-Aug.;19(4):894-901.
expresses the health state of individuals, families or community (3) .
A didactic resource used to enable nursing students and nurses to better understand the nursing process and diagnosis reasoning is to treat these from a linear point of view, which however, does not allow students to visualize how the stages are interconnected or interdependent (2) .
From this perspective, the search for scientific improvement to advance teaching and qualification is essential because the job market requires professionals to have knowledge to work in the systematization of nursing care (4) .
There is a lack of studies addressing Nursing Diagnosis and diagnostic reasoning specifically in the field of neonatal nursing care provided to preterm newborns.
Only six studies published in the last five years focused on preterm newborns and their families.
The teaching of Nursing Diagnoses and diagnostic reasoning in neonatal nursing can benefit from technology, which can help qualify competent nurses in the nursing process contributing to improved quality of care delivered to preterm newborns and their families.
Because it permits the construction of repositories of classes to be accessed by various users and provide synchronous and asynchronous interaction tools, the use of Virtual Learning Environments (VLE) can be a teaching strategy used in the education and qualification of nurses concerning nursing diagnoses in care provided to preterm newborns (5) .

Methods
This descriptive study reports the evaluation of a virtual interactive learning object.The project was approved by the Research Ethics Committee (Process 5229/2008).
The virtual object was constructed using the multimedia-authoring tool Macromedia Authorware ® , inserted into a VLE, the Moodle.
The Macromedia Authorware ® is acknowledged for its precision and efficiency (6) , able to gather text and multimedia resources in a single application, thus favoring interactivity.
Up to January 2010, Moodle registered more than 40 million users in more than 4 million programs, demonstrating that VLE is recognized as a pedagogical resource that helps students to improve cognition, construct knowledge, and promote positive attitudes through discussion and cooperation (7) .
The In relation to the number of evaluators, only one study used a sample greater than six evaluators from computer science (5) and another used a sample greater than 15 nursing scorers (8) .
We invited 15 experts with bachelor degrees in computer science or related fields to identify operational errors in the system; 12 agreed to participate in the study and signed free and informed consent forms.
After an initial evaluation and technical corrections in the virtual object, we proceeded to the evaluation by nursing experts.A total of 43 Brazilian university hospitals and 43 undergraduate nursing programs were contacted through mail and email.
Of these, 29 nurses and 22 professors expressed interest in participating in the evaluation of the virtual object in Moodle.However, only those who met the study criteria were included in the study: 17 nurses and 14 professors.These criteria, contained in an adapted instrument, characterize expert nurses (9) .The minimum score for such a characterization is 4. All the selected raters scored between six and 11 and signed free and informed consent forms.
Evaluation instruments including both the fields of technology and pedagogy were searched for critical analysis of the application and an instrument (10) was then adapted to be used by both computer and nursing professionals.This instrument has been already used by a study conducted in Brazil (11) .An instrument was adapted in the form of a checklist to permit evaluating Góes FSN, Fonseca LMM, Furtado MCC, Leite AM, Scochi CGS.
the ergonomics of interface criteria, which were included to encompass those who study technology.
Such an instrument was developed by professors from the Federal University of Santa Catarina and made available on the Internet (12) .The instruments presented statements concerning aspects related to the expert's field of evaluation, a Likert-type summative method, and a blank space for suggestions.
The instruments for computer science and nursing were evaluated in a pilot-test by three computer professionals and two nurses to identify potential difficulties of understanding the terms used.These evaluations helped clarify some of the instrument's expressions.
Data were collected between April and June 2010.
The virtual learning object and respective instruments of evaluation were made available in Moodle and later sent to the researchers through email.
Descriptive statistics were used in analyzing data related to the evaluation process of the VLE.The items that reached 70% agreement among scorers, through concepts such as "agree" or "strongly agree", according to criterion adopted in other studies, considered validated (13)(14) .

Evaluation -Computer Science
The evaluation of the interactive virtual learning object "Diagnostic reasoning in nursing applied to preterm infants," performed jointly with computer science professionals, was composed of an instrument addressing a general impression concerning the presentation and organization of content (Table 1) and another addressing usability.
Concerning the general impression of the virtual object, table 1 shows there were no negative evaluations.

Evaluation -Nursing Field
Given the extensive content in the virtual object, we divided the evaluation into four groups, whose compositions were: Groups 1 and 4: four professors and four nurses; Group 2: four professors and three nurses; Group 3: five professors and three nurses.The groups 1, www.eerp.usp.br/rlae Rev. Latino-Am.Enfermagem 2011 July-Aug.;19(4):894-901.
2 and 3 evaluated a case in the teaching module and one simulation.Group 4 evaluated a case in the simulation module and the theoretical content module concerning nursing diagnosis, though, theoretical content was available to all the other groups for consultation.
After navigating through the virtual object, the experts answered the instruments for general impression (Table 2), content (Table 3) and usability evaluations.

Discussion
We realized over the course of this study that the use of computers in teaching nursing, specifically virtual learning objects, has been intensified in recent years, especially in teaching and research centers.
The option to use Moodle facilitated the participation of experts from other Brazilian regions and will also enable the dissemination of this virtual object of learning Góes FSN, Fonseca LMM, Furtado MCC, Leite AM, Scochi CGS.
as resource aide in learning for teaching, research and care institutions.
Some evaluators of this virtual learning object reported difficulties accessing Moodle.We verified that the problems were related to difficulty handling the computer and the Internet or even not reading instructions on how to execute Moodle and the interactive object.
When users were qualified to use Moodle, they reported positive impressions concerning the environment and considered the platform easy to use.
They also manifested their intention to transform the content of the their courses in virtual language (15) .
A limitation of this study is the proportion of individuals from the nursing field who were included in the study and did not achieve the minimum of ten evaluators per group.Nonetheless, small samples composed of experts in the nursing and/or computer fields have been used in studies evaluating virtual objects or educational software in nursing (5,11,13,16) .
A study (17) analyzing interactive multimedia as a resource to be used in the teaching of semiology for nursing students verified that it is medium easy to use and a facilitator between theory and practice that improves understanding of theoretical classes.
The virtual object also presents limitations that may in part be related to the Authorware authoring software.
The construction of content in this program requires the creation of a structure similar to a flow chart for events, tasks and decisions (18) and, during the creation of this virtual object, we observed that the system was incapable of performing some necessary functions, resulting in the perception on the part of evaluators that there were deficiencies in the system, especially related to control (options to go back).
Another difficulty found is that it was not possible to execute the object directly in Moodle due to the size of the file, even after dividing it into smaller modules.
For the evaluation to occur, it was necessary to install one executable file and send detailed instructions to the experts.
Other authors (19) also reported limitations in relation to Authorware that could not be resolved due to the system's format, which reduced possibilities of interaction.Hence, we suggest new authoring software be used to create virtual learning objects that withstand different levels of complexity in actions.
In relation to this study's virtual object, its content received such recommendations because it was assessed by a group of experts in neonatology and in Nursing Diagnoses to bring the user into proximity of the context found in clinical practice and ensure appropriately structured theoretical content and that reliable clinical cases are available.Clinical cases are presented in this virtual object, allowing students to problematize real contexts (20) .
Structuring the content of virtual learning objects into modules and in a non-linear manner enables users to navigate through content the way they like with flexibility, freedom respect for each one's own rhythm, and user's can actively participate in the construction of their own knowledge.All these are premises of a problem-posing education (20) .
In relation to the evaluation of the virtual object's usability, the great advantage in testing it lies in discovering problems that can represent difficulties in course development (16) .
We believe that the option to evaluate usability criteria based on the criteria of the ergonomics of interface enabled the analysis of technical aspects relevant to learning.Such aspects can facilitate or hinder navigation and consequently either encourage or compromise learning.However nursing studies conducting ergonomic evaluations similar to the evaluation conducted in this study were not found.
Only the criterion of 'informational density' was considered inadequate by computer professionals, though it was considered adequate by nurses.
Another study evaluated ergonomic criteria of a virtual environment of a clinical simulation of nursing in intensive therapy and the following were reported: the organization criterion scored 4.43 (maximum was 5); presentation scored 4.5; technical criterion related to appropriate functioning of links and download speed scored 4.79 (11) .
Evaluation of VLE in another study (21) was similar to that of this study.Three computer experts evaluated time of response, quality of interface, tools and resources, educational aspects, quality of environments and didactic resources.Evaluations related to screen format, error messages, ease of use, links, logical sequence of menus, icons, and informational density were considered satisfactory or even excellent by two experts, while one expert considered the text, ease of use and links to be regular.The comments were centered on aspects related to clarification of navigation and instructions to execute modules (5) .
In relation to the usability of the online course addressing care provided to critical patients, ease of navigation, quality and understanding of content were evaluated before it was distributed to students as adjuvant Rev. Latino-Am.Enfermagem 2011 July-Aug.;19(4):894-901.
learning material.The nurses evaluated whether the course ensured active learning, feedback, interaction of students with the course, collaboration, and whether it presented multiple resources to encourage learning.
On a scale from 1 to 5, all the items scored from 2.63 (collaboration) to 4.2 (resources to encourage learning), while the general evaluation of satisfaction scored 4.17, which reflects great satisfaction with the course (16) .
Activities mediated by computer should ensure flexibility of time organization, site of study, rhythm of learning, access to coherent information and interaction (22) .We believe that our virtual object plays such a role since its content is available on the Internet, facilitating its access from anywhere there is network connection.The student or nurse can navigate whenever is more convenient and establish his/her own rhythm of learning.Additionally, the fact the object is not constructed in a linear manner allows the user to interact the way s/he deems appropriate with freedom of choice.
From this perspective, interactivity motivates technology users and multimedia has a prominent role in this scenario (23) .
Appropriate navigability is what allows users to "move" freely through the program, making the best use of information.The application of different media is frequent in educational software and increases the understanding of content (23) .

Conclusion
We constructed this virtual interactive learning object because we believe that the Nursing Process The need to perform the last stages of implementation provided in the adopted software is apparent: it should be evaluated by the final users.
Therefore, it is necessary to develop further studies focusing on the impact of the virtual learning object on the teaching of the nursing process and the retention of knowledge by undergraduate students and nurses as they use it.
We conclude that the results obtained in this study can contribute to the adoption of educational practices based on the use of new computer technologies toward improving the quality of nursing education and the process of qualifying nurses.
reported the use of VLE in teaching nursing.However, only four studies used computer-based interactive resources to teach neonatal nursing and none used VLE, denoting the scarcity of research in the field.Hence, this study evaluated the content and appearance of a virtual learning object inserted into a VLE addressing diagnostic reasoning in nursing related to preterm infants and their families in a neonatal intermediate care unit.
within care, which in this study focused on the stage of development of Nursing Diagnosis reasoning, coupled with computer technology, has a prominent role in the qualification of nurses.Only two out of the 45 items evaluated by the computer experts, which refer to informational density, failed to achieve the established 70% of agreement (agree and strongly agree).All the 46 items evaluated by nursing professionals achieved the validation criteria.Hence, we assert that the developed product is appropriate for use in the teaching of neonatal nursing and the qualification of nurses regarding Nursing Diagnosis in care provided to preterm infants and their families, included in the problem-posing pedagogical framework in light of basic human needs and the NANDA-I taxonomy, which can be a motivation for future studies.

Table 2 -
Evaluation of the general impression of virtual learning object -nursing.2010.
All the items achieved 100% of agreement with exception of the item 4 (computer animation).