Objective: to evaluate the workload perceived by operating room nurses and the time spent on the activities performed and to understand the activities that influence their perception.
Method: sequential explanatory mixed methods study. The quantitative stage involved a survey of 34 nurses from five hospitals and measuring the time spent on each activity in the hospitals with the highest and lowest perceived workload, during 129 hours of observation. Semi-structured interviews were then conducted with 12 nurses. The quantitative data was analyzed descriptively and inferentially, and the qualitative data was submitted to content analysis and then integrated by connection.
Results: there was a predominance of females (88.23%) and a mean age of 39±8.18 years among the nurses, with a moderate (r=0.502) and significant (p=0.002) correlation between age and perceived workload. Managerial activities spent more time and were identified as the most influential in the perception of the workload associated with the mental demand dimension.
Conclusion the activities that have the greatest impact on the perception of workload include managing the sector and people. Direct patient care was identified as providing job fulfillment and purpose.
Descriptors:
Nurse’s Role; Workload; Perioperative Nursing; Intraoperative Period; Professional Competence; Surgicenters
Highlights:
(1) Moderate and significant correlation between perception of workload and age. (2) The highest percentage of time measured was spent on managerial activities. (3) Mental demand scored highest in the perception of workload. (4) Direct patient care is a significant source of job fulfillment. (5) Nurses express a loss in the essence of care to the detriment of other activities.
Objetivo: avaliar a carga de trabalho percebida pelos enfermeiros assistenciais de centro cirúrgico e o tempo despendido nas atividades realizadas, bem como compreender as atividades que influenciam a sua percepção.
Método: estudo de métodos mistos explanatório sequencial. Etapa quantitativa desenvolvida por survey com 34 enfermeiros de cinco hospitais e aferição do tempo despendido por atividade nos hospitais com maior e menor percepção de carga de trabalho, durante 129 horas de observação. Sequencialmente, realizaram-se entrevistas semiestruturadas com 12 enfermeiros. Os dados quantitativos, analisados de forma descritiva e inferencial, e qualitativos submetidos à Análise de Conteúdo, foram posteriormente integrados por conexão.
Resultados: houve o predomínio do sexo feminino (88,23%) e idade média 39±8,18 anos entre os enfermeiros, com correlação moderada (r=0,502) e significativa (p=0,002) entre a idade e a percepção de carga de trabalho. As atividades gerenciais despenderam mais tempo e foram identificadas como as mais influentes na percepção da carga de trabalho associada à dimensão demanda mental.
Conclusão: as atividades que mais repercutem na percepção da carga de trabalho englobam o gerenciamento do setor e das pessoas. A assistência direta ao paciente foi apontada como uma atividade que proporciona a satisfação no trabalho e propósito em sua atuação.
Descritores:
Papel do Profissional de Enfermagem; Carga de Trabalho; Enfermagem Perioperatória; Período Intraoperatório; Competência Profissional; Centros Cirúrgicos
Destaques:
(1) Correlação moderada e significativa da percepção da carga de trabalho com a idade. (2) O maior percentual do tempo mensurado foi despendido em atividades gerenciais. (3) A demanda mental obteve maior pontuação na percepção da carga de trabalho. (4) O cuidado direto ao paciente é fonte significativa de satisfação profissional. (5) Enfermeiros expressam perda na essência do cuidado em detrimento das outras atividades.
Objetivo: evaluar la carga de trabajo percibida por los enfermeros asistenciales de centro quirúrgico y el tiempo utilizado en las actividades realizadas, así como comprender las actividades que influencian su percepción.
Método: estudio de métodos mixtos explicativo secuencial. Etapa cuantitativa desarrollada por survey en 34 enfermeros de cinco hospitales y medición del tiempo utilizado por actividades en los hospitales con mayor y menor percepción de carga de trabajo, durante 129 horas de observación. Secuencialmente, se realizaron entrevistas semiestructuradas con 12 enfermeros. Los datos cuantitativos, fueron analizados de forma descriptiva e inferencial y los cualitativos después de sometidos al análisis de contenido, fueron posteriormente integrados por conexión.
Resultados: hubo predominio del sexo femenino (88,23%) y la edad media fue de 39±8,18 años entre los enfermeros, con correlación moderada (r=0,502) y significación (p=0,002) entre edad y percepción de la carga de trabajo. Las actividades administrativas utilizaron más tiempo y fueron identificadas como las más influentes en la percepción de la carga de trabajo asociada a la dimensión demanda mental.
Conclusión: las actividades que más repercuten en la percepción de la carga de trabajo engloban la administración del sector y las personas. La asistencia directa al paciente fue apuntada como la actividad que proporciona satisfacción en el trabajo y propósito en la actuación.
Descriptores:
Rol de la Enfermera; Carga de Trabajo; Enfermería Perioperatoria; Periodo Intraoperatorio; Competencia Profesional; Centros Quirúrgicos
Destacados:
(1) Correlación moderada y significativa de la percepción de la carga de trabajo con la edad. (2) El mayor porcentaje del tiempo medido fue utilizado en actividades administrativas. (3) La demanda mental obtuvo mayor puntuación en la percepción de la carga de trabajo. (4) El cuidado directo al paciente es fuente significativa de satisfacción profesional. (5) Los enfermeros expresan pérdida en la esencia del cuidado en detrimento a otras actividades.
Introduction
The Surgical Center (SC) is a highly complex area in which the flow of information, materials, and people requires a significant coordination effort. In this scenario, the nurse’s role requires team leadership and communication skills, as well as carrying out various activities, such as managing people, materials, and the surgery schedule (surgical map), as well as direct patient care (1).
Nurses’ activities in the SC are mainly related to the organization of the sector and the surgical schedule, to allocate the scheduled procedures according to the physical structure and qualification of the team to best meet the needs of each situation (2).
Nursing workload can be defined as the amount of time spent performing a task, taking into account: the degree of complexity of caring for different patients; the level of knowledge and skills required of nurses to meet the different needs of patients; direct patient care; as well as the physical, mental and emotional effort of the professional to carry out nursing activities (3). Studies to determine workload by measuring the time spent on nursing activities have been carried out mainly in inpatient units (4 - 6) and Intensive Care Units (ICUs) (7).
However, workload also has a subjective dimension related to the way each nurse experiences their activities, and can be a predictor of the quality of patient care (8). One of the tools that can be used to identify perceived workload is the National Aeronautics and Space Administration - Task Load Index (NASA-TLX) scale, initially used to collect subjective information on the workload of pilots and air traffic controllers (9).
In health services, NASA-TLX has been used to assess the workload perceived by nurses in neonatal (8 , 10), adult (11 - 13), pediatric (8), pediatric inpatient (14), and emergency (15 - 16) units. In the SC, two studies were found: one that compared the implications of a new surgical instrumentation table design (17), and another (18) that evaluated the repercussions of the noise level in the operating room. As limitations, these studies did not consider all the activities carried out by the nursing team and did not provide a systemic assessment of the workload in the SC supported by multiple sources of evidence, both qualitative and quantitative, as in this proposed mixed-method study.
These considerations and the specificity of work in the SC have demonstrated the need to make sensitive efforts to capture the workload perceived by nurses in this sector and the activities they carry out. Given this, the objectives of this study were: to evaluate the workload perceived by operating room nurses and the time spent on the activities performed and to understand the activities that influence their perception.
Method
Study type
This is a three-stage sequential explanatory mixed-methods study, with greater weight given to the quantitative approach (QUAN➝ qual) (19). The designs of each stage were as follows: 1) survey; 2) observational study; and 3) exploratory study. In the first two quantitative stages (QUAN), the points to be explored in the third (qual) were identified. The mixed method was chosen due to the possibility of integrating qualitative data with quantitative data, to complement and enrich the understanding of the phenomenon under study, in the quest to clarify the activities that influence the perception of workload by nurses in the SC.
The Strengthening the Reporting Observational Studies in Epidemiology (STROBE) (20), Consolidated Criteria for Reporting Qualitative Research (COREQ) (21), and Mixed Methods Appraisal Tool (MMAT) (22) guides were used to conduct and report this research, seeking transparency and reproducibility in the investigation.
Study site
It was carried out in the SC of five large public and private hospitals in Porto Alegre, Rio Grande do Sul, Brazil.
Study length
Between March and September 2023, sequentially, according to the planned stages.
Population
Nurses working in the SC of the five institutions during the collection period, totaling 60 nurses.
Selection criteria
Inclusion criteria: nursing assistants working in SCs with eight or more operating theaters and with a minimum of six months working in the SC.
Exclusion criteria: nurse managers or nurses on leave for any reason during data collection.
Definition of participants
In the first stage (survey), a non-probabilistic convenience sample was used, consisting of 34 (56.67%) completed questionnaires. For the second observational stage, the hospitals with the highest (Hospital B) and lowest (Hospital D) scores for perceived workload by the nurses who responded to the survey were selected. Fifteen six-hour work shifts were observed in each of the two hospitals, with one nurse/observer/shift, totaling 129h22min, with a total of 30 shifts and 15 nurses observed. In the third, exploratory stage, 12 nurses who worked in the two hospitals selected for the observational stage were interviewed, according to interest and availability, with the sample delimitation being obtained by data saturation (23).
Study variables
The variables were: perceived workload score using the NASA-TLX scale, activities carried out by nurses, time spent on these activities, sociodemographic variables, and the work environment.
Instruments used to collect information
In the first stage, an online form was used via the Research Electronic Data Capture (REDCap®) platform (24) containing: a Free and Informed Consent Term (FICT); extraction of sociodemographic and work environment data (age, gender, work shift, monthly workload, number of operating rooms, number of nurses on shift); and the NASA-TLX scale (9), an instrument translated and validated into Portuguese (25).
In the NASA-TLX scale, the six dimensions (Mental Demand, Physical Demand, Temporal Demand, Performance, Effort, and Frustration Level), paired together, resulted in 15 combinations (for example: Mental Demand X Physical Demand), with the one that contributed most to the work being chosen in each pair. The six dimensions were then scored separately on a continuous scale, with the score ranging from one to 100, representing the level of influence on the workload (9 , 22).
The perceived workload was calculated individually using the NASA-TLX scale, following four steps described by Terra (26). Firstly, we counted how many times each item was considered the most influential among the six dimensions (for example, in how many of the 15 comparisons effort was preponderant). Then, to calculate the weight of each dimension, the number of times the item was chosen was divided by 15, which is the maximum number of pairings. In the second step, the dimension score was obtained by multiplying the dimension weight by the level of influence, which ranges from one (little influence) to 100 (a lot of influence), except for the performance dimension, whose value was inverted, since the greater the influence, the better. In the third step, the values were rescaled so that the scores for each dimension were parameterized from zero to 10, dividing the value obtained for workload by the maximum possible value (5/15=0.33), and this result by 10. Finally, the overall workload index for each individual was obtained from the sum of the six dimensions, also rescaled from zero to 10. Currently, there is no solid evidence on the reference values and classifications of the scores, so it is considered that the higher the score, the greater the perception of workload.
The software TrackingTime® (27) was used to measure activity time, with an initial list of 23 activities carried out by SC nurses in Brazil, identified in a scoping review (28). During the observation, ten activities were added, and after regrouping according to the frequency and similarity of the work processes, a result of 26 observed items was obtained. During data collection, the stopwatch was activated at the start of the activity and deactivated at the end, pausing and restarting at each interruption.
The questions addressed in the third stage interviews were conducted to explore the results of the first and second stages using a structured script, with questions related to the activities that most impact the perception of workload, the activities recognized as important but which they are unable to carry out during their work shift, as well as the activities that bring the most job fulfillment.
Data collection
The quantitative stages took place between March and August 2023 and were conducted through an invitation sent via e-mail containing the link to the form and instructions on how to fill in the instrument. After analyzing the results of this stage, the two SCs for the observational stage were defined. The collection team for this stage was made up of the study’s main researcher, a scientific initiation scholarship holder, and two volunteer nurses from the research group. A tutorial was prepared on the use of the TrackingTime® (27) application, which had been previously tested by the researchers for the observation, but without a pilot test with the nurses in the real practice scenario. At the start of their shift, the nurses were invited to be observed while carrying out their activities, throughout the six-hour period that comprised their shift at the SC.
The third stage took place between August and September 2023 and was conducted by the main researcher. Participants were given the letter “P” followed by a numeral. The interviews were recorded, transcribed, and returned by email for validation by the respondents, with a deadline of one week. Of the participants, one person returned the transcript fully validated, another requested adjustments, and the others did not respond within the established timeframe. This process of returning the transcripts allowed the research team to reflect on the importance of involving the respondents in validating the information, even if not all of them returned it, highlighting it as a positive point in the search for rigor and transparency in the research.
Data processing and analysis
The quantitative data was organized in a Google® spreadsheet (29) and imported into the Statistical Package for the Social Sciences (SPSS) software (30), version 25.0, and analyzed descriptively and analytically. Perceived workload was measured using the NASA-TLX scale and was calculated individually according to the four steps described in a previous study (26), with the final score being rescaled to a scale of one to 10.
The Shapiro-Wilk (S-W) test was used to assess the normal distribution of the numerical data. Student’s t-test, ANOVA, and Pearson’s bivariate correlation were used to relate the sociodemographic variables to the NASA-TLX scale score, adopting a significance level of 5% (p≤0.05).
The frequency and average time spent on the activities were classified according to the three main areas of activity for nurses: management, care, or teaching/research, as listed in the scoping review (28). The time used for breaks/personal care was also calculated.
The qualitative data was submitted to Bardin’s Content Analysis (31), respecting the stages of pre-analysis, exploration of the material, treatment of the results, and interpretation. NVivo® (31) software, version 14.23.2, was used as an auxiliary tool in the process of organizing and systematizing the data. In total, 9h23min of recordings were obtained, resulting in 39 pages of transcript with around 20,300 words. To reach a consensus during the coding and categorization stages of the results, meetings were held between the researchers, ensuring consistency in the interpretation of the data.
Initially, the interview transcripts were imported into NVivo® (32) software, which allows quick and precise navigation through the corpus, as well as the possibility of making notes directly on the text. This process made it easier to break down the recording units, group them, and regroup them. In the categorization stage, relationships were established between the units of meaning identified in the coding, bringing together the elements that could be combined and/or classified, which gave rise to the categories. From these categories, new understandings of the phenomenon under study emerged, enriching the analysis.
The data was integrated by connecting the three stages, presenting meta-conferences based on the analysis of the integrated results, as well as a joint display. The joint display consists of clearly visually representing the quantitative and qualitative aspects of a mixed methods study. The iterative process of developing these representations can improve understanding of the integrative analysis by including diagrams based on the study’s findings (33 - 34).
Ethical aspects
The study was approved by the Research Ethics Committee (REC), Certificate of Submission for Ethical Appraisal (CAAE): 62257722.8.0000.5347.
Results
Among the 34 nurses who returned the survey, it was found that four (12%) belonged to each of Hospitals A, C, and E, 10 (29%) to Hospital B, and 12 (35%) to Hospital D. The sample was predominantly female (n=30; 88.23%); with a mean age of 39±8.18 years; 12 (35.29%) worked the afternoon shift; and 24 (70.58%) worked 180 hours a month.
The number of operating rooms in the SCs varied between 12 and 18, with an average of 15±2.83 rooms. There were, on average, three ±1.31 nurses on each shift in the SCs of each hospital, and a median of 24 (12;36) nursing technicians under their supervision. The number of nurses per shift varied between one and five, and the number of technicians varied between five and 60.
The mean overall index of the NASA-TLX scale ranged from 6.05±1.00 to 7.34±1.00, with no significant difference between the hospitals (Table 1).
There was no significant correlation between the following variables and the overall index of the NASA-TLX scale: sex (p=0.789), work shift (p=0.057), monthly workload (p=0.095), number of nurses on shift (p=0.318), number of rooms (p=0.080), number of operating rooms under their responsibility (p=0.564), and the number of nursing technicians under their direct supervision (0.245). Age showed a moderate (r=0.502) and significant (p=0.002) correlation with the overall index of the NASA-TLX scale (Figure 1).
Global index of the NASA-TLX* scale according to age (n = 34). Porto Alegre, RS, Brazil, 2023
Measuring the activities carried out in the two selected hospitals resulted in a total of 129h22min of observation, 60h16min in Hospital B, and 69h6min in Hospital D. There was a predominance of time dedicated to management in Hospital D (p<0.001) and assistance in Hospital B (p=0.004), with a significant difference between them (Table 2).
The five most prevalent activities in the hospitals observed, which accounted for 47.14% of the time measured, were: patient assessment and documentation of the care provided (nursing process), planning the schedule for the next day/shift, resolving administrative issues, monitoring anesthetic induction and team management. The 10 least frequent activities accounted for 5.45% of the total time measured: equipment (failure or lack of equipment), map/round beating, managing supplies, resolving computer problems, warning the anesthesiologist, recording occurrences and incidents, updating the next day’s schedule for the materials and sterilization center, warning/notifying the transplant, attending to intercurrences and training the team. The time used for personal breaks corresponded to 7.83% of the nurses’ working days.
From the analysis of the interviews concerning the activities that most influenced the perception of workload, six categories emerged, represented by different colors, and 15 subcategories, as shown in Figure 2. The categories described below are illustrated with excerpts from the interviews.
Factors influencing the perception of workload by Surgical Center nurses (n = 12). Porto Alegre, RS, Brazil, 2023
Activities that impact the perception of workload
Nurses associate managerial activities with an increased perception of workload, especially concerning managing the surgical schedule, because [...] even to set up an operating room, it’s not just putting the room there, I have to think about the team that’s going to be there, who’s going to attend, if there’s going to be equipment, if there’s going to be material, and all of this requires a lot of planning [...] (P2) and nursing professionals, which involves the reassignment of workers and the organization of the sector to meet the SC’s demand., [...] organizing the daily roster, not of surgeries, but of people, [...] I have to remember that someone is on sick leave, someone isn’t coming. Apart from looking at a schedule, I have to look at several schedules to produce one [...] (P10).
Mental overload is impacted by conflict management, I manage situations with all these teams. The surgical team, the anesthesia [team], my nursing team, and with patient care [...] (P2), can lead to frustration and strained relationships between teams, [...] of us feeling unappreciated, belittled, demeaned, various negative things to the detriment of a conflict that you can’t manage (P3).
The inability to be present at the beginning of all surgical procedures and unsuccessful complications were identified as care activities that influenced the perception of workload, [...] maybe it’s because I’ve had this whole nursing process, where we really have to do all this systematization, we have to assist in the room [...] positioning, helping with induction, in short, organizing surgical equipment, surgical materials, [...] (P2), [...] the most frustrating thing is that you have four rooms and, when you see [...] they’ve already gone in and you haven’t managed to keep up with the start (P5), and [...] when we can’t reverse a cardiac arrest, for example, when you attend to a baby and [...] you don’t succeed (P2).
The centralization of information and attributions in the figure of the nurse was highlighted by the participants, because [...] it seems like it’s all our fault, because the anesthesia isn’t working, because the room has been blocked, because the material hasn’t come down from the CMS [Central Material and Sterilization], it’s all on the nurse’s back, and then, for the technician, it seems like the flows, nothing works, that we don’t know what’s going on (P5).
Activities that generate fulfillment
Direct patient care is mentioned as the biggest fulfillment factor, [...] when I take care of the patient directly in the room [...], look at them, hold their hand, position them after they’ve been anesthetized with the utmost care. (P3), and take part in a transplant, [...] a surgery of this complexity and with such a huge impact on an entire family, which is to remove a piece of the father’s liver [and implant it] in the child. (P3).
Recognizing the competence and importance of the nurse’s presence in the operating room: [...] I think it’s great when someone says: “I’m glad the nurse is in the room”. Because you feel that people are happy that you’re there, that if they need you, they know you’ll be able to help them (P3), and the interpersonal relationship with the team of nursing technicians was pointed out as activities that generate fulfillment, through [...] a return on what they’ve asked me for. Even if it’s time off. Sometimes I’ve managed to give that technician feedback in good time, but I don’t give a positive response to the time off, sometimes even a negative one (P4).
Activities they can’t do
While the interpersonal relationship with the team brings fulfillment, it is also recognized as an activity with insufficient time to devote to it: [...] giving more attention to the personal side of your nursing team [...] is something I miss. (P1) Being able to talk more with the nursing technicians about trivial things in life. Getting to know their history better (P3).
Training and initial support for the nursing technician are compromised by the demand for work, [...] training, mentoring a new employee, who is very flawed, we leave him out in the cold, and he picks it up on his own [...] (P9), can be detrimental to the employee’s development and assessment throughout the year. The need to improve teamwork, coupled with caring for others, is identified vehemently at times [...] not seeing people as people for lack of time, [...] this is not a priority because we have other demands (P12), This is an important factor in establishing trusting and quality bonds.
Due to the dynamics of the SC, nurses are often unable to get involved in direct care at the start of the procedure, [...] being there when the patient was being intubated, positioned, so when you enter the room and the surgery has already begun (P5), which could be a factor of frustration, since this was also pointed out as one of the activities that generates the most fulfillment.
Work dynamics in the SC do not represent physical strain
Nurses do not recognize physical demands as influencing their perception of their workload, and it is more frequent in large and complex surgeries, such as transplants, [...] I don’t feel physically tired, except when I have to attend to a transplant and I stay inside the room exclusively. In that specific situation, I leave physically tired, but feeling so fulfilled [...] (P3).
The physical strain is pointed out in the condition of taking on several operating theaters, when there is a reduction in staff, as expressed by [...] there are fewer nurses, the [...] physical demand is much greater too (P4). Another participant said that, as much as the SC represents a very large area here, [...] you don’t have to go to other places, [because it has] a delimited physical area [...] Nursing procedures [...] are not tiring [activities] (P6).
The duality between length of experience in SC and perception of workload
Experience can contribute to a greater perception of the workload, as they have a better view of the needs of the sector and the institution, and greater involvement in processes and committees, due to their qualifications and recognition by the team as a reference in resolving certain situations, as expressed in the following excerpts: [...] the people who have been there the longest end up being a reference, I don’t mean specialties, but for some functions (P1) [...] the more experience we have, the more responsibilities we have, [...] I realize that not only age but length of service, and contribution within the sector (P5).
On the other hand, some more experienced professionals reported a lower perception of the workload, because over the years, you learn [...] not to let this influence your work so much (P1), for having already reached a level of relationship with the surgical team, I don’t mean intimacy, but trust, the credibility of working with them (P3).
Inexperience was pointed out as a factor that could contribute to a lower perception of the workload by the physical disposition because they have energy and drive (P11), and a high capacity to adapt to situations (P12), or because they don’t know the routines, the problems and don’t foresee avoidable occurrences, or as a factor that can increase this perception because they don’t know how to deal with the unexpected or [...] don’t have enough expertise to deal with complications (P2).
Organizational and individual factors that impact workload perception
The level of personal involvement as well as the non-involvement of colleagues increases the feeling of work overload, [...] because if you’re a person who knows how to take your place, who knows the difference you make, you’ll get involved in more work fronts (P3).
The accumulation of managerial and administrative activities leads to a detour of the nurse’s care role, as they take on demands that could be carried out by an administrative team: [...] we’re losing what used to be the essence of care to do other things, so our load is increasing as a result. The flows, the processes that aren’t well aligned; they usually fall to the nurse. [...] the nurse doesn’t know how to say no either, and you’re not going to keep the patient waiting, you’re going to receive material when you’re not supposed to, you’re going to go to the pharmacy to get something [...], you’re going to look for an invoice from another surgery that nobody has seen [...] (P5).
The management of the team and the adequacy of the staff were mentioned as a factor contributing to an increase in the perception of workload in one of the hospitals, according to the report: [...] he lack of staff certificates, the sizing, the demand for nurses, the emergency room, having more complex surgeries, and us not having an increase in the staff (P7). On the other hand, at the other hospital, it was reported that the completeness of the nursing staff contributed to a lower perception of the workload because [...] staff sizing has improved a lot (P8) [...] because, as much as there are a lot of things to do, today we have more nurses. When I was on my own, I thought my workload was much greater because I had to do vacations, the monthly roster, I had to do everything [...] and today I’m responsible for a roster, I still can’t get used to it (P10).
The lack of recognition expressed by nurses when they said that becoming just another number can contribute to making their efforts invisible because if you become just another common denominator, and sometimes because of the high demand, you sometimes can’t be so apparent that you get recognition. So this lack of recognition sometimes generates frustration (P12).
The joint display and the integration of the data were presented in a joint display following the connection proposal, where the qualitative findings seek to explain and complement the quantitative data (Figure 3).
Integration of data from the global index of the NASA-TLX scale, time spent performing activities, and the perception of workload by Surgical Center nurses. Porto Alegre, RS, Brazil, 2023
Discussion
Mental demand was the dimension that obtained the highest score on the NASA-TLX scale, reflecting the extent to which nurses perceived this dimension as the most challenging. The reasons why the nurses perceived the influence of this dimension on their workload became clearer with the data from the interviews, which reported that among the most influential activities were: planning staff schedules and the flow of the surgical schedule, managing the sector, and carrying out the patient assessment and documentation; these were also the activities that demanded most of their time. These findings converge with other studies, which have pointed out that the managerial role played by nurses in the SC focuses mainly on the organization of the sector and the dynamics of workflows (2 , 28 , 35).
In the SCs observed, unscheduled activities were mainly related to room relocations due to surgical delays and/or cancellations, relocation of staff to adapt rooms, and blocking for emergency care and transplants. The unpredictability and difficulty in maintaining planning, as well as the accumulation of multiple and concomitant activities centered on the professional nurse, can overload these workers (35 - 37). A study conducted in hospitalization units highlighted that unscheduled activities are a predictor of mental workload (38), which converged with the nurses’ perceptions, reflected in the SC’s dynamic characteristics.
The prevalence of time spent on patient assessment and documentation (16.67%) was lower than the result found in an American study, in which nurses spent 27% of their time on health records (39). The perception that this activity has an impact on mental demand converged with the results of studies in the Netherlands (40) and Italy (41) in which more than half of the nurses pointed to documentation as one of the causes of their perception of high workload, which can be associated with pressure and the substantial increase in time spent on this activity (38 - 39). To mitigate the impact on workload, it has been pointed out that the documentation process should be carried out in a more integrated way, with equipment close to the patients. This contributes to the recording taking place almost concurrently with the care (39), which can mitigate memory bias and, consequently, reduce the pressure on nurses to be assertive in their records.
The dimension with the lowest score on the NASA-TLX scale was physical demand, which indicates that the nurses did not recognize the influence of this dimension on the perception of workload, compared to the other dimensions, suggesting an ability to adapt to the physical demands of daily life in the SC. The low score on the NASA-TLX scale and the lower percentage (15.66%) of time spent on activities such as organizing the ward and surgical positioning suggested that the nurses felt adapted to the physical structure of the ward and the tasks that required physical effort. This finding contrasts with the results of a study that highlights the consequences of physical demand on nurses’ health since a previous study found that 77.7% of operating room nurses reported work-related musculoskeletal disorders (42). Furthermore, in a systematic review and meta-analysis, lumbar problems were the most common among perioperative nurses, with a prevalence of 62% in 19 studies (43).
When the time demands were analyzed in conjunction with the information from the interviews, it emerged that the nurses felt they needed to devote more time to supervising the team and establishing a bond with them, i.e. accompanying the new nursing technicians at the institution, reviewing and standardizing care activities in the operating room, as well as promoting training for the team. These findings reinforce the need to invest in continuing education, even in the face of the intense routine of the sector, as updates and training for the nursing team are considered essential for the quality of care provided (1).
The percentage of time spent (14.58%) on activities related to presence in the operating room, emotional support for the patient, and direct care, converged with the low score for the performance dimension on the NASA-TLX scale, demonstrating the nurses’ lesser involvement in these activities. The qualitative findings contributed to understanding these results when nurses expressed their desire to be closer to patient-centered care. Few studies have advanced in relation to the time dedicated to direct patient care activities in the operating room. A previous study carried out in a Brazilian setting, showed that nurses considered their presence in the operating room to be important, even in less complex procedures (44).
The participants reported supervising an average of five operating rooms for each nurse and considered this number to be adequate given the demands of their activities. It is known that adapting the nursing team to the workload is a challenge, and its importance is related to patient safety since an insufficient number of staff inevitably increases the workload and is a factor that can lead to the occurrence of adverse events and negatively influence the quality of care (45 - 46). Brazil’s Federal Nursing Council (47) recommends deducting the number of nursing hours required in the SC by the volume of procedures segregated into sizes, providing for one nurse for every three (elective) operating rooms, also considering the need for an exclusive nurse for emergency surgeries or according to their complexity. It is possible to infer that the low number of nurses (i.e. the professional with the highest level of training) working with patients is related to the low number of nurses working shifts. However, the findings of this study led to reflection on the adequacy of the workload, not just based on numbers, but related to the characteristics of the institution in terms of the specific procedures carried out (such as robotic surgery and transplants), as well as the training and experience of the professionals.
Among the personal factors, the positive correlation between age and perceived workload demonstrates the tendency for perceived workload to increase as age increases. Qualitative data contributed to clarifying these findings, where more experienced professionals were highlighted as a reference in the team, both in terms of knowledge and problem-solving expertise. In contrast to this, a systematic review and meta-analysis of results with the same instrument identified a greater perception of workload among inexperienced nurses, indicating that this may be related to a lack of knowledge of the nursing process and insecurity in resolving adverse situations (48).
Organizational factors can have an impact on the perception of workload, even though little time was spent on activities related to reviewing the surgical schedule for the following day, and communication with the anesthetic and transplant team, which were pointed out by the participants as activities that took nurses away from care. The identification and establishment of administrative tasks that can be delegated under the supervision of nurses need further study, including the use of computerized resources or artificial intelligence, as proposed by a German study protocol with the aim of testing and evaluating the acceptance of users (nursing staff, service staff, and patients) in the implementation of a robotic-digital system to relieve the overload of activities in the nursing service (49).
Nurses often associate managerial functions with an increase in perceived workload, especially when the focus is on managing surgical schedules rather than direct patient care. This view, however, is not just about mental overload, but seems to reveal the deeper aspects linked to nursing training and values, historically prioritizing care activities to the detriment of managerial, teaching, and research skills. The dichotomy between direct patient care and service management reflects a cultural construction that places greater value on care practices to the detriment of the leadership positions held by nurses. This condition is worrying, as it can lead to the development of nurses’ managerial competence, and service management can be seen as dispensable. This scenario could have serious consequences for the profession, considering that the WHO itself (50) has highlighted the positive impact of the leadership of nurse managers in services, but has also pointed out that this presence is still limited in number and hinders the implementation of health policies on a global scale.
A limitation of this study is the number of participating professionals and institutions, which may restrict the generalizability of the results. The specific characteristics of the participants and the variety of practices and approaches may not reflect the entire population in question. We, therefore, suggest expanding the diversity and representativeness of the sample in future studies to strengthen the robustness and applicability of the conclusions reached.
The results of this study provide new insights into how the activities performed and the time spent by nurses can have repercussions on the perception of workload. The analysis of time spent on different activities has the potential to contribute to the rationalization of time and resources, as well as the appropriate sizing of teams. An in-depth understanding can help develop strategies to optimize the distribution of tasks, improve operational efficiency, and promote a more balanced and satisfactory working environment for these professionals. The study can support discussions by professional associations and specialty societies about the duties of SC nurses and their greater involvement in direct patient care, which will lead to a review of team composition.
Conclusion
When evaluating the perceived workload and the time spent on the activities carried out by SC nurses, the highest score was given to the mental demand dimension, with a predominance of activities related to managing the sector and people, as well as activities related to patient assessment and documentation. Although management tasks demand a preponderant portion of these professionals’ time, the direct connection with patient care during surgical procedures, even to a lesser extent, rewards them by providing job fulfillment and purpose in their work. This duality between efficient management and direct patient care highlights the complexity and importance of the role of SC nurses.
References
-
1. Martins KN, Bueno AA, Mazoni SR, Machado VB, Evangelista RA, Bolina AF. Management process in surgicenters from the perspective of nurses. Acta Paul Enferm. 2021;43:eAPE00753. http://dx.doi.org/10.37689/acta-ape/2021AO00753
» https://doi.org/10.37689/acta-ape/2021AO00753 -
2. Borchhardt SVB, Rodrigues S, Souza e Silva SM, Calvette AM, Rangel RF, Siqueira HCH. Care management for patient safety in the operationg room: contributions from nurses. Res Soc Dev. 2022;11(6):e25711629075. https://doi.org/10.33448/rsd-v11i6.29075
» https://doi.org/10.33448/rsd-v11i6.29075 -
3. Alghamdi MG. Nursing workload: a concept analysis. J Nurs Manag. 2016;24(4):449-57. https://doi.org/10.1111/jonm.12354
» https://doi.org/10.1111/jonm.12354 -
4. Campos MS, Oliveira BA, Perroca MG. Workload of nurses: observational study of indirect care activities/interventions. Rev Bras Enferm. 2018;71(2):297-305. http://doi.org/10.1590/0034-7167-2016-0561
» https://doi.org/10.1590/0034-7167-2016-0561 -
5. Michel O, Manjon AJG, Pasquier J, Bucher CO. How do nurses spend their time? A time and motion analysis of nursing activities in an internal medicine unit. J Adv Nurs. 2021;77:4459-70. https://doi.org/10.1111/jan.14935
» https://doi.org/10.1111/jan.14935 -
6. Al-Moteri M, Alzahrani AA, Althobiti ES, Plummer V, Sahrah AZ, Alkhaldi MJ, et al. The Road to Developing Standard Time for Efficient Nursing Care: A Time and Motion Analysis. Healthcare. 2023;11(15):2216. https://doi.org/10.3390/healthcare11152216
» https://doi.org/10.3390/healthcare11152216 -
7. Margadant CC, Keizer NF, Hoogendoorn, ME, Bosmanb RJ, Spijkstra JJ, Brinkman S. Nurse Operation Workload (NOW), a new nursing workload model for intensive care units based on time measurements: An observational study. Int J Nurs Stud. 2021;113:103780. https://doi.org/10.1016/j.ijnurstu.2020.103780
» https://doi.org/10.1016/j.ijnurstu.2020.103780 -
8. Tubbs-Cooley HL, Mara CA, Carle AC, Gurses AP. The NASA Task Load Index as a measure of overall workload among neonatal, paediatric and adult intensive care nurses. Intensive Crit Care Nurs. 2018;46:64-9. https://doi.org/10.1016/j.iccn.2018.01.004
» https://doi.org/10.1016/j.iccn.2018.01.004 -
9. Hart SG, Staveland LE. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Adv Psychol. 1988;52:139-83. https://doi.org/10.1016/s0166-4115(08)62386-9
» https://doi.org/10.1016/s0166-4115(08)62386-9 -
10. Lebet RM, Hasbani NR, Sisko MT, Agus MSD, Nadkarni VM, Wypij D, et al. Nurses’ Perceptions of Workload Burden in Pediatric Critical Care. Am J Crit Care. 2021;30(1):27-35. https://doi.org/10.4037/ajcc2021725
» https://doi.org/10.4037/ajcc2021725 -
11. Moghadam KN, Chehrzad MM, Masouleh SR, Malek Mi, Mardani A, Atharyan S, et al. Nursing physical workload and mental workload in intensive care units: Are they related? Nurs Open. 2021;8:1625-33. https://doi.org/10.1002/nop2.785
» https://doi.org/10.1002/nop2.785 -
12. Zahednezhad H, Shokrollahi N, Gheshlagh RG, Afshar PF. Does heavy mental workload affect moral sensitivity among critical care unit nursing professionals? A cross-sectional study. BMC Nurs. 2021;20:140. https://doi.org/10.1186/s12912-021-00662-8
» https://doi.org/10.1186/s12912-021-00662-8 -
13. Dhaini SR, Al Ahad MA, Simon M, Ausserhofer D, Huijer HA, Elbejjani M. Repeated Assessments and Predictors of Nurses’ Shift-specific Perceived Workload. Nurs Forum. 2022;(57):1026-33. https://doi.org/10.1111/nuf.12776
» https://doi.org/10.1111/nuf.12776 -
14. Rasooly IR, Kern-Goldberger AS, Xiao R, Ponnala S, Ruppel H, Luo B, et al. Physiologic Monitor Alarm Burden and Nurses’ Subjective Workload in a Children’s Hospital. Hosp Pediatr. 2021;11(7):703-10. https://doi.org/10.1542/hpeds.2020-003509
» https://doi.org/10.1542/hpeds.2020-003509 -
15. Mansour H, Abu Sharour L. Results of survey on perception of patient safety culture among emergency nurses in Jordan: Influence of burnout, job satisfaction, turnover intention, and workload. J Healthc Qual Res. 2021;36(6):370-7. https://doi.org/10.1016/j.jhqr.2021.05.001
» https://doi.org/10.1016/j.jhqr.2021.05.001 -
16. Barzani KIS, Dal Yılmaz Ü. The Relationship Between Mental Workload and Fatigue in Emergency Department Nurses. Cyprus J Med Sci. 2022;7(3):381-6. https://doi.org/10.4274/cjms.2020.2039
» https://doi.org/10.4274/cjms.2020.2039 -
17. Thakur K, Kuber PM, Abdollahi M, Wenker D, Kandrikar M, Rashedi E. Assessing the Ergonomic Design of a New Back Table for Perioperative Nurses. In: Proceedings of the 2021 International Symposium on Human Factors and Ergonomics in Health Care [Internet]; 2021 Apr 12-16. Washington, D.C.: HFES; 2021 [cited 2024 June 13]. Available from: ( https://doi.org/10.1177%2F2327857921101077 )
» https://doi.org/10.1177%2F2327857921101077 -
18. Arabaci A, Önler E. The Effect of Noise Levels in the Operating Room on the Stress Levels and Workload of the Operating Room Team. J Perianesth Nurs. 2021;36(1):54-8. ( https://doi.org/10.1177%2F2327857921101077)10.1016/j.jopan.2020.06.024
» https://doi.org/10.1016/j.jopan.2020.06.024 - 19. Creswell JW, Creswell JD. Projeto de pesquisa: métodos qualitativo, quantitativo e misto. 5. ed. Porto Alegre: Artmed; 2021. 398 p.
-
20. Vandenbroucke JP, von Elm E, Altman DG, Gotzsche PC, Mulrow CD, Pocock SJ, Poole C, Schlesselman JJ, Egger M. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration. Ann Intern Med. 2007;147(8):W163-94. https://doi.org/10.7326/0003-4819-147-8-200710160-00010-w1
» https://doi.org/10.7326/0003-4819-147-8-200710160-00010-w1 -
21. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349-57. https://doi.org/10.1093/intqhc/mzm042
» https://doi.org/10.1093/intqhc/mzm042 - 22. Hong QN, Pluye P, Fàbregues S, Bartlett G, Boardman F, Cargo M, et al. Mixed Methods Appraisal Tool (MMAT) version 2018 – user guide [Internet]. Montréal: McGill University; 2018 [cited 2024 Apr 20]. Available from: http://mixedmethodsappraisaltoolpublic.pbworks.com/w/file/fetch/127916259/MMAT_2018_criteria-manual_2018-08-01_ENG.pdf
-
23. Minayo MCS. Amostragem e saturação em pesquisa qualitativa: consensos e controvérsias. Rev Pesqui Qual [Internet]. 2017 [cited 2024 May 13];5(7):1-12. Available from: https://editora.sepq.org.br/rpq/article/view/82
» https://editora.sepq.org.br/rpq/article/view/82 -
24. Research Eletronic Data Capture (REDCap®) [Internet]. Nashville, TN: Vanderbilt University; c2024 [cited 2024 June 13]. Available from: https://redcap.ufes.br/
» https://redcap.ufes.br/ -
25. Ciofi-Silva CL, Cordeiro L, Oliveira NA, Mainardi GM, Levin AS, Almeida RMA, et al. Workload assessment: cross-cultural adaptation, content validity and instrument reliability. Rev Bras Enferm. 2023;76(3):e20220556. https://doi.org/10.1590/0034-7167-2022-0556
» https://doi.org/10.1590/0034-7167-2022-0556 -
26. Terra SX. Implicações do desempenho resiliente na percepção da carga de trabalho: um estudo com profissionais da saúde [thesis]. Porto Alegre: Universidade Federal do Rio Grande do Sul; 2022 [cited 2024 May 10]. Available from: https://lume.ufrgs.br/handle/10183/239702
» https://lume.ufrgs.br/handle/10183/239702 -
27. TrackingTime [Internet]. [s.l.]: TrackinbgTime, LLC; c2024 [cited 2024 June 13]. Available from: https://trackingtime.co/
» https://trackingtime.co/ -
28. Trevilato DD, Martins FZ, Schneider DSS, Sakamoto VTM, Oliveira JLC, Dal Pai D, et al. Perioperative nurses’ activities in the Brazilian scenario: a scoping review. Acta Paul Enferm. 2023;36:eAPE01434. https://doi.org/10.37689/acta-ape/2023AR0014344
» https://doi.org/10.37689/acta-ape/2023AR0014344 -
29. Google. Google Sheets [Internet]. [s.l.]: Google; c2024 [cited 2024 June 13]. Available from: https://www.google.com/sheets/about/
» https://www.google.com/sheets/about/ - 30. IBM Corp. IBM SPSS Statistics for Windows, Version 25.0. Armonk, NY: IBM Corp; c2022.
- 31. Bardin L. Análise de conteúdo. São Paulo: Edições 70; 2016. 280 p.
-
32. NVivo 14 Windows [Internet]. [s.l.]; Lumivero; c2023 [cited 2024 June 13]. Available from: https://techcenter.qsrinternational.com/Content/nv14/nv14_standard_installation.htm
» https://techcenter.qsrinternational.com/Content/nv14/nv14_standard_installation.htm -
33. Guetterman TC, Fàbregues S, Sakakibara R. Visuals in joint displays to represent integration in mixed methods research: A methodological review. Methods Psychol. 2021;5:100080. https://doi.org/10.1016/j.metip.2021.100080
» https://doi.org/10.1016/j.metip.2021.100080 -
34. Guetterman TC, Clarck VLP, Molina-Azorin JF. Terminology and Mixed Methods Research: A Persistent Challenge. J Mixed Methods Res. 2023;18(1):9-13. https://doi.org/10.1177/15586898231217855
» https://doi.org/10.1177/15586898231217855 -
35. Lemos CS, Poveda VB. Role of perioperative nursing in anesthesia: a national overview. Rev Esc Enferm USP. 2022;56:e20210465. https://doi.org/10.1590/1980-220X-REEUSP-2021-0465
» https://doi.org/10.1590/1980-220X-REEUSP-2021-0465 -
36. Oliveira EB, Xavier T, Zeitoune RCG, Passos JP, Oliveira BR, Ferreira ARA. Precarious work at a surgical center: implications for the organization and for the health of nursing workers. Rev Bras Enferm. 2023;76(2):e20220120. https://doi.org/10.1590/0034-7167-2022-0120
» https://doi.org/10.1590/0034-7167-2022-0120 -
37. Madrid BP, Glanzner CH. The work of the nursing team in the operating room and the health-related damages. Rev Gaucha Enferm. 2021;42(spe):e20200087. https://doi.org/10.1590/1983-1447.2021.20200087
» https://doi.org/10.1590/1983-1447.2021.20200087 -
38. Ivziku D, Ferramosca FMP, Filomeno L, Gualand R, De Maria M, Tartaglini D. Defining nursing workload predictors: A pilot study. J Nurs Manag. 2022;30:473-81. https://doi.org/10.1111/jonm.13523
» https://doi.org/10.1111/jonm.13523 -
39. Bakhoum N, Gerhart C, Schremp E, Jeffrey AD, Anders S, France D, et. al. A Time and Motion Analysis of Nursing Workload and Electronic Health Record Use in the Emergency Department. J Emerg Nurs. 2021;47(5):733-41. https://doi.org/10.1016/j.jen.2021.03.007
» https://doi.org/10.1016/j.jen.2021.03.007 -
40. De Groot K, De Veer AJE, Munster AM, Francke AL, Paans W. Nursing documentation and its relationship with perceived nursing workload: a mixed-methods study among community nurses. BMC Nurs. 2022;21:34. https://doi.org/10.1186/s12912-022-00811-7
» https://doi.org/10.1186/s12912-022-00811-7 -
41. Ferramosca FMP, De Maria M, Ivziku D, Raffaele B, Lommi M, Tolentino Diaz MY, et al. Nurses’ Organization of Work and Its Relation to Workload in Medical Surgical Units: A Cross-Sectional Observational Multi-Center Study. Healthcare (Basel). 2023;11:156. https://doi.org/10.3390/healthcare11020156
» https://doi.org/10.3390/healthcare11020156 -
42. Chandralekha K, Joseph M, Joseph B. Work-related Musculoskeletal Disorders and Quality of Life Among Staff Nurses in a Tertiary Care Hospital of Bangalore. Indian J Occup Environ Med. 2022;26(3):178-82. https://doi.org/10.4103/ijoem.ijoem_25_22
» https://doi.org/10.4103/ijoem.ijoem_25_22 -
43. Clari M, Godono A, Garzar G, Voglino G, Gualano MR, Migliaretti G, et al. Prevalence of musculoskeletal disorders among perioperative nurses: a systematic review and META-analysis. BMC Musculoskel Dis. 2021;22:226. https://doi.org/10.1186/s12891-021-04057-3
» https://doi.org/10.1186/s12891-021-04057-3 -
44. Trevilato DD, Costa MR, Magalhães AMM, Caregnato RCA. Nurses’ conceptions regarding patient safety during surgical positioning. Rev Gaucha Enferm. 2022;43:e20210045. https://doi.org/10.1590/1983-1447.2022.20210045.en
» https://doi.org/10.1590/1983-1447.2022.20210045.en -
45. McHugh MD, Aiken LH, Sloane DM, Windsor C, Douglas C, Yates PP. Effects of nurse-to-patient ratio legislation on nurse staffing and patient mortality, readmissions, and length of stay: a prospective study in a panel of hospitals. Lancet. 2021;397:1905-13. https://doi.org/10.1016/s0140-6736(21)00768-6
» https://doi.org/10.1016/s0140-6736(21)00768-6 -
46. Neves TMA, Parreira PMSD, Rodrigues VJL, Graveto JMGN. Impact of safe nurse staffing on the quality of care in Portuguese public hospitals: A cross-sectional study. J Nurs Manag. 2021;29(5):1246-55. https://doi.org/10.1111/jonm.13263
» https://doi.org/10.1111/jonm.13263 -
47. Conselho Federal de Enfermagem (BR). Parecer normativo 1/2024/COFEN. Parâmetros para o planejamento da força de trabalho da Enfermagem pelo Enfermeiro [Internet]. Brasília: COFEN; 2024 [cited 2024 Apr 14]. Available from: https://www.cofen.gov.br/wp-content/uploads/2024/03/Parecer-Normativo-1-2024.pdf
» https://www.cofen.gov.br/wp-content/uploads/2024/03/Parecer-Normativo-1-2024.pdf -
48. Yuan Z, Wang J, Feng F, Jin M, Xie W, He H, et al. The levels and related factors of mental workload among nurses: A systematic review and meta-analysis. Int J Nurs Pract. 2023;29:e13148. https://doi.org/10.1111/ijn.13148
» https://doi.org/10.1111/ijn.13148 -
49. Ohneberg C, Warmbein A, Stöbich N, Rathgeber I, Kruppa A, Nast‑Kolb J, et al. Study protocol for the implementation and evaluation of a digital-robotic-based intervention for nurses and patients in a hospital: a quantitative and qualitative triangulation based on the Medical Research Council (MRC) framework for developing and evaluating complex interventions. BMC Nurs. 2022;21:349. https://doi.org/10.1186/s12912-022-01088-6
» https://doi.org/10.1186/s12912-022-01088-6 -
50. World Health Organization. Global strategic directions for nursing and midwifery 2021-2025 [Internet]. Geneva: WHO; 2021 [cited 2024 June 10]. Available from: https://iris.who.int/bitstream/handle/10665/344562/9789240033863-eng.pdf?sequence=1
» https://iris.who.int/bitstream/handle/10665/344562/9789240033863-eng.pdf?sequence=1
-
*
Paper extracted from doctoral dissertation “Atividades e carga de trabalho dos enfermeiros de Centro Cirúrgico: estudo de métodos mistos”, presented to Universidade Federal do Rio Grande do Sul, Escola de Enfermagem, Porto Alegre, RS, Brazil. This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) - Finance Code 001, Brazil and supported by Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), Grant # 404041/2023-0, Brazil.
-
How to cite this article
Trevilato DD, Martins FZ, Oliveira JLC, Caregnato RCA, Saurin TA, Magalhães AMM. Workload in the Surgical Center: perceptions, activities and time spent by nurses Rev. Latino-Am. Enfermagem. 2025;33:e4512 [cited]. Available from: . https://doi.org/10.1590/1518-8345.7549.4512
Edited by
-
Associate Editor:
Andrea Bernardes
Publication Dates
-
Publication in this collection
31 Mar 2025 -
Date of issue
2025
History
-
Received
13 June 2024 -
Accepted
29 Oct 2024




*NASA-TLX = National Aeronautics and Space Administration - Task Load Index

*QUAN = Quantitative; †qual = Qualitative; ‡NASA-TLX = National Aeronautics and Space Administration - Task Load Index; §m = Mean; ||SD = Standard Deviation; ¶h = Hours; **min = Minutes