Acessibilidade / Reportar erro

A systematized approach for reduction of medical appointment waiting list

Abstract

Paper aims

This work aims to develop a systematized approach for the reduction of medical appointment waiting lists, proposing an optimization decision-making model followed by continuous people engagement towards a systematic approach for waiting list problem-solving.

Originality

There are several studies related to waiting lists in healthcare contexts, however, the present study presents an innovative approach for waiting list problem-solving by proposing prescriptive decision-making models followed by continuous improvement and people engagement.

Research method

A research approach with the following phases was developed: system analysis, problem quantification, and development of an optimization model. After these phases, the model was applied, and the results were analysed, as contributions to a systematized model.

Main findings

The model was applied to the screening waiting list for orthopaedics appointments followed by the fundamental involvement of medical doctors, which made it possible to implement the optimal solution generated by the model, resulting in a reduction of 90% by 56 days in waiting time for the screening process.

Implications for theory and practice

This model contributes for theory and for practice as a way to deal with different scenarios for waiting list reduction in the upcoming days during and after the pandemic.

Keywords
Hospital operations management; Lean healthcare; Capacity planning; Waiting list; Elective patients

1. Introduction

The existence of waiting lists for elective procedures is a common issue in the health services in several countries (Almomani & AlSarheed, 2016Almomani, I., & AlSarheed, A. (2016). Enhancing outpatient clinics management software by reducing patients’ waiting time. Journal of Infection and Public Health, 9(6), 734-743. http://dx.doi.org/10.1016/j.jiph.2016.09.005. PMid:27663518.
http://dx.doi.org/10.1016/j.jiph.2016.09...
; Comans et al., 2017Comans, T. A., Chang, A. T., Standfield, L., Knowles, D., O’Leary, S., & Raymer, M. (2017). The development and practical application of a simulation model to inform musculoskeletal service delivery in an australian Public Health Service. Operations Research for Health Care, 15, 13-18. http://dx.doi.org/10.1016/j.orhc.2017.07.002.
http://dx.doi.org/10.1016/j.orhc.2017.07...
), representing a difficulty to comply with the expected Guaranteed Maximum Response Time (GMRT). Waiting lists are viewed as necessary to avoid idle time of valuable medical resources, but are also a problem as they are usually much longer than necessary due to the lack of capacity to deal with the demand (Worthington, 1991Worthington, D. (1991). Hospital waiting list management models. The Journal of the Operational Research Society, 42(10), 833-843. http://dx.doi.org/10.1057/jors.1991.164.
http://dx.doi.org/10.1057/jors.1991.164...
). The waiting list creates a late response to the patient's needs that can lead to a worsening of their health status. There are two types of waiting times for patients, the waiting time spent in the hospital (Mandahawi et al., 2017Mandahawi, N., Shurrab, M., Al-Shihabi, S., Abdallah, A. A., & Alfarah, Y. M. (2017). Utilizing six sigma to improve the processing time: a simulation study at an emergency department. Journal of Industrial and Production Engineering, 34(7), 495-503. http://dx.doi.org/10.1080/21681015.2017.1367728.
http://dx.doi.org/10.1080/21681015.2017....
) and the waiting time for an appointment date (Lin, 2015Lin, C. K. Y. (2015). An adaptive scheduling heuristic with memory for the block appointment system of an outpatient specialty clinic. International Journal of Production Research, 53(24), 7488-7516. http://dx.doi.org/10.1080/00207543.2015.1084060.
http://dx.doi.org/10.1080/00207543.2015....
; Chen & Juan 2013Chen, P.-S., & Juan, K.-L. (2013). Applying simulation optimization for solving a collaborative patient-referring mechanism problem. Journal of Industrial and Production Engineering, 30(6), 405-413. http://dx.doi.org/10.1080/21681015.2013.849766.
http://dx.doi.org/10.1080/21681015.2013....
), classified as the access time or indirect waiting time.

As an example, the relationship between the waiting time and the patient's clinical status was studied (Chen et al., 2008Chen, Z., King, W., Pearcey, R., Kerba, M., & Mackillop, W. J. (2008). The relationship between waiting time for radiotherapy and clinical outcomes: a systematic review of the literature. Radiotherapy and Oncology: Journal of the European Society for Therapeutic Radiology and Oncology, 87(1), 3-16. http://dx.doi.org/10.1016/j.radonc.2007.11.016.
http://dx.doi.org/10.1016/j.radonc.2007....
; Simunovic et al., 2010Simunovic, N., Devereaux, P. J., Sprague, S., Guyatt, G. H., Schemitsch, E., DeBeer, J., & Bhandari, M. (2010). Effect of early surgery after hip fracture on mortality and complications: systematic review and meta-analysis. Canadian Medical Association Journal, 182(15), 1609-1616. http://dx.doi.org/10.1503/cmaj.092220.
http://dx.doi.org/10.1503/cmaj.092220...
) in some orthopaedic pathologies. Another recent study analysed a way to reduce the waiting time for an ambulance in emergency medical services (Yu et al., 2020Yu, J.-Y., Huang, K.-L., Sun, W.-Z., & Ma, M. H.-M. (2020). The study of guarding and cruising modes of ambulances for emergency medical service. Journal of Industrial and Production Engineering, 37(8), 440-450. http://dx.doi.org/10.1080/21681015.2020.1840449.
http://dx.doi.org/10.1080/21681015.2020....
). Several other authors developed during the last decades different approaches to deal with healthcare waiting lists problems. Testi et al. (2007)Testi, A., Tanfani, E., & Torre, G. (2007). A three-phase approach for operating theatre schedules. Health Care Management Science, 10(2), 163-172. http://dx.doi.org/10.1007/s10729-007-9011-1. PMid:17608057.
http://dx.doi.org/10.1007/s10729-007-901...
developed a three-phase hierarchical approach for the weekly scheduling of operating rooms, aiming an integrated way of facing surgical activity planning in order to improve overall operating theatre efficiency in terms of overtime and throughput as well as waiting list reduction. Smith & Hadorn (2002)Smith, D. H., & Hadorn, D. C. (2002). Lining up for children’s mental health services: a tool for prioritizing waiting lists. Journal of the American Academy of Child and Adolescent Psychiatry, 41(4), 367-376. http://dx.doi.org/10.1097/00004583-200204000-00007. PMid:11931592.
http://dx.doi.org/10.1097/00004583-20020...
developed a priority criteria model for reliably assess patients urgency level and reducing waiting lists for medical support. Comas et al. (2008)Comas, M., Castells, X., Hoffmeister, L., Román, R., Cots, F., Mar, J., Gutiérrez-Moreno, S., & Espallargues, M. (2008). Discrete-event simulation applied to analysis of waiting lists. evaluation of a prioritization system for cataract surgery. Value in Health, 11(7), 1203-1213. http://dx.doi.org/10.1111/j.1524-4733.2008.00322.x. PMid:18494754.
http://dx.doi.org/10.1111/j.1524-4733.20...
presented a discrete-event simulation model for use in decision-making in the context of waiting list management strategies in which a comparison between a waiting list prioritization system and a routinely used first-in, first-out (FIFO), is carried out. (Mangan et al., 1992Mangan, J. L., Walsh, C., Kernohan, W. G., Murphy, J. S., Mollan, R. A., McMillen, R., & Beverland, D. E. (1992). Total joint replacement: implication of cancelled operations for hospital costs and waiting list management. Quality in Health Care, 1(1), 34-37. http://dx.doi.org/10.1136/qshc.1.1.34. PMid:10136828.
http://dx.doi.org/10.1136/qshc.1.1.34...
) studied the phenomenon of medical appointments cancellation and its impacts on the services waiting list. Vissers et al. (2001)Vissers, J. M. H., van Der Bij, J. D., & Kusters, R. J. (2001). Towards decision support for waiting lists: an operations management view. Health Care Management Science, 4(2), 133-142. http://dx.doi.org/10.1023/A:1011409711828. PMid:11393742.
http://dx.doi.org/10.1023/A:101140971182...
tackled the waiting lists phenomena in a high-level framework. A reference framework for waiting list management is described, distinguishing different levels of planning in healthcare demonstrating that each level contributes to the existence of waiting lists through managerial decision making.

There are several studies related to the phenomenon of waiting list in healthcare contexts, however the present study presents an innovative approach for waiting list problem-solving by proposing prescriptive decision-making models with continuous improvement cycles and people engagement towards a systematic approach for waiting list problem-solving.

This study addresses the access time of elective patients for the first appointment of medical specialties, coming from primary healthcare services and was developed in collaboration with a Portuguese public hospital. The study started with an improvement project in the orthopaedic specialty having been interrupted by due to Covid 19 pandemic. However, this document presents data collected before and during the pandemic. In Portugal, due to the epidemic of the new coronavirus, SARS-CoV-2, among other restrictions, it was recommended by health authorities that the use of health services should be reduced to the essential. Thus, primary healthcare services did not send so many patients for hospital appointments, which triggered, in the case of elective patients, a reduction in the waiting list for first medical appointment, however the waiting times are still high.

Being recognized the difficulty of managing the waiting lists in an empirical way (van Bussel et al., 2018van Bussel, E. M., van der Voort, M. B. V. R., Wessel, R. N., & van Merode, G. G. (2018). Demand, capacity, and access of the outpatient clinic: a framework for analysis and improvement. Journal of Evaluation in Clinical Practice, 24(3), 561-569. http://dx.doi.org/10.1111/jep.12926. PMid:29665314.
http://dx.doi.org/10.1111/jep.12926...
; Elkhuizen et al., 2007Elkhuizen, S. G., Das, S. F., Bakker, P. J. M., & Hontelez, J A M. (2007). Using computer simulation to reduce access time for outpatient departments. Quality & Safety in Health Care, 16(5), 382-386. http://dx.doi.org/10.1136/qshc.2006.021568. PMid:17913781.
http://dx.doi.org/10.1136/qshc.2006.0215...
), this article aims developing a systematized approach for reduction of medical appointment waiting list. This approach proposes an optimization method for determining the minimum number of hours * doctor needed in a period of time, to reduce and maintain the waiting list for first medical appointment within predefined dynamic limits. After determining that limit, the hospital may consider usual capacity planning strategies to accomplish the reduction of the waiting list: extra-hours, acquiring extra resources, subcontracting the extra capacity.

Such a model should be designed to be effective and easy to use by health professionals, providing powerful outcomes to help in the resource capacity allocation decision process.

The main gap relies on the lack of a systematized approach for problem solving with a well-defined step-by-step process that allows each medical service to, locally and individually, perform custom analyses for specific problem solving. This work provides a systematized approach that guides the medical services in structuring and defining the problem and then provides tools for the problem solving. The approach allows for custom problem definition and custom problem solving which is of paramount importance as each medical service has its own characteristics, work method and resources. This approach greatly increases medical services capability and flexibility on custom problem analyses and solving.

The paper follows with a literature review, which provides an overview of different approaches to the problem (section 2); section 3 presents a brief problem description, the research method applied, and the proposed optimization model and the application context are presented; this is followed by the application of the model to an hospital real problem (section 4); finally section 5 presents the discussion of the results, followed by the main concluding remarks.

2. Literature review

With the main objective of improving the services provided, promoting an increase in added value to the patient (Miao et al., 2020Miao, R., Zhang, H., Wu, Q., Zhang, J., & Jiang, Z. (2020). Using structural equation modeling to analyze patient value, satisfaction, and loyalty: a case study of healthcare in China. International Journal of Production Research, 58(2), 577-596. http://dx.doi.org/10.1080/00207543.2019.1598595.
http://dx.doi.org/10.1080/00207543.2019....
), there are several studies in the literature that aim to reduce the waiting time in different health services. Literature reviews show the adoption of production system techniques adapted to health services, indicating a growing focus on operations management (Keskinocak & Savva, 2019Keskinocak, P., & Savva, N. (2019). A review of the healthcare-management (modeling) literature published in manufacturing & service operations management. Manufacturing & Service Operations Management, 22. http://dx.doi.org/10.1287/msom.2019.0817.
https://doi.org/10.1287/msom.2019.0817...
). In particular, using the Lean production system, several initiatives have been introduced in health services, with an emphasis on hospital areas such as the emergency department and operating room (Lima et al., 2021Lima, R. M., Dinis-Carvalho, J., Souza, T. A., Vieira, E., & Gonçalves, B. (2021). Implementation of lean in health care environments: an update of systematic reviews. International Journal of Lean Six Sigma, 12(2), 399-431. http://dx.doi.org/10.1108/IJLSS-07-2019-0074.
http://dx.doi.org/10.1108/IJLSS-07-2019-...
; Costa & Godinho Filho, 2016). Although these studies demonstrate the good results of lean initiatives promoted in various health sectors, the importance of involving health professionals, including physicians, is emphasized as a fundamental factor for their long-term sustainability (Leite et al., 2020Leite, H., Bateman, N., & Radnor, Z. (2020). Beyond the ostensible: an exploration of barriers to lean implementation and sustainability in healthcare. Production Planning and Control, 31(1), 1-18. http://dx.doi.org/10.1080/09537287.2019.1623426.
http://dx.doi.org/10.1080/09537287.2019....
; Fournier et al., 2021Fournier, P.-L., Jobin, M.-H., Lapointe, L., & Bahl, L. (2021). Lean implementation in healthcare: offsetting physicians’ resistance to change. Production Planning and Control, 1-13. http://dx.doi.org/10.1080/09537287.2021.1938730.
http://dx.doi.org/10.1080/09537287.2021....
).

Likewise, also the use of statistical mathematical models and algorithms to analyse and quantify the relevant aspects in a health care context, typically with the aim of improving or optimizing performance and helping in decision making, have been adopted in health services (Priyan, 2017Priyan, S. (2017). Operations research in healthcare: a review. Juniper Online Journal of Public Health, 1(3), 1-12.). Namely, in the surgical planning and scheduling process by developing an optimization model for effective scheduling, contemplating the involvement of health professionals for an easier implementation (Visintin et al., 2017Visintin, F., Cappanera, P., Banditori, C., & Danese, P. (2017). Development and implementation of an operating room scheduling tool: an action research study. Production Planning and Control, 28(9), 758-775. http://dx.doi.org/10.1080/09537287.2017.1310328.
http://dx.doi.org/10.1080/09537287.2017....
). In the same way on the management of queues for diagnostic exams demonstrating the efficiency of new alternatives to the models in force through numerical experiments (Geng et al., 2017Geng, N., Chen, L., Liu, R., & Zhu, Y. (2017). Optimal patient assignment for W queueing network in a diagnostic facility setting. International Journal of Production Research, 55(19), 5609-5631. http://dx.doi.org/10.1080/00207543.2017.1324650.
http://dx.doi.org/10.1080/00207543.2017....
). In a broader approach, regarding to problems involving capacity planning in hospitals, there are many examples of how operations research models can be used to provide important information about operational strategies in health services (Green, 2005Green, L. (2005). Capacity planning and management in hospitals. In M. L. Brandeau, F. Sainfort & W. P. Pierskalla (Eds.), Operations research and health care a handbook of methods and applications (Vol. 70, pp. 15-41). Boston: Springer. http://dx.doi.org/10.1007/1-4020-8066-2_2.
http://dx.doi.org/10.1007/1-4020-8066-2_...
; Raymond et al., 2016Raymond, M.-H., Demers, L., & Feldman, D. E. (2016). Waiting list management practices for home-care occupational therapy in the Province of Quebec, Canada. Health & Social Care in the Community, 24(2), 154-164. http://dx.doi.org/10.1111/hsc.12195. PMid:25684435.
http://dx.doi.org/10.1111/hsc.12195...
; Frost, 1980Frost, C. E. B. (1980). How permanent are NHS waiting lists? Social Science & Medicine. Part C, Medical Economics, 14(1), 1-11. http://dx.doi.org/10.1016/0160-7995(80)90003-9. PMid:7444482.
http://dx.doi.org/10.1016/0160-7995(80)9...
; Lodge & Bamford, 2007; Elwyn et al., 1996Elwyn, G. J., Williams, L. A., Barry, S., & Kinnersley, P. (1996). Waiting list management in general practice: a review of orthopaedic patients. British Medical Journal, 312(7035), 887-888. http://dx.doi.org/10.1136/bmj.312.7035.887. PMid:8611882.
http://dx.doi.org/10.1136/bmj.312.7035.8...
; Neby et al., 2015Neby, S., Lægreid, P., Mattei, P., & Feiler, T. (2015). Bending the rules to play the game: accountability, DRG and waiting list scandals in Norway and Germany. European Policy Analysis, 1(1), 127-148. http://dx.doi.org/10.18278/epa.1.1.9.
http://dx.doi.org/10.18278/epa.1.1.9...
; Escobar et al., 2009Escobar, A., Quintana, J. M., González, M., Bilbao, A., & Ibañez, B. (2009). Waiting list management: priority criteria or first-in first-out? A case for total joint replacement. Journal of Evaluation in Clinical Practice, 15(4), 595-601. http://dx.doi.org/10.1111/j.1365-2753.2008.01056.x. PMid:19674214.
http://dx.doi.org/10.1111/j.1365-2753.20...
; Cipriano et al., 2008Cipriano, L. E., Chesworth, B. M., Anderson, C. K., & Zaric, G. S. (2008). An evaluation of strategies to reduce waiting times for total joint replacement in Ontario. Medical Care, 46(11), 1177-1183. http://dx.doi.org/10.1097/MLR.0b013e31817925e8. PMid:18953229.
http://dx.doi.org/10.1097/MLR.0b013e3181...
; Tatham et al., 2012Tatham, M., Stringer, H., Perera, S., & Waller, G. (2012). Do you still want to be seen? The pros and cons of active waiting list management. International Journal of Eating Disorders, 45(1), 57-62. http://dx.doi.org/10.1002/eat.20920. PMid:21321990.
http://dx.doi.org/10.1002/eat.20920...
).

Concerned with political approaches, given the importance of reducing waiting times to promote faster access to elective health care by the population, several measures have been promoted in several OECD countries (Siciliani et al., 2014Siciliani, L., Moran, V., & Borowitz, M. (2014). Measuring and comparing health care waiting times in OECD countries. Health Policy, 118(3), 292-303. http://dx.doi.org/10.1016/j.healthpol.2014.08.011. PMid:25217838.
http://dx.doi.org/10.1016/j.healthpol.20...
). In Portugal, measures such as the introduction of an integrated computer system for the National Health System (NHS), the free movement of patients within the NHS, the introduction of GMRT and the creation of vouchers for patients who exceed this waiting times, demonstrated positive results (Barros et al., 2011Barros, P. P., Machado, S. R., & Jorge de Almeida, S. (2011). Portugal: health system review. Geneva: World Health Organization, Regional Office for Europe.; Siciliani et al., 2014Siciliani, L., Moran, V., & Borowitz, M. (2014). Measuring and comparing health care waiting times in OECD countries. Health Policy, 118(3), 292-303. http://dx.doi.org/10.1016/j.healthpol.2014.08.011. PMid:25217838.
http://dx.doi.org/10.1016/j.healthpol.20...
).

In a similar approach as to this study, van Bussel et al. (2018)van Bussel, E. M., van der Voort, M. B. V. R., Wessel, R. N., & van Merode, G. G. (2018). Demand, capacity, and access of the outpatient clinic: a framework for analysis and improvement. Journal of Evaluation in Clinical Practice, 24(3), 561-569. http://dx.doi.org/10.1111/jep.12926. PMid:29665314.
http://dx.doi.org/10.1111/jep.12926...
make a great contribution on analysing real outpatient demand, supply and access time. The authors present a 6-step model to gain insights for guidance in redesigning the access to a medical appointment system and a better match between demand, supply and access time. Differently to such approach, this study does not include follow-up medical appointments, which, although important, do not interfere with the legal time constraints imposed by the ministry and so are not considered in the presented analysis approach.

Likewise Elkhuizen et al. (2007)Elkhuizen, S. G., Das, S. F., Bakker, P. J. M., & Hontelez, J A M. (2007). Using computer simulation to reduce access time for outpatient departments. Quality & Safety in Health Care, 16(5), 382-386. http://dx.doi.org/10.1136/qshc.2006.021568. PMid:17913781.
http://dx.doi.org/10.1136/qshc.2006.0215...
used a waiting list analysis model to determine the capacity needed to meet the demand for patients and developed a simulation model that could handle daily variations in demand and capacity schedules. The authors present the results for the need to eliminate delays and the ability to maintain access time within 2 weeks. Both models were applied in two outpatient departments and provided results very close to those observed in the implementation. Woodhouse (2006)Woodhouse, A. E. (2006). Reducing waiting times: using an opt-in system and changing prioritisation criteria. Child and Adolescent Mental Health, 11(2), 94-97. http://dx.doi.org/10.1111/j.1475-3588.2005.00372.x. PMid:32811089.
http://dx.doi.org/10.1111/j.1475-3588.20...
developed a opt-in appointment system to inform the waiting list management. By doing so the attendance at first appointments was significantly increased and waiting times were significantly reduced. Spratt & Kozan (2016)Spratt, B., & Kozan, E. (2016). Waiting list management through master surgical schedules: a case study. Operations Research for Health Care, 10, 49-64. http://dx.doi.org/10.1016/j.orhc.2016.07.002.
http://dx.doi.org/10.1016/j.orhc.2016.07...
tackle the waiting list management problem by generating master surgical schedules that adhere to staff and equipment restrictions whilst ensuring patients are treated in a timely manner. Stochastic surgical durations were considered to produce more robust schedules and reduce unexpected overtime. Regarding the same clinical area, Al-Hakim (2006)Al-Hakim, L. (2006). Web-based hospital information system for managing operating theatre waiting list. International Journal of Healthcare Technology and Management, 7(3-4), 266-282. http://dx.doi.org/10.1504/IJHTM.2006.008436.
http://dx.doi.org/10.1504/IJHTM.2006.008...
developed a model to manage waiting lists for surgery interventions with three specific objectives: unifying the waiting lists, reduce the unexpected deviation of planned activities and deliver an effective support system for decisions-making. In Bowers (2011)Bowers, J. A. (2011). Simulating waiting list management. Health Care Management Science, 14(3), 292-298. http://dx.doi.org/10.1007/s10729-011-9171-x. PMid:21695520.
http://dx.doi.org/10.1007/s10729-011-917...
, the behaviour of waiting list management is simulated in which a model of waiting list management is developed that includes an explicit measure of priority associated with the patient's wait compared to specified targets. Briggs et al. (2011)Briggs, R. J., Smith, K. M., Dejager, E. M., Callahan, J. T., Abernethy, J. A., Dunn, E. J., & Hunter-Smith, D. J. (2011). The active management of surgical waiting lists: a urological surgery case study. Australian Health Review, 35(4), 399-403. http://dx.doi.org/10.1071/AH10923. PMid:22126940.
http://dx.doi.org/10.1071/AH10923...
developed a multifaceted approach to wait list management including audit, direct lines of communication between clinical and administrative staff, resources planning and outsourcing and others.

While this literature review has not the objective of being complete, a summary allow to identify an increasing interest in the application of operations management (Costa & Godinho Filho, 2016; Lima et al., 2021Lima, R. M., Dinis-Carvalho, J., Souza, T. A., Vieira, E., & Gonçalves, B. (2021). Implementation of lean in health care environments: an update of systematic reviews. International Journal of Lean Six Sigma, 12(2), 399-431. http://dx.doi.org/10.1108/IJLSS-07-2019-0074.
http://dx.doi.org/10.1108/IJLSS-07-2019-...
) methods and approaches to several health services with a special focus in increasing the value added to the patient (Miao et al., 2020Miao, R., Zhang, H., Wu, Q., Zhang, J., & Jiang, Z. (2020). Using structural equation modeling to analyze patient value, satisfaction, and loyalty: a case study of healthcare in China. International Journal of Production Research, 58(2), 577-596. http://dx.doi.org/10.1080/00207543.2019.1598595.
http://dx.doi.org/10.1080/00207543.2019....
), involving as much as possible the health professionals (Fournier et al., 2021Fournier, P.-L., Jobin, M.-H., Lapointe, L., & Bahl, L. (2021). Lean implementation in healthcare: offsetting physicians’ resistance to change. Production Planning and Control, 1-13. http://dx.doi.org/10.1080/09537287.2021.1938730.
http://dx.doi.org/10.1080/09537287.2021....
; Leite et al., 2020Leite, H., Bateman, N., & Radnor, Z. (2020). Beyond the ostensible: an exploration of barriers to lean implementation and sustainability in healthcare. Production Planning and Control, 31(1), 1-18. http://dx.doi.org/10.1080/09537287.2019.1623426.
http://dx.doi.org/10.1080/09537287.2019....
) in the process of finding the best solutions. Thus, it was possible to identify the following references related to operations management approaches and hospital areas:

- Operations management approaches: queue management (Geng et al., 2017Geng, N., Chen, L., Liu, R., & Zhu, Y. (2017). Optimal patient assignment for W queueing network in a diagnostic facility setting. International Journal of Production Research, 55(19), 5609-5631. http://dx.doi.org/10.1080/00207543.2017.1324650.
http://dx.doi.org/10.1080/00207543.2017....
); statistical modelling (Priyan, 2017Priyan, S. (2017). Operations research in healthcare: a review. Juniper Online Journal of Public Health, 1(3), 1-12.); operations research (Bowerman et al., 2007; Cipriano et al., 2008Cipriano, L. E., Chesworth, B. M., Anderson, C. K., & Zaric, G. S. (2008). An evaluation of strategies to reduce waiting times for total joint replacement in Ontario. Medical Care, 46(11), 1177-1183. http://dx.doi.org/10.1097/MLR.0b013e31817925e8. PMid:18953229.
http://dx.doi.org/10.1097/MLR.0b013e3181...
; Elwyn et al., 1996Elwyn, G. J., Williams, L. A., Barry, S., & Kinnersley, P. (1996). Waiting list management in general practice: a review of orthopaedic patients. British Medical Journal, 312(7035), 887-888. http://dx.doi.org/10.1136/bmj.312.7035.887. PMid:8611882.
http://dx.doi.org/10.1136/bmj.312.7035.8...
; Escobar et al., 2009Escobar, A., Quintana, J. M., González, M., Bilbao, A., & Ibañez, B. (2009). Waiting list management: priority criteria or first-in first-out? A case for total joint replacement. Journal of Evaluation in Clinical Practice, 15(4), 595-601. http://dx.doi.org/10.1111/j.1365-2753.2008.01056.x. PMid:19674214.
http://dx.doi.org/10.1111/j.1365-2753.20...
; Frost, 1980Frost, C. E. B. (1980). How permanent are NHS waiting lists? Social Science & Medicine. Part C, Medical Economics, 14(1), 1-11. http://dx.doi.org/10.1016/0160-7995(80)90003-9. PMid:7444482.
http://dx.doi.org/10.1016/0160-7995(80)9...
; Green, 2005Green, L. (2005). Capacity planning and management in hospitals. In M. L. Brandeau, F. Sainfort & W. P. Pierskalla (Eds.), Operations research and health care a handbook of methods and applications (Vol. 70, pp. 15-41). Boston: Springer. http://dx.doi.org/10.1007/1-4020-8066-2_2.
http://dx.doi.org/10.1007/1-4020-8066-2_...
; Neby et al., 2015Neby, S., Lægreid, P., Mattei, P., & Feiler, T. (2015). Bending the rules to play the game: accountability, DRG and waiting list scandals in Norway and Germany. European Policy Analysis, 1(1), 127-148. http://dx.doi.org/10.18278/epa.1.1.9.
http://dx.doi.org/10.18278/epa.1.1.9...
; Raymond et al., 2016Raymond, M.-H., Demers, L., & Feldman, D. E. (2016). Waiting list management practices for home-care occupational therapy in the Province of Quebec, Canada. Health & Social Care in the Community, 24(2), 154-164. http://dx.doi.org/10.1111/hsc.12195. PMid:25684435.
http://dx.doi.org/10.1111/hsc.12195...
; Tatham et al., 2012Tatham, M., Stringer, H., Perera, S., & Waller, G. (2012). Do you still want to be seen? The pros and cons of active waiting list management. International Journal of Eating Disorders, 45(1), 57-62. http://dx.doi.org/10.1002/eat.20920. PMid:21321990.
http://dx.doi.org/10.1002/eat.20920...
); demand (outpatient) management (van Bussel et al., 2018van Bussel, E. M., van der Voort, M. B. V. R., Wessel, R. N., & van Merode, G. G. (2018). Demand, capacity, and access of the outpatient clinic: a framework for analysis and improvement. Journal of Evaluation in Clinical Practice, 24(3), 561-569. http://dx.doi.org/10.1111/jep.12926. PMid:29665314.
http://dx.doi.org/10.1111/jep.12926...
); capacity planning (Elkhuizen et al., 2007Elkhuizen, S. G., Das, S. F., Bakker, P. J. M., & Hontelez, J A M. (2007). Using computer simulation to reduce access time for outpatient departments. Quality & Safety in Health Care, 16(5), 382-386. http://dx.doi.org/10.1136/qshc.2006.021568. PMid:17913781.
http://dx.doi.org/10.1136/qshc.2006.0215...
); master production scheduling (Spratt & Kozan, 2016Spratt, B., & Kozan, E. (2016). Waiting list management through master surgical schedules: a case study. Operations Research for Health Care, 10, 49-64. http://dx.doi.org/10.1016/j.orhc.2016.07.002.
http://dx.doi.org/10.1016/j.orhc.2016.07...
); priority management (Bowers, 2011Bowers, J. A. (2011). Simulating waiting list management. Health Care Management Science, 14(3), 292-298. http://dx.doi.org/10.1007/s10729-011-9171-x. PMid:21695520.
http://dx.doi.org/10.1007/s10729-011-917...
).

Hospital areas: Emergency department; surgical department (Visintin et al., 2017Visintin, F., Cappanera, P., Banditori, C., & Danese, P. (2017). Development and implementation of an operating room scheduling tool: an action research study. Production Planning and Control, 28(9), 758-775. http://dx.doi.org/10.1080/09537287.2017.1310328.
http://dx.doi.org/10.1080/09537287.2017....
; Spratt & Kozan, 2016Spratt, B., & Kozan, E. (2016). Waiting list management through master surgical schedules: a case study. Operations Research for Health Care, 10, 49-64. http://dx.doi.org/10.1016/j.orhc.2016.07.002.
http://dx.doi.org/10.1016/j.orhc.2016.07...
; Al-Hakim, 2006Al-Hakim, L. (2006). Web-based hospital information system for managing operating theatre waiting list. International Journal of Healthcare Technology and Management, 7(3-4), 266-282. http://dx.doi.org/10.1504/IJHTM.2006.008436.
http://dx.doi.org/10.1504/IJHTM.2006.008...
); diagnostic exams (Geng et al., 2017Geng, N., Chen, L., Liu, R., & Zhu, Y. (2017). Optimal patient assignment for W queueing network in a diagnostic facility setting. International Journal of Production Research, 55(19), 5609-5631. http://dx.doi.org/10.1080/00207543.2017.1324650.
http://dx.doi.org/10.1080/00207543.2017....
); outpatient consultation (Siciliani et al., 2014Siciliani, L., Moran, V., & Borowitz, M. (2014). Measuring and comparing health care waiting times in OECD countries. Health Policy, 118(3), 292-303. http://dx.doi.org/10.1016/j.healthpol.2014.08.011. PMid:25217838.
http://dx.doi.org/10.1016/j.healthpol.20...
; van Bussel et al., 2018van Bussel, E. M., van der Voort, M. B. V. R., Wessel, R. N., & van Merode, G. G. (2018). Demand, capacity, and access of the outpatient clinic: a framework for analysis and improvement. Journal of Evaluation in Clinical Practice, 24(3), 561-569. http://dx.doi.org/10.1111/jep.12926. PMid:29665314.
http://dx.doi.org/10.1111/jep.12926...
; Elkhuizen et al., 2007Elkhuizen, S. G., Das, S. F., Bakker, P. J. M., & Hontelez, J A M. (2007). Using computer simulation to reduce access time for outpatient departments. Quality & Safety in Health Care, 16(5), 382-386. http://dx.doi.org/10.1136/qshc.2006.021568. PMid:17913781.
http://dx.doi.org/10.1136/qshc.2006.0215...
; Woodhouse, 2006Woodhouse, A. E. (2006). Reducing waiting times: using an opt-in system and changing prioritisation criteria. Child and Adolescent Mental Health, 11(2), 94-97. http://dx.doi.org/10.1111/j.1475-3588.2005.00372.x. PMid:32811089.
http://dx.doi.org/10.1111/j.1475-3588.20...
; Bowers, 2011Bowers, J. A. (2011). Simulating waiting list management. Health Care Management Science, 14(3), 292-298. http://dx.doi.org/10.1007/s10729-011-9171-x. PMid:21695520.
http://dx.doi.org/10.1007/s10729-011-917...
; Briggs et al., 2011Briggs, R. J., Smith, K. M., Dejager, E. M., Callahan, J. T., Abernethy, J. A., Dunn, E. J., & Hunter-Smith, D. J. (2011). The active management of surgical waiting lists: a urological surgery case study. Australian Health Review, 35(4), 399-403. http://dx.doi.org/10.1071/AH10923. PMid:22126940.
http://dx.doi.org/10.1071/AH10923...
).

The objective of the current work is to encompass high degrees of flexibility when dealing with the most common constraints regarding the dynamic levels of waiting list, demand and capacity needed. Fully autonomous or manual handling modes should be provided so the medical teams or hospital administration may use the one that best fits the context under analysis. A systematic modelling and analysis approach is aimed so that the model can be transversally used across all types of medical specialties.

3. Methods

This section describes in detail the methodological approach, the waiting list for medical appointments problem, followed by the approach developed to tackle that problem, based on an optimization model. In the context of the developed work the concept of waiting list represents the number of patients waiting for a healthcare service.

3.1. Systematic approach

This study addresses capacity management for first medical appointments, in the elective services of a Portuguese hospital. Figure 1 shows the main steps followed on the development of the study.

Figure 1
Methodological approach.

Thus, to obtain accurate insights for the research, a mixed-methods approach was performed to collect both quantitative and qualitative data. Since part of this study was developed in 2019 and was extended in time during the covid 19 pandemic, data collection and analysis were performed at different times. So, in 2019, it was made a careful analysis of the data referent to 2018, on access to orthopaedics appointments. Namely, data relating to the number of schedules, number of first orthopaedics appointments, number of referrals for first orthopaedics appointments and waiting list were analysed and processed. Likewise, to understand the current state of the situation due to the pandemic, data on the number of referrals received by the hospital in 2019 and 2020 for the first appointment of orthopaedics and the waiting list in April 2021 were analysed and processed. Likewise, several interactions were promoted with orthopaedists and other health professionals to the characterization of the problem and an in-depth understanding of its perceptions. For a better contextualization of the problem, current legislation was also consulted regarding GMRT.

3.2. Problem description

For a patient to have access to the hospital's outpatient service, it is necessary that MD from primary healthcare services, hospital inpatient services or emergency services perform a patient referral to the service. This study focuses on patients from primary healthcare services. Thus, for these patients, the access to an orthopaedics appointment begins with the referral of the general clinical doctors (also known as “family doctors” in Portugal). The referral will provide the orthopaedist with essential basic information for the screening process, such as the patient's medical history, and will also contain details that allow the classification of the patient's degree of urgency. In the medical screening process, MD should prioritize referrals to establish an orderly place on the waiting list, according to the patient's clinical status, to schedule the appointment. Likewise, the doctor has the possibility to refuse referral if he considers that the appointment is not justified, or to return the referral to family doctors to review the clinical process of the patient (for example, due to lack of clinical information or due to lack of exams). If the request is accepted, then a priority is assigned. If the request is discarded, then it may be completely discarded being then removed from the system (and waiting list) or it may be returned to family doctors, to obtain more information, and the request remains in the system increasing the waiting time continuously until a response. Figure 2 illustrates how the waiting times for the different processes, screening, and first medical appointment, are determined.

Figure 2
Measurement of the waiting time for screening process and first medical appointment.

The waiting time for the first appointment and for medical screening represents the difference between the effective date in which each process takes place and the arrival date of the referral. The waiting time for the first appointment is counted from the patient referral arrival, however the patient is not included on the waiting list for first appointment until the screening process is completed (although waiting time is still counting). Thus, it is considered the existence of two waiting lists, the waiting list for screening and the waiting list for the first appointment.

These referrals are widely monitored by health authorities, especially regarding waiting times. Based on the GMRT imposed by law, the screening process should take place within a limit of five days and the first appointment should be provided in 30 days for very urgent requests, 60 days for urgent requests and 120 days for normal requests. However, in the hospital under study, the waiting times are far above these reference values, representing a great concern for the hospital administration because, in addition to late patient care, they are associated with financial penalties.

Thus, taking into consideration the variations in demand as well as in available capacity, the management of waiting lists and consequently access times becomes complex (Elkhuizen et al., 2007Elkhuizen, S. G., Das, S. F., Bakker, P. J. M., & Hontelez, J A M. (2007). Using computer simulation to reduce access time for outpatient departments. Quality & Safety in Health Care, 16(5), 382-386. http://dx.doi.org/10.1136/qshc.2006.021568. PMid:17913781.
http://dx.doi.org/10.1136/qshc.2006.0215...
). Thus, understanding how capacity and demand affect the waiting list is essential to guarantee a certain level of service, with regard to access time (van Bussel et al., 2018van Bussel, E. M., van der Voort, M. B. V. R., Wessel, R. N., & van Merode, G. G. (2018). Demand, capacity, and access of the outpatient clinic: a framework for analysis and improvement. Journal of Evaluation in Clinical Practice, 24(3), 561-569. http://dx.doi.org/10.1111/jep.12926. PMid:29665314.
http://dx.doi.org/10.1111/jep.12926...
) .

In the same way, other constraints like the efficiency of the resources, the days that the speciality operates, and the existing waiting list make the reduction and maintenance of the waiting list a problem difficult to be solved empirically. Thus, this study aims responding to the following research question:

  1. 1

    What optimization model allows the definition of the necessary capacity to comply with the pre-defined and dynamic levels of the waiting list in an effective, easy to use and accessible approach to health professionals so that can be systematically applied to all medical specialties?

3.3. Solution approach

With main objective to provide a solid support tool for decision making, assessing the needed capacity, translated into hours * doctor per day, an optimization model was developed. This model allows to manage the waiting list for medical screening and first appointment to promote the reduction of waiting time. The optimization model presented next was applied to the access waiting lists of orthopaedics speciality in real context. Before pandemic, considering the high demand for orthopaedics elective services and in parallel with a continuous improvement project under development in the hospital in the orthopaedics service, the optimization model was applied to the orthopaedics screening waiting list. Subsequently, considering the effects of the pandemic, it was refined and prepared to be applied to the waiting list for the first medical appointment.

3.3.1. Formulation of the model

Following the presented approach (Figure 1), after analysing the system that stores the accesses to the first appointments and quantifying the problem through the analysis of the collected data, it was possible to quantify and identify the variables and constraints of the problem. Therefore, to validate the interpretation of the procedure and analysed data, a debate with orthopaedics doctors was promoted, which allowed the development of the present optimization model.

Thus, to support the decisions on how to manage the waiting list for the screening process and the first medical appointment, the optimization model was developed to achieve the optimal solution for the minimum number of hours required for a time period of 52 weeks. This integer linear programming model uses OpenSolver in the Excel VBA add-in, which extends Excel’s built-in Solver capabilities. The option for using the Microsoft Excel is justified due to its great dissemination across hospital computers, meaning that no extra software is needed which also represents no investment needed. By being well disseminated across the hospital facilities it also enables the transferability, transversality and systematicity of the model and approach though all medical specialities.

The model is defined according to mathematical notation of the parameters, decision variables, objective function and constraints in order to allow an adequate conceptual modelling of the problem.

  • Indices

i identifies the week, ∀ i ∈ {1,52}.

  • Parameters

C represents an additional (higher) cost per extra hour.

LI represents the current waiting list.

LPi represents the expected (forecasted) waiting list for week i.

LMAXi represents the desired maximum waiting list for week i.

LMINi represents the minimum waiting list for week i.

HMAXi represents the maximum number of hours * doctor per day for week i.

HMINVi represents the minimum number of hours * doctor per day for week i.

EHMAXi represents the maximum number of extra hours * doctor per day for week i.

EHMINVi represents the minimum number of extra hours * doctor per day for week i.

HVi represents the limit on the variation of hours * doctor per day between week i and week i+1.

EHVi represents the limit on the variation of extra hours * doctor per day between week i and week i+1.

P represents the number of days planned for the service to operate.

D represents the average number of daily requests.

CT represents the standard time for the execution of the process (cycle time).

T represents the time factor that converts the number of planned days into weeks.

E represents the level of efficiency in the process.

The efficiency is an important parameter, it quantifies the percentage of time that is actually dedicated to the process and, consequently, the percentage of time that is wasted with voluntary or involuntary stops.

  • Decision variables

xi number of hours * doctor per day in the week i.

Exi number of extra hours * doctor per day in the week i.

  • Objective function

The purpose of the model is to minimize the total number of hours * doctor per day, per week, for the process, according to Equation 1. It is considered an additional penalty (C) for each extra hour used (overtime).

Min Z = i x i + i E x i × C (1)
  • Constraints

Regarding the control of patients on the waiting list, the constraints presented in Expressions 2 and 3 were considered for a progressive reduction of the waiting list by limiting the maximum number of patients on the waiting list in the week i. The left-hand side represents the number of consults to be performed in week i which must be equal or greater than the difference between the waiting list level in the previous week and the desired maximum waiting list level (LMAXi) in the current week:

E × 60 × P × T C T ( x i + E x i ) L I + D × P × T L M A X i i = 1 (2)
E × 60 × P × T CT ( x i + E x i ) LP i 1 + D × P × T LMAX i i > 1 (3)

A minimum number of patients in the waiting list was also considered allowing better use of hospital resources without compromising the on-time responses to patients’ requests. For achieving this behaviour Expressions 4 and 5 were modelled. The left-hand side represents the number of consults to be performed in week i which must be equal or less than the difference between the waiting list level in the previous week and the desired minimum waiting list level (LMINi) in the current week:

E × 60 × P × T CT ( x i + E x i ) LI + D × P × T LMIN i i = 1 (4)
E × 60 × P × T CT ( x i + E x i ) ( LP i 1 + D × P × T ) LMIN i i > 1 (5)

This restriction (2-5) aims to define the limit values ​​of the waiting list, considering the desired response times and to distribute the workload more evenly among the several weeks of analysis.

All MD perform several tasks other than consultation (e.g., surgeries, emergency room) so there are a limit number of hours that may be dedicated to consultation. Thus, a maximum limit was established for the number of hours * doctor per day. Expression 6 restrains the maximum number of hours * doctor per day in the week i (HMAXi):

x i HMAX i i (6)

To avoid the existence of days with null capacity (no consultations performed) the constraint indicated by Expression 7 aims to ensure a minimum number of hours * doctor per day for week i (HMINi):

x i HMIN i i (7)

In view of the high number of patients waiting, and after a preliminary analysis of the real restrictions of the problem, it was concluded that it would be necessary to define the possibility of allocating overtime. It is a possibility that the administration is considering, if necessary, and so it would not be correct to increase the value of HMAX, as it is important to understand which times are not included for the availability of MD for the service under study. Thus, constraints to the maximum and minimum limits for the allocation of overtime were also established. Expression 8 shows the maximum number of Extra hours * doctor per day in the week i (HMAXi):

Ex i EHMAX i i (8)

The Expression 9 shows the minimum number of Extra hours * doctor per day for week i (EHMINi):

Ex i EHMIN i i (9)

In order to avoid major variations in the doctor's schedule between consecutive weeks, the Expressions 10 and 11 show restrictions for the definition of the limit variation on the number of hours * doctor per day between two consecutive weeks (HVi).

x i x i + 1 HV i i (10)
x i + 1 x i HV i i (11)

The maximum variation in the number of extra hours * doctor per day between two consecutive weeks (EHVi) is limited according to Expressions 12 and 13:

Ex i Ex i + 1 EHV i i (12)
Ex i + 1 Ex i EHV i i (13)

3.3.2. Context of application - Before the pandemic period

The application of the optimization model to the screening waiting list occurred with an essential principle – the involvement of MD in the improvement process through the development of a continuous improvement culture based on lean philosophy. For several months, weekly meetings were held with a team of orthopaedists to identify problems and find possible solutions implemented through improvement cycles inspired by Toyota Kata (Rother, 2010Rother, M. (2010). Toyota Kata: managing people for improvement, adaptiveness and superior results. New York: McGraw-Hill Education.) and its PDCA cycles.

At the beginning of 2019, the number of requests in the waiting list for a first orthopaedic appointment was 4835 with an average waiting time of 210 days and for screening process were about 1244 patients with an average waiting time of 66 days. One of the main problems identified by MD and confirmed by the data analysis is related to the lack of response capacity, limited by the number of hours * doctor dedicated to the external consultations and more concretely to the first appointment, given the high number of referrals. Figure 3 shows this reality, showing the gap between capacity and demand. The number of scheduled consults corresponds to the capacity devoted to first consults, being shown in the figure in the form of vertical bars (representing the number of consults performed), and the demand requests are shown in the form of a line. It becomes clear the lack of capacity analysing the differences between consults performed and number of referrals (demand).

Figure 3
Comparison between the number of first orthopaedics appointments scheduled and the number of requests received, in 2018.

In 2018, the number of orthopaedic consults scheduled is much lower than the number of referrals received by the hospital in the same period. It is important to note that the numbers presented clearly show the number of requests (that represent patients) that accumulate every week increasing the waiting list, consequence of the scheduled consults not meeting the requests received. Another important characteristic of the data analysed is the variable behaviour of demand and also capacity (van Bussel et al., 2018van Bussel, E. M., van der Voort, M. B. V. R., Wessel, R. N., & van Merode, G. G. (2018). Demand, capacity, and access of the outpatient clinic: a framework for analysis and improvement. Journal of Evaluation in Clinical Practice, 24(3), 561-569. http://dx.doi.org/10.1111/jep.12926. PMid:29665314.
http://dx.doi.org/10.1111/jep.12926...
).

According to the orthopaedics doctors, many of the patients who are observed in the appointments were sent to the hospital without a previous study of the disease, namely without prescribed exams. It was also identified that several patients do not presented pathologies justifying an appointment in the hospital. Although such requests are not eligible for an appointment in the hospital, the orthopaedic doctors accept these referrals because they consider unacceptable to discard a request that is waiting for so long for the triage process. Thus, smaller times in the screening waiting list will possibly allow for more justifiable discards of requests contributing for the consistent reduction of the waiting list. The orthopaedic doctors admit that no triage time is defined in their schedules (the triage process was performed by good will in the emergency room in periods of low service demand). All these factors were contributing to the increase of the waiting list.

During this project, many constraints were identified, and different initiatives were promoted (Dinis-Carvalho et al., 2022Dinis-Carvalho, J., Vieira, E., Lima, R. M., & Gonçalves, B. S. (2022). Reducing waiting time for orthopaedic consultation through a continuous improvement approach. In J. Machado, F. Soares, J. Trojanowska & V. Ivanov (Eds.), Innovations in industrial engineering (Lecture Notes in Mechanical Engineering). Cham: Springer. http://dx.doi.org/10.1007/978-3-030-78170-5_40.
http://dx.doi.org/10.1007/978-3-030-7817...
), and the need to reduce the waiting list for screening process was one of the proposals that brought together more consensus within health professionals.

Following the same procedure, the model was applied to the consultation process, specifically to the first medical appointment. However, due to the pandemic, the face-to-face activities related to the continuous improvement project were interrupted. During this period, the optimization model was evolved for its application during and after pandemic contexts.

3.3.3. Context of application – During the pandemic period

In Portugal, due to the epidemic of the new coronavirus, SARS-CoV-2, the first lockdown was decreed in March 2020. Thus, among other restrictions, it was recommended by health authorities that the use of health services should be reduced to the essential. Despite the objective of mitigating the epidemiological infection by COVID-19, this is a measure envisaged as a way to increase the capacity of health services in the event of a pandemic or mass disaster (Dichter et al., 2014Dichter, J. R., Kanter, R. K., Dries, D., Luyckx, V., Lim, M. L., Wilgis, J., Anderson, M. R., Sarani, B., Hupert, N., Mutter, R., Devereaux, A. V., Christian, M. D., & Kissoon, N. (2014). System-level planning, coordination, and communication: care of the critically Ill and injured during pandemics and disasters: CHEST consensus statement. Chest, 146(4, Suppl.), e87S-e102S. http://dx.doi.org/10.1378/chest.14-0738. PMid:25144713.
http://dx.doi.org/10.1378/chest.14-0738...
).

In this sense, following the recommendations of the health authorities, the lesser influx of non-urgent patients to the primary healthcare services was reflected in the reduction in the number of requests for first speciality appointments. In fact, the hospital's external consultation service adopted the closure of the service for three months. The reduction in the number of requests and the resumption of the programmed procedures promoted a reduction of the waiting list for first appointments. Thus, at the end of March 2021 the waiting list for first orthopaedics appointments had 1106 patients with an average waiting time of 98 days.

The application of the optimization model to the waiting list for first appointment considering different scenarios intends to demonstrate the versatility of the model and in the same way to present a solution for the different behaviour possibilities of the system.

4. Results

4.1. Screening waiting list

The optimization model was applied to the waiting list for screening and presented the optimal solution fulfilling all restrictions. The parameters were defined according to the information collected from the historic data and to the knowledge of MD about the process. For LI of 1244 patients, the maximum limits of the list were established in up to 400 patients, with respect to LMAX, considering a gradual reduction of 40 patients and 300 patients for LMIN. It was considered the demand D verified in 2018 (42 patients per day) for a period P of 244 effective working days. The efficiency value was validated by health professionals at 80% for the 6-minute cycle time (CT) process. Regarding HMAX and HMIN, 8 and 4 hours were considered, respectively, according to the possibility of making these medical hours available for the screening process.

The optimal solution presented by the model for the minimum number of hours needed to reduce the waiting list was 1400 hours * doctor for a time horizon of 52 weeks (Vieira et al., 2020Vieira, E., Gonçalves, B. S., Lima, R. M., & Dinis-Carvalho, J. (2020). Optimization model for waiting list management and service continuous improvement. In Proceedings of the 4th International Conference on Quality Engineering and Management. Braga: University of Minho.).

Several approaches were parameterized and tested with the model (e.g. regarding the level of intensity of the waiting list reduction and the time horizon for such reduction). These results were explored with the team and given the consensus that an effective screening can improve on the performance of the service, a doctor was allocated, temporarily, exclusively dedicated to the screening process. Thus, it was possible to reduce the screening process average waiting time to 7 days in just 12 weeks.

4.2. Waiting list for first medical appointment

4.2.1. Scenario 1: Before pandemic

Considering the information collected previously, in the analysis of the data and with health professionals, the optimization model was applied to the waiting list for first medical appointment with the same parameters defined for the screening waiting list. However, considering the characteristics of the waiting list and the medical appointment process, LI of 4835 patients and CT of 16.35 were defined. Although when scheduling appointments a 15-minute consultation time and cycle is defined, as observed in 2018, the CT performed is higher. Likewise, according to historical production data, HMAX is 11 hours and HMIN is 2 hours.

Since the amount of overtime that can be attributed has not been confirmed, departing from common assumption in previous studies is that health capacity could be acquired on a constant basis cost fee (Chen et al., 2020Chen, W., Zhang, Z. G., & Chen, X. (2020). On two-tier healthcare system under capacity constraint. International Journal of Production Research, 58(12), 3744-3764. http://dx.doi.org/10.1080/00207543.2019.1634846.
http://dx.doi.org/10.1080/00207543.2019....
), 8 hours for EHMAX and 0 for EHMIN were establish representing the equivalent of a full-time doctor dedicated to the first appointment process.

The scenario depicted in Figure 4 represents a consistent moderate reduction of the waiting list during the planning time horizon.

Figure 4
Optimal solution for the reduction of first appointment waiting list.

Although it may represent a soft imposition to the LMAX constraint, the fact is that the maximum capacity is required throughout the time horizon (normal day hours and overtime hours) which converts into a linear behaviour of the forecasted waiting list. During the planning period the average waiting time would be 44 days and by the end of the time horizon the waiting time would be near 20 days. This scenario would represent the optimal approach to solve the waiting list problem by meeting the constraints related to the maximum and minimum capacity allowed. This scenario would also allow a steady reduction of the waiting list facilitating resources utilization planning. Due to the pandemic hospital operational procedures changed and other scenarios were tested to depict several approaches for solving the waiting list problem during and after the pandemic.

4.2.2. Scenario 2: Current waiting list and demand

This scenario represents the same constraints and variables however to a LI of 1106 patients and D equal to 20 patients per day.

The optimal solution presented by the model that meets all restrictions is 2520 hours, as shown in Figure 5.

Figure 5
Optimal solution to the first appointment in the current context.

The proposed scenario imposes a steady waiting list reduction during 19 weeks and then stabilizes the LMAX in 400 patients which was found to be an accepted value regarding the consequent waiting time. As can be seen, there is no need for overtime hours and a pattern appears when the model enters the stabilized period which can also represent stabilized planning of resource needs. The average waiting time would be 16 days which would tend to stabilize in lower values as the model continues through the stabilized period. This scenario assumes that hospital operational procedures allow such patients in-flow.

4.2.3. Scenario 3: Better user experience

According to clinical criteria, although the fact that each doctor may decide what time is dedicated to each patient, there is a recommended consultation time. For the first orthopaedic appointment this time was set at 20 minutes. In this sense, this scenario was tested considering a CT equal to 20 minutes to promote a better user experience (by avoiding rush appointments). This scenario implements the same assumptions as the previous scenario with the only intent to understand the additional stress in resources utilization, meaning, the amount of hours * doctor needed to comply with the constraints. By increasing 22% the appointment CT the total number of hours * doctor needed increases 460 hours (including 13 overtime hours), according to the optimal solution presented in Figure 6.

Figure 6
Optimal solution to the first appointment considering the promotion of a better user experience.

Due to the high flexibility of the model, it is possible to parameterize and test successive scenarios. So, to avoid the use of overtime hours that are much more expensive to the hospital, a more soft and gradual waiting list reduction was imposed during the first 36 weeks (Figure 7). The behaviour of the forecasted waiting list is identical to the previous test but without using any overtime hours, however promoting an increase in the average waiting time to 19 days.

Figure 7
Optimal solution to the first appointment considering a more soft and gradual waiting list reduction.

4.2.4. Scenario 4: Seasonal planning

The hospital funds are assigned by the regulatory health institutions that occasionally charge the hospital with additional funds to promote hospital service improvement. The seasonal planning scenario intents to replicate the real scenarios in which additional funding is assigned to hospital so it can impose waiting list reduction. In this scenario a demonstration is made regarding two seasonal extra funding, as shown in the Figure 8 that also presents the solution presented by the model.

Figure 8
Optimal solution for a seasonal planning.

By parameterizing a relaxation on the LMAX constraint the waiting list is allowed to increase as the minimum number of hours * doctor is used. Then, in two different periods in the time horizon a heavy reduction on the waiting list is imposed coincidental to the extra budget availability.

This allows the hospital to hire overtime hours and perform the waiting list decrease. This type of operational approach is very common in public health hospitals. This scenario presents and average waiting time of 176 days.

5. Discussion

In each scenario the number of hours * doctor (ordinary and extra) represents the minimum number of hours to allow the fulfilment of all constraints. The number of hours * doctor represents the production intensity needed to comply with the model parameterization demand. The expected behaviour of the waiting list (number and time) directly relies on the number of hours * doctor that the model computes. The waiting list waiting times are a function that depends on the number of consultations performed given a predefined cycle-time and a number of hours * doctor. As more consultations are performed the waiting list waiting times are reduced. So, increasing or decreasing the number of hours * doctor will have a decisive impact on the waiting list (number of patients waiting) and consequently on the waiting times (time that patients wait in the waiting list).

The optimization model proves to be an adequate tool for dealing with the waiting list reduction problem by generating optimal solutions for the desired scenarios.

In scenario 1 and 2 a smooth waiting list reduction was imposed to gradually achieve better response times. Scenario 3 tests the possibility of increasing the consults time so that it can be translated into higher patient satisfaction and general better experience. The results show that it can be achieved at the expense of more hours needed although no extra hours are needed. Scenario 4 explores the common approach of seasonal extra funding allowing for seasonal heavy waiting list reduction by applying extra hours.

Considering the budget restrictions and usual limitations of extra specialized resources, the tested scenarios did not consider the complete eliminate of the waiting list, and instead defined acceptable levels of waiting list (and consequent waiting time). The objective is to define the minimum number of resources’ capacity that allow an acceptable system behavior that complies with all health regulators guidelines.

The model flexibility allows to test several other scenarios that the hospital management considers appropriate. In fact, the model has a buil-in feature that allows the managers to manually control the model parameters and decision variables so that they have maximum control over the model behavior. This is especially important when trying to replicate a custom real scenario. The built-in feature throws alerts when a model constraint is violated and identifies the values that are causing the problem. By doing so, the model guides the manager to obtain a feasible solution for the custom problem.

The optimization model can simulate several real-case scenarios which endow the hospital management with a powerful analysis tool for decision making. The model was tested and validated in the orthopaedics speciality however it can be used by any other medical speciality. In fact, the proposed approach may be systematized and spread to all medical specialities (Figure 9).

Figure 9
Problem-solving systematization approach diagram.

The first step is the data gathering and information processing. This means that is mandatory to collect all the important data regarding the system parameterization and then process it into useful information. Next the optimization model must be feed with the processed information that characterizes the system. When all information is introduced in the model several scenarios should be simulated according to the organizational guidelines. After scenarios generation the managers should analyze the results and decide on about the actions to apply. After applying the actions, the system status monitoring phase takes place in which the progress of the actions is monitored. Periodic management meeting should analyse the system status and decide whether actions are resulting as planned or if extra actions are needed. If no more actions are needed, then the system status monitoring phase should again be the focus. However, if more actions are needed, then the new information must be processed and feed to the optimization model, reinitiating the systematization approach for waiting list problem solving.

6. Concluding remarks

Continuously better health systems is what countries try to deliver to its citizens. However, heavy budget constraints limit the availability of resources needed to provide the health systems. Hospitals have to operate under contexts of budget limitations and high demand patterns. Moreover, more than higher demand, hospitals have to deal with higher patients’ expectations regarding service quality.

The proposed model is capable of defining the needed capacity in terms of hours * doctor to meet imposed requirements in terms of waiting list levels. It can also differentiate between normal working hours and overtime hours. The model can represent real scenarios and deliver OSs. It also allows the manual control of the model throwing alerts if constraints are not met so guiding the user to achieve a feasible solution.

The model was developed in excel and uses a freeware solver which means that public institutions do not need to invest extra budget as long as they have access to excel software. This enhances the systematization approach proposed. The model may be applied to any hospital specialty and become powerful decision-making support tool.

Acknowledgements

The authors would like to thank the hospital administration and health professionals that collaborated with the research team during this work.

  • How to cite this article: Gonçalves, B. S., Vieira, E., Lima, R. M., & Dinis-Carvalho, J. (2022). A systematized approach for reduction of medical appointment waiting list. Production, 32, e20210137. https://doi.org/10.1590/0103-6513.20210137.
  • This work was supported by projects UIDB/00319/2020 and POCI-01-0145-FEDER-030299, from Fundação para a Ciência e Tecnologia (FCT), Portugal.

References

  • Al-Hakim, L. (2006). Web-based hospital information system for managing operating theatre waiting list. International Journal of Healthcare Technology and Management, 7(3-4), 266-282. http://dx.doi.org/10.1504/IJHTM.2006.008436
    » http://dx.doi.org/10.1504/IJHTM.2006.008436
  • Almomani, I., & AlSarheed, A. (2016). Enhancing outpatient clinics management software by reducing patients’ waiting time. Journal of Infection and Public Health, 9(6), 734-743. http://dx.doi.org/10.1016/j.jiph.2016.09.005 PMid:27663518.
    » http://dx.doi.org/10.1016/j.jiph.2016.09.005
  • Barros, P. P., Machado, S. R., & Jorge de Almeida, S. (2011). Portugal: health system review Geneva: World Health Organization, Regional Office for Europe.
  • Bowerman, J., Lodge, A., & Bamford, D. (2007). Health Service Improvement through Diagnostic Waiting List Management. Leadership in Health Services, 20(4), 254-265. http://dx.doi.org/10.1108/17511870710829364
    » http://dx.doi.org/10.1108/17511870710829364
  • Bowers, J. A. (2011). Simulating waiting list management. Health Care Management Science, 14(3), 292-298. http://dx.doi.org/10.1007/s10729-011-9171-x PMid:21695520.
    » http://dx.doi.org/10.1007/s10729-011-9171-x
  • Briggs, R. J., Smith, K. M., Dejager, E. M., Callahan, J. T., Abernethy, J. A., Dunn, E. J., & Hunter-Smith, D. J. (2011). The active management of surgical waiting lists: a urological surgery case study. Australian Health Review, 35(4), 399-403. http://dx.doi.org/10.1071/AH10923 PMid:22126940.
    » http://dx.doi.org/10.1071/AH10923
  • Chen, P.-S., & Juan, K.-L. (2013). Applying simulation optimization for solving a collaborative patient-referring mechanism problem. Journal of Industrial and Production Engineering, 30(6), 405-413. http://dx.doi.org/10.1080/21681015.2013.849766
    » http://dx.doi.org/10.1080/21681015.2013.849766
  • Chen, W., Zhang, Z. G., & Chen, X. (2020). On two-tier healthcare system under capacity constraint. International Journal of Production Research, 58(12), 3744-3764. http://dx.doi.org/10.1080/00207543.2019.1634846
    » http://dx.doi.org/10.1080/00207543.2019.1634846
  • Chen, Z., King, W., Pearcey, R., Kerba, M., & Mackillop, W. J. (2008). The relationship between waiting time for radiotherapy and clinical outcomes: a systematic review of the literature. Radiotherapy and Oncology: Journal of the European Society for Therapeutic Radiology and Oncology, 87(1), 3-16. http://dx.doi.org/10.1016/j.radonc.2007.11.016
    » http://dx.doi.org/10.1016/j.radonc.2007.11.016
  • Cipriano, L. E., Chesworth, B. M., Anderson, C. K., & Zaric, G. S. (2008). An evaluation of strategies to reduce waiting times for total joint replacement in Ontario. Medical Care, 46(11), 1177-1183. http://dx.doi.org/10.1097/MLR.0b013e31817925e8 PMid:18953229.
    » http://dx.doi.org/10.1097/MLR.0b013e31817925e8
  • Comans, T. A., Chang, A. T., Standfield, L., Knowles, D., O’Leary, S., & Raymer, M. (2017). The development and practical application of a simulation model to inform musculoskeletal service delivery in an australian Public Health Service. Operations Research for Health Care, 15, 13-18. http://dx.doi.org/10.1016/j.orhc.2017.07.002
    » http://dx.doi.org/10.1016/j.orhc.2017.07.002
  • Comas, M., Castells, X., Hoffmeister, L., Román, R., Cots, F., Mar, J., Gutiérrez-Moreno, S., & Espallargues, M. (2008). Discrete-event simulation applied to analysis of waiting lists. evaluation of a prioritization system for cataract surgery. Value in Health, 11(7), 1203-1213. http://dx.doi.org/10.1111/j.1524-4733.2008.00322.x PMid:18494754.
    » http://dx.doi.org/10.1111/j.1524-4733.2008.00322.x
  • Costa, L. B. M., & Godinho Filho, M. (2016). Lean healthcare: review, classification and analysis of literature. Production Planning and Control, 27(10), 823-836. http://dx.doi.org/10.1080/09537287.2016.1143131
    » http://dx.doi.org/10.1080/09537287.2016.1143131
  • Dichter, J. R., Kanter, R. K., Dries, D., Luyckx, V., Lim, M. L., Wilgis, J., Anderson, M. R., Sarani, B., Hupert, N., Mutter, R., Devereaux, A. V., Christian, M. D., & Kissoon, N. (2014). System-level planning, coordination, and communication: care of the critically Ill and injured during pandemics and disasters: CHEST consensus statement. Chest, 146(4, Suppl.), e87S-e102S. http://dx.doi.org/10.1378/chest.14-0738 PMid:25144713.
    » http://dx.doi.org/10.1378/chest.14-0738
  • Dinis-Carvalho, J., Vieira, E., Lima, R. M., & Gonçalves, B. S. (2022). Reducing waiting time for orthopaedic consultation through a continuous improvement approach. In J. Machado, F. Soares, J. Trojanowska & V. Ivanov (Eds.), Innovations in industrial engineering (Lecture Notes in Mechanical Engineering). Cham: Springer. http://dx.doi.org/10.1007/978-3-030-78170-5_40
    » http://dx.doi.org/10.1007/978-3-030-78170-5_40
  • Elkhuizen, S. G., Das, S. F., Bakker, P. J. M., & Hontelez, J A M. (2007). Using computer simulation to reduce access time for outpatient departments. Quality & Safety in Health Care, 16(5), 382-386. http://dx.doi.org/10.1136/qshc.2006.021568 PMid:17913781.
    » http://dx.doi.org/10.1136/qshc.2006.021568
  • Elwyn, G. J., Williams, L. A., Barry, S., & Kinnersley, P. (1996). Waiting list management in general practice: a review of orthopaedic patients. British Medical Journal, 312(7035), 887-888. http://dx.doi.org/10.1136/bmj.312.7035.887 PMid:8611882.
    » http://dx.doi.org/10.1136/bmj.312.7035.887
  • Escobar, A., Quintana, J. M., González, M., Bilbao, A., & Ibañez, B. (2009). Waiting list management: priority criteria or first-in first-out? A case for total joint replacement. Journal of Evaluation in Clinical Practice, 15(4), 595-601. http://dx.doi.org/10.1111/j.1365-2753.2008.01056.x PMid:19674214.
    » http://dx.doi.org/10.1111/j.1365-2753.2008.01056.x
  • Fournier, P.-L., Jobin, M.-H., Lapointe, L., & Bahl, L. (2021). Lean implementation in healthcare: offsetting physicians’ resistance to change. Production Planning and Control, 1-13. http://dx.doi.org/10.1080/09537287.2021.1938730
    » http://dx.doi.org/10.1080/09537287.2021.1938730
  • Frost, C. E. B. (1980). How permanent are NHS waiting lists? Social Science & Medicine. Part C, Medical Economics, 14(1), 1-11. http://dx.doi.org/10.1016/0160-7995(80)90003-9 PMid:7444482.
    » http://dx.doi.org/10.1016/0160-7995(80)90003-9
  • Geng, N., Chen, L., Liu, R., & Zhu, Y. (2017). Optimal patient assignment for W queueing network in a diagnostic facility setting. International Journal of Production Research, 55(19), 5609-5631. http://dx.doi.org/10.1080/00207543.2017.1324650
    » http://dx.doi.org/10.1080/00207543.2017.1324650
  • Green, L. (2005). Capacity planning and management in hospitals. In M. L. Brandeau, F. Sainfort & W. P. Pierskalla (Eds.), Operations research and health care a handbook of methods and applications (Vol. 70, pp. 15-41). Boston: Springer. http://dx.doi.org/10.1007/1-4020-8066-2_2
    » http://dx.doi.org/10.1007/1-4020-8066-2_2
  • Keskinocak, P., & Savva, N. (2019). A review of the healthcare-management (modeling) literature published in manufacturing & service operations management. Manufacturing & Service Operations Management, 22 http://dx.doi.org/10.1287/msom.2019.0817.
    » https://doi.org/10.1287/msom.2019.0817
  • Leite, H., Bateman, N., & Radnor, Z. (2020). Beyond the ostensible: an exploration of barriers to lean implementation and sustainability in healthcare. Production Planning and Control, 31(1), 1-18. http://dx.doi.org/10.1080/09537287.2019.1623426
    » http://dx.doi.org/10.1080/09537287.2019.1623426
  • Lima, R. M., Dinis-Carvalho, J., Souza, T. A., Vieira, E., & Gonçalves, B. (2021). Implementation of lean in health care environments: an update of systematic reviews. International Journal of Lean Six Sigma, 12(2), 399-431. http://dx.doi.org/10.1108/IJLSS-07-2019-0074
    » http://dx.doi.org/10.1108/IJLSS-07-2019-0074
  • Lin, C. K. Y. (2015). An adaptive scheduling heuristic with memory for the block appointment system of an outpatient specialty clinic. International Journal of Production Research, 53(24), 7488-7516. http://dx.doi.org/10.1080/00207543.2015.1084060
    » http://dx.doi.org/10.1080/00207543.2015.1084060
  • Mandahawi, N., Shurrab, M., Al-Shihabi, S., Abdallah, A. A., & Alfarah, Y. M. (2017). Utilizing six sigma to improve the processing time: a simulation study at an emergency department. Journal of Industrial and Production Engineering, 34(7), 495-503. http://dx.doi.org/10.1080/21681015.2017.1367728
    » http://dx.doi.org/10.1080/21681015.2017.1367728
  • Mangan, J. L., Walsh, C., Kernohan, W. G., Murphy, J. S., Mollan, R. A., McMillen, R., & Beverland, D. E. (1992). Total joint replacement: implication of cancelled operations for hospital costs and waiting list management. Quality in Health Care, 1(1), 34-37. http://dx.doi.org/10.1136/qshc.1.1.34 PMid:10136828.
    » http://dx.doi.org/10.1136/qshc.1.1.34
  • Miao, R., Zhang, H., Wu, Q., Zhang, J., & Jiang, Z. (2020). Using structural equation modeling to analyze patient value, satisfaction, and loyalty: a case study of healthcare in China. International Journal of Production Research, 58(2), 577-596. http://dx.doi.org/10.1080/00207543.2019.1598595
    » http://dx.doi.org/10.1080/00207543.2019.1598595
  • Neby, S., Lægreid, P., Mattei, P., & Feiler, T. (2015). Bending the rules to play the game: accountability, DRG and waiting list scandals in Norway and Germany. European Policy Analysis, 1(1), 127-148. http://dx.doi.org/10.18278/epa.1.1.9
    » http://dx.doi.org/10.18278/epa.1.1.9
  • Priyan, S. (2017). Operations research in healthcare: a review. Juniper Online Journal of Public Health, 1(3), 1-12.
  • Raymond, M.-H., Demers, L., & Feldman, D. E. (2016). Waiting list management practices for home-care occupational therapy in the Province of Quebec, Canada. Health & Social Care in the Community, 24(2), 154-164. http://dx.doi.org/10.1111/hsc.12195 PMid:25684435.
    » http://dx.doi.org/10.1111/hsc.12195
  • Rother, M. (2010). Toyota Kata: managing people for improvement, adaptiveness and superior results. New York: McGraw-Hill Education.
  • Siciliani, L., Moran, V., & Borowitz, M. (2014). Measuring and comparing health care waiting times in OECD countries. Health Policy, 118(3), 292-303. http://dx.doi.org/10.1016/j.healthpol.2014.08.011 PMid:25217838.
    » http://dx.doi.org/10.1016/j.healthpol.2014.08.011
  • Simunovic, N., Devereaux, P. J., Sprague, S., Guyatt, G. H., Schemitsch, E., DeBeer, J., & Bhandari, M. (2010). Effect of early surgery after hip fracture on mortality and complications: systematic review and meta-analysis. Canadian Medical Association Journal, 182(15), 1609-1616. http://dx.doi.org/10.1503/cmaj.092220
    » http://dx.doi.org/10.1503/cmaj.092220
  • Smith, D. H., & Hadorn, D. C. (2002). Lining up for children’s mental health services: a tool for prioritizing waiting lists. Journal of the American Academy of Child and Adolescent Psychiatry, 41(4), 367-376. http://dx.doi.org/10.1097/00004583-200204000-00007 PMid:11931592.
    » http://dx.doi.org/10.1097/00004583-200204000-00007
  • Spratt, B., & Kozan, E. (2016). Waiting list management through master surgical schedules: a case study. Operations Research for Health Care, 10, 49-64. http://dx.doi.org/10.1016/j.orhc.2016.07.002
    » http://dx.doi.org/10.1016/j.orhc.2016.07.002
  • Tatham, M., Stringer, H., Perera, S., & Waller, G. (2012). Do you still want to be seen? The pros and cons of active waiting list management. International Journal of Eating Disorders, 45(1), 57-62. http://dx.doi.org/10.1002/eat.20920 PMid:21321990.
    » http://dx.doi.org/10.1002/eat.20920
  • Testi, A., Tanfani, E., & Torre, G. (2007). A three-phase approach for operating theatre schedules. Health Care Management Science, 10(2), 163-172. http://dx.doi.org/10.1007/s10729-007-9011-1 PMid:17608057.
    » http://dx.doi.org/10.1007/s10729-007-9011-1
  • van Bussel, E. M., van der Voort, M. B. V. R., Wessel, R. N., & van Merode, G. G. (2018). Demand, capacity, and access of the outpatient clinic: a framework for analysis and improvement. Journal of Evaluation in Clinical Practice, 24(3), 561-569. http://dx.doi.org/10.1111/jep.12926 PMid:29665314.
    » http://dx.doi.org/10.1111/jep.12926
  • Vieira, E., Gonçalves, B. S., Lima, R. M., & Dinis-Carvalho, J. (2020). Optimization model for waiting list management and service continuous improvement. In Proceedings of the 4th International Conference on Quality Engineering and Management. Braga: University of Minho.
  • Visintin, F., Cappanera, P., Banditori, C., & Danese, P. (2017). Development and implementation of an operating room scheduling tool: an action research study. Production Planning and Control, 28(9), 758-775. http://dx.doi.org/10.1080/09537287.2017.1310328
    » http://dx.doi.org/10.1080/09537287.2017.1310328
  • Vissers, J. M. H., van Der Bij, J. D., & Kusters, R. J. (2001). Towards decision support for waiting lists: an operations management view. Health Care Management Science, 4(2), 133-142. http://dx.doi.org/10.1023/A:1011409711828 PMid:11393742.
    » http://dx.doi.org/10.1023/A:1011409711828
  • Woodhouse, A. E. (2006). Reducing waiting times: using an opt-in system and changing prioritisation criteria. Child and Adolescent Mental Health, 11(2), 94-97. http://dx.doi.org/10.1111/j.1475-3588.2005.00372.x PMid:32811089.
    » http://dx.doi.org/10.1111/j.1475-3588.2005.00372.x
  • Worthington, D. (1991). Hospital waiting list management models. The Journal of the Operational Research Society, 42(10), 833-843. http://dx.doi.org/10.1057/jors.1991.164
    » http://dx.doi.org/10.1057/jors.1991.164
  • Yu, J.-Y., Huang, K.-L., Sun, W.-Z., & Ma, M. H.-M. (2020). The study of guarding and cruising modes of ambulances for emergency medical service. Journal of Industrial and Production Engineering, 37(8), 440-450. http://dx.doi.org/10.1080/21681015.2020.1840449
    » http://dx.doi.org/10.1080/21681015.2020.1840449

Publication Dates

  • Publication in this collection
    15 Aug 2022
  • Date of issue
    2022

History

  • Received
    19 Nov 2021
  • Accepted
    18 July 2022
Associação Brasileira de Engenharia de Produção Av. Prof. Almeida Prado, Travessa 2, 128 - 2º andar - Room 231, 05508-900 São Paulo - SP - São Paulo - SP - Brazil
E-mail: production@editoracubo.com.br