Acessibilidade / Reportar erro

Clinical decision support systems for diabetic foot ulcers: a scoping review

Sistemas de apoyo a decisiones clínicas para las úlceras del pie diabético: una revisión de alcance

ABSTRACT

Objective:

Map the scientific evidence on the use of clinical decision support systems in diabetic foot care.

Method:

A scoping review based on the JBI Manual for Evidence Synthesis and registered on the Open Science Framework platform. Searches were carried out in primary and secondary sources on prototypes and computerized tools aimed at assisting patients with diabetic foot or at risk of having it, published in any language or period, in eleven databases and grey literature.

Results:

A total of 710 studies were identified and, following the eligibility criteria, 23 were selected, which portrayed the use of decision support systems in diabetic foot screening, predicting the risk of ulcers and amputations, classifying the stage of severity, deciding on the treatment plan, and evaluating the effectiveness of interventions, by processing data relating to clinical and sociodemographic information.

Conclusion:

Expert systems stand out for their satisfactory results, with high precision and sensitivity when it comes to guiding and qualifying the decision-making process in diabetic foot prevention and care.

DESCRIPTORS
Diabetes Mellitus; Diabetic Foot; Decision Support Systems; Clinical; Review

RESUMEN

Objetivo:

Mapeo de la evidencia científica sobre el uso de sistemas de apoyo a la toma de decisiones clínicas en el cuidado del pie diabético.

Método:

Revisión de alcance basada en el Manual de Síntesis de la Evidencia del JBI y registrada en la plataforma Open Science Framework. Se realizaron búsquedas en fuentes primarias y secundarias sobre prototipos y herramientas informatizadas dirigidas a la asistencia de pacientes con pie diabético o en riesgo de padecerlo, publicadas en cualquier idioma o periodo, en once bases de datos y literatura gris.

Resultados:

Se identificaron 710 estudios y, tras cumplir los criterios de elegibilidad, se seleccionaron 23, que retrataban el uso de sistemas de apoyo a la toma de decisiones en el diagnóstico del pie diabético, la predicción del riesgo de úlceras y amputaciones, la clasificación del estadio de gravedad, la decisión sobre el plan de tratamiento y la evaluación de la eficacia de las intervenciones, mediante el procesamiento de datos relativos a la información clínica y sociodemográfica.

Conclusión:

Los sistemas expertos destacan por sus resultados satisfactorios, con gran precisión y sensibilidad a la hora de orientar y cualificar el proceso de toma de decisiones en la prevención y el cuidado del pie diabético.

DESCRIPTORES
Diabetes Mellitus; Pie Diabético; Sistemas de Apoyo a Decisiones Clínicas; Revisión

RESUMO

Objetivo:

Mapear as evidências científicas sobre uso de Sistemas de Apoio à Decisão Clínica no pé diabético.

Método:

Revisão de escopo fundamentada no JBI Manual for Evidence Synthesis e registrada na plataforma Open Science Framework. Realizaram-se buscas, em fontes primárias e secundárias, sobre protótipos e ferramentas informatizadas direcionadas à assistência ao paciente com pé diabético ou em risco de tê-lo, publicados em qualquer idioma ou período, em onze bases de dados e literatura cinza.

Resultados:

Foram identificados 710 estudos e, após critérios de elegibilidade, foram selecionados 23 que retratam o uso de sistemas de apoio à decisão no rastreio do pé diabético, predição do risco de úlceras e amputações, classificação do estágio de gravidade, decisão quanto ao plano de tratamento e avaliação da efetividade das intervenções, por meio do processamento de dados referentes a informações clínicas e sociodemográficas.

Conclusão:

Os sistemas especialistas destacam-se por resultados satisfatórios, com alta precisão e sensibilidade no que tange à orientação e qualificação do processo de tomada de decisão na prevenção e no cuidado ao pé diabético.

DESCRITORES
Diabetes Mellitus; Pé Diabético; Sistemas de Apoio a Decisões Clínicas; Revisão

INTRODUCTION

Diabetic foot ulcers are a late complication of diabetes mellitus (DM) and are significantly associated with morbidity, hospitalization and mortality (11. Reardon R, Simring D, Kim B, Mortensen J, Williams D, Leslie A. The diabetic foot ulcer. Aust J Gen Pract. 2020;49(5):250–5. doi: http://dx.doi.org/10.31128/AJGP-11-19-5161. PubMed PMID: 32416652.
https://doi.org/10.31128/AJGP-11-19-5161...
). It is estimated that the lifetime incidence of developing this complication is between 19% and 34%, and recurrence rates vary between 40% within one year of healing and 65% within five years(22. Armstrong DG, Boulton AJM, Bus SA. Diabetic foot ulcers and their recurrence. N Engl J Med. 2017;376(24):2367–75. doi: http://dx.doi.org/10.1056/NEJMra1615439. PubMed PMID: 28614678.
https://doi.org/10.1056/NEJMra1615439...
).

The event in question is costly to health systems worldwide, given its association with outcomes such as amputation, death, and loss of years of productivity, as well as the complexity of the treatment(33. Schoen DE, Glance DG, Thompson SC. Clinical decision support software for diabetic foot risk stratification: development and formative evaluation. J Foot Ankle Res. 2015;8(1):73. doi: http://dx.doi.org/10.1186/s13047-015-0128-z. PubMed PMID: 26692903.
https://doi.org/10.1186/s13047-015-0128-...
). In Brazil, it is estimated that the annual medical costs of diabetic foot disease are R$586.1 million, 87% of which is spent on outpatient care and 13% on hospitalization. Of this amount, R$498.4 million is spent on treating patients with ulcerated neuro-ischemic feet(44. Toscano CM, Sugita TH, Rosa MQM, Pedrosa HC, Rosa R, Bahia LR. Annual direct medical costs of diabetic foot disease in Brazil: a cost of illness study. Int J Environ Res Public Health. 2018;15(1):89. doi: http://dx.doi.org/10.3390/ijerph15010089. PubMed PMID: 29316689.
https://doi.org/10.3390/ijerph15010089...
).

Faced with this problem, clinical guidelines and DM manuals recommend screening for the risk of diabetic foot ulceration, as well as providing flows and protocols for managing the complication. However, they vary substantially in terms of the evidence and variables used to support the recommendations, culminating in great variation in clinical signs, tests, and implementation of interventions in an intuitive way and without standardization(55. Crawford F, Bekker HL, Jovem M, Sheikh A. General practitioners’ and nurses’ experiences of using computerised decision support in screening for diabetic foot disease: implementing Scottish Clinical Information - Diabetes Care in routine clinical practice. J Inovation Health Inf. 2010;18(4):259–68. doi: http://dx.doi.org/10.14236/jhi.v18i4.781.
https://doi.org/10.14236/jhi.v18i4.781...
).

Decision support systems (DSS), also known as expert systems, are a valuable tool for qualifying the evidence base in clinical decision-making, as they enable the integration of different techniques and approaches to information management, providing simplified risk assessment and recommendation of specific interventions with high prognostic value, based on individual characteristics and scientific evidence(66. Schaarup C, Pape-Haugaard L, Jensen MH, Laursen AC, Bermark S, Hejlesen OK. Probing community nurses’ professional basis: a situational case study in diabetic foot ulcer treatment. Br J Community Nurs. 2017;22(Suppl 3):S46–52. doi: http://dx.doi.org/10.12968/bjcn.2017.22.Sup3.S46.
https://doi.org/10.12968/bjcn.2017.22.Su...
,77. Casal-Guisande M, Cerqueiro-Pequeño J, Comesaña-Campos A, Bouza-Rodríguez JB. Proposal of a methodology based on expert systems for the treatment of diabetic foot condition. TEEM’20. 2020;(21):491–6. doi: http://dx.doi.org/10.1145/3434780.3436625.
https://doi.org/10.1145/3434780.3436625...
).

Based on the evidence presented, DSS are useful for predicting diabetic foot risk, as well as for guiding, qualifying, and standardizing decision-making, with a view to preventing outcomes such as amputations and death(88. Lee JH, Staley J, Robinson R. Models used in clinical decision support systems supporting healthcare professionals treating chronic wounds: systematic literature review. JMIR Diabetes. 2018;3(2):e11. doi: http://dx.doi.org/10.2196/diabetes.8316. PubMed PMID: 30291078.
https://doi.org/10.2196/diabetes.8316...
,99. Bender C, Cichosz SL, Malovini A, Bellazzi R, Pape-Haugaard L, Hejlesen O. Using case-based reasoning in a learning system: a prototype of a pedagogical nurse tool for evidence-based diabetic foot ulcer care. J Diabetes Sci Technol. 2021;16(2):454–9. doi: http://dx.doi.org/10.1177/1932296821991127. PubMed PMID: 33583205.
https://doi.org/10.1177/1932296821991127...
). In a preliminary search, a systematic review identified clinical decision support models aimed at different types of chronic wounds, while the only study that addressed a support model for the management of diabetic foot lesions used resources proposed by specialists and based on clinical studies(1010. Schaarup C, Pape-Haugaard LB, Hejlesen OK. Models used in clinical decision support systems supporting healthcare professionals treating chronic wounds: systematic literature review. JMIR Diabetes. 2018;3(2):e11. doi: http://dx.doi.org/10.2196/diabetes.8316. PubMed PMID: 30291078.
https://doi.org/10.2196/diabetes.8316...
).

However, no mapping reviews were found that specifically address the use of DSS in the treatment of diabetic foot ulcers or people at imminent risk of ulceration. This gap motivates the investigation and updating of knowledge on the subject, with the aim of providing support for health professionals, researchers, and decision-makers. In light of this, the present study aims to map the evidence on the use of clinical decision support systems in diabetic foot care.

METHOD

Study Design

This is a scoping review, based on the JBI Manual for Evidence Synthesis(1111. Peters MDJ, Godfrey C, McInerney P, Munn Z, Tricco AC, Khalil H. Chapter 11: Scoping reviews (2020 version). In: Aromataris E, Munn Z, editors. JBI Manual for Evidence Synthesis. Australia: JBI; 2020. doi: http://dx.doi.org/10.46658/JBIMES-20-12.
https://doi.org/10.46658/JBIMES-20-12...
) and the reporting recommendations of the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) checklist(1212. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi: http://dx.doi.org/10.1136/bmj.n71. PubMed PMID: 33782057.
https://doi.org/10.1136/bmj.n71...
). The final protocol was registered on the Open Science Framework (OSF) platform on May 17, 2022, with DOI identification 10.17605/OSF.IO/UWTH6.

The study was conducted in five stages: 1) identification of the research question; 2) survey of relevant studies; 3) selection of studies according to pre-established criteria; 4) categorization of data; and 5) presentation of results.

Research Questions

The Population, Concept, and Context (PCC) strategy was used to construct the research question. The participants (P) in this review were people diagnosed with DM, the concept (C) addressed was the clinical decision support system, and the context (C) was people with diabetic foot or imminent risk. Thus, the following main guiding question was formulated:

– What is the scientific evidence on the use of DSS in the health care of people with diabetic feet or at risk of having them?

Secondary questions were:

– What do DSS for diabetic foot generally address?

– How can DSS for diabetic foot be categorized?

– What are the main advances and gaps in research on DSS for diabetic foot?

Eligibility Criteria

Studies that presented some prototype or functional computerized tool, applicable or applied to the care of patients at risk or with diabetic foot, published in any language or period, were included. As for the type of study, observational and experimental, quantitative and/or qualitative studies with primary or secondary data were chosen. Letters to the editor, abstracts, and studies in the design phase were excluded, as they do not provide concise results on DSS in clinical practice.

Search Strategy

The search strategy was built using the Health Sciences Descriptors (DeCS) and Medical Subject Headings (MeSH) databases, together with Boolean operators AND and OR, as shown in Chart 1(1313. Araújo WCO. Recuperação da informação em saúde: construção, modelos e estratégias. Convergências em Ciência da Informação. 2020;3(2):100–34. doi: http://dx.doi.org/10.33467/conci.v3i2.13447.
https://doi.org/10.33467/conci.v3i2.1344...
).

Chart 1
Search strategy – Fortaleza, CE, Brazil, 2022.

The search took place on October 23, 2022, in the following databases: Scientific Electronic Library Online (SciELO), Medical Literature Analysis and Retrieval System Online (MEDLINE), PubMed, Scopus, Web of Science, ScienceDirect, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Latin American and Caribbean Health Sciences Literature (LILACS), Cochrane Library, and Embase. Gray literature was retrieved from the Brazilian Digital Library of Theses and Dissertations (BDTD), the Catalogue of Theses and Dissertations (CTD) of the Coordination for the Improvement of Higher Education Personnel (CAPES), and the Open Access Theses and Dissertations (OATD).

Selection of Studies

The results obtained from the databases were imported into the Rayyan®(1414. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan: a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. doi: http://dx.doi.org/10.1186/s13643-016-0384-4. PubMed PMID: 27919275.
https://doi.org/10.1186/s13643-016-0384-...
), reference manager, developed by the Qatar Computing Research Institute (QCRI). At this point, duplicates were removed, and the studies were independently selected and screened by two researchers, with any discrepancies being resolved with the participation of a third examiner with experience in the field.

After removing the duplicates, the articles were selected by reading their titles and abstracts based on the pre-established study criteria. The studies included in the first stage were then read in their entirety to check for permanence. Justification was given for the articles that were excluded. All the references of the included articles were checked for other potentially relevant studies. Finally, the identification and selection stages were documented using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses flowchart(1212. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi: http://dx.doi.org/10.1136/bmj.n71. PubMed PMID: 33782057.
https://doi.org/10.1136/bmj.n71...
).

Mapping and Data Analysis

A data extraction strategy was defined and adapted according to the JBI manual in order to select the following relevant information: 1) characterization: author, country, journal, theme, year, title, objectives, and type of study; 2) clinical applicability; 3) type of technology used; and 4) main results and limitations, which were organized in the form of tables with narrative content in Microsoft Excel®.

RESULTS

The search in the information sources resulted in 710 studies, of which 43 were excluded because they were duplicates, leaving 667 publications. Titles and abstracts were analyzed, and 632 were excluded by applying the eligibility criteria. As a result, 35 studies were fully analyzed and, of these, 23 met the primary and secondary questions of the study, as shown in Figure 1.

Figure 1
Search flowchart, according to the PRISMA-ScR recommendations – Fortaleza, CE, Brazil, 2022.

Chart 2 shows the characterization and summary of the articles mapped and included in this review. In terms of place of origin, the majority of the studies were carried out on the European continent (n = 10; 43.4%), followed by the Asian continent (n = 8; 34.7%), with three studies (n = 3; 13.0%) from the American continent, and two (n = 2; 8.6%) from Oceania.

Chart 2
Characterization and synthesis of the articles mapped – Fortaleza, CE, Brazil, 2022.

Regarding the journals and their topics of interest, we found journals related to the development of technologies and innovations in health (n = 7; 30.4%), medicine (n = 5; 21.7%), diabetes and the development of technologies aimed at the disease (n = 4; 17.3%), computer science and engineering (n = 2; 8.6%), and the repository of scientific events in technology (n = 4; 17.3%). One study remained, corresponding to the gray literature.

Eighteen studies (78.2%) were observational studies, nine of which were descriptive (39.1%), three cohort studies (13.0%), two case-control studies (8.6%), two cross-sectional studies (8.6%), one single-case study (4.3%), and one multiple-case study (4.3%). The remainder (n = 5; 21.7%) were methodological studies, concerning the construction of the DSS and its application.

In the field of diabetic foot, expert systems are involved in screening(99. Bender C, Cichosz SL, Malovini A, Bellazzi R, Pape-Haugaard L, Hejlesen O. Using case-based reasoning in a learning system: a prototype of a pedagogical nurse tool for evidence-based diabetic foot ulcer care. J Diabetes Sci Technol. 2021;16(2):454–9. doi: http://dx.doi.org/10.1177/1932296821991127. PubMed PMID: 33583205.
https://doi.org/10.1177/1932296821991127...
), predicting the risk of ulcers and amputations(33. Schoen DE, Glance DG, Thompson SC. Clinical decision support software for diabetic foot risk stratification: development and formative evaluation. J Foot Ankle Res. 2015;8(1):73. doi: http://dx.doi.org/10.1186/s13047-015-0128-z. PubMed PMID: 26692903.
https://doi.org/10.1186/s13047-015-0128-...
,55. Crawford F, Bekker HL, Jovem M, Sheikh A. General practitioners’ and nurses’ experiences of using computerised decision support in screening for diabetic foot disease: implementing Scottish Clinical Information - Diabetes Care in routine clinical practice. J Inovation Health Inf. 2010;18(4):259–68. doi: http://dx.doi.org/10.14236/jhi.v18i4.781.
https://doi.org/10.14236/jhi.v18i4.781...
,77. Casal-Guisande M, Cerqueiro-Pequeño J, Comesaña-Campos A, Bouza-Rodríguez JB. Proposal of a methodology based on expert systems for the treatment of diabetic foot condition. TEEM’20. 2020;(21):491–6. doi: http://dx.doi.org/10.1145/3434780.3436625.
https://doi.org/10.1145/3434780.3436625...
,1515. Chappell FM, Crawford F, Horne M, Leese GP, Martin A, Weller D, et al. Development and validation of a clinical prediction rule for development of diabetic foot ulceration: an analysis of data from five cohort studies. BMJ Open Diabetes Res Care. 2021;9(1):e002150. doi: http://dx.doi.org/10.1136/bmjdrc-2021-002150. PubMed PMID: 34035053.
https://doi.org/10.1136/bmjdrc-2021-0021...
,1616. Crawford F, Bekker HL, Jovem M, Sheikh A. General practitioners’ and nurses’ experiences of using computerised decision support in screening for diabetic foot disease: implementing Scottish Clinical Information - Diabetes Care in routine clinical practice. J Inovation Health Inf. 2010;18(4):259–68. doi: http://dx.doi.org/10.14236/jhi.v18i4.781.
https://doi.org/10.14236/jhi.v18i4.781...
,1818. Cruz-Vega I, Peregrina-Barreto H, Rangel-Magdaleno JJ, Ramires-Cortes MJ. A comparison of intelligent classifiers of thermal patterns in diabetic foot. In: 2019 IEEE International Instrumentation and Measurement Technology Conference (I2MTC); 2019; Auckland, New Zealand. USA: IEEE; 2019. p. 1–6. doi: http://dx.doi.org/10.1109/I2MTC.2019.8827044
https://doi.org/10.1109/I2MTC.2019.88270...
,2121. Das SK, Roy P, Mishra AK. Fusion of handcrafted and deep convolutional neural network features for effective identification of diabetic foot ulcer. Concurr Comput. 2022;34(5):e6690. doi: http://dx.doi.org/10.1002/cpe.6690.
https://doi.org/10.1002/cpe.6690...
2424. Ferreira ACBH, Ferreira DD, Oliveira HC, Resende ICD, Anjos A, Lopes MHBDM. Competitive neural layer-based method to identify people with high risk for diabetic foot. Comput Biol Med. 2020;120:103744. doi: http://dx.doi.org/10.1016/j.compbiomed.2020.103744. PubMed PMID: 32421649.
https://doi.org/10.1016/j.compbiomed.202...
,3030. Nguyen G, Agu E, Tulu B, Strong D, Mombini H, Pedersen P, et al. Machine learning models for synthesizing actionable care decisions on lower extremity wounds. Smart Health. 2020;18:100139. doi: http://dx.doi.org/10.1016/j.smhl.2020.100139.
https://doi.org/10.1016/j.smhl.2020.1001...
3434. Wijesinghe I, Gamage C, Perera I, Chitranjan C. A smart telemedicine system with deep learning to manage diabetic retinopathy and foot ulcers. In 2019 Moratuwa Engineering Research Conference (MERCon); 2019; Moratuwa, Sri Lanka. USA: IEEE; 2019. p. 686–91. doi: http://dx.doi.org/10.1109/MERCon.2019.8818682.
https://doi.org/10.1109/MERCon.2019.8818...
), diagnosis(2121. Das SK, Roy P, Mishra AK. Fusion of handcrafted and deep convolutional neural network features for effective identification of diabetic foot ulcer. Concurr Comput. 2022;34(5):e6690. doi: http://dx.doi.org/10.1002/cpe.6690.
https://doi.org/10.1002/cpe.6690...
,2323. Farzi S, Kianian S, Rastkhadive I. Predicting serious diabetic complications using hidden pattern detection. In: 2017 IEEE 4th International Conference on Knowledge-Based Engineering and Innovation (KBEI); 2017; Tehran, Iran. USA: IEEE; 2018. p. 0063–8. doi: http://dx.doi.org/10.1109/KBEI.2017.8324885.
https://doi.org/10.1109/KBEI.2017.832488...
,2424. Ferreira ACBH, Ferreira DD, Oliveira HC, Resende ICD, Anjos A, Lopes MHBDM. Competitive neural layer-based method to identify people with high risk for diabetic foot. Comput Biol Med. 2020;120:103744. doi: http://dx.doi.org/10.1016/j.compbiomed.2020.103744. PubMed PMID: 32421649.
https://doi.org/10.1016/j.compbiomed.202...
,3131. Peleg M, Shachak A, Wang D, Karnieli E. Using multi-perspective methodologies to study users’ interactions with the prototype front end of a guideline-based decision support system for diabetic foot care. Int J Med Inform. 2009;78(7):482–93. doi: http://dx.doi.org/10.1016/j.ijmedinf.2009.02.008. PubMed PMID: 19328739.
https://doi.org/10.1016/j.ijmedinf.2009....
,3434. Wijesinghe I, Gamage C, Perera I, Chitranjan C. A smart telemedicine system with deep learning to manage diabetic retinopathy and foot ulcers. In 2019 Moratuwa Engineering Research Conference (MERCon); 2019; Moratuwa, Sri Lanka. USA: IEEE; 2019. p. 686–91. doi: http://dx.doi.org/10.1109/MERCon.2019.8818682.
https://doi.org/10.1109/MERCon.2019.8818...
), classifying the stage of severity(1919. Gamage C, Wijesinghe I, Perera I. Automatic scoring of diabetic foot ulcers through Deep CNN based feature extraction with low rank matrix factorization. In: 2019 IEEE 19th International Conference on Bioinformatics and Bioengineering (BIBE); 2019; Athens, Greece. USA: IEEE; 2019. pp. 352–6. doi: http://dx.doi.org/10.1109/BIBE.2019.00069.
https://doi.org/10.1109/BIBE.2019.00069...
,2525. Husers J, Hafer G, Heggemann J, Wiemeyer S, John SM, Hubner U. Development and evaluation of a bayesian risk stratification method for major amputations in patients with diabetic foot ulcers. Stud Health Technol Inform. 2022;289:212–5. doi: http://dx.doi.org/10.3233/SHTI210897. PubMed PMID: 35062130.
https://doi.org/10.3233/SHTI210897...
,3434. Wijesinghe I, Gamage C, Perera I, Chitranjan C. A smart telemedicine system with deep learning to manage diabetic retinopathy and foot ulcers. In 2019 Moratuwa Engineering Research Conference (MERCon); 2019; Moratuwa, Sri Lanka. USA: IEEE; 2019. p. 686–91. doi: http://dx.doi.org/10.1109/MERCon.2019.8818682.
https://doi.org/10.1109/MERCon.2019.8818...
), deciding on the treatment plan and evaluating the effectiveness of the interventions implemented(2727. Jayashree J, Vijayashree J. Anticipating diabetic foot ulcer using generative fuzzy expert system framework. Int J Civil Engineering Tech. 2017 [cited 2022 Dec 24];8(12):642–50. Available from: https://research.vit.ac.in/publication/anticipating-diabetic-foot-ulcer-using-generative-fuzzy-expert
https://research.vit.ac.in/publication/a...
,2828. Medeiros RA. Sistema inteligente de monitoramento da prevenção do pé diabético. [Dissertação]. Mossoró: Universidade do Estado do Rio Grande do Norte; 2015 [cited 2022 Dec 24]. Available from: https://ppgcc.ufersa.edu.br/wp-content/uploads/sites/42/2014/09/rodrigo-azevedo-de-medeiros.pdf.
https://ppgcc.ufersa.edu.br/wp-content/u...
,3333. Schafer Z, Mathisen A, Svendsen K, Engberg S, Thomsen RT, Kirketerp-Moler K. Toward machine-learning-based decision support in diabetes care: a risk stratification study on diabetic foot ulcer and amputation. Front Med (Lausanne). 2021;7:601602. doi: http://dx.doi.org/10.3389/fmed.2020.601602. PubMed PMID: 33681236.
https://doi.org/10.3389/fmed.2020.601602...
). One study compared their cost-effectiveness(2020. Goulionis JE, Vozikis A, Benos VC, Nikolakis D. On the decision rules of cost-effective treatment for patients with diabetic foot syndrome. Clinicoecon Outcomes Res. 2010;2:121–6. doi: http://dx.doi.org/10.2147/CEOR.S11981. PubMed PMID: 21935321.
https://doi.org/10.2147/CEOR.S11981...
).

Various resources were used to train the algorithms. These include processing data relating to the image of the lesion(77. Casal-Guisande M, Cerqueiro-Pequeño J, Comesaña-Campos A, Bouza-Rodríguez JB. Proposal of a methodology based on expert systems for the treatment of diabetic foot condition. TEEM’20. 2020;(21):491–6. doi: http://dx.doi.org/10.1145/3434780.3436625.
https://doi.org/10.1145/3434780.3436625...
,2121. Das SK, Roy P, Mishra AK. Fusion of handcrafted and deep convolutional neural network features for effective identification of diabetic foot ulcer. Concurr Comput. 2022;34(5):e6690. doi: http://dx.doi.org/10.1002/cpe.6690.
https://doi.org/10.1002/cpe.6690...
,2525. Husers J, Hafer G, Heggemann J, Wiemeyer S, John SM, Hubner U. Development and evaluation of a bayesian risk stratification method for major amputations in patients with diabetic foot ulcers. Stud Health Technol Inform. 2022;289:212–5. doi: http://dx.doi.org/10.3233/SHTI210897. PubMed PMID: 35062130.
https://doi.org/10.3233/SHTI210897...
,3030. Nguyen G, Agu E, Tulu B, Strong D, Mombini H, Pedersen P, et al. Machine learning models for synthesizing actionable care decisions on lower extremity wounds. Smart Health. 2020;18:100139. doi: http://dx.doi.org/10.1016/j.smhl.2020.100139.
https://doi.org/10.1016/j.smhl.2020.1001...
), thermal analysis(1515. Chappell FM, Crawford F, Horne M, Leese GP, Martin A, Weller D, et al. Development and validation of a clinical prediction rule for development of diabetic foot ulceration: an analysis of data from five cohort studies. BMJ Open Diabetes Res Care. 2021;9(1):e002150. doi: http://dx.doi.org/10.1136/bmjdrc-2021-002150. PubMed PMID: 34035053.
https://doi.org/10.1136/bmjdrc-2021-0021...
,1818. Cruz-Vega I, Peregrina-Barreto H, Rangel-Magdaleno JJ, Ramires-Cortes MJ. A comparison of intelligent classifiers of thermal patterns in diabetic foot. In: 2019 IEEE International Instrumentation and Measurement Technology Conference (I2MTC); 2019; Auckland, New Zealand. USA: IEEE; 2019. p. 1–6. doi: http://dx.doi.org/10.1109/I2MTC.2019.8827044
https://doi.org/10.1109/I2MTC.2019.88270...
), plantar grip measurements(2222. Deschamps K, Matricali GA, Desmet D, Roosen P, Keijsers N, Nobel F, et al. Efficacy measures associated to a plantar pressure-based classification system in diabetic foot medicine. Gait Posture. 2016;49:168–75. doi: http://dx.doi.org/10.1016/j.gaitpost.2016.07.009. PubMed PMID: 27427834.
https://doi.org/10.1016/j.gaitpost.2016....
), a questionnaire with clinical and sociodemographic data(77. Casal-Guisande M, Cerqueiro-Pequeño J, Comesaña-Campos A, Bouza-Rodríguez JB. Proposal of a methodology based on expert systems for the treatment of diabetic foot condition. TEEM’20. 2020;(21):491–6. doi: http://dx.doi.org/10.1145/3434780.3436625.
https://doi.org/10.1145/3434780.3436625...
,1616. Crawford F, Bekker HL, Jovem M, Sheikh A. General practitioners’ and nurses’ experiences of using computerised decision support in screening for diabetic foot disease: implementing Scottish Clinical Information - Diabetes Care in routine clinical practice. J Inovation Health Inf. 2010;18(4):259–68. doi: http://dx.doi.org/10.14236/jhi.v18i4.781.
https://doi.org/10.14236/jhi.v18i4.781...
,2323. Farzi S, Kianian S, Rastkhadive I. Predicting serious diabetic complications using hidden pattern detection. In: 2017 IEEE 4th International Conference on Knowledge-Based Engineering and Innovation (KBEI); 2017; Tehran, Iran. USA: IEEE; 2018. p. 0063–8. doi: http://dx.doi.org/10.1109/KBEI.2017.8324885.
https://doi.org/10.1109/KBEI.2017.832488...
2525. Husers J, Hafer G, Heggemann J, Wiemeyer S, John SM, Hubner U. Development and evaluation of a bayesian risk stratification method for major amputations in patients with diabetic foot ulcers. Stud Health Technol Inform. 2022;289:212–5. doi: http://dx.doi.org/10.3233/SHTI210897. PubMed PMID: 35062130.
https://doi.org/10.3233/SHTI210897...
,3232. Peng B, Min R, Liao Y, Yu A. Development of predictive nomograms for clinical use to quantify the risk of amputation in patients with diabetic foot ulcer. J Diabetes Res. 2021;2021:6621035. doi: http://dx.doi.org/10.1155/2021/6621035. PubMed PMID: 33511218.
https://doi.org/10.1155/2021/6621035...
3434. Wijesinghe I, Gamage C, Perera I, Chitranjan C. A smart telemedicine system with deep learning to manage diabetic retinopathy and foot ulcers. In 2019 Moratuwa Engineering Research Conference (MERCon); 2019; Moratuwa, Sri Lanka. USA: IEEE; 2019. p. 686–91. doi: http://dx.doi.org/10.1109/MERCon.2019.8818682.
https://doi.org/10.1109/MERCon.2019.8818...
), the Wagner scale(77. Casal-Guisande M, Cerqueiro-Pequeño J, Comesaña-Campos A, Bouza-Rodríguez JB. Proposal of a methodology based on expert systems for the treatment of diabetic foot condition. TEEM’20. 2020;(21):491–6. doi: http://dx.doi.org/10.1145/3434780.3436625.
https://doi.org/10.1145/3434780.3436625...
,1919. Gamage C, Wijesinghe I, Perera I. Automatic scoring of diabetic foot ulcers through Deep CNN based feature extraction with low rank matrix factorization. In: 2019 IEEE 19th International Conference on Bioinformatics and Bioengineering (BIBE); 2019; Athens, Greece. USA: IEEE; 2019. pp. 352–6. doi: http://dx.doi.org/10.1109/BIBE.2019.00069.
https://doi.org/10.1109/BIBE.2019.00069...
) and other clinical prediction rules(1515. Chappell FM, Crawford F, Horne M, Leese GP, Martin A, Weller D, et al. Development and validation of a clinical prediction rule for development of diabetic foot ulceration: an analysis of data from five cohort studies. BMJ Open Diabetes Res Care. 2021;9(1):e002150. doi: http://dx.doi.org/10.1136/bmjdrc-2021-002150. PubMed PMID: 34035053.
https://doi.org/10.1136/bmjdrc-2021-0021...
,3535. Lira JAC, Nogueira T, Oliveira BMA, Soares DR, Santos AMR, Araújo TME. Factors associated with the risk of diabetic foot in patients with diabetes mellitus in Primary Care. Rev Esc Enferm USP. 2021;55:e03757. doi: http://dx.doi.org/10.1590/S1980-220X2020019503757.
https://doi.org/10.1590/S1980-220X202001...
), alerts relating to remote self-care monitoring(2828. Medeiros RA. Sistema inteligente de monitoramento da prevenção do pé diabético. [Dissertação]. Mossoró: Universidade do Estado do Rio Grande do Norte; 2015 [cited 2022 Dec 24]. Available from: https://ppgcc.ufersa.edu.br/wp-content/uploads/sites/42/2014/09/rodrigo-azevedo-de-medeiros.pdf.
https://ppgcc.ufersa.edu.br/wp-content/u...
), and financial analysis between different treatments and amputation(2020. Goulionis JE, Vozikis A, Benos VC, Nikolakis D. On the decision rules of cost-effective treatment for patients with diabetic foot syndrome. Clinicoecon Outcomes Res. 2010;2:121–6. doi: http://dx.doi.org/10.2147/CEOR.S11981. PubMed PMID: 21935321.
https://doi.org/10.2147/CEOR.S11981...
).

In this context, the main factors related to ulceration, including amputation, were peripheral arterial disease, neuropathy, poor diabetes control, dyslipidemia, cardiovascular disease, chronic kidney complications, and a history of previous ulceration, deformities, inability to feel a 10g monofilament, at least one absent pedal pulse, plantar grip areas, unfavorable family history, smoking and alcoholism, barefoot walking habits, and lack of guidance/care from health professionals regarding the complication(55. Crawford F, Bekker HL, Jovem M, Sheikh A. General practitioners’ and nurses’ experiences of using computerised decision support in screening for diabetic foot disease: implementing Scottish Clinical Information - Diabetes Care in routine clinical practice. J Inovation Health Inf. 2010;18(4):259–68. doi: http://dx.doi.org/10.14236/jhi.v18i4.781.
https://doi.org/10.14236/jhi.v18i4.781...
,2222. Deschamps K, Matricali GA, Desmet D, Roosen P, Keijsers N, Nobel F, et al. Efficacy measures associated to a plantar pressure-based classification system in diabetic foot medicine. Gait Posture. 2016;49:168–75. doi: http://dx.doi.org/10.1016/j.gaitpost.2016.07.009. PubMed PMID: 27427834.
https://doi.org/10.1016/j.gaitpost.2016....
,3333. Schafer Z, Mathisen A, Svendsen K, Engberg S, Thomsen RT, Kirketerp-Moler K. Toward machine-learning-based decision support in diabetes care: a risk stratification study on diabetic foot ulcer and amputation. Front Med (Lausanne). 2021;7:601602. doi: http://dx.doi.org/10.3389/fmed.2020.601602. PubMed PMID: 33681236.
https://doi.org/10.3389/fmed.2020.601602...
,3535. Lira JAC, Nogueira T, Oliveira BMA, Soares DR, Santos AMR, Araújo TME. Factors associated with the risk of diabetic foot in patients with diabetes mellitus in Primary Care. Rev Esc Enferm USP. 2021;55:e03757. doi: http://dx.doi.org/10.1590/S1980-220X2020019503757.
https://doi.org/10.1590/S1980-220X202001...
).

Most expert systems make predictions using supervised or unsupervised machine learning techniques(99. Bender C, Cichosz SL, Malovini A, Bellazzi R, Pape-Haugaard L, Hejlesen O. Using case-based reasoning in a learning system: a prototype of a pedagogical nurse tool for evidence-based diabetic foot ulcer care. J Diabetes Sci Technol. 2021;16(2):454–9. doi: http://dx.doi.org/10.1177/1932296821991127. PubMed PMID: 33583205.
https://doi.org/10.1177/1932296821991127...
,1818. Cruz-Vega I, Peregrina-Barreto H, Rangel-Magdaleno JJ, Ramires-Cortes MJ. A comparison of intelligent classifiers of thermal patterns in diabetic foot. In: 2019 IEEE International Instrumentation and Measurement Technology Conference (I2MTC); 2019; Auckland, New Zealand. USA: IEEE; 2019. p. 1–6. doi: http://dx.doi.org/10.1109/I2MTC.2019.8827044
https://doi.org/10.1109/I2MTC.2019.88270...
,2121. Das SK, Roy P, Mishra AK. Fusion of handcrafted and deep convolutional neural network features for effective identification of diabetic foot ulcer. Concurr Comput. 2022;34(5):e6690. doi: http://dx.doi.org/10.1002/cpe.6690.
https://doi.org/10.1002/cpe.6690...
,2828. Medeiros RA. Sistema inteligente de monitoramento da prevenção do pé diabético. [Dissertação]. Mossoró: Universidade do Estado do Rio Grande do Norte; 2015 [cited 2022 Dec 24]. Available from: https://ppgcc.ufersa.edu.br/wp-content/uploads/sites/42/2014/09/rodrigo-azevedo-de-medeiros.pdf.
https://ppgcc.ufersa.edu.br/wp-content/u...
,3333. Schafer Z, Mathisen A, Svendsen K, Engberg S, Thomsen RT, Kirketerp-Moler K. Toward machine-learning-based decision support in diabetes care: a risk stratification study on diabetic foot ulcer and amputation. Front Med (Lausanne). 2021;7:601602. doi: http://dx.doi.org/10.3389/fmed.2020.601602. PubMed PMID: 33681236.
https://doi.org/10.3389/fmed.2020.601602...
,3434. Wijesinghe I, Gamage C, Perera I, Chitranjan C. A smart telemedicine system with deep learning to manage diabetic retinopathy and foot ulcers. In 2019 Moratuwa Engineering Research Conference (MERCon); 2019; Moratuwa, Sri Lanka. USA: IEEE; 2019. p. 686–91. doi: http://dx.doi.org/10.1109/MERCon.2019.8818682.
https://doi.org/10.1109/MERCon.2019.8818...
). Among the algorithms used are convolutional neural networks(1919. Gamage C, Wijesinghe I, Perera I. Automatic scoring of diabetic foot ulcers through Deep CNN based feature extraction with low rank matrix factorization. In: 2019 IEEE 19th International Conference on Bioinformatics and Bioengineering (BIBE); 2019; Athens, Greece. USA: IEEE; 2019. pp. 352–6. doi: http://dx.doi.org/10.1109/BIBE.2019.00069.
https://doi.org/10.1109/BIBE.2019.00069...
,2121. Das SK, Roy P, Mishra AK. Fusion of handcrafted and deep convolutional neural network features for effective identification of diabetic foot ulcer. Concurr Comput. 2022;34(5):e6690. doi: http://dx.doi.org/10.1002/cpe.6690.
https://doi.org/10.1002/cpe.6690...
) for image processing and other decision algorithms(77. Casal-Guisande M, Cerqueiro-Pequeño J, Comesaña-Campos A, Bouza-Rodríguez JB. Proposal of a methodology based on expert systems for the treatment of diabetic foot condition. TEEM’20. 2020;(21):491–6. doi: http://dx.doi.org/10.1145/3434780.3436625.
https://doi.org/10.1145/3434780.3436625...
,2020. Goulionis JE, Vozikis A, Benos VC, Nikolakis D. On the decision rules of cost-effective treatment for patients with diabetic foot syndrome. Clinicoecon Outcomes Res. 2010;2:121–6. doi: http://dx.doi.org/10.2147/CEOR.S11981. PubMed PMID: 21935321.
https://doi.org/10.2147/CEOR.S11981...
,2424. Ferreira ACBH, Ferreira DD, Oliveira HC, Resende ICD, Anjos A, Lopes MHBDM. Competitive neural layer-based method to identify people with high risk for diabetic foot. Comput Biol Med. 2020;120:103744. doi: http://dx.doi.org/10.1016/j.compbiomed.2020.103744. PubMed PMID: 32421649.
https://doi.org/10.1016/j.compbiomed.202...
,2727. Jayashree J, Vijayashree J. Anticipating diabetic foot ulcer using generative fuzzy expert system framework. Int J Civil Engineering Tech. 2017 [cited 2022 Dec 24];8(12):642–50. Available from: https://research.vit.ac.in/publication/anticipating-diabetic-foot-ulcer-using-generative-fuzzy-expert
https://research.vit.ac.in/publication/a...
,3030. Nguyen G, Agu E, Tulu B, Strong D, Mombini H, Pedersen P, et al. Machine learning models for synthesizing actionable care decisions on lower extremity wounds. Smart Health. 2020;18:100139. doi: http://dx.doi.org/10.1016/j.smhl.2020.100139.
https://doi.org/10.1016/j.smhl.2020.1001...
), such as fuzzy inference mechanisms, Gradient Boosted Machine, random forest, support vector machine, multi-layer perception neural network, Naive Bayes, artificial neural networks, competitive neural layer-based method and Radial Base Function.

The introduction of DSS in diabetic foot care was statistically significantly associated with the use of guideline-based practices, improved spending on treatments and interventions, risk factor management, screening, and preventive strategies. In addition, they have reminder, alert, and suggestion resources which, as well as promoting self-care and autonomy, encourage the discussion of therapeutic options, qualifying the professional-patient dialogue in an individualized and unique way(3535. Lira JAC, Nogueira T, Oliveira BMA, Soares DR, Santos AMR, Araújo TME. Factors associated with the risk of diabetic foot in patients with diabetes mellitus in Primary Care. Rev Esc Enferm USP. 2021;55:e03757. doi: http://dx.doi.org/10.1590/S1980-220X2020019503757.
https://doi.org/10.1590/S1980-220X202001...
3737. Santos MAFRN, Tygesen H, Eriksson H, Herlitz J. Clinical decision support system (CDSS)--effects on care quality. Int J Health Care Qual Assur. 2014;27(8):707–18. doi: http://dx.doi.org/10.1108/IJHCQA-01-2014-0010. PubMed PMID: 25417376.
https://doi.org/10.1108/IJHCQA-01-2014-0...
).

However, the main limitations pointed out are due to the insufficient number of studies with the target population, i.e. patients prone to ulceration and amputation, and/or testing limited to community settings with a restricted sample(99. Bender C, Cichosz SL, Malovini A, Bellazzi R, Pape-Haugaard L, Hejlesen O. Using case-based reasoning in a learning system: a prototype of a pedagogical nurse tool for evidence-based diabetic foot ulcer care. J Diabetes Sci Technol. 2021;16(2):454–9. doi: http://dx.doi.org/10.1177/1932296821991127. PubMed PMID: 33583205.
https://doi.org/10.1177/1932296821991127...
,1515. Chappell FM, Crawford F, Horne M, Leese GP, Martin A, Weller D, et al. Development and validation of a clinical prediction rule for development of diabetic foot ulceration: an analysis of data from five cohort studies. BMJ Open Diabetes Res Care. 2021;9(1):e002150. doi: http://dx.doi.org/10.1136/bmjdrc-2021-002150. PubMed PMID: 34035053.
https://doi.org/10.1136/bmjdrc-2021-0021...
,2424. Ferreira ACBH, Ferreira DD, Oliveira HC, Resende ICD, Anjos A, Lopes MHBDM. Competitive neural layer-based method to identify people with high risk for diabetic foot. Comput Biol Med. 2020;120:103744. doi: http://dx.doi.org/10.1016/j.compbiomed.2020.103744. PubMed PMID: 32421649.
https://doi.org/10.1016/j.compbiomed.202...
,2525. Husers J, Hafer G, Heggemann J, Wiemeyer S, John SM, Hubner U. Development and evaluation of a bayesian risk stratification method for major amputations in patients with diabetic foot ulcers. Stud Health Technol Inform. 2022;289:212–5. doi: http://dx.doi.org/10.3233/SHTI210897. PubMed PMID: 35062130.
https://doi.org/10.3233/SHTI210897...
,3131. Peleg M, Shachak A, Wang D, Karnieli E. Using multi-perspective methodologies to study users’ interactions with the prototype front end of a guideline-based decision support system for diabetic foot care. Int J Med Inform. 2009;78(7):482–93. doi: http://dx.doi.org/10.1016/j.ijmedinf.2009.02.008. PubMed PMID: 19328739.
https://doi.org/10.1016/j.ijmedinf.2009....
,3333. Schafer Z, Mathisen A, Svendsen K, Engberg S, Thomsen RT, Kirketerp-Moler K. Toward machine-learning-based decision support in diabetes care: a risk stratification study on diabetic foot ulcer and amputation. Front Med (Lausanne). 2021;7:601602. doi: http://dx.doi.org/10.3389/fmed.2020.601602. PubMed PMID: 33681236.
https://doi.org/10.3389/fmed.2020.601602...
), coupled with the resistance of health professionals to incorporating the tool into routine care(1515. Chappell FM, Crawford F, Horne M, Leese GP, Martin A, Weller D, et al. Development and validation of a clinical prediction rule for development of diabetic foot ulceration: an analysis of data from five cohort studies. BMJ Open Diabetes Res Care. 2021;9(1):e002150. doi: http://dx.doi.org/10.1136/bmjdrc-2021-002150. PubMed PMID: 34035053.
https://doi.org/10.1136/bmjdrc-2021-0021...
,1616. Crawford F, Bekker HL, Jovem M, Sheikh A. General practitioners’ and nurses’ experiences of using computerised decision support in screening for diabetic foot disease: implementing Scottish Clinical Information - Diabetes Care in routine clinical practice. J Inovation Health Inf. 2010;18(4):259–68. doi: http://dx.doi.org/10.14236/jhi.v18i4.781.
https://doi.org/10.14236/jhi.v18i4.781...
,1818. Cruz-Vega I, Peregrina-Barreto H, Rangel-Magdaleno JJ, Ramires-Cortes MJ. A comparison of intelligent classifiers of thermal patterns in diabetic foot. In: 2019 IEEE International Instrumentation and Measurement Technology Conference (I2MTC); 2019; Auckland, New Zealand. USA: IEEE; 2019. p. 1–6. doi: http://dx.doi.org/10.1109/I2MTC.2019.8827044
https://doi.org/10.1109/I2MTC.2019.88270...
2828. Medeiros RA. Sistema inteligente de monitoramento da prevenção do pé diabético. [Dissertação]. Mossoró: Universidade do Estado do Rio Grande do Norte; 2015 [cited 2022 Dec 24]. Available from: https://ppgcc.ufersa.edu.br/wp-content/uploads/sites/42/2014/09/rodrigo-azevedo-de-medeiros.pdf.
https://ppgcc.ufersa.edu.br/wp-content/u...
,3131. Peleg M, Shachak A, Wang D, Karnieli E. Using multi-perspective methodologies to study users’ interactions with the prototype front end of a guideline-based decision support system for diabetic foot care. Int J Med Inform. 2009;78(7):482–93. doi: http://dx.doi.org/10.1016/j.ijmedinf.2009.02.008. PubMed PMID: 19328739.
https://doi.org/10.1016/j.ijmedinf.2009....
3434. Wijesinghe I, Gamage C, Perera I, Chitranjan C. A smart telemedicine system with deep learning to manage diabetic retinopathy and foot ulcers. In 2019 Moratuwa Engineering Research Conference (MERCon); 2019; Moratuwa, Sri Lanka. USA: IEEE; 2019. p. 686–91. doi: http://dx.doi.org/10.1109/MERCon.2019.8818682.
https://doi.org/10.1109/MERCon.2019.8818...
), and the incompleteness of the information available in databases(55. Crawford F, Bekker HL, Jovem M, Sheikh A. General practitioners’ and nurses’ experiences of using computerised decision support in screening for diabetic foot disease: implementing Scottish Clinical Information - Diabetes Care in routine clinical practice. J Inovation Health Inf. 2010;18(4):259–68. doi: http://dx.doi.org/10.14236/jhi.v18i4.781.
https://doi.org/10.14236/jhi.v18i4.781...
,1515. Chappell FM, Crawford F, Horne M, Leese GP, Martin A, Weller D, et al. Development and validation of a clinical prediction rule for development of diabetic foot ulceration: an analysis of data from five cohort studies. BMJ Open Diabetes Res Care. 2021;9(1):e002150. doi: http://dx.doi.org/10.1136/bmjdrc-2021-002150. PubMed PMID: 34035053.
https://doi.org/10.1136/bmjdrc-2021-0021...
,1818. Cruz-Vega I, Peregrina-Barreto H, Rangel-Magdaleno JJ, Ramires-Cortes MJ. A comparison of intelligent classifiers of thermal patterns in diabetic foot. In: 2019 IEEE International Instrumentation and Measurement Technology Conference (I2MTC); 2019; Auckland, New Zealand. USA: IEEE; 2019. p. 1–6. doi: http://dx.doi.org/10.1109/I2MTC.2019.8827044
https://doi.org/10.1109/I2MTC.2019.88270...
,1919. Gamage C, Wijesinghe I, Perera I. Automatic scoring of diabetic foot ulcers through Deep CNN based feature extraction with low rank matrix factorization. In: 2019 IEEE 19th International Conference on Bioinformatics and Bioengineering (BIBE); 2019; Athens, Greece. USA: IEEE; 2019. pp. 352–6. doi: http://dx.doi.org/10.1109/BIBE.2019.00069.
https://doi.org/10.1109/BIBE.2019.00069...
,3232. Peng B, Min R, Liao Y, Yu A. Development of predictive nomograms for clinical use to quantify the risk of amputation in patients with diabetic foot ulcer. J Diabetes Res. 2021;2021:6621035. doi: http://dx.doi.org/10.1155/2021/6621035. PubMed PMID: 33511218.
https://doi.org/10.1155/2021/6621035...
,3333. Schafer Z, Mathisen A, Svendsen K, Engberg S, Thomsen RT, Kirketerp-Moler K. Toward machine-learning-based decision support in diabetes care: a risk stratification study on diabetic foot ulcer and amputation. Front Med (Lausanne). 2021;7:601602. doi: http://dx.doi.org/10.3389/fmed.2020.601602. PubMed PMID: 33681236.
https://doi.org/10.3389/fmed.2020.601602...
).

DISCUSSION

Mapping the evidence available in the literature reveals that DSS are becoming increasingly relevant in the management and clinical follow-up of DM, including the prevention and care of the diabetic foot. These systems involve supporting health professionals and patients in solving clinical problems by incorporating data from qualitative and quantitative sources, entered manually or automatically into an electronic record system, combined with the experience of specialists and guidelines. Their main purposes include guiding, Qualifying, and unifying the decision-making process(33. Schoen DE, Glance DG, Thompson SC. Clinical decision support software for diabetic foot risk stratification: development and formative evaluation. J Foot Ankle Res. 2015;8(1):73. doi: http://dx.doi.org/10.1186/s13047-015-0128-z. PubMed PMID: 26692903.
https://doi.org/10.1186/s13047-015-0128-...
,77. Casal-Guisande M, Cerqueiro-Pequeño J, Comesaña-Campos A, Bouza-Rodríguez JB. Proposal of a methodology based on expert systems for the treatment of diabetic foot condition. TEEM’20. 2020;(21):491–6. doi: http://dx.doi.org/10.1145/3434780.3436625.
https://doi.org/10.1145/3434780.3436625...
,3030. Nguyen G, Agu E, Tulu B, Strong D, Mombini H, Pedersen P, et al. Machine learning models for synthesizing actionable care decisions on lower extremity wounds. Smart Health. 2020;18:100139. doi: http://dx.doi.org/10.1016/j.smhl.2020.100139.
https://doi.org/10.1016/j.smhl.2020.1001...
,3333. Schafer Z, Mathisen A, Svendsen K, Engberg S, Thomsen RT, Kirketerp-Moler K. Toward machine-learning-based decision support in diabetes care: a risk stratification study on diabetic foot ulcer and amputation. Front Med (Lausanne). 2021;7:601602. doi: http://dx.doi.org/10.3389/fmed.2020.601602. PubMed PMID: 33681236.
https://doi.org/10.3389/fmed.2020.601602...
).

In general, studies on the subject show promising prospects for the incorporation of DSS into the routine of health professionals, as they favor and direct screening, diagnosis, prediction, treatment, risk stratification, referrals, and evaluation of the implementation of the care plan, with an individual and targeted approach, based on patients’ data.

In line with this, DSS have acted to reduce the barriers involved in health care, such as the rational use of resources, integration and transfer of information between primary, specialized, and tertiary care, “clinical inertia” (failure to initiate or intensify therapy when indicated), lack of familiarity with guidelines, protocols, and qualified electronic records, while offering summary reports on patient care, feedback on quality indicators, and benchmarking(3636. Njie GJ, Proia KK, Thota AB, Finnie RKC, Hopkins DP, Banks SM, et al. Clinical decision support systems and prevention: a community guide cardiovascular disease systematic review. Am J Prev Med. 2015;49(5):784–95. doi: http://dx.doi.org/10.1016/j.amepre.2015.04.006. PubMed PMID: 26477805.
https://doi.org/10.1016/j.amepre.2015.04...
,3838. Sim LLW, Ban KHK, Tan TW, Sethi SK, Loh TZ. Development of a clinical decision support system for diabetes care: a pilot study. PLoS One. 2017;12(2):e0173021. doi: http://dx.doi.org/10.1371/journal.pone.0173021. PubMed PMID: 28235017.
https://doi.org/10.1371/journal.pone.017...
).

Similarly, the literature discusses the functionalities of DSS, which mostly include personalized reminders, targeting for risk factor screening, preventive care and clinical tests, assessments for at-risk populations based on history, evidence-based treatment recommendations, including intensification of existing treatment regimens, recommendations for behavioral changes, and alerts for signs of serious risk(3636. Njie GJ, Proia KK, Thota AB, Finnie RKC, Hopkins DP, Banks SM, et al. Clinical decision support systems and prevention: a community guide cardiovascular disease systematic review. Am J Prev Med. 2015;49(5):784–95. doi: http://dx.doi.org/10.1016/j.amepre.2015.04.006. PubMed PMID: 26477805.
https://doi.org/10.1016/j.amepre.2015.04...
).

There is evidence that DSS with alert, reminder or feedback functionalities are more likely to have an impact on health care. In a randomized clinical trial, the odds ratio of the intervention group versus the control group for the probability of no worsening and improvement was 1.09 (95% CI 0.73; 1.63)(3939. Heselmans A, Delvaux N, Laenen A, Velde SB, Ramaekers D, Hunnamo I, et al. Computerized clinical decision support system for diabetes in primary care does not improve quality of care: a cluster-randomized controlled trial. Implement Sci. 2020;15(1):5. doi: http://dx.doi.org/10.1186/s13012-019-0955-6. PubMed PMID: 31910877.
https://doi.org/10.1186/s13012-019-0955-...
). Furthermore, a systematic review with meta-analysis confirms that 82% of the DSS available in the literature inferred a significant impact on the care process and, of these, 31% found tangible results with regard to the management of variables associated with DM(4040. Pengli H, Zhao P, Chen J, Zhang M. Evaluation of clinical decision support systems for diabetes care: an overview of current evidence. J Eval Clin Pract. 2019;25(1):66–77. doi: http://dx.doi.org/10.1111/jep.12968. PubMed PMID: 29947136.
https://doi.org/10.1111/jep.12968...
).

Regarding the quality of practices and clinical results related to morbidity and mortality from other conditions (e.g. cancer screening, immunization, CVD prevention), the analysis of randomized clinical trials similarly points to a significant improvement in variables related to screening, requesting clinical exams, and prescribing treatments(3636. Njie GJ, Proia KK, Thota AB, Finnie RKC, Hopkins DP, Banks SM, et al. Clinical decision support systems and prevention: a community guide cardiovascular disease systematic review. Am J Prev Med. 2015;49(5):784–95. doi: http://dx.doi.org/10.1016/j.amepre.2015.04.006. PubMed PMID: 26477805.
https://doi.org/10.1016/j.amepre.2015.04...
). However, there is scant evidence of its effectiveness in clinical outcomes(4141. Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux RR, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med. 2012;157(1):29–43. doi: http://dx.doi.org/10.7326/0003-4819-157-1-201207030-00450. PubMed PMID: 22751758.
https://doi.org/10.7326/0003-4819-157-1-...
).

In the hospital field, there have been good results in increasing adherence to surgical safety guidelines and protocols, especially with regard to the prescription of perioperative antibiotics, with a reduction in the rate of infections (<1%), qualification of the blood transfusion process and prophylaxis of deep vein thrombosis, inferring savings of more than US$1.6 million annually in a single hospital(4141. Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux RR, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med. 2012;157(1):29–43. doi: http://dx.doi.org/10.7326/0003-4819-157-1-201207030-00450. PubMed PMID: 22751758.
https://doi.org/10.7326/0003-4819-157-1-...
).

There is growing evidence that well-designed and carefully implemented DSS in DM follow-up improve not only the ordering of tests and preventive care, but also enable a dynamic, standardized, and personalized care plan to be drawn up and easily accessed by any member of the healthcare team at any time(4242. O’Connor PJ, Sperl-Hillen JM, Fazio CJ, Averbeck BM, Rank BH, Margolis KL. Outpatient diabetes clinical decision support: current status and future directions. Diabet Med. 2016;33(6):734–41. doi: http://dx.doi.org/10.1111/dme.13090. PubMed PMID: 27194173.
https://doi.org/10.1111/dme.13090...
).

Studies on the implementation of DSS in DM, in primary and specialized care, show positive impacts on the control of glycemic index, glycated hemoglobin, blood pressure, and blood cholesterol levels. The systems are generally compatible with the routine practice of institutions and can be integrated with other strategies, such as home visits, educational interventions, case management, and the use of social media(3939. Heselmans A, Delvaux N, Laenen A, Velde SB, Ramaekers D, Hunnamo I, et al. Computerized clinical decision support system for diabetes in primary care does not improve quality of care: a cluster-randomized controlled trial. Implement Sci. 2020;15(1):5. doi: http://dx.doi.org/10.1186/s13012-019-0955-6. PubMed PMID: 31910877.
https://doi.org/10.1186/s13012-019-0955-...
,4242. O’Connor PJ, Sperl-Hillen JM, Fazio CJ, Averbeck BM, Rank BH, Margolis KL. Outpatient diabetes clinical decision support: current status and future directions. Diabet Med. 2016;33(6):734–41. doi: http://dx.doi.org/10.1111/dme.13090. PubMed PMID: 27194173.
https://doi.org/10.1111/dme.13090...
).

For example, a study to build a DSS with a decision manager supported by fuzzy inference for diabetic retinopathy showed an accuracy of 80.76%, sensitivity of 80.67%, and specificity of 85.96%, enabling screening for the complication every three years(4343. Romero-Aroca P, Valls A, Moreno A, Sagarra-Alamo R, Basora-Galissa J, Saleh E, et al. A clinical decision support system for diabetic retinopathy screening: creating a clinical support application. Telemed J E Health. 2019;25(1):31–40. doi: http://dx.doi.org/10.1089/tmj.2017.0282. PubMed PMID: 29466097.
https://doi.org/10.1089/tmj.2017.0282...
). In the field of clinical decision support for diabetic foot, researchers encourage the promotion of research based on the findings of promoting healing, reducing the risk of death and amputation(4444. Soares MFM. Clinical decision rules applied to diabetic foot ulceration: prediction, prognosis and prevention [tese]. Porto: Universidade do Porto; 2016 [cited 2022 Dec 23]. Available from: https://repositorio-aberto.up.pt/handle/10216/87681.
https://repositorio-aberto.up.pt/handle/...
), as well as reflecting the guidelines and protocols for managing the complication(33. Schoen DE, Glance DG, Thompson SC. Clinical decision support software for diabetic foot risk stratification: development and formative evaluation. J Foot Ankle Res. 2015;8(1):73. doi: http://dx.doi.org/10.1186/s13047-015-0128-z. PubMed PMID: 26692903.
https://doi.org/10.1186/s13047-015-0128-...
) and the possibility of reducing errors in diagnosis, risk stratification and functional limitations(4545. Zihni E, Madai VI, Livne M, Galinovic I, Khalil AA, Fiebach JB, et al. Opening the black box of artificial intelligence for clinical decision support: a study predicting stroke outcome. PLoS One. 2020;15(4):e0231166. doi: http://dx.doi.org/10.1371/journal.pone.0231166. PubMed PMID: 32251471.
https://doi.org/10.1371/journal.pone.023...
).

The variables most commonly included in the DSS are diabetic neuropathy, peripheral arterial disease, foot deformity, and previous foot complications. These, in turn, are consistently associated with the occurrence of ulceration. The sensitivity of the classifications ranged from 38% to 100%, specificity from 30% to 88%, whereas negative predictive values were always higher than 80% and positive predictive values were always lower than 60%(4444. Soares MFM. Clinical decision rules applied to diabetic foot ulceration: prediction, prognosis and prevention [tese]. Porto: Universidade do Porto; 2016 [cited 2022 Dec 23]. Available from: https://repositorio-aberto.up.pt/handle/10216/87681.
https://repositorio-aberto.up.pt/handle/...
). Therefore, the literature shows that health professionals considered the diabetic foot DSS to be easy to use (99%), and believed that it provided useful information for patient care (100%)(4343. Romero-Aroca P, Valls A, Moreno A, Sagarra-Alamo R, Basora-Galissa J, Saleh E, et al. A clinical decision support system for diabetic retinopathy screening: creating a clinical support application. Telemed J E Health. 2019;25(1):31–40. doi: http://dx.doi.org/10.1089/tmj.2017.0282. PubMed PMID: 29466097.
https://doi.org/10.1089/tmj.2017.0282...
).

As a result, machine learning artificial intelligence methods are increasingly being used in clinical predictive modeling, while modern machine learning approaches such as artificial neural networks and deep learning generally perform better when compared to more traditional methods such as logistic and linear regression(4545. Zihni E, Madai VI, Livne M, Galinovic I, Khalil AA, Fiebach JB, et al. Opening the black box of artificial intelligence for clinical decision support: a study predicting stroke outcome. PLoS One. 2020;15(4):e0231166. doi: http://dx.doi.org/10.1371/journal.pone.0231166. PubMed PMID: 32251471.
https://doi.org/10.1371/journal.pone.023...
).

Machine learning mechanisms such as support vector machines, gradient boosted machines, artificial neural networks, random forests, and multi-layer perception neural networks stand out for their satisfactory results, with high accuracy and sensitivity, when it comes to understanding patterns in medical images for predicting, diagnosing, and stratifying diabetic foot disease. However, they require a prior stage of resource extraction and data availability(1818. Cruz-Vega I, Peregrina-Barreto H, Rangel-Magdaleno JJ, Ramires-Cortes MJ. A comparison of intelligent classifiers of thermal patterns in diabetic foot. In: 2019 IEEE International Instrumentation and Measurement Technology Conference (I2MTC); 2019; Auckland, New Zealand. USA: IEEE; 2019. p. 1–6. doi: http://dx.doi.org/10.1109/I2MTC.2019.8827044
https://doi.org/10.1109/I2MTC.2019.88270...
,2121. Das SK, Roy P, Mishra AK. Fusion of handcrafted and deep convolutional neural network features for effective identification of diabetic foot ulcer. Concurr Comput. 2022;34(5):e6690. doi: http://dx.doi.org/10.1002/cpe.6690.
https://doi.org/10.1002/cpe.6690...
,2323. Farzi S, Kianian S, Rastkhadive I. Predicting serious diabetic complications using hidden pattern detection. In: 2017 IEEE 4th International Conference on Knowledge-Based Engineering and Innovation (KBEI); 2017; Tehran, Iran. USA: IEEE; 2018. p. 0063–8. doi: http://dx.doi.org/10.1109/KBEI.2017.8324885.
https://doi.org/10.1109/KBEI.2017.832488...
,3434. Wijesinghe I, Gamage C, Perera I, Chitranjan C. A smart telemedicine system with deep learning to manage diabetic retinopathy and foot ulcers. In 2019 Moratuwa Engineering Research Conference (MERCon); 2019; Moratuwa, Sri Lanka. USA: IEEE; 2019. p. 686–91. doi: http://dx.doi.org/10.1109/MERCon.2019.8818682.
https://doi.org/10.1109/MERCon.2019.8818...
). On the other hand, deep learning and Naive Bayes techniques have shown limited accuracy and sensitivity results. However, these methods manage to include the vast majority of patients at real risk of ulceration and amputation(1818. Cruz-Vega I, Peregrina-Barreto H, Rangel-Magdaleno JJ, Ramires-Cortes MJ. A comparison of intelligent classifiers of thermal patterns in diabetic foot. In: 2019 IEEE International Instrumentation and Measurement Technology Conference (I2MTC); 2019; Auckland, New Zealand. USA: IEEE; 2019. p. 1–6. doi: http://dx.doi.org/10.1109/I2MTC.2019.8827044
https://doi.org/10.1109/I2MTC.2019.88270...
,2424. Ferreira ACBH, Ferreira DD, Oliveira HC, Resende ICD, Anjos A, Lopes MHBDM. Competitive neural layer-based method to identify people with high risk for diabetic foot. Comput Biol Med. 2020;120:103744. doi: http://dx.doi.org/10.1016/j.compbiomed.2020.103744. PubMed PMID: 32421649.
https://doi.org/10.1016/j.compbiomed.202...
).

Regarding the assessment of the severity of ulcers already installed and the cost of care, the decision manager supported by fuzzy inference showed favorable results, starting with the collection of images and risk factors, followed by the implementation of the Wagner scale and modeling calculations, for data interpretation, support for decision-making regarding treatment, and the generation of alerts(77. Casal-Guisande M, Cerqueiro-Pequeño J, Comesaña-Campos A, Bouza-Rodríguez JB. Proposal of a methodology based on expert systems for the treatment of diabetic foot condition. TEEM’20. 2020;(21):491–6. doi: http://dx.doi.org/10.1145/3434780.3436625.
https://doi.org/10.1145/3434780.3436625...
). In addition to the diabetic foot context, the fuzzy method has shown high sensitivity in other clinical conditions(4646. Sizilio GR, Leite CR, Guerreiro AM, Dória No AD. Fuzzy method for pre-diagnosis of breast cancer from the Fine Needle Aspirate analysis. BioMed Eng OnLine. 2012;11:83. doi: http://dx.doi.org/10.1186/1475-925X-11-83.
https://doi.org/10.1186/1475-925X-11-83...
,4747. Li Z, Teng Z, Miao H. Modeling and control for HIV/AIDS transmission in China based on data from 2004 to 2016. Comp Math Methods Med. 2017;8935314. doi: http://dx.doi.org/10.1155/2017/8935314.
https://doi.org/10.1155/2017/8935314...
), around 98%, given that risk prediction considers a set of carefully chosen rules based on the patient’s characteristics. In this respect, the fuzzy method is a potential algorithm for identifying early diagnosis, stratifying risk and monitoring the progress of diabetic foot disease.

The synthesis of information showed the use of the support vector machine method combined with other technologies. Furthermore, this tool shows preferable results in the literature over deep learning and convolutional neural networks, inferring accurate diagnoses (above 99%) in a shorter workflow time, especially from imaging results(4848. Kanwal S, Khan F, Alamri S, Dashtipur K, Gogate M. COVID-opt-aiNet: a clinical decision support system for COVID-19 detection. Int J Imaging Syst Technol. 2022;32(2):444–61. doi: https://doi.org/10.1002/ima.22695.
https://doi.org/10.1002/ima.22695...
,4949. Barstugan M, Ozkaya U, Ozturk S. Coronavirus (COVID-19) classification using ct images by machine learning methods. arXiv. 2020; [cited 2022 Dec 23];2003:09424. Available from: http://arxiv.org/abs/2003.09424
http://arxiv.org/abs/2003.09424...
). However, the performance of the chosen method may vary depending on the resources used and deployment scenarios, emphasizing that technologies used together have the potential to improve system performance(4848. Kanwal S, Khan F, Alamri S, Dashtipur K, Gogate M. COVID-opt-aiNet: a clinical decision support system for COVID-19 detection. Int J Imaging Syst Technol. 2022;32(2):444–61. doi: https://doi.org/10.1002/ima.22695.
https://doi.org/10.1002/ima.22695...
).

In addition, the use of case-based reasoning algorithms has proved capable of calculating dissimilarity scores to provide a quantitative measure between a new case and cases stored in the case base(99. Bender C, Cichosz SL, Malovini A, Bellazzi R, Pape-Haugaard L, Hejlesen O. Using case-based reasoning in a learning system: a prototype of a pedagogical nurse tool for evidence-based diabetic foot ulcer care. J Diabetes Sci Technol. 2021;16(2):454–9. doi: http://dx.doi.org/10.1177/1932296821991127. PubMed PMID: 33583205.
https://doi.org/10.1177/1932296821991127...
). For example, the experience with SM2PeD, a platform integrated with a mobile device, shows satisfactory results, based on tests with a real sample, regarding the remote monitoring of self-care activities by the medical team, together with the issuing of alerts and recommendations by the expert system(2828. Medeiros RA. Sistema inteligente de monitoramento da prevenção do pé diabético. [Dissertação]. Mossoró: Universidade do Estado do Rio Grande do Norte; 2015 [cited 2022 Dec 24]. Available from: https://ppgcc.ufersa.edu.br/wp-content/uploads/sites/42/2014/09/rodrigo-azevedo-de-medeiros.pdf.
https://ppgcc.ufersa.edu.br/wp-content/u...
). In addition, there is insight into the development of intelligent decision support systems with data generated from remote monitoring based on the Internet of Things.

Thus, clinical prediction rules, guiding flowcharts, and prognostic models, together with expert systems and preventive interventions, have proved to be useful, simple, and effective tools, with satisfactory predictive capacity and low implementation costs, with a view to guiding, unifying, and improving the quality of diagnosis, choice of treatment plan and preventive strategies in diabetic foot(55. Crawford F, Bekker HL, Jovem M, Sheikh A. General practitioners’ and nurses’ experiences of using computerised decision support in screening for diabetic foot disease: implementing Scottish Clinical Information - Diabetes Care in routine clinical practice. J Inovation Health Inf. 2010;18(4):259–68. doi: http://dx.doi.org/10.14236/jhi.v18i4.781.
https://doi.org/10.14236/jhi.v18i4.781...
,1515. Chappell FM, Crawford F, Horne M, Leese GP, Martin A, Weller D, et al. Development and validation of a clinical prediction rule for development of diabetic foot ulceration: an analysis of data from five cohort studies. BMJ Open Diabetes Res Care. 2021;9(1):e002150. doi: http://dx.doi.org/10.1136/bmjdrc-2021-002150. PubMed PMID: 34035053.
https://doi.org/10.1136/bmjdrc-2021-0021...
,2929. Nair HKR, Kaur G. Using the diabetic foot ulcer aetiology-specific T.I.M.E. clinical decision support tool to promote consistent holistic wound management and eliminate variation in practice. Wounds International. [cited 2022 Dec 23] 2021;12(3):38–45. Available from: https://www.woundsinternational.com/resources/details/using-diabetic-foot-ulcer-aetiologyspecific-time-clinical-decision-support-tool-promote-consistent-holistic-wound-management-and-eliminate-variation-practice
https://www.woundsinternational.com/reso...
,3232. Peng B, Min R, Liao Y, Yu A. Development of predictive nomograms for clinical use to quantify the risk of amputation in patients with diabetic foot ulcer. J Diabetes Res. 2021;2021:6621035. doi: http://dx.doi.org/10.1155/2021/6621035. PubMed PMID: 33511218.
https://doi.org/10.1155/2021/6621035...
). In addition, a heuristic decision algorithm for evaluating the cost of medical treatments and diabetic foot amputation provided an early and efficient decision-making process, with the choice of cost-effective treatments and adaptability between different healthcare environments(2828. Medeiros RA. Sistema inteligente de monitoramento da prevenção do pé diabético. [Dissertação]. Mossoró: Universidade do Estado do Rio Grande do Norte; 2015 [cited 2022 Dec 24]. Available from: https://ppgcc.ufersa.edu.br/wp-content/uploads/sites/42/2014/09/rodrigo-azevedo-de-medeiros.pdf.
https://ppgcc.ufersa.edu.br/wp-content/u...
).

However, some DSS are limited to recording information and providing generic advice, proving to be not very attractive, which promotes distancing between health professionals and users, hindering the process of implementing smart technologies and promoting self-care strategies(5050. Daley BJ, Ni’Man M, Neves MR, Huda MSB, Marsh W, Fenton NE, et al. mHealth apps for gestational diabetes mellitus that provide clinical decision support or artificial intelligence: a scoping review. Diabet Med. 2022;39(1):e14735. doi: http://dx.doi.org/10.1111/dme.14735. PubMed PMID: 34726798.
https://doi.org/10.1111/dme.14735...
). The panorama thus highlights the still incipient interaction between clinical practice and expert systems, in terms of usability, acceptance, and recognition of the benefits, substantially evidenced in experimental studies(3636. Njie GJ, Proia KK, Thota AB, Finnie RKC, Hopkins DP, Banks SM, et al. Clinical decision support systems and prevention: a community guide cardiovascular disease systematic review. Am J Prev Med. 2015;49(5):784–95. doi: http://dx.doi.org/10.1016/j.amepre.2015.04.006. PubMed PMID: 26477805.
https://doi.org/10.1016/j.amepre.2015.04...
).

To this end, an understanding of the models applied is essential, with a view to the usability of the systems, the effectiveness of clinical decision support, and the instruction of those involved in the process. The literature points out that five “rights” must be considered for the successful integration of technology: the right information must be presented to the right audience, in the right format, through the right channels, at the right points in the patients’ lives(4242. O’Connor PJ, Sperl-Hillen JM, Fazio CJ, Averbeck BM, Rank BH, Margolis KL. Outpatient diabetes clinical decision support: current status and future directions. Diabet Med. 2016;33(6):734–41. doi: http://dx.doi.org/10.1111/dme.13090. PubMed PMID: 27194173.
https://doi.org/10.1111/dme.13090...
).

Furthermore, the use of DSS should be sparing, restricted to the provision of recommendations, without prejudice to the judgment of health professionals, while also paying attention to the reliability of the data, algorithm, and system itself. Therefore, the availability of reliable sources should be considered before and during the project, reducing negative impacts on patients’ health, methodological limitations, and the presence of biases, which are still seen in health DSS(5151. Jeffery R, Iserman E, Haynes RB, CDSS Systematic Review Team. Can computerized clinical decision support systems improve diabetes management? A systematic review and meta-analysis. Diabet Med. 2013;30(6):739–45. doi: http://dx.doi.org/10.1111/dme.12087. PubMed PMID: 23199102.
https://doi.org/10.1111/dme.12087...
), and their negative impact on health outcomes(5252. Gurupur V, Wan TTH. Inherent bias in artificial intelligence-based decision support systems for healthcare. Medicina (Kaunas). 2020;56(3):141. doi: http://dx.doi.org/10.3390/medicina56030141. PubMed PMID: 32244930.
https://doi.org/10.3390/medicina56030141...
).

Allied to this, problems such as the lack of standardization of measurement processes and presentation of results, and low quality in the execution of methods stand out, leading to inconsistent conclusions in some studies(4141. Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux RR, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med. 2012;157(1):29–43. doi: http://dx.doi.org/10.7326/0003-4819-157-1-201207030-00450. PubMed PMID: 22751758.
https://doi.org/10.7326/0003-4819-157-1-...
). To this end, we recommend the development of consistent studies for the design and testing of DSS, including validation with specialists and the target population, implemented in the various scenarios of diabetic foot care practice, to establish results on the effectiveness of their use and impact on outcomes such as cure, hospitalization, amputation, and death, as well as promoting easy and flexible access to these technologies, with a view to training and raising awareness among health professionals(2929. Nair HKR, Kaur G. Using the diabetic foot ulcer aetiology-specific T.I.M.E. clinical decision support tool to promote consistent holistic wound management and eliminate variation in practice. Wounds International. [cited 2022 Dec 23] 2021;12(3):38–45. Available from: https://www.woundsinternational.com/resources/details/using-diabetic-foot-ulcer-aetiologyspecific-time-clinical-decision-support-tool-promote-consistent-holistic-wound-management-and-eliminate-variation-practice
https://www.woundsinternational.com/reso...
,3838. Sim LLW, Ban KHK, Tan TW, Sethi SK, Loh TZ. Development of a clinical decision support system for diabetes care: a pilot study. PLoS One. 2017;12(2):e0173021. doi: http://dx.doi.org/10.1371/journal.pone.0173021. PubMed PMID: 28235017.
https://doi.org/10.1371/journal.pone.017...
).

The study contributes to expanding knowledge in the field of nursing and health about diabetic foot DSS, bringing new and relevant information about the use of this resource for early diagnosis, appropriate treatment, and continuous monitoring. These systems can help nursing professionals screen at-risk patients, enabling early interventions and early diagnosis of lesions. It also helps support clinical decision-making and evidence-based guidelines for treatment, promoting standardized and personalized care.

The limitations of this scoping review include the difficulty in understanding the context in which DSS are applied and their contribution to clinical practice. In addition, the presence of heterogeneous studies makes it difficult to directly compare the studies and synthesize the results.

CONCLUSION

Decision support systems corroborate the orientation and qualification of clinical practice, with regard to screening, diagnosis, prediction, treatment, risk stratification, and evaluation of the diabetic foot care plan, using artificial intelligence and machine learning resources, which stand out for their satisfactory results, with high precision and sensitivity, inferring excellent prospects for their incorporation into clinical practice.

  • Financial support Coordination for the Improvement of Higher Education Personnel (CAPES) - Funding Code 001, Brazil.

REFERENCES

  • 1.
    Reardon R, Simring D, Kim B, Mortensen J, Williams D, Leslie A. The diabetic foot ulcer. Aust J Gen Pract. 2020;49(5):250–5. doi: http://dx.doi.org/10.31128/AJGP-11-19-5161. PubMed PMID: 32416652.
    » https://doi.org/10.31128/AJGP-11-19-5161
  • 2.
    Armstrong DG, Boulton AJM, Bus SA. Diabetic foot ulcers and their recurrence. N Engl J Med. 2017;376(24):2367–75. doi: http://dx.doi.org/10.1056/NEJMra1615439. PubMed PMID: 28614678.
    » https://doi.org/10.1056/NEJMra1615439
  • 3.
    Schoen DE, Glance DG, Thompson SC. Clinical decision support software for diabetic foot risk stratification: development and formative evaluation. J Foot Ankle Res. 2015;8(1):73. doi: http://dx.doi.org/10.1186/s13047-015-0128-z. PubMed PMID: 26692903.
    » https://doi.org/10.1186/s13047-015-0128-z
  • 4.
    Toscano CM, Sugita TH, Rosa MQM, Pedrosa HC, Rosa R, Bahia LR. Annual direct medical costs of diabetic foot disease in Brazil: a cost of illness study. Int J Environ Res Public Health. 2018;15(1):89. doi: http://dx.doi.org/10.3390/ijerph15010089. PubMed PMID: 29316689.
    » https://doi.org/10.3390/ijerph15010089
  • 5.
    Crawford F, Bekker HL, Jovem M, Sheikh A. General practitioners’ and nurses’ experiences of using computerised decision support in screening for diabetic foot disease: implementing Scottish Clinical Information - Diabetes Care in routine clinical practice. J Inovation Health Inf. 2010;18(4):259–68. doi: http://dx.doi.org/10.14236/jhi.v18i4.781.
    » https://doi.org/10.14236/jhi.v18i4.781
  • 6.
    Schaarup C, Pape-Haugaard L, Jensen MH, Laursen AC, Bermark S, Hejlesen OK. Probing community nurses’ professional basis: a situational case study in diabetic foot ulcer treatment. Br J Community Nurs. 2017;22(Suppl 3):S46–52. doi: http://dx.doi.org/10.12968/bjcn.2017.22.Sup3.S46.
    » https://doi.org/10.12968/bjcn.2017.22.Sup3.S46
  • 7.
    Casal-Guisande M, Cerqueiro-Pequeño J, Comesaña-Campos A, Bouza-Rodríguez JB. Proposal of a methodology based on expert systems for the treatment of diabetic foot condition. TEEM’20. 2020;(21):491–6. doi: http://dx.doi.org/10.1145/3434780.3436625.
    » https://doi.org/10.1145/3434780.3436625
  • 8.
    Lee JH, Staley J, Robinson R. Models used in clinical decision support systems supporting healthcare professionals treating chronic wounds: systematic literature review. JMIR Diabetes. 2018;3(2):e11. doi: http://dx.doi.org/10.2196/diabetes.8316. PubMed PMID: 30291078.
    » https://doi.org/10.2196/diabetes.8316
  • 9.
    Bender C, Cichosz SL, Malovini A, Bellazzi R, Pape-Haugaard L, Hejlesen O. Using case-based reasoning in a learning system: a prototype of a pedagogical nurse tool for evidence-based diabetic foot ulcer care. J Diabetes Sci Technol. 2021;16(2):454–9. doi: http://dx.doi.org/10.1177/1932296821991127. PubMed PMID: 33583205.
    » https://doi.org/10.1177/1932296821991127
  • 10.
    Schaarup C, Pape-Haugaard LB, Hejlesen OK. Models used in clinical decision support systems supporting healthcare professionals treating chronic wounds: systematic literature review. JMIR Diabetes. 2018;3(2):e11. doi: http://dx.doi.org/10.2196/diabetes.8316. PubMed PMID: 30291078.
    » https://doi.org/10.2196/diabetes.8316
  • 11.
    Peters MDJ, Godfrey C, McInerney P, Munn Z, Tricco AC, Khalil H. Chapter 11: Scoping reviews (2020 version). In: Aromataris E, Munn Z, editors. JBI Manual for Evidence Synthesis. Australia: JBI; 2020. doi: http://dx.doi.org/10.46658/JBIMES-20-12.
    » https://doi.org/10.46658/JBIMES-20-12
  • 12.
    Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi: http://dx.doi.org/10.1136/bmj.n71. PubMed PMID: 33782057.
    » https://doi.org/10.1136/bmj.n71
  • 13.
    Araújo WCO. Recuperação da informação em saúde: construção, modelos e estratégias. Convergências em Ciência da Informação. 2020;3(2):100–34. doi: http://dx.doi.org/10.33467/conci.v3i2.13447.
    » https://doi.org/10.33467/conci.v3i2.13447
  • 14.
    Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan: a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. doi: http://dx.doi.org/10.1186/s13643-016-0384-4. PubMed PMID: 27919275.
    » https://doi.org/10.1186/s13643-016-0384-4
  • 15.
    Chappell FM, Crawford F, Horne M, Leese GP, Martin A, Weller D, et al. Development and validation of a clinical prediction rule for development of diabetic foot ulceration: an analysis of data from five cohort studies. BMJ Open Diabetes Res Care. 2021;9(1):e002150. doi: http://dx.doi.org/10.1136/bmjdrc-2021-002150. PubMed PMID: 34035053.
    » https://doi.org/10.1136/bmjdrc-2021-002150
  • 16.
    Crawford F, Bekker HL, Jovem M, Sheikh A. General practitioners’ and nurses’ experiences of using computerised decision support in screening for diabetic foot disease: implementing Scottish Clinical Information - Diabetes Care in routine clinical practice. J Inovation Health Inf. 2010;18(4):259–68. doi: http://dx.doi.org/10.14236/jhi.v18i4.781.
    » https://doi.org/10.14236/jhi.v18i4.781
  • 17.
    Crawford F, Cezard G, Chappell FM, PODUS Group. The development and validation of a multivariable prognostic model to predict foot ulceration in diabetes using a systematic review and individual patient data meta-analyses. Diabet Med. 2018;35(11):1480–93. doi: http://dx.doi.org/10.1111/dme.13797. PubMed PMID: 30102422.
    » https://doi.org/10.1111/dme.13797
  • 18.
    Cruz-Vega I, Peregrina-Barreto H, Rangel-Magdaleno JJ, Ramires-Cortes MJ. A comparison of intelligent classifiers of thermal patterns in diabetic foot. In: 2019 IEEE International Instrumentation and Measurement Technology Conference (I2MTC); 2019; Auckland, New Zealand. USA: IEEE; 2019. p. 1–6. doi: http://dx.doi.org/10.1109/I2MTC.2019.8827044
    » https://doi.org/10.1109/I2MTC.2019.8827044
  • 19.
    Gamage C, Wijesinghe I, Perera I. Automatic scoring of diabetic foot ulcers through Deep CNN based feature extraction with low rank matrix factorization. In: 2019 IEEE 19th International Conference on Bioinformatics and Bioengineering (BIBE); 2019; Athens, Greece. USA: IEEE; 2019. pp. 352–6. doi: http://dx.doi.org/10.1109/BIBE.2019.00069.
    » https://doi.org/10.1109/BIBE.2019.00069
  • 20.
    Goulionis JE, Vozikis A, Benos VC, Nikolakis D. On the decision rules of cost-effective treatment for patients with diabetic foot syndrome. Clinicoecon Outcomes Res. 2010;2:121–6. doi: http://dx.doi.org/10.2147/CEOR.S11981. PubMed PMID: 21935321.
    » https://doi.org/10.2147/CEOR.S11981
  • 21.
    Das SK, Roy P, Mishra AK. Fusion of handcrafted and deep convolutional neural network features for effective identification of diabetic foot ulcer. Concurr Comput. 2022;34(5):e6690. doi: http://dx.doi.org/10.1002/cpe.6690.
    » https://doi.org/10.1002/cpe.6690
  • 22.
    Deschamps K, Matricali GA, Desmet D, Roosen P, Keijsers N, Nobel F, et al. Efficacy measures associated to a plantar pressure-based classification system in diabetic foot medicine. Gait Posture. 2016;49:168–75. doi: http://dx.doi.org/10.1016/j.gaitpost.2016.07.009. PubMed PMID: 27427834.
    » https://doi.org/10.1016/j.gaitpost.2016.07.009
  • 23.
    Farzi S, Kianian S, Rastkhadive I. Predicting serious diabetic complications using hidden pattern detection. In: 2017 IEEE 4th International Conference on Knowledge-Based Engineering and Innovation (KBEI); 2017; Tehran, Iran. USA: IEEE; 2018. p. 0063–8. doi: http://dx.doi.org/10.1109/KBEI.2017.8324885.
    » https://doi.org/10.1109/KBEI.2017.8324885
  • 24.
    Ferreira ACBH, Ferreira DD, Oliveira HC, Resende ICD, Anjos A, Lopes MHBDM. Competitive neural layer-based method to identify people with high risk for diabetic foot. Comput Biol Med. 2020;120:103744. doi: http://dx.doi.org/10.1016/j.compbiomed.2020.103744. PubMed PMID: 32421649.
    » https://doi.org/10.1016/j.compbiomed.2020.103744
  • 25.
    Husers J, Hafer G, Heggemann J, Wiemeyer S, John SM, Hubner U. Development and evaluation of a bayesian risk stratification method for major amputations in patients with diabetic foot ulcers. Stud Health Technol Inform. 2022;289:212–5. doi: http://dx.doi.org/10.3233/SHTI210897. PubMed PMID: 35062130.
    » https://doi.org/10.3233/SHTI210897
  • 26.
    Hüsers J, Hafer G, Heggemann J, Stefan W, Prysucha M, Dissemond J, et al. Automatic classification of diabetic foot ulcer images - a transfer-learning approach to detect wound maceration. Stud Health Technol Inform. 2022;289:301–4. doi: http://dx.doi.org/10.3233/SHTI210919. PubMed PMID: 35062152.
    » https://doi.org/10.3233/SHTI210919
  • 27.
    Jayashree J, Vijayashree J. Anticipating diabetic foot ulcer using generative fuzzy expert system framework. Int J Civil Engineering Tech. 2017 [cited 2022 Dec 24];8(12):642–50. Available from: https://research.vit.ac.in/publication/anticipating-diabetic-foot-ulcer-using-generative-fuzzy-expert
    » https://research.vit.ac.in/publication/anticipating-diabetic-foot-ulcer-using-generative-fuzzy-expert
  • 28.
    Medeiros RA. Sistema inteligente de monitoramento da prevenção do pé diabético. [Dissertação]. Mossoró: Universidade do Estado do Rio Grande do Norte; 2015 [cited 2022 Dec 24]. Available from: https://ppgcc.ufersa.edu.br/wp-content/uploads/sites/42/2014/09/rodrigo-azevedo-de-medeiros.pdf
    » https://ppgcc.ufersa.edu.br/wp-content/uploads/sites/42/2014/09/rodrigo-azevedo-de-medeiros.pdf
  • 29.
    Nair HKR, Kaur G. Using the diabetic foot ulcer aetiology-specific T.I.M.E. clinical decision support tool to promote consistent holistic wound management and eliminate variation in practice. Wounds International. [cited 2022 Dec 23] 2021;12(3):38–45. Available from: https://www.woundsinternational.com/resources/details/using-diabetic-foot-ulcer-aetiologyspecific-time-clinical-decision-support-tool-promote-consistent-holistic-wound-management-and-eliminate-variation-practice
    » https://www.woundsinternational.com/resources/details/using-diabetic-foot-ulcer-aetiologyspecific-time-clinical-decision-support-tool-promote-consistent-holistic-wound-management-and-eliminate-variation-practice
  • 30.
    Nguyen G, Agu E, Tulu B, Strong D, Mombini H, Pedersen P, et al. Machine learning models for synthesizing actionable care decisions on lower extremity wounds. Smart Health. 2020;18:100139. doi: http://dx.doi.org/10.1016/j.smhl.2020.100139.
    » https://doi.org/10.1016/j.smhl.2020.100139
  • 31.
    Peleg M, Shachak A, Wang D, Karnieli E. Using multi-perspective methodologies to study users’ interactions with the prototype front end of a guideline-based decision support system for diabetic foot care. Int J Med Inform. 2009;78(7):482–93. doi: http://dx.doi.org/10.1016/j.ijmedinf.2009.02.008. PubMed PMID: 19328739.
    » https://doi.org/10.1016/j.ijmedinf.2009.02.008
  • 32.
    Peng B, Min R, Liao Y, Yu A. Development of predictive nomograms for clinical use to quantify the risk of amputation in patients with diabetic foot ulcer. J Diabetes Res. 2021;2021:6621035. doi: http://dx.doi.org/10.1155/2021/6621035. PubMed PMID: 33511218.
    » https://doi.org/10.1155/2021/6621035
  • 33.
    Schafer Z, Mathisen A, Svendsen K, Engberg S, Thomsen RT, Kirketerp-Moler K. Toward machine-learning-based decision support in diabetes care: a risk stratification study on diabetic foot ulcer and amputation. Front Med (Lausanne). 2021;7:601602. doi: http://dx.doi.org/10.3389/fmed.2020.601602. PubMed PMID: 33681236.
    » https://doi.org/10.3389/fmed.2020.601602
  • 34.
    Wijesinghe I, Gamage C, Perera I, Chitranjan C. A smart telemedicine system with deep learning to manage diabetic retinopathy and foot ulcers. In 2019 Moratuwa Engineering Research Conference (MERCon); 2019; Moratuwa, Sri Lanka. USA: IEEE; 2019. p. 686–91. doi: http://dx.doi.org/10.1109/MERCon.2019.8818682.
    » https://doi.org/10.1109/MERCon.2019.8818682
  • 35.
    Lira JAC, Nogueira T, Oliveira BMA, Soares DR, Santos AMR, Araújo TME. Factors associated with the risk of diabetic foot in patients with diabetes mellitus in Primary Care. Rev Esc Enferm USP. 2021;55:e03757. doi: http://dx.doi.org/10.1590/S1980-220X2020019503757.
    » https://doi.org/10.1590/S1980-220X2020019503757
  • 36.
    Njie GJ, Proia KK, Thota AB, Finnie RKC, Hopkins DP, Banks SM, et al. Clinical decision support systems and prevention: a community guide cardiovascular disease systematic review. Am J Prev Med. 2015;49(5):784–95. doi: http://dx.doi.org/10.1016/j.amepre.2015.04.006. PubMed PMID: 26477805.
    » https://doi.org/10.1016/j.amepre.2015.04.006
  • 37.
    Santos MAFRN, Tygesen H, Eriksson H, Herlitz J. Clinical decision support system (CDSS)--effects on care quality. Int J Health Care Qual Assur. 2014;27(8):707–18. doi: http://dx.doi.org/10.1108/IJHCQA-01-2014-0010. PubMed PMID: 25417376.
    » https://doi.org/10.1108/IJHCQA-01-2014-0010
  • 38.
    Sim LLW, Ban KHK, Tan TW, Sethi SK, Loh TZ. Development of a clinical decision support system for diabetes care: a pilot study. PLoS One. 2017;12(2):e0173021. doi: http://dx.doi.org/10.1371/journal.pone.0173021. PubMed PMID: 28235017.
    » https://doi.org/10.1371/journal.pone.0173021
  • 39.
    Heselmans A, Delvaux N, Laenen A, Velde SB, Ramaekers D, Hunnamo I, et al. Computerized clinical decision support system for diabetes in primary care does not improve quality of care: a cluster-randomized controlled trial. Implement Sci. 2020;15(1):5. doi: http://dx.doi.org/10.1186/s13012-019-0955-6. PubMed PMID: 31910877.
    » https://doi.org/10.1186/s13012-019-0955-6
  • 40.
    Pengli H, Zhao P, Chen J, Zhang M. Evaluation of clinical decision support systems for diabetes care: an overview of current evidence. J Eval Clin Pract. 2019;25(1):66–77. doi: http://dx.doi.org/10.1111/jep.12968. PubMed PMID: 29947136.
    » https://doi.org/10.1111/jep.12968
  • 41.
    Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux RR, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med. 2012;157(1):29–43. doi: http://dx.doi.org/10.7326/0003-4819-157-1-201207030-00450. PubMed PMID: 22751758.
    » https://doi.org/10.7326/0003-4819-157-1-201207030-00450
  • 42.
    O’Connor PJ, Sperl-Hillen JM, Fazio CJ, Averbeck BM, Rank BH, Margolis KL. Outpatient diabetes clinical decision support: current status and future directions. Diabet Med. 2016;33(6):734–41. doi: http://dx.doi.org/10.1111/dme.13090. PubMed PMID: 27194173.
    » https://doi.org/10.1111/dme.13090
  • 43.
    Romero-Aroca P, Valls A, Moreno A, Sagarra-Alamo R, Basora-Galissa J, Saleh E, et al. A clinical decision support system for diabetic retinopathy screening: creating a clinical support application. Telemed J E Health. 2019;25(1):31–40. doi: http://dx.doi.org/10.1089/tmj.2017.0282. PubMed PMID: 29466097.
    » https://doi.org/10.1089/tmj.2017.0282
  • 44.
    Soares MFM. Clinical decision rules applied to diabetic foot ulceration: prediction, prognosis and prevention [tese]. Porto: Universidade do Porto; 2016 [cited 2022 Dec 23]. Available from: https://repositorio-aberto.up.pt/handle/10216/87681
    » https://repositorio-aberto.up.pt/handle/10216/87681
  • 45.
    Zihni E, Madai VI, Livne M, Galinovic I, Khalil AA, Fiebach JB, et al. Opening the black box of artificial intelligence for clinical decision support: a study predicting stroke outcome. PLoS One. 2020;15(4):e0231166. doi: http://dx.doi.org/10.1371/journal.pone.0231166. PubMed PMID: 32251471.
    » https://doi.org/10.1371/journal.pone.0231166
  • 46.
    Sizilio GR, Leite CR, Guerreiro AM, Dória No AD. Fuzzy method for pre-diagnosis of breast cancer from the Fine Needle Aspirate analysis. BioMed Eng OnLine. 2012;11:83. doi: http://dx.doi.org/10.1186/1475-925X-11-83.
    » https://doi.org/10.1186/1475-925X-11-83
  • 47.
    Li Z, Teng Z, Miao H. Modeling and control for HIV/AIDS transmission in China based on data from 2004 to 2016. Comp Math Methods Med. 2017;8935314. doi: http://dx.doi.org/10.1155/2017/8935314.
    » https://doi.org/10.1155/2017/8935314
  • 48.
    Kanwal S, Khan F, Alamri S, Dashtipur K, Gogate M. COVID-opt-aiNet: a clinical decision support system for COVID-19 detection. Int J Imaging Syst Technol. 2022;32(2):444–61. doi: https://doi.org/10.1002/ima.22695.
    » https://doi.org/10.1002/ima.22695
  • 49.
    Barstugan M, Ozkaya U, Ozturk S. Coronavirus (COVID-19) classification using ct images by machine learning methods. arXiv. 2020; [cited 2022 Dec 23];2003:09424. Available from: http://arxiv.org/abs/2003.09424
    » http://arxiv.org/abs/2003.09424
  • 50.
    Daley BJ, Ni’Man M, Neves MR, Huda MSB, Marsh W, Fenton NE, et al. mHealth apps for gestational diabetes mellitus that provide clinical decision support or artificial intelligence: a scoping review. Diabet Med. 2022;39(1):e14735. doi: http://dx.doi.org/10.1111/dme.14735. PubMed PMID: 34726798.
    » https://doi.org/10.1111/dme.14735
  • 51.
    Jeffery R, Iserman E, Haynes RB, CDSS Systematic Review Team. Can computerized clinical decision support systems improve diabetes management? A systematic review and meta-analysis. Diabet Med. 2013;30(6):739–45. doi: http://dx.doi.org/10.1111/dme.12087. PubMed PMID: 23199102.
    » https://doi.org/10.1111/dme.12087
  • 52.
    Gurupur V, Wan TTH. Inherent bias in artificial intelligence-based decision support systems for healthcare. Medicina (Kaunas). 2020;56(3):141. doi: http://dx.doi.org/10.3390/medicina56030141. PubMed PMID: 32244930.
    » https://doi.org/10.3390/medicina56030141

Edited by

ASSOCIATE EDITOR

Cristiane Helena Gallasch

Publication Dates

  • Publication in this collection
    09 Feb 2024
  • Date of issue
    2023

History

  • Received
    31 July 2023
  • Accepted
    06 Dec 2023
Universidade de São Paulo, Escola de Enfermagem Av. Dr. Enéas de Carvalho Aguiar, 419 , 05403-000 São Paulo - SP/ Brasil, Tel./Fax: (55 11) 3061-7553, - São Paulo - SP - Brazil
E-mail: reeusp@usp.br