Diagnostic performance of microRNA-29a in active pulmonary tuberculosis: a systematic review and meta-analysis

Abstract

Background:

In recent years, more and more studies have shown that microRNA-29a (miRNA-29a) can be used as a potential biomarker for active tuberculosis, but the results of these studies are not consistent.

Objective:

To comprehensively evaluate the value of miRNA-29a in the diagnosis of active tuberculosis by meta-analysis.

Methods:

The databases of CNKI, WanFang, PubMed, The Cochrane Library, Web of Science and EMBASE were searched for relevant studies. Studies were screened strictly according to inclusion and exclusion criteria. QUA-DAS-2 scale was used to evaluate the quality of the included studies. Data were extracted and analyzed by Meta-DiSc 1.4 and Stata 16.0 software.

Results:

13 articles were included, including a total of 1598 subjects, including 872 active tuberculosis patients and 726 controls. The combined sensitivity and specificity of miRNA-29a in the diagnosis of active tuberculosis were 78 % and 76 %, respectively, and the area under the overall summary receiver operating characteristic curve was 0.8564.

Conclusion:

miRNA-29a can be used as a biomarker for the diagnosis of active tuberculosis.

Keywords:
Tuberculosis; microRNA-29a; Diagnosis; Meta-analysis

HIGHLIGHTS

A meta-analysis was applied to analyze the performance of miRNA-29a in diagnosing active pulmonary tuberculosis.

miRNA-29a can be used as a biomarker for the diagnosis of active tuberculosis.

Tuberculosis burden and sample type of miRNA-29a may influence its diagnostic performance.

Introduction

Tuberculosis (TB) is an infectious disease caused by Mycobacterium Tuberculosis (MTB), which is spread by droplets with pathogenic bacteria. The disease usually occurs in the lungs, but any extra-pulmonary site may be involved.¹ Currently, nearly 25 % of patients with latent TB infection worldwide.² Although patients with latent infection have no clinical symptoms, 5 %‒10 % of them may develop active TB and become a new source of infection.³ According to the World Health Organization, the global incidence of TB has seen a partial recovery after a sharp decline due to the impact of the novel coronavirus pneumonia pandemic. With some 6.4 million new TB cases reported globally in 2021 and over 1.6 million deaths, the global TB burden is still heavy.⁴ Diagnosing TB can be challenging because of its different clinical forms and disease severity.⁵ In order to realize the strategy of eliminating TB, it is the key to develop simple, reliable, and economical biomarkers to diagnose the disease.

MicroRNAs (miRNAs) are small regulatory non-coding RNAs with a length of about 22 nucleotides, which mainly play roles in the post-transcriptional regulation of gene expression,⁶ and are crucial for biological processes such as cell proliferation, differentiation, and apoptosis.⁷ Altered expression patterns of miRNAs have been demonstrated in multiple human diseases, and their dysregulation is an important factor in disease progression.⁸ The lungs have a very specific miRNA expression profile, and these miRNAs play undeniable roles in lung development and maintaining lung homeostasis. The changes in miRNA expression profile may be related to pathological processes in the lungs and lead to the development of various lung diseases, including mild inflammatory diseases to severe lung cancer.⁹, ¹⁰ Garg et al.¹¹ found that the serum miRNA-29a level in TB patients was significantly higher than that in healthy controls, indicating a good ability to distinguish TB patients from healthy people. The results of another study also showed that miRNA-29a could be used as a biomarker of active TB, and the expression level was related to clinical characteristics.¹²

In recent years, miRNA-29a has been widely studied in the diagnosis of active TB, but the results are inconsistent. This study aims to comprehensively evaluate the value of miRNA-29a in the diagnosis of active TB through meta-analysis, providing an evidence-based basis for further research and clinical application of miRNA-29a.

Methods

Search strategy

This meta-analysis was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines 2020.¹³ The authors searched the literature on miRNA-29a diagnosis of active TB in CNKI, Wanfang, PubMed, The Cochrane Library, Web of Science, and EMBASE databases. The search terms were as follows: (“tuberculosis” or “active tuberculosis” or “mycobacterium” or “TB” or “ATB”) and (“microRNA-29a” or “miRNA-29a” or “miR-29a”). The retrieval time was from the establishment of each database to December 2022.

Inclusion and exclusion criteria

The inclusion criteria were as follows: (1) Original studies assessed the accuracy of miRNA-29a in diagnosing active TB, (2) There were clear reference standards for the diagnosis of each individual, (3) Studies reported True Positive (TP), False Positive (FP), True Negative (TN), and False Negative (FN), or provided sufficient data to calculate them.

The exclusion criteria were as follows: (1) Reviews and conference abstracts, (2) The research was not aimed at active TB, (3) Not a diagnostic study, (4) The study was not focused on miRNA-29a.

Data extraction

The authors read the entire content of each eligible article, and a researcher extracted the following data: the first author, country of publication, year of publication, sample type, TP, TN, FP, FN, and participant characteristics. All data were aggregated and processed in the form of characteristic tables. Another researcher checked the data for accuracy and completeness. Disagreements were resolved through discussion.

Quality assessment

The authors assessed the quality and risk of bias of each study using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2), which included four fields: patient selection, index test, reference standard, flow, and timing. The evaluation result was defined as “yes”, “no”, or “unclear”, with corresponding risk biases of “low”, “high”, and “unclear”.

Statistical analysis

Meta-DiSc 1.4 and Stata 14.0 software were used for statistical analysis. The Spearman correlation coefficient between the logarithm of sensitivity and the logarithm of (1-specificity) was calculated to test the threshold effect. If p < 0.05, it indicates the existence of a threshold effect. Calculate the I² index of sensitivity and specificity to evaluate heterogeneity caused by non-threshold effects between studies. I² values above 50 % were considered significant heterogeneity, then a random effects model should be used to combine sensitivity, specificity, Positive Likelihood Ratio (PLR), Negative Likelihood Ratio (NLR), and diagnostic Odds Ratio (DOR). And further explored the sources of heterogeneity. Evaluated the overall diagnostic value of miRNA-29a using the overall Summary Receiver Operating Characteristic (SROC) curve. Finally, the Deeks’ funnel plot asymmetry test was used to evaluate publication bias.

Results

Literature search

After a preliminary search, a total of 141 records were found. The authors removed 44 duplicate articles and excluded 60 articles by reading titles and abstracts. Then carefully read the full text of the remaining 37 articles. Since extrapulmonary TB is generally not contagious, the authors excluded those articles, as well as articles with duplicate data and articles without sufficient data. Finally, 13 articles were included for analysis.¹¹, ¹², ¹⁴, ¹⁵, ¹⁵, ¹⁶, ¹⁷, ¹⁸, ¹⁹, ²⁰, ²¹, ²², ²³, ²⁴ The flow chart of the research search and selection is shown in Fig. 1.

Fig. 1
Flow chart of the study selection process.

Study characteristics and quality assessment

The included 13 studies were published from 2014 to 2022 and were from China (8), India (2), Australia (1), Indonesia (1), and Cameroon (1), covering a total of 1598 subjects, of which 872 active TB patients and 726 controls. In all included studies, the diagnosis of TB was based on bacteriological, clinical, and radiological evidence, and miRNA-29a was determined by real-time quantitative Polymerase Chain Reaction. The characteristics of the included studies are listed in Table 1. The authors used the QUADAS-2 tool to assess the basis of patient selection, index test, reference standard, flow and timing, and the risk of bias of applicability concerns. The result was visualized, as shown in Fig. 2.

Table 1
Characteristics of the included studies.

Author	Year	Country	Age	TB burden	HIV status (n)	Sample	Dysregulated status	Case/Control (n)	TP	FP	FN	TN
Angria20	2022	Indonesia	Adult	High	NA	Blood	Up	50/30	43	8	7	22
Barry14	2018	Australia	Adult	Low	NA	Plasma	Up	100/100	37	4	63	96
Cai21	2016	China	Adult	High	Negative	Plasma	Up	30/30	24	9	6	21
Cao18	2014	China	Adult	High	Negative	Plasma	Up	40/60	27	15	13	45
Chen22	2017	China	Adult	High	NA	Plasma	Up	45/45	30	3	15	42
Fu15	2011	China	Adult + child	High	Negative	Serum	Up	30/30	25	6	5	24
Garg11	2021	India	Adult	High	NA	Blood	Up	30/30	24	5	6	25
Li12	2020	China	Adult	High	NA	Serum	Up	192/186	172	54	20	132
Liu19	2015	China	Adult	High	Negative	Blood	Up	60/20	42	6	18	14
Ndzi16	2019	Cameroon	Adult + child	Low	Positive (17)	Plasma	Up	62/42	50	12	12	30
Wagh17	2017	India	Adult	High	Negative	Serum	Down	30/30	29	16	1	14
Zhan23	2019	China	Adult	High	Negative	Plasma	Up	151/78	142	28	9	50
Zhang24	2021	China	Adult	High	Negative	Plasma	Up	52/45	35	9	17	36

• Dysregulated status: miRNA-29a was up-regulated or down-regulated in each study.

Fig. 2
Quality assessments of the included studies.

Diagnostic accuracy of miRNA-29a in active tuberculosis

Meta-DiSc software was used to analyze extracted data. The I² of sensitivity and specificity were 91.8 % and 81.0 %, respectively, indicating significant heterogeneity. Therefore, the authors used the random effects model to combine diagnostic indicators. The combined sensitivity of miRNA-29a for diagnosing active TB was 0.78 (95 % CI 0.75‒0.81), the combined specificity was 0.76 (95 % CI 0.73‒0.79), the combined PLR was 3.03 (95 % CI 2.48‒3.69), the combined NLR was 0.27 (95 % CI 0.17‒0.42), and the combined DOR was 14.03 (95 % CI 10.23‒19.25). The area under the SROC curve was 0.8564. Forest plots of indicators and the SROC curve are shown in Fig. 3.

Fig. 3
The forest plots of combined sensitivity (A), specificity (B), PLR (C), NLR (D), DOR (E) and SROC curve (F) for miRNA-29a to diagnose active tuberculosis.

Threshold effect and sensitive analysis

Due to the heterogeneity that may be caused by the threshold effect and non-threshold effect, the authors used the Spearman correlation coefficient (0.730, p = 0.005, p < 0.05) to evaluate the threshold effect, and the result showed that there was a threshold effect in this study. Sensitive analysis was performed by Stata software. As shown in Fig. 4, one original study showed strong sensitivity. After excluding the study by Barry et al.,¹⁴ the combined sensitivity was 0.83 (95 % CI 0.80‒0.86), the combined specificity was 0.73 (95 % CI 0.69‒0.76), the combined PLR was 2.87 (95 % CI 2.41‒3.42), the combined NLR was 0.25 (95 % CI 0.19‒0.35), and the combined DOR was 13.96 (95 % CI 9.89‒19.70). Except for combined sensitivity, all other diagnostic indicators had decreased to varying degrees, indicating that there may be significant heterogeneity between this study and the other 12 studies.

Fig. 4
Sensitive analysis result.

Subgroup analysis and meta-regression

The authors performed subgroup analysis of the included studies by age, TB burden, sample type, and miRNA-29a dysregulation status. The results showed that the sensitivity and specificity of miRNA-29a were similar in the two groups when stratified by age. The sensitivity of miRNA-29a was higher in areas with a high TB burden than in areas with a low TB burden, but the specificity was the opposite. Serum-derived miRNA-29a had the highest sensitivity, while plasma-derived miRNA-29a had the highest specificity. The results of the subgroup analysis are shown in Table 2. With the above 4 factors as covariables, meta-regression analysis was used to further explore the source of heterogeneity of the non-threshold effect, and the results are shown in Fig. 5. For sensitivity, the sample type had statistical significance (p < 0.01). For specificity, the TB burden was statistically significant (p < 0.01).

Table 2
Subgroup analysis results.

Subgroups	Studies (n)	Sensitivity	Specificity
Age
Adult	11	0.78 (0.74‒0.80)	0.76 (0.73‒0.79)
Adult + child	2	0.82 (0.72‒0.89)	0.75 (0.63‒0.84)
TB burden
High	11	0.84 (0.81‒0.86)	0.73 (0.69‒0.76)
Low	2	0.54 (0.46‒0.62)	0.89 (0.82‒0.93)
Sample type
Plasma	7	0.72 (0.68‒0.76)	0.80 (0.76‒0.84)
Serum	3	0.90 (0.85‒0.93)	0.69 (0.63‒0.75)
Blood	3	0.78 (0.70‒0.84)	0.76 (0.65‒0.85)
Dysregulation status
Up	12	0.77 (0.74‒0.80)	0.77 (0.74‒0.80)
Down	1	-	-

• Dysregulated status: miRNA-29a was up-regulated or down-regulated in each study.

Fig. 5
Meta-regression analysis results. For age, “yes” meant that participants were adults and “no” meant that participants were adults and children; for TB burden, “yes” meant that TB burden was high and “no” meant that TB burden was low; for sample, “yes” meant that the sample source was plasma and “no” meant that the sample source was not plasma; and for dysregulation status, “yes” meant that miRNA-29a was up-regulated and “no” meant that miRNA-29a was down-regulated.

Publication bias

Deeks’ funnel plot asymmetry was used to test for publication bias. As shown in Fig. 6, p = 0.17, p > 0.05, indicating that no significant publication bias was found in the included studies.

Fig. 6
Deeks’ funnel plots for the assessment of publication bias.

Discussion

The traditional diagnosis method of TB is based on clinical and radiological evidence, but the confirmation test must be etiology and/or histology.²⁵ Histological specimens usually require invasive procedures to obtain and are not easily obtainable in clinical practice. At present, there are three main effective methods for detecting active TB: microscopy, nucleic acid amplification tests, and cultures.²⁶ The main limitations of microscopy are its low sensitivity and its inability to distinguish MTB from non-tuberculous mycobacteria.²⁷ Nucleic acid amplification tests do not distinguish between viable and non-viable bacteria, and their detection depends on the bacterial load in the tested specimen.²⁸ The culture of MTB from the analyzed sample is the definitive method of TB, but it usually takes two to six weeks.²⁹ Despite many advances that have been made in the diagnosis of TB, accurate, fast, and simple diagnosis of active TB remains a challenge. miRNAs are involved in many normal cellular processes, such as cell cycle control, apoptosis, and developmental and physiological processes.³⁰ In recent years, it has been found that miRNAs play important roles in regulating immunity against MTB.³¹ MTB can induce or inhibit the expression of miRNAs, and miRNAs are involved in regulating gene expression in the main target cells of MTB, such as macrophages, dendritic cells, natural killer cells, and T-cells.³² miRNA-29a is the most richly expressed member of the miRNA-29 family. It is a key regulatory factor of adaptive immunity. miRNA-29a is mainly located in the cytoplasm and is expressed in T-cells and B-cells as well as major helper cell types of thymic epithelial cells and dendritic cells. [³³, ³⁴] miRNA-29a is a miRNA associated with MTB infection that inhibits the immune response to MTB by reducing IFN-γ levels.²⁰

The effect of miRNA-29a in the diagnosis of active TB varies according to different study areas and subjects. Therefore, the authors summarized and analyzed the literature on the diagnosis of active TB with miRNA-29a and evaluated the value of miRNA-29a in the diagnosis of active TB. The present results showed that the combined sensitivity, specificity, PLR, NLR, and DOR of miRNA-29a in the diagnosis of active TB were 78 %, 76 %, 3.03, 0.27, and 14.03, respectively. The area under the SROC curve was 0.8564, indicating that miRNA-29a had a good ability to diagnose active TB.

The I² of sensitivity and specificity were both greater than 50 %, suggesting significant heterogeneity in this study. The key to meta-analysis was to explore the source of heterogeneity. The Spearman correlation coefficient in this study was 0.730, p = 0.005, indicating that the threshold effect was one of the causes of heterogeneity. The results of sensitivity analysis showed that there was one study with discrete distribution, which may be one of the causes of heterogeneity. The authors further explored the source of heterogeneity of non-threshold effect by subgroup analysis and meta-regression. Subgroup analysis showed that the diagnostic sensitivity and specificity of miRNA-29a were similar in adults and non-adults. In high TB burden areas, miRNA-29a was more accurate in identifying TB patients, while in low TB burden areas, miRNA-29a was more accurate in identifying non-TB patients. Among different sample types, serum-derived miRNA-29a had the highest sensitivity, while plasma-derived miRNA-29a had the highest specificity. The results of regression analysis showed that the source of miRNA-29a samples and the burden of TB may also be the cause of heterogeneity. However, the present subgroup analysis did not fully cover the factors that may have contributed to the heterogeneity. Other factors such as HIV infection status may also explain the heterogeneity, which unfortunately was not analyzed due to insufficient data.

The limitations the our meta-analysis were that most of the included studies were conducted in countries with a high burden of TB, and the sample size for active TB was only 872 in the 13 included articles. Therefore, a larger study with uniform standards is needed to verify the present results in the future.

Conclusion

The results of this meta-analysis indicated that miRNA-29a had a good diagnostic performance as a biomarker for the diagnosis of active TB.

Acknowledgments

None

• Ethics approval and consent to participate
  Not applicable.
• Funding
  No funding was received.

References

• ¹
  Dheda K., Barry C.E., Maartens G. Tuberculosis lancet 2016;387(10024):1211-26.
• ²
  Cohen A, Mathiasen VD, Schon T, Wejse C. The global prevalence of latent tuberculosis: a systematic review and meta-analysis. Eur Respir J 2019;54(3):1900655.
• ³
  WHO guidelines approved by the guidelines review committee. latent tuberculosis infection: updated and consolidated guidelines for programmatic management. Geneva: World Health Organization©. World Health Organization; 2018.
• ⁴
  Global tuberculosis report 2022. Geneva: World Health organization; 2022. Licence: cc bY-Nc-sa 3.0 iGo. https://www.who.int/publications/i/item/9789240061729
  » https://www.who.int/publications/i/item/9789240061729.
• ⁵
  O’Garra A, Redford PS, McNab FW, Bloom CI, Wilkinson RJ, Berry MP. The immune response in tuberculosis. Annu Rev Immunol 2013;31:475–527.
• ⁶
  Matsuyama H, Suzuki HI. Systems and synthetic microRNA Biology: from biogenesis to disease pathogenesis. Int J Mol Sci 2019;21(1):132.
• ⁷
  Nazarov PV, Reinsbach SE, Muller A, Nicot N, Philippidou D, Vallar L, et al. Interplay of microRNAs, transcription factors and target genes: linking dynamic expression changes to function. Nucleic Acids Res 2013;41(5):2817–31.
• ⁸
  Saliminejad K, Khorram Khorshid HR, Soleymani Fard S, Ghaffari SH. An overview of microRNAs: biology, functions, therapeutics, and analysis methods. J Cell Physiol 2019;234(5):5451–65.
• ⁹
  Boateng E, Krauss-Etschmann S. miRNAs in lung development and diseases. Int J Mol Sci 2020;21(8):2765.
• ¹⁰
  Rupani H, Sanchez-Elsner T, Howarth P. MicroRNAs and respiratory diseases. Eur Respir J 2013;41(3):695–705.
• ¹¹
  Garg J, Garg A, Kumar A. Circulating microRNA 29a: an evolving biomarker for diagnosis of pulmonary tuberculosis. J Clin Diagnostic Res 2021;15(3):DC19–23.
• ¹²
  Li Z, Li C, Bao R, Liu Z. Expressions of miR-29a, TNF-A and vascular endothelial growth factor in peripheral blood of pulmonary tuberculosis patients and their clinical significance. Iran J Public Health 2020;49(9):1683–91.
• ¹³
  Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Syst Rev 2021;10(1):89.
• ¹⁴
  Barry SE, Ellis M, Yang Y, Guan G, Wang X, Britton WJ, et al. Identification of a plasma microRNA profile in untreated pulmonary tuberculosis patients that is modulated by anti-mycobacterial therapy. J Infect 2018;77(4):341–8.
• ¹⁵
  Fu Y, Yi Z, Wu X, Li J, Xu F. Circulating microRNAs in patients with active pulmonary tuberculosis. J Clin Microbiol 2011;49(12):4246–51.
• ¹⁶
  Ndzi EN, Nkenfou CN, Mekue LM, Zentilin L, Tamgue O, Pefura EWY, et al. MicroRNA hsa-miR-29a-3p is a plasma biomarker for the differential diagnosis and monitoring of tuberculosis. Tuberculosis (Edinb) 2019;114:69–76.
• ¹⁷
  Wagh V, Urhekar A, Modi D. Levels of microRNA miR-16 and miR-155 are altered in serum of patients with tuberculosis and associate with responses to therapy. Tuberculosis (Edinb) 2017;102:24–30.
• ¹⁸
  Cao SL, Shen AP, Zhu QF, Yang Q, Cao XD, Xing JX, et al. A study on the possibility of using circulating microRNA as biomarkers for the diagnosis of tuberculosis. Chin J Microbiol Immunol 2014(10):787–92. In Chinese.
• ¹⁹
  Liu YM, Li DD, Zhu SY, Liu QQ, Chen QX, An JN, et al. Expression of miR-29a in peripheral blood leucocyte as biomarker of pulmonary tuberculosis and its diagnostic potential. J Prev Med Inf 2015;31(10):755–8.
• ²⁰
  Angria N, Massi MN, Bukhari A, Djaharuddin I, Jumadi O, Ahmad A, et al. Expression of miRNA-29a-3p and IFN-gamma as biomarkers in active and latent pulmonary tuberculosis. Ann Med Surg (Lond) 2022;83:104786.
• ²¹
  Cai QS, Chen YY, Xia Q, Sun YP. Study on the expression and clinical significance of miRNA in peripheral blood of patients with pulmonary tuberculosis. Chin J Gen Pract 2016;14(4). 546-8,588In Chinese.
• ²²
  Chen XF, Xu WF. The expression and clinical significance of miR-29a in peripheral biood of patients with active pulmonary tuberculosis. Chin J Microecol 2017;29(12).1416-1419+1423. In Chinese.
• ²³
  Zhan Y, Liu SY, Liu YW, Liu HZ, Zhou ST, Li X, et al. Diagnose value of miR-29a and T-SPOT assay in active pulmonary tuberculosis patients. J Clin Hematol 2019;32(10):765–8. In Chinese.
• ²⁴
  Zhang GD, Lei D, Zhu YB, Wu HL. Expression and significance of the plasma miR-29 family and interferon-gamma in serum and peripheral blood mono-nuclear cells of patients with active pulmonary tuberculosis. Chin J Diffic Compl Cas 2021;20(11):1131–5. In Chinese.
• ²⁵
  Jabri H, Lakhdar N, El Khattabi W, Afif H. Diagnostic means for tuberculosis. Rev Pneumol Clin 2016;72(5):320–5.
• ²⁶
  Pai M, Nicol MP, Boehme CC. Tuberculosis diagnostics: state of the art and future directions. Microbiol Spectr 2016;4(5).
• ²⁷
  Chopra KK, Singh S. Tuberculosis: newer diagnostic tests: applications and limitations. Indian J Tuberc 2020;67(4S):S86–90.
• ²⁸
  Dorman S. Advances in the diagnosis of tuberculosis: current status and future prospects. Int J Tuberc Lung Dis 2015;19(5):504–16.
• ²⁹
  Gupta S, Kakkar V. Recent technological advancements in tuberculosis diagnostics - A review. Biosens Bioelectron 2018;115:14–29.
• ³⁰
  Ruiz-Tagle C, Naves R, Balcells ME. Unraveling the role of MicroRNAs in mycobacterium tuberculosis infection and disease: advances and pitfalls. Infect Immun 2020;88(3):e00619–49.
• ³¹
  Kundu M, Basu J. The role of microRNAs and long non-coding RNAs in the regulation of the immune response to mycobacterium tuberculosis infection. Front Immunol 2021;12:687962.
• ³²
  Sinigaglia A, Peta E, Riccetti S, Venkateswaran S, Manganelli R, Barzon L. Tuberculosis-associated MicroRNAs: from pathogenesis to disease biomarkers. Cells. 2020;9(10):2160.
• ³³
  Horita M, Farquharson C, Stephen LA. The role of miR-29 family in disease. J Cell Biochem 2021;122(7):696–715.
• ³⁴
  Liston A, Papadopoulou AS, Danso-Abeam D, Dooley J. MicroRNA-29 in the adaptive immune system: setting the threshold. Cell Mol Life Sci 2012;69(21):3533–41.

Publication Dates

• Publication in this collection
  13 Nov 2023
• Date of issue
  2023

History

• Received
  28 Apr 2023
• Reviewed
  30 Aug 2023
• Accepted
  26 Sept 2023