Acessibilidade / Reportar erro

A predictive score for COVID-19 diagnosis using clinical, laboratory and chest image data

Abstract

Objectives

Differential diagnosis of COVID-19 includes a broad range of conditions. Prioritizing containment efforts, protective personal equipment and testing can be challenging. Our aim was to develop a tool to identify patients with higher probability of COVID-19 diagnosis at admission.

Methods

This cross-sectional study analyzed data from 100 patients admitted with suspected COVID-19. Predictive models of COVID-19 diagnosis were performed based on radiology, clinical and laboratory findings; bootstrapping was performed in order to account for overfitting.

Results

A total of 29% of patients tested positive for SARS-CoV-2. Variables associated with COVID-19 diagnosis in multivariate analysis were leukocyte count ≤7.7 × 103 mm–3, LDH >273 U/L, and chest radiographic abnormality. A predictive score was built for COVID-19 diagnosis, with an area under ROC curve of 0.847 (95% CI 0.77–0.92), 96% sensitivity and 73.5% specificity. After bootstrapping, the corrected AUC for this model was 0.827 (95% CI 0.75–0.90).

Conclusions

Considering unavailability of RT-PCR at some centers, as well as its questionable early sensitivity, other tools might be used in order to identify patients who should be prioritized for testing, re-testing and admission to isolated wards. We propose a predictive score that can be easily applied in clinical practice. This score is yet to be validated in larger populations.

Keywords
Diagnosis; COVID-19; SARS-CoV-2; Predictive score

Introduction

As a result of its broad clinical presentation – from asymptomatic infection to severe acute respiratory syndrome (SARS) – as well as non-specific laboratory and radiological features, differential diagnosis of COVID-19, particularly at admission, is challenging. Influenza, pneumonia, tuberculosis, arbovirus infections, and even non-infectious illnesses have been reported as conditions that can mimic COVID-19.11 World Health Organization. Clinical management of severe acute respiratory infection (SARI) when COVID-19 disease is suspected; 2020.33 Nickel Christian H, Bingisser R. Mimics and chameleons of COVID-19. Swiss Med Wkly. 2020;150:w20231.

Identification of patients at high-risk for COVID-19 before confirmatory testing is key to prioritize containment efforts, RT-PCR tests, and personal protective equipment (PPE), especially in hospital settings. Considering that RT-PCR sensitivity is variable – in some reports, it is as low as 71%,44 Fang Y, Zhang H, Xie J, et al. Sensitivity of chest CT for COVID-19: comparison to RT-PCR. Radiology. 2020;:.
https://doi.org/10.1148/radiol.202020043...
patients at high-risk for COVID-19 with a negative RT-PCR result should be re-tested before being transferred to a non-COVID ward. However, there is little knowledge on how to identify patients who have a higher pre-test probability for COVID-19.

In this study we analyzed significant variables associated with initial COVID-19 diagnosis. Our objective was to develop a useful predictive tool for COVID-19 diagnosis based on clinical, laboratory and image data prior to RT-PCR test confirmation. ROC Curve models and a clinical score are provided aiming to predict early SARS-CoV-2 infection diagnosis.

Methods

The first 118 consecutive patients aged 18 or older admitted to Hospital de Clínicas de Porto Alegre, an 831 bed tertiary referral hospital located in Southern Brazil, due to suspected COVID-19 were assessed. Clinical, laboratory and radiological findings at presentation were analyzed. Patients discharged within 24 h of admission were excluded. This study protocol was approved by the institutional review board, and informed consent was obtained from each patient or closest family member.

Upon admission, samples of nasal and throat swabs were collected by trained healthcare professionals according to the American Centers for Disease Control and Prevention (CDC) guidelines. The sample was used for real-time polymerase chain reaction (RT- PCR), designed to detect three regions of the virus nucleocapsid (N1, N2, N3), according to the CDC diagnostic panel.55 Interim Guidelines for Collecting, Handling, and Testing Clinical Specimens from Persons for Coronavirus Disease 2019 (COVID-19). Available from: https://www.cdc.gov/coronavirus/2019-ncov/lab/guidelines-clinical-specimens.html.
https://www.cdc.gov/coronavirus/2019-nco...
Patients undertook chest image exams before RT-PCR results; therefore, radiologists were unaware of the patient diagnosis.

Patients were divided into those who had positive RT-PCR for SARS-CoV-2 and those with negative results. Kruskal–Wallis test, χ 2 test and Fisher's exact test were used to compare differences between groups.

For our predictive score, variables associated with outcome (defined as p ≤ 0.05) in univariate analysis were tested in a logistic regression model. Each significant variable received points based on multivariate model odds ratio (OR). Variables that showed no significant association with COVID-19 diagnosis in univariate analysis were not included. The final model included abnormality on chest radiography, LDH levels, and leukocyte count. Bootstrapping was performed to assess overfitting of the models. Development of this score was performed according to TRIPOD guidelines.66 The TRIPOD Statement: Explanation and Elaboration. Available from: https://annals.org/aim/fullarticle/2088542/transparent-reporting-multivariable-prediction-model-individual-prognosis-diagnosis-tripod-explanation.
https://annals.org/aim/fullarticle/20885...

Results

Patients were admitted from March 17 to April 10, 2020; 18 were excluded because they had been discharged within 24 h of admission. Out of 100 patients, 29 were SARS-CoV-2 positive. Main characteristics are listed in Table 1.

Table 1
Clinical, laboratory and radiographic characteristics of patients with suspected SARS-CoV-2 infection at admission.

Four patients (13.7%) of the confirmed group were hospital healthcare staff. In the negative RT-PCR group, six (21.4%) patients had no contact with confirmed or suspected cases, compared to 58 (82.8%) in the confirmed group (p < 0.001). No patients in the negative group had traveled in the previous three weeks, compared to eight (28.6%) patients in the confirmed group (p < 0.001).

Patients in the negative group were more likely to have a higher number of comorbidities and to present with a higher PSI/PORT index. There was no difference in CURB-65 score among groups (p = 0.10).

The optimal cut-off value was 273 U/L for LDH and 7.7 × 103 per mm3 for leukocyte count. Results from the multivariable analyses are presented in Table 2.

Table 2
Results of multivariable analysis.

Of the 29 patients who tested positive for SARS-CoV-2, four had a previous negative result. For the remaining 71 who were considered negative, 19 (26%) were re-tested – 15 of them because the first test was inconclusive, and four patients because of clinical suspicion.

Predictive score

A predictive score for COVID-19 was built including variables that had shown an association with outcome in multivariate analysis; it yielded two points for LDH >273 U/L, three for leukocyte count ≤7.7 × 103 per mm3 and four for any chest radiography abnormality. A result ≥5 points was considered positive. This score had 96% sensitivity and 73.5% specificity in our sample, with an area under ROC curve (AUC) of 0.847 (95% CI 0.77–0.92), as seen in Fig. 1.

Fig. 1
ROC Curve for model including leukocyte count, LDH and chest radiography abnormality.

After bootstrapping, this model had an AUC of 0.827 (95% CI 0.75–0.90) (Fig. 1).

Discussion

RT-PCR TESTING

Two patients in the COVID-19 group had tested negative at admission; after negative results, they were transferred to non-COVID wards. Because of clinical suspicion, these patients were re-tested, yielding positive results.

Admitting a COVID-19 patient into a regular ward can be catastrophic. We advocate that patients who are to be moved to regular wards be re-tested before they are transferred; if testing all of them was not possible, patients with higher probability for COVID-19 – using a combination of clinical, laboratory and radiological data – should be prioritized for testing. Those who are discharged with one negative RT-PCR result should be advised to remain isolated at home for two weeks.

In addition, two other cases in the positive group were health workers who had tested negative two days before retesting. Infected health care workers are likely to transmit SARS-CoV-2 to patients with comorbidities – which are at higher risk for severe infection. Hence, we highlight the need for more than one negative result in order to allow health care workers to return to work. Although the CDC advocates the need for at least two negative nasopharyngeal swab specimens,77 Criteria for Return to Work for Healthcare Personnel with Confirmed or Suspected COVID-19 (Interim Guidance). Available from: https://www.cdc.gov/coronavirus/2019-ncov/hcp/return-to-work.html.
https://www.cdc.gov/coronavirus/2019-nco...
some local guidelines around the world require only one negative test.88 Return to Work Guidance for Healthcare Workers (HCWs) and First Responders (FRs) Who Have Confirmed COVID-19 or Are Asymptomatic with High or Medium Risk Exposures* to a Known Case of COVID-19. Available from: https://www.doh.wa.gov/Portals/1/Documents/1600/coronavirus/HealthCareworke rReturn2Work.pdf.
https://www.doh.wa.gov/Portals/1/Documen...

Predictive score

There is increasing need for a validated clinical score estimating COVID-19 probability. Considering shortage of PPE, PCR testing and isolation units in many countries around the world, as well as non-ideal sensitivity of nasopharyngeal swabs, doctors at Emergency and Intensive Care Units should be provided with clinical tools, other than contact history, in order to prioritize isolation and testing. A combination of clinical findings, laboratory data and radiological patterns (when available) can be useful in this context.

Our predictive score yielded good sensitivity and specificity after adjusting for overfitting. Fever was not included in the model because patients without fever are rarely admitted for suspected COVID-19.

Clinical presentation

Most patients with confirmed COVID-19 diagnosis had fever, consistent with data published so far on clinical manifestations of COVID-19.99 Yang W, Cao Q, Qin L, et al. Clinical characteristics and imaging manifestations of the 2019 novel coronavirus disease (COVID-19): a multi-center study in Wenzhou city, Zhejiang, China. J Infect. 2020;80:388-393.1111 Liu Y, Chen H, Tang K, Guo Y. Clinical manifestations and outcome of SARS-CoV-2 infection during pregnancy. Journal of Infection. Article in press. doi:10.1016/j.jinf.2020.02.028.
10.1016/j.jinf.2020.02.028...
Most of them had traveled and/or had contact with a suspected case; this was expected, as our study sample reflects some of the first cases of COVID-19 in our region and most of them were infected before community transmission was declared.

In our sample, patients without COVID-19 were more likely to present with a higher PSI/PORT at admission. We believe these higher scores reflect a higher number of comorbidities and increased severity in the differential diagnosis group, which could explain their increased serum lactate and bilirubin levels at admission. In addition, patients who were returning travelers, and those who had a positive contact history for SARS-CoV-2 seemed to be more prone to have an early hospital presentation. We have excluded patients who were discharged within 24 h to diminish this bias.

Our analysis did not have enough power to demonstrate a significant association for each of the included comorbidities; however, there was an inverse association between number of comorbidities and COVID-19 diagnosis. This can be explained by a number reasons: patients with other comorbidities are more likely to present with severe bacterial pneumonia and sepsis, for example; also, almost a third of COVID-19 cases had traveled in the previous three weeks, compared to none in the other group. Patients with more comorbidities might be less able to travel – which might have lessened the probability of being infected in the first days of transmission in Brazilian territory. As community transmission increases in our region, we believe the contrast in number of comorbidities between COVID-19 and other respiratory conditions may decrease.

Laboratorial findings

Many studies have found that COVID-19 correlates with lower leukocyte count.1212 Guan W, Ni Z, Hu Y, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;:.1414 Liu J, Liu Y, Xiang P, et al. Neutrophil-to-Lymphocyte Ratio Predicts Severe Illness Patients with 2019 Novel Coronavirus in the Early Stage. medRxiv. 2020;:.
https://doi.org/10.1101/2020.02.10.20021...
,1616 Morale-Rodriguez AJ, Cardona-Ospina JA, Gutiérrez-Ocampo E, et al. Clinical, laboratory and imaging features of COVID-19: A systematic review and meta- analysis. Travel Med Infect Dis. 2020;:101623. Relationship between this finding and severity of COVID-19 cases is unknown; some studies have reported that more severe cases had lower leukocyte count1212 Guan W, Ni Z, Hu Y, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;:. while some have reported the inverse.99 Yang W, Cao Q, Qin L, et al. Clinical characteristics and imaging manifestations of the 2019 novel coronavirus disease (COVID-19): a multi-center study in Wenzhou city, Zhejiang, China. J Infect. 2020;80:388-393. In our cohort, a lower leukocyte count (however not sufficient to be categorized as leukopenia) was a predictor for COVID-19 diagnosis. This might be due to marked leukocytosis of some differentials, for instance bacterial infections.

In our sample LDH was a strong predictor for COVID-19 diagnosis. LDH is a predictor of inflammation in several lung diseases. Consistently with data from previous studies,1010 Zhao D, Yao F, Wang L, Zheng L, et al. A comparative study on the clinical features of COVID-19 pneumonia to other pneumonias. Clinical Infectious Diseases, ciaa247, doi:10.1093/cid/ciaa247.
https://doi.org/10.1093/cid/ciaa247https...
higher LDH levels were associated with COVID-19 diagnosis. Most studies revealed that it is a good predictor of severity and ICU admission.1010 Zhao D, Yao F, Wang L, Zheng L, et al. A comparative study on the clinical features of COVID-19 pneumonia to other pneumonias. Clinical Infectious Diseases, ciaa247, doi:10.1093/cid/ciaa247.
https://doi.org/10.1093/cid/ciaa247https...
,1212 Guan W, Ni Z, Hu Y, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;:.,1515 C-reactive protein levels in the early stage of COVID-19. L. Wang. Médecine et Maladies Infectieuses; 2020.

Elevation of ALT and AST have already been described as severity markers; in our study higher levels of ALT were associated with COVID-19 diagnosis. In a systematic review of COVID-19 presentation, 17.2 to 28.3% had elevated ALT, and 29.4 to 75.8% had elevated LDH.1717 Rubin D, Ryerson CJ, Haramati LB, et al. The role of chest imaging in patient management during the COVID-19 pandemic: a multinational consensus statement from the Fleischner Society. Chest. 2020;:.

In our sample, CRP and D-dimer levels were markers of disease severity and associated with ICU admission and higher CURB-65 at admission, irrespective of COVID-19 diagnosis. In a study by Guan et al., CRP was elevated in 60% of COVID-19 patients upon arrival, also associated with ICU admission1212 Guan W, Ni Z, Hu Y, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;:.; some articles reported an association between CRP levels and extension of pulmonary involvement.1515 C-reactive protein levels in the early stage of COVID-19. L. Wang. Médecine et Maladies Infectieuses; 2020.

The lack of a significant association between COVID-19 diagnosis and CRP levels in this study may be due to a small sample size and also increased severity of presentation for non-COVID patients. Also, we have only used CRP levels upon admission; perhaps CRP increase would occur later on in COVID-19 presentation.

Image findings

In our patients submitted to chest CT, the most relevant image findings were ground-glass opacities. In addition, positive cases usually presented with lower lobe predominance; this is consistent with some of the data published so far on radiological patterns of COVID-19,1717 Rubin D, Ryerson CJ, Haramati LB, et al. The role of chest imaging in patient management during the COVID-19 pandemic: a multinational consensus statement from the Fleischner Society. Chest. 2020;:. although some studies have not found a lobe predominance.1818 Ai T, Yang Z, Hou H, et al. Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases. Radiology. 2020;:200642.

It is worth to highlight that in our sample, only one COVID-19 patient had normal chest image. Radiographic patterns associated with COVID-19 are unspecific, indicating the need to correlate imaging with clinical data.

Contact history

Even though report of contact with patients who were positive for SARS-CoV-2 increased accuracy of our score, it was not included as a variable. Once local transmission is established within a region, tracking an epidemiological history becomes impractical.

Differential diagnoses

Although Influenza is reported as one of the most important differential diagnoses of COVID- 19, we had no cases reported, probably due to seasonality; in our region, Influenza cases peak by June.1919 Centro Estadual de Vigilância em Saúde RS. Situação Epidemiológica/Dados. Available from: https://www.cevs.rs.gov.br/situacao-epidemiologica-dados-588b34630bcca.
https://www.cevs.rs.gov.br/situacao-epid...
In winter months, we also expect higher rates of COPD exacerbation; differentiating between these conditions will be challenging.

Excluding COVID-19 is burdensome in a number of ways, but especially in the emergency department, considering COVID-19 can be asymptomatic.2020 Rothe C, Schunk M, Sothmann P, et al. Transmission of 2019-nCoV infection from an asymptomatic contact in Germany. N Engl J Med. doi: 10.1056/NEJMc2001468.
10.1056/NEJMc2001468...
One of our patients sought medical assistance for acute onset of hemiparesis and tested positive for SARS-CoV-2 after a head and neck computed tomography angiography with an incidental finding of ground glass opacities in both superior lung lobes. Among a group of pregnant women admitted for delivery in a New York City hospital, Sutton et al.2121 Sutton D, Fuchs K, D’Alton M, Goffman D. Universal screening for SARS-CoV-2 in women admitted for delivery. N Engl J Med. 2020;:.
https://doi.org/10.1056/NEJMc2009316...
found 13% of asymptomatic patients tested positive. Due to lack of resources, universal testing is not a plausible option, therefore high clinical suspicion, along with low threshold for chest imaging, is advisable.

Limitations

Our study has some limitations, aside from intrinsic limitations of an observational study; most of them are associated with data collected from medical records. Visiting and interviewing patients was not possible at all times; collecting data from patients in mechanical ventilation was challenging and likely to be compromised since it was not always possible to reach for family members.

Our control population has a high number of comorbidities and may not represent the general public; in addition, optimal cut-points for this study may not be the same in other samples. Our study has a small sample size and may not have enough power to evaluate other variables that might be associated with COVID-19 diagnosis. It is important to note that this score has not yet been validated.

Another limitation of our study was the unavailability of a second negative PCR testing for the ruled-out group. Of 23 patients who were re-tested, four turned out positive at re-testing; it is possible that some patients classified as negative would result positive in further testing, particularly those with inconclusive diagnosis. This can also underestimate relationships between COVID- 19 diagnosis and some of the variables analyzed.

Nevertheless, considering the need to segregate in a special ward a patient with a low pre- test probability of COVID19, we find our score useful, especially on the fact that LDH, blood counts and X ray are easily available, even in low income emergency rooms, and poses a low risk to healthcare infection spread. We acknowledge that future evaluation of our proposed scores are needed.

Conclusion

We propose that clinicians use diagnostic tools to anticipate RT-PCR testing. This instrument encompassing WBC count, LDH, and image findings offers adequate sensitivity and specificity for this task.

References

  • 1
    World Health Organization. Clinical management of severe acute respiratory infection (SARI) when COVID-19 disease is suspected; 2020.
  • 2
    Differential diagnosis of illness in patients underinvestigation for the novel coronavirus (SARS-CoV-2), Italy;2020.
  • 3
    Nickel Christian H, Bingisser R. Mimics and chameleons of COVID-19. Swiss Med Wkly. 2020;150:w20231.
  • 4
    Fang Y, Zhang H, Xie J, et al. Sensitivity of chest CT for COVID-19: comparison to RT-PCR. Radiology. 2020;:.
    » https://doi.org/10.1148/radiol.2020200432
  • 5
    Interim Guidelines for Collecting, Handling, and Testing Clinical Specimens from Persons for Coronavirus Disease 2019 (COVID-19). Available from: https://www.cdc.gov/coronavirus/2019-ncov/lab/guidelines-clinical-specimens.html
    » https://www.cdc.gov/coronavirus/2019-ncov/lab/guidelines-clinical-specimens.html
  • 6
    The TRIPOD Statement: Explanation and Elaboration. Available from: https://annals.org/aim/fullarticle/2088542/transparent-reporting-multivariable-prediction-model-individual-prognosis-diagnosis-tripod-explanation
    » https://annals.org/aim/fullarticle/2088542/transparent-reporting-multivariable-prediction-model-individual-prognosis-diagnosis-tripod-explanation
  • 7
    Criteria for Return to Work for Healthcare Personnel with Confirmed or Suspected COVID-19 (Interim Guidance). Available from: https://www.cdc.gov/coronavirus/2019-ncov/hcp/return-to-work.html
    » https://www.cdc.gov/coronavirus/2019-ncov/hcp/return-to-work.html
  • 8
    Return to Work Guidance for Healthcare Workers (HCWs) and First Responders (FRs) Who Have Confirmed COVID-19 or Are Asymptomatic with High or Medium Risk Exposures* to a Known Case of COVID-19. Available from: https://www.doh.wa.gov/Portals/1/Documents/1600/coronavirus/HealthCareworke rReturn2Work.pdf
    » https://www.doh.wa.gov/Portals/1/Documents/1600/coronavirus/HealthCareworke rReturn2Work.pdf
  • 9
    Yang W, Cao Q, Qin L, et al. Clinical characteristics and imaging manifestations of the 2019 novel coronavirus disease (COVID-19): a multi-center study in Wenzhou city, Zhejiang, China. J Infect. 2020;80:388-393.
  • 10
    Zhao D, Yao F, Wang L, Zheng L, et al. A comparative study on the clinical features of COVID-19 pneumonia to other pneumonias. Clinical Infectious Diseases, ciaa247, doi:https://doi.org/10.1093/cid/ciaa247
    » https://doi.org/10.1093/cid/ciaa247
  • 11
    Liu Y, Chen H, Tang K, Guo Y. Clinical manifestations and outcome of SARS-CoV-2 infection during pregnancy. Journal of Infection. Article in press. doi:10.1016/j.jinf.2020.02.028
    » 10.1016/j.jinf.2020.02.028
  • 12
    Guan W, Ni Z, Hu Y, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;:.
  • 13
    Yongxia L, Wei W, Tao Y, et al. Characteristics of peripheral blood leukocyte differential counts in patients with COVID-19 [J/OL]. Chin J Intern Med. 2020;59:.
  • 14
    Liu J, Liu Y, Xiang P, et al. Neutrophil-to-Lymphocyte Ratio Predicts Severe Illness Patients with 2019 Novel Coronavirus in the Early Stage. medRxiv. 2020;:.
    » https://doi.org/10.1101/2020.02.10.20021584
  • 15
    C-reactive protein levels in the early stage of COVID-19. L. Wang. Médecine et Maladies Infectieuses; 2020.
  • 16
    Morale-Rodriguez AJ, Cardona-Ospina JA, Gutiérrez-Ocampo E, et al. Clinical, laboratory and imaging features of COVID-19: A systematic review and meta- analysis. Travel Med Infect Dis. 2020;:101623.
  • 17
    Rubin D, Ryerson CJ, Haramati LB, et al. The role of chest imaging in patient management during the COVID-19 pandemic: a multinational consensus statement from the Fleischner Society. Chest. 2020;:.
  • 18
    Ai T, Yang Z, Hou H, et al. Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases. Radiology. 2020;:200642.
  • 19
    Centro Estadual de Vigilância em Saúde RS. Situação Epidemiológica/Dados. Available from: https://www.cevs.rs.gov.br/situacao-epidemiologica-dados-588b34630bcca
    » https://www.cevs.rs.gov.br/situacao-epidemiologica-dados-588b34630bcca
  • 20
    Rothe C, Schunk M, Sothmann P, et al. Transmission of 2019-nCoV infection from an asymptomatic contact in Germany. N Engl J Med. doi: 10.1056/NEJMc2001468
    » 10.1056/NEJMc2001468
  • 21
    Sutton D, Fuchs K, D’Alton M, Goffman D. Universal screening for SARS-CoV-2 in women admitted for delivery. N Engl J Med. 2020;:.
    » https://doi.org/10.1056/NEJMc2009316

Publication Dates

  • Publication in this collection
    02 Oct 2020
  • Date of issue
    Jul-Aug 2020

History

  • Received
    19 Apr 2020
  • Accepted
    22 June 2020
Brazilian Society of Infectious Diseases Rua Augusto Viana, SN, 6º., 40110-060 Salvador - Bahia - Brazil, Telefax: (55 71) 3283-8172, Fax: (55 71) 3247-2756 - Salvador - BA - Brazil
E-mail: bjid@bjid.org.br