Delirium rating scales in critically ill patients: a systematic literature review

Carvalho, João Pedro Lins Mendes; Almeida, Antônio Raimundo Pinto de; Gusmao-Flores, Dimitri

doi:10.5935/0103-507X.20130026

Abstracts

OBJECTIVE: To identify scales that can establish a quantitative assessment of delirium symptoms in critically ill patients through a systematic review. METHODS: Studies that evaluated delirium stratification scales in patients hospitalized in intensive care units were selected in a search performed in the MedLine database. Validation studies of these scales and their target patient populations were analyzed, and we identified the examiner and the signs and symptoms evaluated. In addition, the duration of the application and the sensitivity and specificity of each scale were assessed. RESULTS: Six scales were identified: the Delirium Detection Score, the Cognitive Test of Delirium, the Memorial Delirium Assessment Scale, the Intensive Care Delirium Screening Checklist, The Neelon and Champagne Confusion Scale and the Delirium Rating Scale-Revised-98. CONCLUSION: The scales identified allow the stratification and monitoring of critically ill patients with delirium. Among the six scales, the most studied and best suited for use in the intensive care units was the Intensive Care Delirium Screening

Delirium; Evaluation; Scales; Sensitivity and specificity; Intensive Care Units

OBJETIVO: Identificar escalas capazes de estabelecer uma avaliação quantitativa dos sintomas do delirium em pacientes graves por meio de uma revisão sistemática. MÉTODOS: Foram selecionados estudos que avaliaram escalas de estratificação de delirium em pacientes internados em unidades de terapia intensiva a partir de busca na base de dados MedLine. Os estudos de validação dessas escalas foram analisados, e foram identificados os pacientes alvos para aplicação, o avaliador, os sinais e sintomas avaliados, a duração da aplicação, além da sensibilidade e da especificidade de cada escala. RESULTADOS: Seis escalas foram identificadas: o Delirium Detection Score, o Cognitive Test of Delirium, a Memorial Delirium Assessment Scale, o Intensive Care Delirium Screening Checklist, a The Neelon and Champagne Confusion Scale e a Delirium Rating Scale-Revised-98. CONCLUSÃO: As escalas identificadas permitem estratificação e acompanhamento do paciente grave com delirium. Dentre as seis escalas, a mais estudada e que melhor se adequa ao uso em unidade de terapia intensiva foi o Intensive Care Delirium Screening Checklist.

Delírio; Avaliação; Escalas; Sensibilidade e especificidade; Unidades de terapia intensiva

REVIEW ARTICLE

^IFaculdade de Medicina da Bahia, Universidade Federal da Bahia - UFBA - Salvador (BA), Brazil

^IIGraduate Program in Interactive Process of Organs and Systems, Instituto de Ciência da Saúde, Universidade Federal da Bahia - UFBA - Salvador (BA), Brazil

^IIIIntensive Care Unit, Hospital Universitário Prof. Edgar Santos, Universidade Federal da Bahia - UFBA - Salvador (BA), Brazil

Corresponding author

ABSTRACT

OBJECTIVE: To identify scales that can establish a quantitative assessment of delirium symptoms in critically ill patients through a systematic review.

METHODS: Studies that evaluated delirium stratification scales in patients hospitalized in intensive care units were selected in a search performed in the MedLine database. Validation studies of these scales and their target patient populations were analyzed, and we identified the examiner and the signs and symptoms evaluated. In addition, the duration of the application and the sensitivity and specificity of each scale were assessed.

RESULTS: Six scales were identified: the Delirium Detection Score, the Cognitive Test of Delirium, the Memorial Delirium Assessment Scale, the Intensive Care Delirium Screening Checklist, The Neelon and Champagne Confusion Scale and the Delirium Rating Scale-Revised-98.

CONCLUSION: The scales identified allow the stratification and monitoring of critically ill patients with delirium. Among the six scales, the most studied and best suited for use in the intensive care units was the Intensive Care Delirium Screening Checklist.

Keywords: Delirium; Evaluation/methods; Scales; Sensitivity and specificity; Intensive Care Units

INTRODUCTION

Delirium is a common neurological dysfunction observed in intensive care units (ICU). Its incidence ranges from 5 to 92% according to the population studied,^(1-4) and delirium is associated with high mortality, longer ICU hospitalizations, extended periods of mechanical ventilation, and long-term cognitive and functional deficits.^(1-3,5-7)

Despite being a major neurological syndrome, delirium is underdiagnosed,^(1,3) particularly in patients on mechanical ventilation.^(3,6,8) Based on this observation, several tools have been developed to facilitate the diagnosis of delirium in critically ill patients.

The criteria recommended by the Diagnostic and Statistical Manual of Mental Disorders, 4^th edition (DSM-IV), and the International Classification of Disease, 10^th revision (ICD-10), are the most frequently used tools in individuals who are able to communicate verbally and are typically used by professionals specialized in the neuroscience field. In critically ill patients, the diagnostic scales most commonly used due to their simplicity and adequate accuracy are the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU) and the Intensive Care Delirium Screening Checklist (ICDSC).^(9-11) However, both the DSM-IV and the ICD-10 as well as the CAM-ICU tools are dichotomous and do not permit stratification according to the severity of the condition. The DSM-IV and ICD-10 are based on the signs and symptoms necessary to diagnose or exclude a certain pathology (including delirium). In turn, the CAM-ICU was created based on the DSM-IV criteria to facilitate the diagnosis of delirium in the ICU and to allow the assessment of patients on mechanical ventilation (who are unable to communicate verbally). The CAM-ICU only permits diagnosis and does not establish a correlation with the severity of the condition.

The present study aimed to systematically review the scales that are able to establish a quantitative assessment of delirium symptoms in critically ill patients.

METHODS

An extensive search was performed in the MedLine database to identify studies that addressed delirium assessment and stratification scales in ICU patients. A search was performed for the keywords "delirium", "acute confusion", "confusion state", "confusional state", "acute confusion state" and "acute confusional state", the associated terms "scales", "scores", "state", "measures", "measurement", "questionnaires", "evaluation", "levels", "indices", "assessment", and "instrument" and the terms "ICU", "critical care", "ICU patients", "sensitivity", "specificity", and "accuracy".

Subsequently, limits and inclusion criteria were established. Studies that addressed scales for a quantitative assessment of delirium were the main inclusion criterion. Only studies published in English and performed in adults (over 18 years) were analyzed. The results of the application of search filters, limits, and the inclusion criteria are described in figure 1.

The final search strategy was as follows: ((((ICU) OR critical care) OR ICU patients)) AND ((((((((((delirium) OR confusional state) OR confusion state) OR acute confusion) OR acute confusion state) OR acute confusional state)) AND (((((((((((scales) OR scores) OR state) OR measurement) OR questionnaires) OR evaluation) OR indices) OR levels) OR measures) OR assessment) OR instruments))) AND (((sensitivity) OR specificity) OR accuracy)) AND (Humans[Mesh] AND (English[lang]) AND adult[MeSH]). Two authors independently performed the search for the studies. Possible divergences regarding the studies selection were resolved with a discussion between all of the authors.

After the selected studies were analyzed and the scales that would be used were identified, a new search for the specific name of each scale was performed to obtain further information.

RESULTS

After applying the search filter and considering the limits and inclusion criteria defined for the present study, six scales were selected that were able to quantitatively identify the symptoms of delirium (each one is briefly described and analyzed below). Table 1 describes the studies included in the review. Table 2 presents a comparative summary of all of the scales included in the study. The description of the variables present in each scale is shown in table 3.

Thumbnail

Delirium Detection Score

The Delirium Detection Score (DDS) is a validated scale that considers eight of the symptoms of delirium. Each one of these symptoms receives a score of 0, 1, 4, or 7 points.⁽¹⁴⁾ The scale was created by modifying an instrument for the evaluation of alcohol withdrawal syndrome (Clinical Withdrawal Assessment for Alcohol - CIWA-Ar).^(23,24) Therefore, it is a useful scale to assess the degree of delirium and guide treatment, and the tool may also serve as a diagnostic scale. The scale exhibited good correlation between examiners, as long as the examiners were previously trained in the scale's application.⁽²⁴⁾

Cognitive Test of Delirium

The Cognitive Test of Delirium (CTD) evaluates five items, each of which receives a score of 0, 2, 4, or 6 points. Thus, the scale has a total of 30 points possible. There is no subdivision described in the literature that correlates the severity levels with the respective CTD values. However, the lower the CTD value, the worse the clinical outcome.⁽¹²⁾ The scale is able to differentiate delirium from other psychiatric illnesses such as dementia.⁽¹²⁾ Due to the long application time, an abbreviated form of the CTD was created, requiring only a few minutes of application time, but it has not yet been validated for routine use in the ICU.⁽¹³⁾

Memorial Delirium Assessment Scale

The Memorial Delirium Assessment Scale (MDAS) was initially created to diagnose delirium in patients with advanced cancer, but it has already been tested and validated for use in the general ICU.^(17,21) The scale assesses variables of two major groups: cognition and behavior.^(17,21) Based on the score obtained, the MDAS allows the stratification of delirium by severity.^(19,21)

Intensive Care Delirium Screening Checklist

The Intensive Care Delirium Screening Checklist (ICDSC) is a scale for delirium stratification, but it can also be used as a diagnostic scale,⁽¹⁰⁾ and the scale's application is easy and quick.⁽¹⁸⁾ The ICDSC consists of eight observed variables that are compared with the assessment of the previous day, and increasing values on the ICDSC are compatible with severity stratification.⁽¹¹⁾ In addition, the ICDSC is useful in the diagnosis of subsyndromal delirium.⁽²⁵⁾ The ICDSC has the advantage of being adapted to Portuguese and validated for routine use in Brazil by Gusmao-Flores et al.⁽¹¹⁾ The ICDSC have been demonstrated to be a good scale to assess and monitor delirium.^(10,11)

The Neelon and Champagne Confusion Scale

The Neelon and Champagne Confusion Scale (NEECHAM) was created as an instrument for nurses to assess delirium daily and has been validated for patients in the ICU⁽¹⁵⁾ and those on mechanical ventilation.⁽²⁰⁾

Delirium Rating Scale-Revised-98

The Delirium Rating Scale-Revised-98 (DRS-R-98) is the oldest and most traditional scale, created to measure the degree of delirium in patients. Among the scales that allow delirium stratification, the DRS-R-98 is one of the most well-known and frequently used in intensive care.^(12,16,18) The DRS-R-98 consists of a scale with 16 items (3 of them used only at the moment of diagnosis and 13 used for stratification in successive evaluations). Each item receives 0 to 2 or 0 to 3 points, and the higher the final score, the higher the severity of the condition.⁽²²⁾ One of the difficulties of this scale is its complexity, as it requires training of qualified professionals, which sometimes generates divergent results.⁽¹⁶⁾ The DRS-R-8 has already been studied and validated for Portuguese by Negreiros et al.⁽²²⁾

DISCUSSION

Many scales are used to detect and evaluate patients with delirium. The present review identified six stratification scales used in ICU patients. The six scales have already been adequately validated in their original language. However, only the ICDSC and DRS-R-68^(11,22) have been translated and validated for the Portuguese language. Other scales need to be validated specifically for use in sedated critically ill patients (DDS), as they should only be applied in patients with Ramsay scale <3.⁽¹⁴⁾ The CTD and ICDSC have the advantage of having dichotomous variables (ICDSC) and using non-verbal language (CTD), allowing simpler and affordable evaluations for intubated patients. However, the level of sedation may influence the accuracy of the scale.⁽¹⁰⁾

Regarding the time of application of each instrument, the CTD and MDAS have a long application time for each patient, hindering the adherence for effective use in the ICU. The ideal tool would be one with an application time that would allow a periodic assessment during each shift in the ICU (due to the fluctuating nature of delirium), such as the ICDSC, NEECHAM or DDS.

Most of the variables assessed in each scale were chosen based on the diagnosis by the DSM-IV criteria. However, some variables incorporated other symptoms that are less common in delirium, which decreases the sensitivity of the tool.⁽²³⁾ One such example is the DDS, which evaluates signals such as tremors and paroxysmal sweating, findings that are not frequent in the course of delirium.⁽²³⁾ Another important aspect is that most scales have variables that assess hyperactive delirium, such as agitation, anxiety, and hallucinations, but few are able to assess hypoactive delirium, which is the most common subtype of the disease, with specificity.^(18,23) The hypoactive nature of the disease (drowsiness, passivity, and inactivity), in most cases, is an intrinsic difficulty of disease, which makes it virtually unrecognizable without the use of a suitable tool.⁽¹⁸⁾ The evaluation of behavior (and not just the agitation), attention, sleep-wake cycle, and the level of consciousness, such as the evaluation permitted by the ICDSC, allows for the evaluation of patients with hypoactive delirium. However, changes in the sleep-wake cycle, present in DDS, MDAS, and ICDSC, hinder precise evaluation, requiring longitudinal information, which can limit its use.

Scales such as the NEECHAM and ICDSC have the advantage of being previously validated, allowing the application both by nurses and nursing home residents, as long as they are properly trained.^(11,20) With respect to the DRS-R-98, its validation study for use in Brazil was applied only by psychiatrists, although these physicians would not be responsible for its application in the ICU.⁽²²⁾ The other tools (DDS, MDAS, and CTD) were tested with the physician-on-duty as the evaluator. The MDAS was also validated when applied by residents.⁽¹⁷⁾ However, training and qualification must be applied prior to the use of the various instruments. With previous training of the professionals, most scales exhibited good correlations between evaluators.^(21,26) The subgroups of patients to be evaluated are another important factor to be considered when choosing the scale. The choice of the tool, based on the admission type and the severity of the patient, influences its accuracy and correlation with other scales.⁽²⁷⁾ The ICDSC was more sensitive than the CAM-ICU in the subgroup of surgical patients, for example.⁽²⁷⁾ Therefore, the choice of the scale that will be used is at the discretion of each intensive care unit, as long as it is correctly used with the most suitable professionals.

Currently, there are several consolidated diagnostic methods,⁽²⁸⁾ but those that use quantitative evaluation remain underused by the medical staff. The combination of diagnostic scales with validated instruments for stratification should always be considered to better understanding and monitoring patients with delirium. The DDS, for example, should only be used after the diagnosis is confirmed.⁽¹⁰⁾ ICDSC, despite having been studied as a diagnostic tool, exhibits varied specificity.^(10,29,30) Thus, the ICDSC can generate false-positive results.^(25,27) However, meta-analyses and recent guidelines suggest that the CAM-ICU and ICDSC are the best-studied instruments for the diagnosis of delirium; therefore, they are suggested as the tools of choice for this purpose.^(28,30,31)

The ICDSC was the most thoroughly studied tool among the studies identified,^{(10,11,25,28-30)} suggesting that although there is not an ideal tool, the ICDSC is the best suited to evaluate the stratification of delirium. Another important characteristic of this tool is the possibility of diagnosing subsyndromal delirium,⁽²⁵⁾ which is a clinical condition with intermediate outcomes among patients with and without delirium.⁽³²⁾

The diagnosis of delirium is already well established in the literature; however, its stratification is remains insufficiently described, which hindered the present review. The studies identified here are heterogeneous with respect to the target population, professional examiner, degree of sedation of the patients included, and the signs and symptoms evaluated, thus making impossible a comparison between the different scales. Therefore, only a descriptive analysis was possible. However, the present review identified the characteristics and the positive and negative aspects of each scale available in the literature for the stratification of ICU patients with delirium.

CONCLUSION

Six validated scales (only two validated for Portuguese) for the diagnosis of delirium in intensive care unit patients under different degrees of sedation (intubated or not) were identified. All of the scales exhibited good accuracy for the stratification of delirium. The most studied scale and the one best suited for use in the intensive care unit was the ICDSC because of its practicality, accuracy, and validation for the portuguese language.

REFERENCES

1. Spronk PE, Riekerk B, Hofhuis J, Rommes JH. Occurrence of delirium is severely underestimated in the ICU during daily care. Intensive Care Med. 2009;35(7):1276-80.
2. Kishi Y, Iwasaki Y, Takezawa K, Kurosawa H, Endo S. Delirium in critical care unit patients admitted through an emergency room. Gen Hosp Psychiatry. 1995;17(5):371-9.
3. Lin SM, Liu CY, Wang CH, Lin HC, Huang CD, Huang PY, et al. The impact of delirium on the survival of mechanically ventilated patients. Crit Care Med. 2004;32(11):2254-9.
4. Guenther U, Popp J, Koecher L, Muders T, Wrigge H, Ely EW, et al. Validity and reliability of the CAM-ICU Flowsheet to diagnose delirium in surgical ICU patients. J Crit Care. 2010;25(1):144-51.
5. Ely EW, Inouye SK, Bernard GR, Gordon S, Francis J, May L, et al. Delirium in mechanically ventilated patients: validity and reliability of the confusion assessment method for the intensive care unit (CAM-ICU). JAMA. 2001;286(21):2703-10.
6. Mistarz R, Eliott S, Whitfield A, Ernest D. Bedside nurse-patient interactions do not reliably detect delirium: an observational study. Aust Crit Care. 2011;24(2):126-32.
7. van den Boogaard M, Pickkers P, Slooter AJ, Kuiper MA, Spronk PE, van der Voort PH, et al. Development and validation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for intensive care patients: observational multicentre study. BMJ. 2012;344:e420.
8. Han JH, Zimmerman EE, Cutler N, Schnelle J, Morandi A, Dittus RS, et al. Delirium in older emergency department patients: recognition, risk factors, and psychomotor subtypes. Acad Emerg Med. 2009;16(3):193-200.
9. Ely EW, Margolin R, Francis J, May L, Truman B, Dittus R, et al. Evaluation of delirium in critically ill patients: validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU). Crit Care Med. 2001;29(7):1370-9.
10. Bergeron N, Dubois MJ, Dumont M, Dial S, Skrobik Y. Intensive Care Delirium Screening Checklist: evaluation of a new screening tool. Intensive Care Med. 2001;27(5):859-64.
11. Gusmao-Flores D, Salluh JI, Dal-Pizzol F, Ritter C, Tomasi CD, Lima MA, et al. The validity and reliability of the Portuguese versions of three tools used to diagnose delirium in critically ill patients. Clinics (Sao Paulo). 2011;66(11):1917-22.
12. Hart RP, Levenson JL, Sessler CN, Best AM, Schwartz SM, Rutherford LE. Validation of a cognitive test for delirium in medical ICU patients. Psychosomatics. 1996;37(6):533-46.
13. Hart RP, Best AM, Sessler CN, Levenson JL. Abbreviated cognitive test for delirium. J Psychosom Res. 1997;43(4):417-23.
14. Otter H, Martin J, Bäsell K, von Heymann C, Hein OV, Böllert P, et al. Validity and reliability of the DDS for severity of delirium in the ICU. Neurocrit Care. 2005;2(2):150-8.
15. Van Rompaey B, Schuurmans MJ, Shortridge-Baggett LM, Truijen S, Elseviers M, Bossaert L. A comparison of the CAM-ICU and the NEECHAM Confusion Scale in intensive care delirium assessment: an observational study in non-intubated patients. Crit Care. 2008;12(1):R16.
16. Osse RJ, Tulen JH, Hengeveld MW, Bogers AJ. Screening methods for delirium: early diagnosis by means of objective quantification of motor activity patterns using wrist-actigraphy. Interact Cardiovasc Thorac Surg. 2009;8(3):344-8; discussion 348.
17. Shyamsundar G, Raghuthaman G, Rajkumar AP, Jacob KS. Validation of memorial delirium assessment scale. J Crit Care. 2009;24(4):530-4.
18. Neufeld KJ, Hayat MJ, Coughlin JM, Huberman AL, Leistikow NA, Krumm SK, et al. Evaluation of two intensive care delirium screening tools for non-critically ill hospitalized patients. Psychosomatics. 2011;52(2):133-40.
19. Breitbart W, Rosenfeld B, Roth A, Smith MJ, Cohen K, Passik S. The Memorial Delirium Assessment Scale. J Pain Symptom Manage. 1997;13(3):128-37.
20. Immers HE, Schuurmans MJ, van de Bijl JJ. Recognition of delirium in ICU patients: a diagnostic study of the NEECHAM confusion scale in ICU patients. BMC Nurs. 2005;4:7.
21. Fadul N, Kaur G, Zhang T, Palmer JL, Bruera E. Evaluation of the memorial delirium assessment scale (MDAS) for the screening of delirium by means of simulated cases by palliative care health professionals. Support Care Cancer. 2007;15(11):1271-6.
22. de Negreiros DP, da Silva Meleiro AM, Furlanetto LM, Trzepacz PT. Portuguese version of the Delirium Rating Scale-Revised-98: reliability and validity. Int J Geriatr Psychiatry. 2008;23(5):472-7.
23. Radtke FM, Franck M, Schneider M, Luetz A, Seeling M, Heinz A, et al. Comparison of three scores to screen for delirium in the recovery room. Br J Anaesth. 2008;101(3):338-43.
24. Radtke FM, Franck M, Schust S, Boehme L, Pascher A, Bail HJ, et al. A comparison of three scores to screen for delirium on the surgical ward. World J Surg. 2010;34(3):487-94.
25. Tomasi CD, Grandi C, Salluh J, Soares M, Giombelli VR, Cascaes S, et al. Comparison of CAM-ICU and ICDSC for the detection of delirium in critically ill patients focusing on relevant clinical outcomes. J Crit Care. 2012;27(2):212-7.
26. Devlin JW, Fong JJ, Fraser GL, Riker RR. Delirium assessment in the critically ill. Intensive Care Med. 2007;33(6):929-40. Review.
27. Fagundes JA, Tomasi CD, Giombelli VR, Alves SC, de Macedo RC, Topanotti MF, et al. CAM-ICU and ICDSC agreement in medical and surgical ICU patients is influenced by disease severity. PloS One. 2012;7(11):e51010.
28. Neto AS, Nassar AP Jr, Cardoso SO, Manetta JA, Pereira VG, Espósito DC, et al. Delirium screening in critically ill patients: a systematic review and meta-analysis. Crit Care Med. 2012;40(6):1946-51. Review.
29. George C, Nair JS, Ebenezer JA, Gangadharan A, Christudas A, Gnanaseelan LK, et al. Validation of the Intensive Care Delirium Screening Checklist in nonintubated intensive care unit patients in a resource-poor medical intensive care setting in South India. J Crit Care. 2011;26(2):138-43.
30. Gusmao-Flores D, Figueira Salluh JI, Chalhub RA, Quarantini LC. The confusion assessment method for the intensive care unit (CAM-ICU) and intensive care delirium screening checklist (ICDSC) for the diagnosis of delirium: a systematic review and meta-analysis of clinical studies. Crit Care. 2012;16(4):R115.
31. Barr J, Fraser GL, Puntillo K, Ely EW, Gélinas C, Dasta JF, Davidson JE, Devlin JW, Kress JP, Joffe AM, Coursin DB, Herr DL, Tung A, Robinson BR, Fontaine DK, Ramsay MA, Riker RR, Sessler CN, Pun B, Skrobik Y, Jaeschke R; American College of Critical Care Medicine. Clinical practice guidelines for the management of pain, agitation, and delirium in adult patients in the intensive care unit. Crit Care Med. 2013;41(1):263-306. Review.
32. Cole M, McCusker J, Dendukuri N, Han L. The prognostic significance of subsyndromal delirium in elderly medical inpatients. J Am Geriatr Soc. 2003;51(6):754-60.