Acessibilidade / Reportar erro

Are the review criteria for automated complete blood counts of the International Society of Laboratory Hematology suitable for all hematology laboratories?

Abstract

OBJECTIVE:

to verify whether the review criteria for automated blood counts suggested by the International Consensus Group for Hematology Review of the International Society for Laboratory Hematology are suitable for the Hematology Laboratory of Hospital de Clinicas, Universidade Federal do Paraná.

METHODS:

initially, the review criteria of the International Society for Laboratory Hematology were adapted due to limitations in the Institution's electronic hospital records and interfacing systems. The adapted review criteria were tested using 1977 samples. After this first assessment, an additional 180 inpatient samples were analyzed to evaluate the screening criteria of the review criteria in conjunction with positive smear findings established by the institution. The performance of the review criteria was verified by determining false positive, false negative, true positive and true negative rates, sensitivity, specificity, positive predictive value, negative predictive value, microscopic review rate and efficiency.

RESULTS:

initial analysis showed false negatives = 6.73%, false positives = 23.27%, microscopic review rate = 46.03% and efficiency = 70.0%. An evaluation of the screening criteria adapted from the review criteria together with the positive smear findings of the institution showed false negatives = 15.5%, false positives = 10.5%, microscopic review rate = 37.3% and efficiency = 73.8%. In both situations the safety limit (false negative <5%) recommended by the review criteria was exceeded.

CONCLUSIONS:

the review criteria adapted from the International Society for Laboratory Hematology are neither suitable nor safe for use in the hematology laboratory of the Hospital de Clinicas. This implies a need to develop and validate institution-specific review criteria in order to decrease false negative results to an acceptable and safe rate for patients.

Automation; Blood cell count; Validation studies; Hematology


Introduction

In 2005, the International Society for Laboratory Hematology (ISLH) through the International Consensus Group for Hematology Reviews, founded by hematologist Berend Houwen, published a set of 41 rules applicable as criteria for the review of automated complete blood counts (CBCs) and leukocyte differential results of automated hematology analyzers, i.e., review criteria for automated complete blood counts (RC).11. International Society for Laboratory Hematology [Internet]. Available from: www.islh.org [accessed on 22.01.14].
Available from: www.islh.org ...
These guidelines were formulated with the aims of reducing costs and the turnaround time of the results without sacrificing their quality, and justifying the performance and skills of the multiparametric hematology analyzers.22. Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11:83-90. , 33. Gulati GL, Alomari M, Kocher W, Schwarting R. Criteria for blood smear review. Lab Med. 2002;33:374-7. , 44. Pierre RV. Peripheral blood film review: the demise of the eyecount leukocyte differential. Clin Lab Med. 2002;22:279-97. Since then, the rules suggested by the ISLH22. Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11:83-90. have been considered the international standard to indicate situations requiring a blood smear review (BSR). They take into account the age and gender of patients, whether the request for CBC is the initial or a subsequent one to monitor CBCs, or whether there are significant differences between the current results, and previously validated and released results.22. Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11:83-90. , 44. Pierre RV. Peripheral blood film review: the demise of the eyecount leukocyte differential. Clin Lab Med. 2002;22:279-97. In practice, they are based on the set of screening thresholds for the results given by the analyzers and in the presence or absence of suspect flags. The aim is to distinguish samples with a high probability of containing relevant morphological alterations for the diagnosis and treatment of patients. When the CBC results do not meet the screening criteria, there are recommended procedures to follow, specifically to prepare an adequate peripheral blood smear for microscopic analysis.22. Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11:83-90.

Hospital de Clínicas of the Universidade Federal do Paraná (HC-UFPR) is a general Class IV hospital according to the hospital classification system of Brazil's publically funded healthcare system (SUS); it is the largest provider of government healthcare services in the State of Paraná with 510 beds. Moderately to highly complex procedures are carried out in 59 departments. Approximately 61,000 consultations are made per month. The clinical hematology laboratory is located in the Diagnosis Support Service and contains two types of hematology analyzers: the Sysmex XE-2100D and XT-2000i (Sysmex Corporation, Kobe, Japan). Approximately 500 samples are sent for CBCs daily. Prior to the development of the RC, 100% of CBCs were analyzed microscopically, which led to delays in the release of the results even when performed by experienced professionals.

According to Bain55. Bain BJ. Diagnosis from the blood smear. N Engl J Med. 2005;353:498-507. because BSRs and manual differential leukocyte counts (MDLCs) are laborious and expensive, they should be based on the RC. Thus, all hematology laboratories must be encouraged to establish locally valid protocols indicating when a BSR and MDLC should be performed. The guidelines suggested by the ISLH can be the starting point as long as they are interpreted in consideration of the experience of the laboratory staff, sophistication of the hematology analyzers and the laboratory's electronic records system, and incidences of abnormalities and variations in reference values of the population being tested.66. Wang H, Sun F, Yu G, Wang M, Liu N, Jin Y. Applications of international slide review criteria for actions among Chinese populations. Int J Lab Hematol. 2008;30(Suppl. 1):65-6. , 77. Peterson P, McNeill S, Gulati G. Cellular morphologic analysis of peripheral blood.10-25. Thus, this study evaluated the implementation of the RC suggested by the ISLH in the HC-UFPR Hematology Laboratory in order to determine automated thresholds such that microscopic analyses are performed only under special circumstances. In addition, the study aimed to define whether such guidelines could be tailored to the population served or whether there is a need to establish and evaluate specific RC for this Institution.

Methods

Study site and sample preparation

The investigation was conducted in the Hematology Laboratory of HC-UFPR after approval by the local Ethics Committee. The samples were obtained in two stages. First, for five consecutive days, all laboratory samples were collected after the release of the results into the electronic hospital records system. A total of 1977 whole-blood samples in ethylenediaminetetraacetic acid (EDTA)-K2 (1.8 mg/mL) were analyzed within 3 h of collection. Of these, 1573 and 404 were analyzed using the XE-2100D and XT-2000i hematology analyzers, respectively. Furthermore, to evaluate the screening criteria adapted from the ISLH together with positive smear findings (PSFs) of the HC-UFPR, an additional 180 inpatient samples were collected randomly and analyzed using the XT-2000i device; these samples were more likely to have PSFs because they also had abnormal CBC results. The PSFs elaborated by the HC-UFPR were intended to ensure clinically significant abnormalities were not omitted from the results, thereby establishing a minimum threshold of information that should be reported in the CBC results according to local consensus. All numerical data and information from suspect flags and blood smear findings were recorded. Approximately 70% of the samples tested were from outpatients, many of whom were having their first blood count. The other 30% were from inpatients from various hospital units (e.g., hematology, chemotherapy, infectious diseases, intensive care units, emergency care), many of whom had their blood counts monitored daily.

Adaptation of the review criteria of the International Society for Laboratory Hematology according to local requirements

In order to determine whether the performance of these RC met local requirements or indicated the need to develop specific RC, the screening criteria and PSFs suggested by the ISLH were initially evaluated. However, changes were made to tailor the ISLH screening criteria to the hematology analyzers used in this study and particularly to adapt them to the electronic hospital records system. The main adaptations were associated with Delta Check rules, which were not possible to implement because of limitations of the institution's electronic hospital records and interfacing systems. The adapted ISLH screening criteria concerning the possibility of local implementation are shown in Table 1. Table 2 shows the PSFs recommended by the ISLH.22. Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11:83-90. PSFs that differ from those recommended by the ISLH were also created for the HC-UFPR (Table 3) in an attempt to meet local requirements.

Table 1
Adapted International Society of Laboratory Hematology review criteria for automated complete blood counts.
Table 2
Criteria for a positive smear recommended by the International Society of Laboratory Hematology.
Table 3
Criteria for a positive smear recommended by the Hospital de Clínicas da Universidade Federal do Paraná.

Sample classification criteria

The criteria followed to select samples for review were compared with the findings of the peripheral BSR. A sample was classified as true positive (TP) if it was positive for a particular screening criterion (Table 1) and the microscopic analysis produced some PSF (Table 2, Table 3). Meanwhile, a sample was classified as false positive (FP) if it was positive for a particular screening criterion with no PSF in the microscopic analysis. A sample was classified as false negative (FN) if it was negative for all screening criteria and contained some PSF in microscopic analysis. Finally, a sample was classified as true negative (TN) if it was negative for all screening criteria and the BSR did not show any PSFs.22. Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11:83-90. , 88. Ruzicka K, Veitl M, Thalhammer-Scherrer R, Schwarzinger I. The new hematology analyzer Sysmex XE-2100: performance evaluation of a novel white blood cell differential technology. Arch Pathol Lab Med. 2001;125:391-6.

Considerations

Good laboratory practices and procedures for quality assurance and quality control in hematology were followed to ensure good performance. All settings and configurations of the hematology analyzers followed the manufacturers' recommendations. For all samples, the BSR and MDLC were performed according to an adapted version of the H20-A2 Clinical and Laboratory Standards Institute (CSLI),99. Clinical and Laboratory Standards Institute (CLSI). Reference Leukocyte (WBC). 2007. because each BSR and each MDLC was carried out by a single observer. In most cases, 100 leukocytes were counted. In some cases with leukocyte counts <0.03 × 103/µL, leukocytes were not observed and only a BSR could be performed. In other cases with leukocyte counts above 50.0 × 103/µL, the MDLC reached 200 leukocytes. Furthermore, in all samples, the BSR was performed to identify any qualitative or quantitative changes in red and white blood cells as well as platelets. Guidelines were formulated to standardize the quantification of morphologic alterations and which terms are used to report changes in CBC results. These guidelines were codified as standard operating procedures (SOP).

Statistical analysis

The sensitivity, specificity, positive predictive value, negative predictive value, microscopic review rate, and efficiency of the RC adapted from the ISLH were calculated as follows: sensitivity (%) = TP/(TP + FN) × 100; specificity (%) = TN/(TN + FP) × 100; positive predictive value (%) = TP/(TP + FP) × 100; negative predictive value (%) = TN/(TN + FN) × 100; microscopic review rate (%) = (TP + FP)/(TP + FP + FN + TN) × 100; and efficiency (%) = (TP + TN)/(TP + FP + FN + TN) × 100.88. Ruzicka K, Veitl M, Thalhammer-Scherrer R, Schwarzinger I. The new hematology analyzer Sysmex XE-2100: performance evaluation of a novel white blood cell differential technology. Arch Pathol Lab Med. 2001;125:391-6.

Results

Out of the 1977 samples used in the initial investigation of the adapted RC, 583 (29.49%) were positive and 1394 (70.51%) were negative for relevant microscopic results, i.e., for PSFs. Most samples failed to meet some screening criteria; usually from one to four criteria but up to 15. The results obtained for the validation of the screening criteria tailored from the ISLH criteria, considering the positive smear criteria in Table 2, are shown in Table 4.

Table 4
Truth table of the adapted International Society of Laboratory Hematology criteria.

The microscopic review rate during the initial investigation (Table 4) was quite high (46.03%) compared to the 30% recommended by the American College of Pathologists.1111. Novis DA, Walsh M, Wilkinson D, Louis MS, Ben-Ezra J. Laboratory productivity and the rate of manual peripheral blood smear review: a College of American Pathologists Q-Probes study of 95,141 complete blood count determinations performed in 263 institutions. Arch Pathol Lab Med. 2006;130:596-601. The main rules producing FP results in the initial assessment were as follows: leukocytes <4.0 × 103/µL (16.7% of total FPs), platelets <100 × 103/µL (13.3% of total FPs), and suspect flags (30% of total FPs). In the initial assessment of the RC adapted from the ISLH criteria, there were 133 FN samples (Table 5) including 114 with nuclear shift to the left in >8% of bands, 13 myelocytes/promylocytes = 1%, 13 alterations in red blood cells, and one alteration in platelets.

Table 5
Incidence of false negatives: the adapted International Society of Laboratory Hematology criteria considering the International Society of Laboratory Hematology criteria for a positive smear.

The evaluation results for the screening criteria adapted from the ISLH in conjunction with the PSFs of the HC-UFPR are shown in Table 6, Table 7. From the 180 samples analyzed, 76 contained PSFs. Using PSFs specific for the HC-UFPR, which were tailored to meet the requirements of the authors' Institution, caused the screening criteria adapted from the ISLH to be incapable of filtering samples with relevant morphological alterations (FN = 15.5%), including one case with blasts present from a patient with acute leukemia.

Table 6
Truth table of the adapted International Society of Laboratory Hematology criteria considering the Hospital de Clínicas da Universidade Federal do Paraná criteria for a positive smear.

Table 7
Incidence of false negatives: the adapted International Society of Laboratory Hematology screening criteria considering the Hospital de Clínicas da Universidade Federal do Paraná criteria for a positive smear.

In both analyses, the percentage of FN results exceeded the reliability threshold of 5% established by the ISLH, causing cases with serious illnesses to be overlooked.

Discussion

Despite the extensive capabilities of the latest-generation multiparametric hematology analyzers, microscopic review of blood smears still plays an important role in hematology laboratories. The use of RC, which would allow the release of automated counts without a BSR, is neither a widespread nor standardized procedure. In practice, many laboratories simply adopt published criteria or alter some criteria without empirical evidence.1212. Cui W, Wu W, Wang X, Wang G, Hao Y, Chen Y, et al. Development of the personalized criteria for microscopic review following four different series of hematology analyzer in a Chinese large scale hospital. Chin Med J (Engl). 2010;123:3231-7.

Establishing and assessing a specific RC for a particular laboratory means that the ISLH screening and positive smear criteria must first be validated, especially because these criteria are international standards. Considering the actual demands and capabilities of each laboratory, this initial validation clarifies whether such criteria require optimization or not.

In this study, after the initial evaluation of the RC adapted from the ISLH, 6.73% and 23.27% of FN and FP results were verified, respectively. Moreover, the microscopic review rate was 46.03% and efficiency was 70.0%. The microscopic review rate with the XT-2000i analyzer (54.45%) was higher than that with the XE-2100D (43.86%). This is because the former analyzer was used by staff members on duty, who only attend inpatients and emergency patients, who evidently have CBC results that differ substantially from those of outpatients.

The negative predictive value determined in the initial evaluation using the screening criteria and positive smear criteria showed that in 87.54% of the times in which the screening criteria adapted from ISLH did not indicate the need for BSR, the sample analyzed really did not contain any PSFs. The observed sensitivity was 77.19%, indicating that out of 583 samples, 450 with PSFs were correctly screened by applying the RC adapted from the ISLH. As mentioned above, the percentage of microscopic reviews (46.03%) greatly exceeded the 30% recommended by the American College of Pathologists. The fact that 30% of the FP results were of samples with suspect flags with a nonexistent microscopic counterpart indicated that the hematology analyzers used were guilty of over-flagging, i.e., they gave more warnings than necessary. As the sensitivity of the suspect flags had been adjusted by technicians of the manufacturer, we suggest that each laboratory should evaluate the efficiency of each suspect flag from the analyzers, thereby making proper adjustments to the sensitivity of the hematology analyzer or defining whether a suspect flag is actually useful as a screening criterion.

A total of 13.3% of samples had a platelet count <100 × 103/µL in the initial evaluation of the RC adapted from the ISLH; this is relatively high considering the sampling was representative of the local reality. Therefore, the microscope estimate of the platelet count should always be performed on samples with this profile in order to verify how well it complies with automated counting and to search for platelet aggregates and giant platelets, which are factors that produce underestimates.1313. Comar SR, Danchura HSM, Silva PH. Contagem de plaquetas: avaliação de metodologias manuais e aplicação na rotina laboratorial. Rev Bras Hematol Hemoter. 2009;31:431-6.

Moreover, the screening criteria adapted from the ISLH were tested according to the PSFs of the HC-UFPR; 15.5% and 10.5% of FNs and FPs were verified, respectively. In addition, the microscopic review rate was 37.3%, and the efficiency was 73.8%. One FN sample contained blasts. It is unacceptable to fail to detect cases of undiagnosed hematological malignancies; therefore, each institution should evaluate the need to perform BSRs in all patients in the hematology unit even at the expense of an increased microscopic review rate.

Despite some studies suggesting poor clinical practice when counting bands,1414. Ward MJ, Fertel BS, Bonomo JB, Smith CL, Hart KW, Lindsell CJ, et al. The degree of bandemia in septic ED patients does not predict impatient mortality. Am J Emerg Med. 2012;30:181-3. , 1515. Cornbleet PJ. Clinical utility of the band count. Clin Lab Med. 2002;22:101-36. , 1616. Van der Meer W, Van Gelder W, De Keijzer R, Willems H. Does the band cell survive the 21st century? Eur J Haematol. 2006;76:251-4. in this study, a band count > 8% was chosen as the positive smear criterion, particularly because a substantial proportion of doctors in Brazil posit there are associations of a nuclear shift to the left of neutrophils with infectious and inflammatory conditions. The FN analysis in the present study revealed a high occurrence of a nuclear shift to the left > 8% bands. Nevertheless, the technical limitations of MDLC must be taken into account when interpreting these results, especially results regarding band counts and variations occurring as a result of age, gender, and conditions such as pregnancy and physical exercise.1515. Cornbleet PJ. Clinical utility of the band count. Clin Lab Med. 2002;22:101-36. , 1717. Rüemke CL. Laboratory aids. Variability of results in differential cell counts on blood smears. Triangle. 1960;4:154-8.

The greatest amendment made to the RC of the ISLH was regarding the Delta check rules. These rules recognize morphological abnormalities detected and validated in previous analyses as well as discrepancies between the results of the current analysis and previous results from up to five days earlier. The Delta check limit threshold for a particular parameter is the amount by which a result can differ from a previous one; this difference can be expressed as the percentage difference or the absolute value in the unit of the hematological parameter in question. Delta limits should be established by each laboratory taking into account the physiopathological aspects and technical characteristics of the hematology analyzers used.

Although the Delta check rules play important roles in the efficiency and reliability of the CBC results directly released without a BSR, many clinical laboratories are incapable of implementing them in their electronic records or interfacing systems because of high software development costs. Even in developed countries, some laboratories are still incapable of modifying their electronic record systems to incorporate such regulations.1818. Galloway MJ, Charlton A, Holland D, Trigg G, Gibson R. An audit of the implementation of the international consensus group's guidelines on reporting of blood films. J Clin Pathol. 2010;63:351-4.

Another equally important factor is how unfamiliar laboratory professionals are with these rules, which make their dissemination and implementation difficult. The ISLH does not suggest specific Delta check limits, leaving them to the discretion of the laboratory. This could lead to small differences in the efficiency of the ISLH criteria when applied by different laboratories using different Delta limits since the International Consensus Group for Hematology Reviews only suggests specific actions for situations in which the Delta limits individually established by the laboratories are exceeded.

Conclusions

Neither assessment carried out in this study proved to be reliable, because the FN rates exceeded 5%. Moreover, the microscopic review rates were high, which may pose problems when attempting to decrease the turnaround time of results and when laboratories have an insufficient number of experienced professionals to perform the BSR. Therefore, in conclusion, new criteria should be developed and evaluated taking into account local peculiarities, requirements, and opportunities while aiming not to overlook samples with PSFs. To this end, additional studies are being carried out by the authors with the aim of developing a method to help establish and evaluate the efficiency of criteria for reviewing automated CBC results.

REFERENCES

  • 1
    International Society for Laboratory Hematology [Internet]. Available from: www.islh.org [accessed on 22.01.14].
    » Available from: www.islh.org
  • 2
    Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11:83-90.
  • 3
    Gulati GL, Alomari M, Kocher W, Schwarting R. Criteria for blood smear review. Lab Med. 2002;33:374-7.
  • 4
    Pierre RV. Peripheral blood film review: the demise of the eyecount leukocyte differential. Clin Lab Med. 2002;22:279-97.
  • 5
    Bain BJ. Diagnosis from the blood smear. N Engl J Med. 2005;353:498-507.
  • 6
    Wang H, Sun F, Yu G, Wang M, Liu N, Jin Y. Applications of international slide review criteria for actions among Chinese populations. Int J Lab Hematol. 2008;30(Suppl. 1):65-6.
  • 7
    Peterson P, McNeill S, Gulati G. Cellular morphologic analysis of peripheral blood.10-25.
  • 8
    Ruzicka K, Veitl M, Thalhammer-Scherrer R, Schwarzinger I. The new hematology analyzer Sysmex XE-2100: performance evaluation of a novel white blood cell differential technology. Arch Pathol Lab Med. 2001;125:391-6.
  • 9
    Clinical and Laboratory Standards Institute (CLSI). Reference Leukocyte (WBC). 2007.
  • 10
    Hyun BH, Gulati GL, Ashton JK. Differential leukocyte count: manual or automated, what should it be? Yonsei Med J. 1991;32:283-91.
  • 11
    Novis DA, Walsh M, Wilkinson D, Louis MS, Ben-Ezra J. Laboratory productivity and the rate of manual peripheral blood smear review: a College of American Pathologists Q-Probes study of 95,141 complete blood count determinations performed in 263 institutions. Arch Pathol Lab Med. 2006;130:596-601.
  • 12
    Cui W, Wu W, Wang X, Wang G, Hao Y, Chen Y, et al. Development of the personalized criteria for microscopic review following four different series of hematology analyzer in a Chinese large scale hospital. Chin Med J (Engl). 2010;123:3231-7.
  • 13
    Comar SR, Danchura HSM, Silva PH. Contagem de plaquetas: avaliação de metodologias manuais e aplicação na rotina laboratorial. Rev Bras Hematol Hemoter. 2009;31:431-6.
  • 14
    Ward MJ, Fertel BS, Bonomo JB, Smith CL, Hart KW, Lindsell CJ, et al. The degree of bandemia in septic ED patients does not predict impatient mortality. Am J Emerg Med. 2012;30:181-3.
  • 15
    Cornbleet PJ. Clinical utility of the band count. Clin Lab Med. 2002;22:101-36.
  • 16
    Van der Meer W, Van Gelder W, De Keijzer R, Willems H. Does the band cell survive the 21st century? Eur J Haematol. 2006;76:251-4.
  • 17
    Rüemke CL. Laboratory aids. Variability of results in differential cell counts on blood smears. Triangle. 1960;4:154-8.
  • 18
    Galloway MJ, Charlton A, Holland D, Trigg G, Gibson R. An audit of the implementation of the international consensus group's guidelines on reporting of blood films. J Clin Pathol. 2010;63:351-4.
  • Erratum

    In the article "Are the review criteria for automated complete blood counts of the International Society of Laboratory Hematology suitable for all hematology laboratories?", published in Rev Bras Hematol Hemoter. 2014;36(3):219–25, please consider the following corrections:
  • Page 221, Table 1, Criteria or rule 12 ">100 × 109/μL" should read as ">100 × 103/μL".

  • Page 223, Table 6, Sensitivity "62.6%" should read as "63.2%"; Positive predictive value "71.2%" should read as "71.6%"; and Efficiency "73.8%" should read as "73.9%".

Publication Dates

  • Publication in this collection
    May-Jun 2014

History

  • Received
    13 Oct 2013
  • Accepted
    02 Jan 2014
Associação Brasileira de Hematologia e Hemoterapia e Terapia Celular R. Dr. Diogo de Faria, 775 cj 114, 04037-002 São Paulo/SP/Brasil, Tel. (55 11) 2369-7767/2338-6764 - São Paulo - SP - Brazil
E-mail: secretaria@rbhh.org