Acessibilidade / Reportar erro

Accuracy of anemia diagnosis by physical examination

Acurácia do diagnóstico de anemia no exame clínico

Abstracts

CONTEXT AND OBJECTIVES: Quantification of clinical signs such as the presence or absence of pallor at clinical examination is a key step for making diagnoses. The aim was, firstly, to evaluate two methods for anemia diagnosis by physical examination: four-level evaluation (crosses method: +/++/+++/++++) and estimated hemoglobin values, both performed by medical students and staff physicians; and secondly, to investigate whether there was any improvement in assessment accuracy according to the number of years in clinical practice. DESIGN AND SETTING: Forty-four randomly selected physicians and medical students in a tertiary care teaching hospital completed a physical examination on five patients with mild to severe anemia. METHODS: The observers used four-level evaluation and also predicted the hemoglobin level. Both methods were compared with the real hemoglobin value as the gold standard. RESULTS: The mean estimated hemoglobin value correlated better with the real hemoglobin values than did the four-level evaluation method, for attending physicians, residents and students (Spearman's correlation coefficients, respectively: 1.0, 1.0 and 0.9 for guessed hemoglobin and -0.8, -0.8 and -0.7 for the four-level evaluation method). There were no differences in the mean "guessed" hemoglobin values from attending physicians, residents and students. However, the correlation between guessed hemoglobin value and the four-level method was positive for attending physicians, thus suggesting some kind of improvement with time (p = 0.04). CONCLUSIONS: This study showed that estimated hemoglobin was more accurate than evaluation by the four-level method. The number of years in clinical practice did not improve the accuracy of clinical examination for anemia.

Anemia; Diagnosis; Physical examination; Clinical competence; Hemoglobins


CONTEXTO E OBJETIVOS: A quantificação dos sinais do exame clínico como a presença de descoramento sugerindo anemia é um passo fundamental para o diagnóstico clínico. Avaliar dois métodos para o diagnóstico de anemia realizados por meio do exame físico-método de cruzes (+,++,+++,++++) e método de estimativa do valor de hemoglobina feito pelo médico ou estudante de medicina. Verificar se a acurácia desses métodos se relaciona com a experiência clínica. TIPO DE ESTUDO E LOCAL: 44 médicos assistentes, residentes e estudantes de medicina selecionados de forma aleatória completaram o exame clínico de cinco pacientes com anemia leve a grave. MÉTODOS: Os examinadores utilizaram o método das cruzes em quatro níveis e, também estimaram o nível da hemoglobina. Ambos os métodos foram comparados com a hemoglobina medida (padrão-ouro). RESULTADOS: O valor estimado da hemoglobina se correlacionou melhor com a hemoglobina aferida por método automático do que a avaliação realizada pelo método das cruzes para as comparações realizadas entre médicos assistentes, residentes e alunos (coeficiente de correlação de Spearman respectivamente de 1,0, 1,0 e 0,9 para hemoglobina estimada e - 0,8, - 0,8 e - 0,7 para o método das cruzes). Não houve nenhuma diferença no valor estimado de hemoglobina entre os médicos assistentes, os residentes e os alunos. Entretanto, a correlação entre o valor estimado da hemoglobina e o método das cruzes somente foi positiva para os médicos assistentes, sugerindo algum tipo de melhora na avaliação da presença de anemia com a experiência clínica (p = 0,04). CONCLUSÕES: Este estudo mostrou que a estimativa do valor da hemoglobina pelo exame físico apresenta maior acurácia do que a avaliação pelo método de cruzes, considerando-se a medida automática de hemoglobina como padrão-ouro. A experiência clínica não melhora o diagnóstico de anemia.

Anemia; Diagnóstico; Exame físico; Competência clínica; Hemoglobinas


ORIGINAL ARTICLE

Accuracy of anemia diagnosis by physical examination

Acurácia do diagnóstico de anemia no exame clínico

Isabela Martins Benseñor; Ana Luísa Garcia Calich; André Russowsky Brunoni; Fábio Ferreira do Espírito-Santo; Renato Lendimuth Mancini; Luciano Ferreira Drager; Paulo Andrade Lotufo

Department of Internal Medicine, Hospital das Clínicas, Faculdade de Medicina da Universidade de São Paulo (USP), São Paulo, Brazil

Address for correspondence Address for correspondence: Isabela Martins Benseñor Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo Av. Enéas Carvalho de Aguiar, 155 – 8º andar Bloco 3 – Clínica Médica São Paulo (SP) – Brasil – CEP 05403-000 Tel. (+55 11) 3067-7990 E-mail: isabensenor@hu.usp.br E-mail: bensenor.lotufo@uol.com.br

ABSTRACT

CONTEXT AND OBJECTIVES: Quantification of clinical signs such as the presence or absence of pallor at clinical examination is a key step for making diagnoses. The aim was, firstly, to evaluate two methods for anemia diagnosis by physical examination: four-level evaluation (crosses method: +/++/+++/++++) and estimated hemoglobin values, both performed by medical students and staff physicians; and secondly, to investigate whether there was any improvement in assessment accuracy according to the number of years in clinical practice.

DESIGN AND SETTING: Forty-four randomly selected physicians and medical students in a tertiary care teaching hospital completed a physical examination on five patients with mild to severe anemia.

METHODS: The observers used four-level evaluation and also predicted the hemoglobin level. Both methods were compared with the real hemoglobin value as the gold standard.

RESULTS: The mean estimated hemoglobin value correlated better with the real hemoglobin values than did the four-level evaluation method, for attending physicians, residents and students (Spearman's correlation coefficients, respectively: 1.0, 1.0 and 0.9 for guessed hemoglobin and -0.8, -0.8 and -0.7 for the four-level evaluation method). There were no differences in the mean "guessed" hemoglobin values from attending physicians, residents and students. However, the correlation between guessed hemoglobin value and the four-level method was positive for attending physicians, thus suggesting some kind of improvement with time (p = 0.04).

CONCLUSIONS: This study showed that estimated hemoglobin was more accurate than evaluation by the four-level method. The number of years in clinical practice did not improve the accuracy of clinical examination for anemia.

Key words: Anemia. Diagnosis. Physical examination. Clinical competence. Hemoglobins.

RESUMO

CONTEXTO E OBJETIVOS: A quantificação dos sinais do exame clínico como a presença de descoramento sugerindo anemia é um passo fundamental para o diagnóstico clínico. Avaliar dois métodos para o diagnóstico de anemia realizados por meio do exame físico-método de cruzes (+,++,+++,++++) e método de estimativa do valor de hemoglobina feito pelo médico ou estudante de medicina. Verificar se a acurácia desses métodos se relaciona com a experiência clínica.

TIPO DE ESTUDO E LOCAL: 44 médicos assistentes, residentes e estudantes de medicina selecionados de forma aleatória completaram o exame clínico de cinco pacientes com anemia leve a grave.

MÉTODOS: Os examinadores utilizaram o método das cruzes em quatro níveis e, também estimaram o nível da hemoglobina. Ambos os métodos foram comparados com a hemoglobina medida (padrão-ouro).

RESULTADOS: O valor estimado da hemoglobina se correlacionou melhor com a hemoglobina aferida por método automático do que a avaliação realizada pelo método das cruzes para as comparações realizadas entre médicos assistentes, residentes e alunos (coeficiente de correlação de Spearman respectivamente de 1,0, 1,0 e 0,9 para hemoglobina estimada e - 0,8, - 0,8 e - 0,7 para o método das cruzes). Não houve nenhuma diferença no valor estimado de hemoglobina entre os médicos assistentes, os residentes e os alunos. Entretanto, a correlação entre o valor estimado da hemoglobina e o método das cruzes somente foi positiva para os médicos assistentes, sugerindo algum tipo de melhora na avaliação da presença de anemia com a experiência clínica (p = 0,04).

CONCLUSÕES: Este estudo mostrou que a estimativa do valor da hemoglobina pelo exame físico apresenta maior acurácia do que a avaliação pelo método de cruzes, considerando-se a medida automática de hemoglobina como padrão-ouro. A experiência clínica não melhora o diagnóstico de anemia.

Palavras-chave: Anemia. Diagnóstico. Exame físico. Competência clínica. Hemoglobinas.

INTRODUCTION

Quantification of clinical signs such as the presence or absence of pallor at clinical examination is a key step for making diagnoses.1 A few studies in more recent years have tried to improve anemia diagnoses using pallor signs obtained from examining the hue of the conjunctivae, tongue, palms and nail bed. Although extreme clinical findings have great interobserver reliability, clinicians often disagree regarding the quantification of pallor in patients with mild anemia.2-7

Sheth et al. evaluated the value of conjunctival pallor for ruling in or ruling out the presence of severe anemia (hemoglobin < 9 g/dl) and to determine interobserver agreement. The likelihood ratios were 4.49 (95% confidence interval [CI]: 1.80-10.99) for the presence of conjunctival pallor, 1.80 (95% CI: 1.18-2.62) for borderline pallor and 0.61 (95% CI: 0.44-0.80) for the absence of conjunctival pallor. The interobserver agreement according to the kappa score ranged from 0.54 to 0.75 among paired observers. They concluded that the presence of conjunctival pallor was reason enough to perform a hemoglobin determination.3 In contrast, by evaluating conjunctival pallor for anemia diagnosis with a cut-off of 10 g/dl, Wurapa et al. found sensitivity of 18.6% and specificity of 95.8% and concluded that conjunctival pallor was not a good screening tool for anemia.4 This result has been confirmed by other studies.5,6

OBJECTIVE

The present study addresses the accuracy of methods for diagnosing and quantifying anemia applied by medical students, residents and attending physicians and whether their abilities improve with experience.

METHODS

A random sample of 10 attending physicians, 18 residents with less than five years of experience since graduation, and 16 fifth-year medical students working in Hospital das Clínicas, Faculdade de Medicina da Universidade de São Paulo (FMUSP), was invited to examine five in-patients on their first day of hospitalization. This study was approved by the Institutional Review Board and informed written consent was obtained from all participants. These patients had been admitted to hospital because of underlying diagnoses other than "anemia". Hemoglobin levels were measured (using an automatic method) on the same day as the observations. We excluded patients who had previously been evaluated by these examiners elsewhere, and none of the participants had any prior information about any clinical data or laboratory test results.

The sample size was calculated for a category variable: presence or absence of anemia in an analytical study, with an effect size of 0.45, alpha (one-sided) of 0.05 and beta (two-sided) of 0.2. This totaled 13 individuals by group.8

The examiners were instructed to give an opinion after examining the hue of the conjunctivae, tongue, palms and nail bed. All physical examinations were performed at the bedside under artificial light. The examiners completed a questionnaire that asked them (1) to guess the likely hemoglobin value, and (2) which of the following methods were used to quantify anemia: a four-level evaluation (crosses method: +/++/+++/++++), a three-level evaluation (mild, moderate or severe), or a dichotomous evaluation (present or absent).

We created a score to compare the "guessed" hemoglobin with the real hemoglobin value that was measured as part of a complete blood cell count performed in an automated cell counter. The latter was taken to be the gold standard. The score formula was:

Score = 1 – [(estimated hemoglobin – real hemoglobin)/estimated hemoglobin]

Thus, if the estimated hemoglobin value was exactly the same as the real hemoglobin value, the numerator of the formula would be zero and the score equal to one.

We compared the mean "guessed" hemoglobin values, mean score values and mean number of crosses (four-level evaluation) by category of participants (medical students, residents with less than five years of clinical practice and physicians with more than five years of clinical practice) using analysis of variance (ANOVA) with the Bonferroni post hoc evaluation test for all examinations on each patient, and for all the patients together. For variables without normal distribution, non-parametric tests were used.

The "guessed" and real hemoglobin (gold standard) were only compared with the four-level evaluation method because 91% of the participants used this method to classify pallor. These comparisons were performed using Spearman's correlation test. The numbers of participants who used three-level or dichotomous evaluation were very small and this prevented other comparisons.

RESULTS

We compared the four-level evaluation (crosses method) for diagnosing anemia with the real hemoglobin value obtained for each patient from a complete blood count (gold standard) that was performed using an automated cell counter, and, it was found that four patients presented mild to moderate anemia and one patient (patient 5) had severe anemia. Table 1 shows the characteristics of the five patients examined in the study, regarding age, gender, race, diagnosis and real hemoglobin value (gold standard).

Table 2 shows the mean estimated hemoglobin value, mean score value and mean number of crosses in the four-level evaluation, categorized into the three groups of examiners. There were no differences in the mean values for any patient between the groups.

Spearman's correlation coefficient between the true hemoglobin value and the mean estimated hemoglobin level for each patient was 1.0 for both students and residents and 0.9 for the physicians. On the other hand, when the real hemoglobin level was correlated with the four-level evaluation, no significant association was observed for students (-0.8), residents (-0.8) or attending physicians (-0.7). Spearman's correlation coefficient between the four-level evaluation and the "guessed" hemoglobin was not significant for students (0.79) and residents (0.82), but it was statistically significant for attending physicians (0.90; p = 0.04).

Table 3 shows the sensitivity, specificity, positive and negative predictive values and positive and negative likelihood ratios of the estimated hemoglobin values for diagnosing mild anemia, using the total blood cell count as the gold standard. The estimated hemoglobin for diagnosing mild anemia had sensitivity of 64.6%, specificity of 83.6%, positive predictive value of 75%, negative predictive value of 92.4%, positive likelihood ratio of 3.9 and negative likelihood ratio of 0.4. In comparison, the four-level evaluation (crosses method) had slightly higher sensitivity of 78.6% but worse values for all other parameters: specificity (34.2%), positive predictive value (18.6%), negative pre-dictive value (89.3%), positive likelihood ratio (1.2) and negative likelihood ratio (0.6).

DISCUSSION

The ability to guess a hemoglobin value following the physical examination was more accurate for diagnosing anemia or not than was the four-level evaluation method among patients with mild to severe anemia. No differences in assessment were found between medical students, residents and attending physicians, except for a positive correlation between the mean estimated hemoglobin value and the four-level evaluation, thereby suggesting some kind of improvement in the diagnosing ability over time. Compared with the four-level evaluation (crosses method), the estimated hemoglobin had higher specificity, positive and negative predictive values and better values for positive and negative likelihood ratios.

Previous data from another sample of medical students, residents and attending physicians showed that most of them used a four-level evaluation method to quantify anemia, as in the present study. Attending physicians with more than five years of clinical practice were more likely to make use of two-level evaluations than were residents or medical students.1 Considering that most of the physicians and physicians in training in the sample did not change their initial approach on the basis of the quantification of clinical signs (the initial management of a patient with an anemia of + or +++ would be the same), the usefulness of quantifying anemia using several categories (as in the case of the four-level evaluation method) needs to be questioned.

One important point is that although the accuracy of the four-level evaluation for anemia was worse than that of the estimated hemoglobin value for the same patient in this sample, in clinical practice and in the majority of medical schools the four-level evaluation is the most used and taught method for evaluating anemia. Another point is that the correlation between the four-level evaluation method and the real hemoglobin value did not increase with more years of clinical practice. In other words, an attending physician with more than five years of clinical practice is not more able to correctly evaluate the presence of anemia and its severity than is a physician in training. However, it is fair to say that some kind of improvement is still possible, because only for attending physicians was a positive correlation found between the four-level evaluation method and the mean "guessed" hemoglobin.

In the present study, we tried to choose patients with mild to moderate anemia because the difficulty in diagnosing or quantifying anemia is greater than in cases of severe anemia. However, even for the patient with severe anemia (patient #5), the correlation between the four-level evaluation method and the real hemoglobin value did not improve. The importance of diagnosing mild anemia is increasing, because anemia is now a valuable prognostic factor for many chronic disorders. In a sample of 100,000 hemodialysis patients, the presence of hematocrit higher than 30% was associated with a lower mortality rate. Subsequent treatment for anemia decreased the risk of death, after one year of follow-up.9 But if for patients with end-stage renal disease an anemia investigation is mandatory, it is not true for other chronic conditions. For example, patients with congestive heart failure are at higher risk of all-cause deaths, according to their lower hemoglobin levels. In a 15-month follow-up on 1,130 patients with low left ventricular ejection fraction, the participants who at enrollment were in the lowest quintile of hematocrit (25.4-37.5%) were found after multivariate adjustment to have a 52% higher risk of death than those in the highest quintile (46.1-58.8%).10 Other studies on patients with heart failure have confirmed these data.11,12

In the present cross-sectional study, all the examiners were under direct observation by the authors, in order to avoid differential misclassification. We decided to take into account a single evaluation by each examiner, instead of subcategorizing the physical examination according to the hue of the conjunctivae, skin, tongue and nail bed, as was done in other studies. Through this, we maximized the responses regarding the mean estimated hemoglobin value. Some patient characteristics such as skin color warrant investigation in the future.

CONCLUSIONS

Evaluations of mild anemia are more effective using a "guessed" hemoglobin value than using the four-level evaluation method that is most commonly used and taught at medical schools. The data suggest a possible improvement in accuracy associated with greater numbers of years in clinical practice.

Acknowledgment: This study was funded by an established investigator award for both Dr. Bensenor and Dr. Lotufo from the Brazilian Council for Research, Brasília, Brazil, which is a federal tax-funded agency. Dr. Garcia-Calich was the recipient of a fellowship for students from the Brazilian Council for Research, Brasília, Brazil. Dr. Brunoni, Dr. Espírito-Santo and Dr. Mancini were recipients of fellowships from Fundação de Amparo à Pesquisa do Estado de São Paulo (Fapesp), São Paulo, Brazil.

Sources of funding: None

Conflict of interest: Not declared

Date of first submission: May 19, 2006

Last received: May 17, 2007

Accepted: May 21, 2007

AUTHOR INFORMATION

Isabela Martins Benseñor, MD, PhD. Department of Internal Medicine, Hospital das Clínicas, School of Medicine, Universidade de São Paulo (USP), São Paulo, Brazil.

Ana Luísa Garcia Calich, MD. Department of Internal Medicine, School of Medicine, Universidade de São Paulo (USP), São Paulo, Brazil.

André Russowsky Brunoni, MD. Department of Internal Medicine, School of Medicine, Universidade de São Paulo (USP), São Paulo, Brazil.

Fábio Ferreira Espírito-Santo, MD. Department of Surgery, School of Medicine, Universidade de São Paulo (USP), São Paulo, Brazil.

Renato Lendimuth Mancini, MD. Department of Internal Medicine, School of Medicine, Universidade de São Paulo (USP), São Paulo, Brazil.

Luciano Ferreira Drager, MD. Heart Institute, Hospital das Clínicas, School of Medicine, Universidade de São Paulo (USP), São Paulo, Brazil.

Paulo Andrade Lotufo, MD, DrPH. Department of Internal, School of Medicine, and Hospital Universitário, Universidade de São Paulo (USP), São Paulo, Brazil.

  • 1. Drager LF, Abe JM, Martins MA, Lotufo PA, Bensenor IJ. Impact of clinical experience on quantification of clinical signs at physical examination. J Intern Med. 2003;254(3):257-63.
  • 2. Desai MR, Phillips-Howard PA, Terlouw DJ, et al. Recognition of pallor associated with severe anaemia by primary caregivers in western Kenya. Trop Med Int Health. 2002;7(10):831-9.
  • 3. Sheth TN, Choudhry NK, Bowes M, Detsky AS. The relation of conjunctival pallor to the presence of anemia. J Gen Intern Med. 1997;12(2):102-6.
  • 4. Wurapa FK, Bulsara MK, Boatin BA. Evaluation of conjunctival pallor in the diagnosis of anaemia. J Trop Med Hyg. 1986;89(1):33-6.
  • 5. Gjorup T, Bugge PM, Hendriksen C, Jensen AM. A critical evaluation of the clinical diagnosis of anemia. Am J Epidemiol. 1986;124(4):657-65.
  • 6. Sanchez-Carrillo CI. Bias due to conjunctiva hue and the clinical assessment of anemia. J Clin Epidemiol. 1989;42(8):751-4.
  • 7. Lewis SM, Stott GJ, Wynn KJ. An inexpensive and reliable new haemoglobin colour scale for assessing anaemia. J Clin Pathol. 1998;51(1):21-4.
  • 8. Browner WS, Newman TB, Cummings SR, Hulley SB. Estimating sample size: the nitty-gritty. In: Hulley SB, Cummings SR, Browner WS, Grady D, Hearst N, Newman TB, editors. Designing clinical research an epidemiologic approach. 2nd ed. Philadelphia: Lippincott Williams & Wilkins; 2001. p. 65-91.
  • 9. Collins A, Xia H, Ebben J, Ma J. Change in hematocrit and risk of mortality. J Am Soc Nephrol. 1998;9(suppl A):204A.
  • 10. Mozzafarian D, Nye R, Levy WC. Anemia predicts mortality in severe heart failure: the prospective randomized amlodipine survival evaluation (PRAISE). J Am Coll Cardiol. 2003;41(11):1933-9.
  • 11. McClellan WM, Flanders WD, Langston RD, Jurkovitz C, Presley R. Anemia and renal insufficiency are independent risk factors for death among patients with congestive heart failure admitted to community hospitals: a population-based study. J Am Soc Nephrol. 2002;13(7):1928-36.
  • 12. Horwich TB, Fonarow GC, Hamilton MA, MacLellan WR, Borenstein J. Anemia is associated with worse symptoms, greater impairment in functional capacity and a significant increase in mortality in patients with advanced heart failure. J Am Coll Cardiol. 2002;39(11):1780-6.
  • Address for correspondence:
    Isabela Martins Benseñor
    Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo
    Av. Enéas Carvalho de Aguiar, 155 – 8º andar Bloco 3 – Clínica Médica
    São Paulo (SP) – Brasil – CEP 05403-000
    Tel. (+55 11) 3067-7990
    E-mail:
    E-mail:
  • Publication Dates

    • Publication in this collection
      26 Sept 2007
    • Date of issue
      May 2007

    History

    • Received
      19 May 2006
    • Reviewed
      17 May 2007
    • Accepted
      21 May 2007
    Associação Paulista de Medicina - APM APM / Publicações Científicas, Av. Brigadeiro Luís Antonio, 278 - 7º and., 01318-901 São Paulo SP - Brazil, Tel.: +55 11 3188-4310 / 3188-4311, Fax: +55 11 3188-4255 - São Paulo - SP - Brazil
    E-mail: revistas@apm.org.br