Noninvasive hemoglobin monitoring in clinical trials: a systematic review and meta-analysis

Abstract

Background and objectives:

The measurement of hemoglobin concentration (Hb) by co-oximetry is an innovative technique that offers efficiency and agility in the processing of information regarding the measurement of Hb obtained through continuous, non-invasive and rapid monitoring. Because of this attribute, it avoids unnecessary exposures of the patient to invasive procedures by allowing a reduction in the number of blood samples for evaluation and other unnecessary therapies. It also helps to make decisions about the need for transfusion and how to handle it. The objective of this study is to compare the performance offered to obtain Hb values between the Masimo Corporation (Irvine, CA, USA) instrument and the standard gold tool (laboratory examination).

Contents:

The study corresponds to a systematic review followed by meta-analysis, which included fully registered full-text clinical trials published from 1990 to 2018. PubMed, Cochrane, Medline, Embase and Web of Science databases were investigated. The mean overall difference found between the non-invasive and invasive methods of hemoglobin monitoring was 0.23 (95% CI -0.16, 0.62), that is, it did not present statistical significance (p = 0.250). The results of the analysis of heterogeneity within and between the studies indicated high levels of inconsistency (Q = 461.63, p < 0.0001, I² = 98%), method for Hb values.

Conclusions:

Although the mean difference between noninvasive measurements of Hb and the gold standard method is small, the co-oximeter can be used as a non-invasive “trend” monitor in detecting unexpected responses at Hb levels.

KEYWORDS
Spectrophotometry; Oximetry; Blood chemical analysis; Blood gas monitoring transcutaneous; Clinical trial; Systematic review; Meta-analysis

Resumo

Justificativa:

A medida da concentração de hemoglobina (Hb)por co-oximetria é uma técnica inovadora que oferece eficiência e agilidade no processamento das informações referentes à medida da concentração de hemoglobina obtida por meio de monitorização contínua, não-invasiva e rápida. Por conta desse atributo, evita exposições desnecessárias do paciente a procedimentos invasivos ao possibilitar redução da quantidade de amostras sanguíneas para avaliação e de outras terapêuticas desnecessárias. Além disso, auxilia a tomada de decisões quanto à necessidade de transfusão e quanto ao manejo da mesma.

Objetivo:

Comparar o desempenho oferecido para a obtenção dos valores de concentração de hemoglobina entre medida não invasiva da Hb e a ferramenta padrão ouro (exame laboratorial).

Conteúdo:

O estudo corresponde a uma revisão sistemática seguida de metanálise que incluiu ensaios clínicos devidamente registrados com texto completo, publicados a partir de 1990 até 2018. Foram investigadas as bases de dados PubMed, Cochrane, Medline, Embase e Web Of Science. A diferença média global encontrada entre os métodos não invasivo e invasivo de monitorização da hemoglobina foi de 0,23 (95% IC -0,16; 0,62), ou seja, não apresentou significância estatística (p = 0,250). Os resultados da análise de heterogeneidade dentro e entre os estudos, apontou níveis elevados de inconsistência (Q = 461,63, p < 0,0001, I² = 98%).

Conclusão:

Embora a diferença média entre as medidas não invasivas da Hb e o método padrão ouro sejam pequenas, o co-oxímetro pode ser utilizado como um monitor não invasivo de “tendência” na detecção de alterações inesperadas nos níveis de Hb.

PALAVRAS-CHAVE
Espectrofotometria; Oximetria; Análise química do sangue; Monitorização transcutânea dos gases sanguíneos; Ensaio clínico; Revisão sistemática; Metanálise

Background

The word monitoring comes from the Latin monere, and comprises the meaning of valuing safety by follow-up and counseling. In 2008, the market introduced a pulse CO-oximeter with technology capable of measuring total Hb fast, continuously and non-invasively. Therefore, the monitor provided an innovating tool for decision making on blood transfusion management and detection of occult bleeding. The method depicts the trend of changes in Hb concentration values, which highlights its use in procedures with potential blood loss, improving patient safety and reducing costs.^1-4,7-9

The reference method for analyzing Hb concentration uses either venous or capillary blood samples. The method requires collecting samples of arterial or venous blood and is associated with unavoidable delay (sample collecting time, transportation to laboratory, analysis of material and sample validation, time for results to reach the anesthesiologist), and this may delay transfusion management, leading to unnecessary transfusions (before receiving results), increasing risks to patients’ health (related to delay or inadequate transfusions), and increase in hospital costs.^{4,5,7,8,10,11}

Therefore, the objective of the present study was to compare the performance for obtaining Hb values by CO-oximetry and by the gold-standard tool (laboratory test).

Method

The present systematic review and meta-analysis was prepared in compliance with the guidelines established in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses, (PRISMA).¹²

The inclusion criteria established for selecting the studies were articles registered as clinical trials published from 1990 to 2018, focusing on non-invasive hemoglobin monitoring, and comparing it to the gold-standard (laboratory test) for adult and children populations, except neonates.

We used PubMed, Cochrane Library, Embase, Medline and Web of Science databases for searching the articles.

In order to develop the search strategy, the major terms related to the topic focused were highlighted. Thus, the terms selected were Total Hemoglobin, tHb, Hb, Measurement, Oximeter, Co-oximeter, Co-oximetry, Spectrophotometric, Spectrophotometry, SpHb, Noninvasive Hemoglobin Monitoring, Continuous, Noninvasive, Real-time, Beat-to-beat, Occlusion Spectroscopy, MASIMO, Rad-57, Rad-87, Radical-7 and Monitor.

Following, we carried out the literature search strategy in each of the databases selected, by restricting the period (we chose studies between the years of 1990 and 2018), type of study (only clinical trials), and type of population (human population trials).

Three surveyors (DPSW, TZ and ESMD) selected the potentially eligible studies, read titles and abstracts, and thereafter excluded articles unrelated to the topic of interest. Following, they searched full-texts of the remaining articles and assessed eligibility according to the inclusion criteria previously established. In case of questions or disagreements during the selection of a specific study, a fourth surveyor (KM) was contacted to proceed to the final decision.

DPSL, TZ and ESMD collected data from studies independently. After this, KM revised all data previously collected. Information taken into account was country or origin of the study, experiment environment, demographic characteristics, name and version of software of monitoring devices and non-invasive Hb sensor, name of central lab analyzer, number of patients included in the analysis, and total number of paired samples.

In this way, data were extracted from the selected articles based on the difference of the means observed between noninvasive and invasive measurements of Hb. The standard deviation was obtained using the Confidence Interval formula (95% CI). Then, data were entered and analyzed on RevMan version 5.3 software.

The meta-analysis used the inversion of variance method for random effects. Standardized differences of means with Confidence Intervals of 95% were calculated. Overall statistical significance obtained was analyzed using the z test.

Heterogeneity within and among studies was analyzed using Cochran's Q statistical calculation (which follows Chi-Square distribution) and I² index, in addition to τ² statistics. A sensitivity analysis was performed to study causes of heterogeneity.

Publication bias was assessed by building a funnel chart. In this way, symmetry of publications was evaluated. If no bias was found, studies would take over the aspect of a symmetric inverted funnel.

To perform quality assessment of the studies included in the meta-analysis we built charts following Quality Assessment of Diagnostic Accuracy Studies, QUADAS-2, guidelines.¹³ The risk for each polarization and applicability domain was considered as low, high or unclear. According these criteria established, two surveyors (DPSW and TZ) analyzed the independent quality of each study. Following, disagreements were solved by a third surveyor (KM).

Results

The database and manufacturer search recovered 1,192 articles. After excluding duplicates, 906 remained for assessment. Three investigators excluded 838 studies based on title and abstract analysis. The 68 full-text articles remaining were recovered and assessed as to eligibility. After full-text review of the articles, 60 studies were excluded because of non-compliance to inclusion criteria or insufficient data, despite efforts to contact the authors for data. Finally, 8 studies were included in the metanalysis (Fig. 1).

Figure 1
Flowchart of article selection process.

A total 1,069 individuals were included in the metanalysis. The features of the individual studies are presented in Table 1. Sample size of studies ranged between 10 and 584 individuals.

Table 1
Characteristics of studies included in the meta-analysis on comparison of the invasive (laboratory) and non-invasive (pulse CO-oximetry) methods to measure Hb.

Author	Year	Country	Population characteristics	Age (mean ± sd), mean (range) or median (range)	Sex	Device tested (version of software, version of sensor)	Hb laboratory analysis	Size of sample/number of paired measurements	Subgroups (size of sample/number of paired measurements)	Device testeda	Laboratory analysisa	SMD	SD
Bergek C, Zdolsek JH, Hahn RG16	2012	Sweden	Study volunteers, fluid infusion	22 (18-28)	Male 100%	Radical-7 (7.6.0.1, A single use adhesive sensor type R2-25a)	Beckman Coulter AcT-5 diff	10/956		NR	NR	-0.07	1.17
Butwick A, Hilton G, Carvalho B20	2011	US	Elective C-section	32 (5)	Female 100%	Radical-7 (7.6.0.4, Sensor Rev E)	Coulter LH 750 or LH 780 or CELLDYN Sapphire o CELL-DYN 1800	50/150	Baseline (50/50)	NR	NR	1.22	1.08
Gayat E et al.17	2012	US	Emergency Department	57 (43-75)	Male 51.5%	Masimo Pronto-7 (version 2.1.9, Masimo, Sensor Rainbow 4D DC)	ADVIA 2120	272/272	Abdominal pain (21%), Chest pain (13%), dyspnea (12%), sepsis (8%) and bleeding (7%).	NR	13.2 (11.9-14.3)	0.56	1.21
Hahn RG, Li Y, Zdolsek J21	2010	Sweden	Study volunteers, fluid infusion	22 (19-37)	Male 100%	Radical-7 (7.4.0.9, Sensor handheld R.7.7.1.0, D-station R5.1.2.7)	Cell-Dyn Sapphire	10/680	Group 1: hydrated volunteers, received 5 mL.kg-1 of Ringer acetate in 15 min. (10/167);	13.425 (0.998)	13.368 (0.862)	-0.37	1.03
									Group 2: dehydrated volunteers, received 5 mL.kg-1 of Ringer acetate in 15 min. (10/187);
									Group 3: hydrated volunteers, received 10 mL.kg-1 of Ringer acetate in 15 min. (10/168);
									Group 4: dehydrated volunteers, received 10 mL.kg-1 of Ringer acetate in 15 min. (10/158).
Khalafallah AA et al.14	2014	Australia	Elective Surgery	Male 65.6 (12)/ Female 61.1 (14.9)	Male 50.34%	Masimo Pronto-7 (version 2.1.9, Masimo Corporation, Rainbow 4D Sensor	Sysmex XE-5000	584/584	Pre-operative: 638 pre-assessment with expectation of normal Hb and 88 oncological patients with expectation of reduced Hb.	NR	NR	-0.71	1.30
Park YH et al.18	2012	South Korea	Neurosurgery, pediatrics	6.4 ± 3.0	Male 62.5%	Radical-7 (7.6.1.1, Sensor Rev E)	ABL820	40/119	After volume replenishment (NR/47); after administration of colloid (NR/32); after red blood cell replenishment (NR/15); tHb < 9 (NR/NR); 9 ≤ tHb < 11 (NR/NR); 11 ≤ tHb (NR/NR).	NR	NR	0.9	1.35
Tsuei BJ et al.15	2014	US	Surgical ICU	> 18	Male 60%	Radical-7 (NR, NR)	iSTAT Abbott Point of Care and CBC LH 780	88/572		CBC	NR	1.49	1.76
Vos JJ et al.19	2012	Netherlands	Liver resection	56 (19-76)	Male 27%	Radical-7 (7.6.0.1, Sensor R2-25, Rev E)	ABL 800	15/335	Crystalloid infusion (15/335)	NR	NR	-0.27	1.06

• ^a
  Hb (Mean ± SD), Mean (Range) or Median (Range).
  SMD, Standardized Means Difference; SD, Standard Deviation; NR, Not Reported.
Source: Research Data, 2018.

Of the eight studies included in the meta-analysis, two were published in 2014,^14,15 four in 2012,^16-19 one in 2011²⁰ and one in 2010.²¹ Four studies were performed during elective surgeries,^14,18-20 two were performed in volunteers during specific experiments (volume kinetic analysis and hemodilution),^16,20 one was performed at the emergency department¹⁷ and one was performed at the Surgical Intensive Care Unit.¹⁵ Three studies were conducted in the United States,^15,17,20 two in Sweden,^16,21 one was carried out in Austraoflia,¹⁴ one was performed in the Netherlands, and one was conducted in South Korea.¹⁸

The mean overall difference found between the non-invasive and invasive method for measuring hemoglobin was 0.23 (95% CI -0.16; 0.62), that is, no statistical significance (p = 0.250). In order to interpret this information appropriately, it should be joined by the analysis of heterogeneity within and among studies, which indicated high levels of inconsistency (Q = 461.63, p < 0.0001, I² = 98%) (Fig. 2).

Figure 2
Overall analysis forest chart.

Although a sensitivity analysis was performed, heterogeneity did not decrease significantly. The analysis was performed according to the type of procedures to which patients were submitted (surgical/no surgical), age group and sex. According to the QUADAS-2 assessment, the high risk of bias prevailed in the assessment of the gold standard. This was because in some studies it was not clear if lab test results were actually interpreted without previous knowledge of the results of the test studied.^15,18,19,21 The lowest risk of bias was observed in patient selection criteria, given most studies showed either a consecutive or random sample, adequately described the process of patient selection, and executed appropriate exclusions.^{15,17,18,20,21} Only two articles were considered of low risk^14,20 according to QUADAS-2. The classification of the remaining articles ranged from high to unclear risk (Fig. 3). performed in five subgroups. The subgroups assessed were formed according to age

Figure 3
QUADAS-2 chart of results per study.

After the overall meta-analysis of the eight articles included, five new meta-analyses were group, sex, country, comorbidities and elective/non-elective character of the procedures patients were submitted to.

The standardized mean difference found between the non-invasive and invasive Hb measuring methods in the subgroup of articles comprising patients submitted to elective procedures^14,16,20,21 was 0.02 (95% CI -0.43; 0.47) (Fig. 4). This meta-analysis corroborated the result found in the overall meta-analysis, with no statistically significant difference between methods (p = 0.910), but with high levels of inconsistency (Q = 165.54, p < 0.0001, I² = 98%).

Figure 4
Subgroup forest chart (elective status patients).

The standardized mean difference found between the non-invasive and invasive Hb measuring methods in the subgroup of articles comprising patients submitted to non-elective procedures^15,17-19 was 0.43 (95% CI -0,11; 0.96) (Fig. 5). This meta-analysis corroborated the result found in the overall meta-analysis, with no statistically significant difference between methods (p = 0.120), but high levels of inconsistency (Q = 126.22, p < 0.0001, I² = 98%).

Figure 5
Subgroup forest chart (non-elective status patients).

The standardized mean difference found between the non-invasive and invasive Hb measurement methods in the subgroup of articles that presented patients with relatively similar age groups^15,16,20,21 was 0.38 (95% CI -0.22; 0.99) (Fig. 6). This meta-analysis corroborated the result found in the overall meta-analysis, with no statistically significant difference between the methods (p = 0.220), but high levels of inconsistency (Q = 295.97, p < 0.0001, I² = 99%).

Figure 6
Subgroup forest chart (age).

The standardized mean difference found between the non-invasive and invasive Hb measurement methods in the subgroup of articles that presented a distribution according to patients’ sex^{14,15,17-19,21} was 0.13 (95% CI -0.37; 0.63) (Fig. 7). This meta-analysis corroborated the result found in the overall meta-analysis global, with no statistically significant difference between methods (p = 0.600), but with high levels of inconsistency (Q = 379.19, p < 0.0001, I² = 99%).

Figure 7
Subgroup forest chart (both sexes).

The standardized mean difference found between non-invasive and invasive Hb measurement methods in the subgroup of articles that presented proximity among sites where studies were conducted (US)^15,17,20 was 0.80 (95% CI 0.47; 1.13) (Fig. 8). This meta-analysis did not corroborate the results found in the overall meta-analysis, presenting a statistically significant difference between the methods (p < 0.001), but with high levels of inconsistency (Q = 22.28, p < 0.0001, I² = 91%).

Figure 8
Subgroup forest chart (country).

Assessment of publication bias was performed by building a funnel chart with the standardized mean differences on the abscissa axis, and the standard error of the standardized mean differences on the ordinate axis. When publication bias is absent, the studies distribute themselves symmetrically in the chart in the shape of an inverted funnel. The studies of this review did not present the latter behavior, suggesting the presence of publication bias (Fig. 9).

Figure 9
Funnel chart.

Discussion

Non-invasive Hb monitoring using CO-oximetry is efficient and expedites the processing of information referring to Hb concentration values, which are obtained quickly and continuously during patient care in several settings (particularly OR, ICU and ER).^14,15,20 Moreover, there is an enormous potential in pediatric populations in which multiple test samplings are less well-tolerated. The non-invasive Hb measurement would also be ideal for patients who have needle phobia.¹⁴

This study compared the accuracy and precision of non-invasive Hb monitoring with monitoring provided by the lab method (gold-standard) in 1,069 individuals in eight clinical trial articles.

Meticulous quality assessment of the articles selected is crucial for meta-analysis.¹³ Unfortunately, the result attained by QUADAS-2 in the present study, in which only two studies were considered as presenting low bias risk and applicability, showed the poor quality of the research on the topic approached.

Due to the heterogeneity of data present in the studies included, they were divided into subgroups to provide a more reliable comparison. Subgroup analysis results were concordant with overall analysis results, suggesting that the subgroups did not represent interference factors for the final result.

The articles used in the present study not only reiterate the issues discussed, but also corroborate the results found in the overall meta-analysis.²² That is, the present study did not show a statistically significant difference between methods.

Therefore, the discussion on the continuous measurement technique is based on the principle that the technique would especially track the direction of change, that is, the trend of values in real-time. Moreover, the instrument is a useful tool both to decrease unnecessary transfusions and simultaneously signal when an early intervention is required.² In this way, it is important to underscore that careful clinical management should be observed when making decisions based only on non-invasive Hb monitoring values, due to underestimation of lower Hb values.²⁰

One of the limitations faced by our study was the small number of studies on the topic chosen. There are more observational studies and the availability of clinical trials is still limited. Moreover, the poor quality of the studies assessed limited the level of consistency of the study performed. Regarding age group, studies concentrate on adults with scarce evidence on the device use in pediatric populations. Last, despite the comprehensive search on several research platforms, many articles selected to be read in full were not available and, therefore, were excluded without extracting data.

The development of criteria that standardize how studies are conducted on a subject can contribute to the development of research with more consistent data. Moreover, we suggest calculating Egger regression to formally assess the existence of publication bias. The development of studies in other subgroups, such as pediatrics, can highlight potential benefits and, thus, further expand the use of the non-invasive method.

References

• ¹
  Cavalcante IL, et al. Monitorização em Anestesia, Rio de Janeiro, Sociedade de Anestesiologia do Estado do Rio de Janeiro/SAERJ; 2011.
• ²
  Amaral JLG, Ferreira ACP, Ferez D, Geretto P. Monitorização da respiração: oximetria e capnografia. Rev Bras Anestesiol. 1992;42:51-8.
• ³
  Bruells CS, Menon AK, Rossaint R, et al. Accuracy of the Masimo Pronto-7® system in patients with left ventricular assist device. J Cardiothorac Surg. 2012;24:8-159.
• ⁴
  Shah N, Osea EA, Martinez GJ. Accuracy of noninvasive hemoglobin and invasive point-of-care hemoglobin testing compared with a laboratory analyzer. Int J Lab Hematol. 2014;36:56-61.
• ⁵
  Ardin S, Störmer M, Radojska S, et al. Comparison of three noninvasive methods for hemoglobin screening of blood donors. Transfusion. 2015;55:379-87.
• ⁶
  Manica J, et al. Anestesiologia: Princípios e Técnicas. 3rd ed. Artmed: Porto Alegre; 2004.
• ⁷
  Riou B. Continuous measurement of hemoglobin. Anesthesiology. 2013;118:497-9.
• ⁸
  Awada WFN, Maher F. Reduction in red blood cell transfusion during neurosurgery with noninvasive and continuous hemoglobin monitoring. In: Proceedings of the society for technology in anesthesia annual meeting. 2013.
• ⁹
  Martin JR, Camp CL, Stitz A, et al. Noninvasive Hemoglobin Monitoring: a rapid, reliable, and cost-effective method following total joint replacement. J Bone Joint Surg Am. 2016;98:349-55.
• ¹⁰
  Patino M, Schultz L, Hossain M, et al. Trending and accuracy of noninvasive hemoglobin monitoring in pediatric perioperative patients. Anesth Analg. 2014;119:920-5.
• ¹¹
  Adel A, Awada W, Abdelhamid B, et al. Accuracy and trending of non-invasive hemoglobin measurement during different volume and perfusion statuses. J Clin Monit Comput. 2018;32:1025-31.
• ¹²
  Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6:e1000097.
• ¹³
  Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155:529-36.
• ¹⁴
  Khalafallah AA, Chilvers CR, Thomas M, et al. Usefulness of non-invasive spectrophotometric haemoglobin estimation for detecting low haemoglobin levels when compared with a standard laboratory assay for preoperative assessment. Br J Anaesth. 2015;114:669-76.
• ¹⁵
  Tsuei BJ, Hanseman DJ, Blakeman MJ, et al. Accuracy of noninvasive hemoglobin monitoring in patients at risk for hemorrhage. J Trauma Acute Care Surg. 2014;77(Suppl 2):S134-9.
• ¹⁶
  Bergek C, Zdolsek JH, Hahn RG. Accuracy of noninvasive haemoglobin measurement by pulse oximetry depends on the type of infusion fluid. Eur J Anaesthesiol. 2012;29:586-92.
• ¹⁷
  Gayat E, Aulagnier J, Matthieu E, Boisson M, Fischler M. Non-invasive measurement of hemoglobin: assessment of two different point-of-care technologies. PLoS One. 2012;7:e30065.
• ¹⁸
  Park YH, Lee JH, Song HG, Byon HJ, Kim HS, Kim JT. The accuracy of noninvasive hemoglobin monitoring using the radical-7 pulse CO-Oximeter in children undergoing neurosurgery. Anesth Analg. 2012;115:1302-7.
• ¹⁹
  Vos JJ, Kalmar AF, Struys MM, et al. Accuracy of non-invasive measurement of haemoglobin concentration by pulse co-oximetry during steady-state and dynamic conditions in liver surgery. Br J Anaesth. 2012;109:522-8.
• ²⁰
  Butwick A, Hilton G, Carvalho B. Non-invasive haemoglobin measurement in patients undergoing elective Caesarean section. Br J Anaesth. 2012;108:271-7.
• ²¹
  Hahn RG, Li Y, Zdolsek J. Non-invasive monitoring of blood haemoglobin for analysis of fluid volume kinetics. Acta Anaesthesiol Scand. 2010;54:1233-40.
• ²²
  Kim SH, Lilot M, Murphy LS, et al. Accuracy of continuous noninvasive hemoglobin monitoring: a systematic review and meta-analysis. Anesth Analg. 2014;119:332-46.

Publication Dates

• Publication in this collection
  21 Sept 2020
• Date of issue
  Jul-Aug 2020

History

• Received
  18 Dec 2018
• Accepted
  15 May 2019