The ROPScore as a Screening Algorithm for Predicting Retinopathy of Prematurity in a Brazilian Population

Abstract

OBJECTIVES:

To evaluate the accuracy of the ROPScore algorithm as a predictor of retinopathy of prematurity (ROP).

METHODS:

A prospective cohort of 220 preterm infants with a birth weight ≤1500 g and/or gestational age ≤32 weeks was included. The ROPScore was determined in the sixth week of life in 181 infants who then survived until a corrected gestational age of 45 weeks. The sensitivity, specificity, and positive (PPV) and negative predictive values (NPV) of the algorithm were analyzed.

RESULTS:

ROP was found in 17.6% of the preterm infants. The sensitivity of this test for any stage of ROP was 87.5%, while that for severe ROP was 95.4% (21/22 cases). The PPV and NPV were 59.6% and 97%, respectively, for any stage of ROP and 44.7% and 99.25%, respectively, for severe ROP. The ROPScore could therefore hypothetically reduce the number of ophthalmologic examinations required to detect ROP by 71.8%.

CONCLUSION:

The ROPScore is a useful screening tool for ROP and may optimize examinations and especially the identification of severe ROP.

Retinopathy of Prematurity; Preterm Infants; Algorithm

INTRODUCTION

In recent years, substantial improvements in neonatal care have increased survival in preterm infants with very low birth weight (¹). They have also increased the incidence of retinopathy of prematurity (ROP), a disease of the developing retinal vasculature that is the leading cause of preventable childhood blindness worldwide, especially in developing countries (²). Timely detection of ROP is very important to protect visual functions in preterm infants (³). The most important risk factors for ROP are birth weight (BW) and gestational age (GA); however, others factors, including the length of oxygen-therapy, sepsis, blood transfusion, bronchopulmonary dysplasia, and hyperglycemia, are also associated with postnatal morbidities (⁴,⁵). Several more recent studies have identified poor postnatal weigh gain as a strong predictor of ROP (⁶-⁸).

Many screening guidelines based on BW and GA have been proposed to identify preterm infants at risk of developing severe ROP. These guidelines have been adapted to account for difference in population characteristics in several countries (⁹-¹²). The Brazilian guidelines for screening and treating ROP recommend that all the preterm infants with GA ≤32 weeks and BW ≤1500 g should be screened by fundus examination starting between the fourth and sixth weeks of life until complete retinal vascularization is achieved (¹³).

Timely screening is costly and requires a large amount of work by health professionals (¹⁴). Furthermore, the excessive number of examinations currently required to identify which preterm infants need treatment can lead to stress and cardiorespiratory instability in patients with other comorbidities (¹⁵,¹⁶). The need to optimize screening so that efforts can be directed to preterm infants at higher risk of ROP and the burden of examinations on neonates can be reduced has led to the development of predictive algorithms that use BW and GA in addition to weight gain to measure postnatal growth (¹⁷).

The ROPScore is a simple scoring system that was proposed by Eckert et al. (¹⁴) to predict severe ROP. This algorithm uses BW, GA, proportional weight gain at the sixth week of life, history of blood transfusion, and use of oxygen in mechanical ventilation as predictive variables.

The score is calculated by an Excel spreadsheet once per infant in the sixth week of life. High score values indicate a high risk of developing severe ROP.

Only one study has validated this screening tool. That study used a retrospective design to analyze an Italian population of 445 preterm infants (⁹). The purpose of the present study was to evaluate the efficacy of the ROPScore as a method for predicting severe ROP in a population of preterm infants in Brazil.

METHODS

We performed a prospective cohort study in which we included all preterm infants born with BW ≤1500 g and GA ≤32 weeks who were admitted to the Neonatal Intensive Care Unit (NICU) of the University Hospital of Botucatu Medical School - UNESP, Brazil, from November 2012 to July 2014. The study protocol was approved by the Research Ethics Committee of the Botucatu Medical School - UNESP (no. 4051/2011), and the parents/guardians of all included infants provided written consent to participate in the study. Infants that died before completing six weeks of life or before reaching 45th weeks of corrected gestational age. No other exclusion criterion was used. ROP screening was performed between the fourth and sixth weeks after birth and repeated based on the findings of ophthalmologic examinations performed at intervals determined by the Brazilian guidelines for detecting and treating ROP, which state that exams should be performed until the retina is fully vascularized or ROP has totally regressed (¹³). Ophthalmologic examinations consisted of binocular indirect ophthalmoscopy after pupillary dilatation with tropicamide 0.5% and phenylephrine 2.5% and were performed using a 28-diopter lens and an eye speculum. ROP was categorized according to the International Classification of Retinopathy of Prematurity Revised (¹⁸). Clinical outcomes were defined as the onset of any stage of ROP (requiring no treatment) or severe ROP that required treatment. Each child was classified according to the most advanced ROP stage observed. The indications for treatment were based on the Early Treatment for Retinopathy of Prematurity study (ETROP) criteria (¹⁹).

ROPScore Screening was applied in the sixth week of life using a Microsoft¯ Excel spreadsheet as proposed by Eckert et al. (¹⁴). This process required the following parameters: BW, GA, weight at the sixth week of live, the presence or absence of blood transfusion up to the sixth week of life, and oxygen in mechanical ventilation (Figure 1).

Figure 1
Excel spreadsheet (Microsoft) used to calculate the ROPScore. From Eckert et al. 2012.

RESULTS

A total of 220 preterm infants met the inclusion criteria, thirty-eight of whom died before the sixth week of life. Thus, 181 patients (86 male and 95 female) completed the study. The prevalence of any stage of ROP was 32/181 infants (17.6%). Ten preterm infants developed low-grade ROP, and 22/181 developed severe ROP that required treatment (12.1%). The baseline demographics and clinical characteristics for this cohort are shown in Table 1.

Table 1
Characteristics of the 181 premature infants included in the study.

Characteristic	Total Cohort	Any stage ROP	Severe ROP
Number of patients	181	32	22
Male	86/181	10/32	6/22
Mean BW (g) *	1271.6 ± 354.6	884.0 ± 250.0	763.1±186.8
Mean GA (weeks) *	29.2 ± 2.2	26.4±1.6	25.9±1.2
Mean WG at the sixth week of life (g) *	596.9 ±248.0	407.4±190.8	390.7±162.8
ROPScore range *	7.2 - 19.6 (13.5±3.0)	12 - 19.6 (16.0±2.3)	14.7 - 19.6 (17.9±1.0)

• ^*
  Data are expressed as the mean ± SD; BW: Birth Weight; GA: Gestational Age; ROP: Retinopathy Of Prematurity; SD: Standard Deviation; WG: Weight Gain from birth to 6 weeks of life.

The accuracy of the ROPScore for predicting the onset of ROP in our population was determined by ROC curves (Figure 2), and cut-off points for sensitivity and specificity were obtained for continuous score values. The ROPScore values ranged from 7.2 to 19.6 (Table 1). The best cut-off point established for any stage of ROP was 16 (87.5% sensitivity and 87.2% specificity), while that for severe ROP was 16.6 (95.4 sensitivity and 83.6% specificity). The positive and negative predictive values (PPV and NPV, respectively) for any stage of ROP and severe ROP are shown in Table 2.

Figure 2
Receiver operating characteristic (ROC) curves for the detection of any stage of retinopathy of prematurity (ROP) (A) and of severe ROP (B) according to the ROPScore algorithm.

Table 2
Accuracy of the ROPScore for predicting the development of ROP.

	Any stage ROP	Severe ROP
	ROPScore: ≥16	ROPScore: ≥16.6
Sensitivity	87.5% (76%-98.9%)	95.4% (86.7%-100%)
Specificity	87.2% (81.9%-92.6%)	83.6% (77.9%-89.4%)
PPV	59.5% (45.5%-73.6%)	44.7% (30.5%-58.9%)
NPV	97.1% (94.1%-99.9%)	99.2% (97.8%-100%)

• NPV: Negative Predictive Value; PPV: Positive Predictive Value; ROP: Retinopathy Of Prematurity.

DISCUSSION

In Brazil, the prevalence of ROP varies according to region, the level of neonatal care, and access to ophthalmologic screening programs. The blindness caused by ROP can be prevented with timely screening (²⁰). In the present study, the ROPScore was a useful and accurate method for predicting ROP.

Scoring systems have become widely used in neonatology, including neonatal intensive care, to help detect comorbidities. Predictive algorithms represent promising and appropriate tools that can be used to identify preterm infants at risk of developing severe ROP and reduce the excessive number of examinations performed per preterm infant (²¹).

The ROPScore was developed in Brazil (¹⁴) and was chosen to be tested in our population because it is simple and practical to use and requires only one weight measurement.

The incidence of severe ROP was much higher in this sample than in the population studied by Eckert et al. (¹⁴) in South Brazil (12.5% versus 5%, respectively). A comparison of the characteristics of that population versus the those of the present cohort revealed that in preterm infants who developed severe ROP, BW (908.7 g±232.6 versus 763.1±186.8), GA (27.9±2.2 versus 25.9±1.2) and weight gain during the first six weeks of life (411.7±277.4 versus 390.7±162.8) were lower in this study than in the previous study, and this may account for the fact that more infants developed the more severe form of the disease in this study.

The cut-off point for ROPScore was higher in this cohort (16 for any stage of ROP and 16.6 for severe ROP) than in the study population in Eckert et al. (¹⁴) (11 for any stage of ROP and 14.5 for severe ROP). Piemarocchi et al. (⁹) evaluated ROPScore in a retrospective cohort but adjusted only the cut-off point for severe ROP, which increased from 14.5 to 15.8.

The NPV calculated in this study indicated that the probability that a preterm infant with a ROPScore below a cut-off point of 16 would not develop any stage of ROP was 97.1%, while the probability that the same infant would not develop the severe form of the disease was 99.2%. An adjusted ROPScore correctly identified 28 of 32 preterm infants who developed any stage of ROP and 21 of 22 who developed severe ROP. Despite the fact that one case of severe ROP was not identified, the adjusted ROPScore had a high NPV and was associated with high sensitivity, indicating that it was a useful tool for identifying preterm infants at greater risk and would, therefore, reduce the number of exams in clinical practice. If the ROPScore were applied, 130 of the preterm infants in this cohort would not need to be evaluated with the same frequency, resulting in a decrease of 71.8% in the total number of tests needed to detect ROP.

The introduction of such algorithms is still in the preliminary phase, and it should be stated that the goal is not to replace the current screening guidelines. However, these tools can help to reduce the number of lost diagnoses in ROP (⁷,⁹). Regardless of this positive characteristic of the function of the algorithms, there are limitations to their clinical use. First, the ROPScore calculation uses preterm weight only at the sixth week of life. Hence, this test may not detect some high-risk preterm infants in whom aggressive posterior ROP is initiated prior to weight measurement but then subsequently evolves rapidly (⁹). Moreover, the early hospital discharge of preterm infants that are evolving well is another factor that contributes to the loss of a weighing on the correct day and the consequent inability to apply the ROPScore.

Accordingly, other predictive models that are currently being tested in ROP in addition to the ROPScore also have limitations. For example, WINROP 2 (²²) was proposed for European populations and has been validated by several studies that have shown it has good effectiveness in predicting ROP. However, some studies have shown that this score does not perform well in underdeveloped countries in which moderate and late preterm infants can also develop ROP (²³-²⁶). These include a study by Ko et al. (²⁴) in which the authors concluded that WINROP was especially effective in preterm infants with BW <1000 g or GA <28 weeks and did not detect six neonates with severe ROP. In Brazil, Hard et al. (²⁵), also reported that some cases with severe ROP were lost when they used WINROP, and they suggested that the algorithm needed to be reformulated with data from developing countries.

CHOP-ROP is another simple model. However, it limits GA to <30 weeks and requires daily weighing, which restricts its usefulness in clinical practice (²⁶). A separate model, the CO-ROP, was recently proposed and is still being validated (²⁷).

In conclusion, we demonstrate that the ROPScore was an effective, promising, and noninvasive screening tool for predicting ROP in a Brazilian population of preterm infants. The results of Eckert et al. (¹⁴) are compatible with those obtained in this cohort with regard for a high score for sensitivity and a high VPN. With regard for ROPScore cut-off points, although we adjusted the values for our population (16 and 16.6, for any stage and severe ROP), the cut-off values used in the original cohort (¹⁴) would have been sufficient to detect all preterm infants with severe ROP.

Although the introduction of algorithms such as the ROPScore is still in the preliminary phase, and the goal of such algorithms is not to replace the current screening guidelines, they can help to reduce the number of lost ROP diagnoses. With regard for this function of the algorithms, one difficulty we encountered in using the ROPScore was that it required assessing preterm weight only in the sixth week of life. Some high-risk preterm infants in whom aggressive ROP initiates prior to this weight measurement can evolve rapidly and may not be detected (⁹). Additionally, the early pre-term hospital discharge of infants that are evolving well is another factor that contributes to the loss of a correct weigh time and therefore the loss of the ROPScore.

Finally, the process by which a scoring system is validated is a dynamic one. In the current study, we aimed to contribute by validating the real-world usefulness of the ROPScore in Brazil. New prospective studies are needed to determine the impact of the ROPScore in a clinical setting in different populations.

REFERENCES

• ¹
  Hartnett ME. Studies on the pathogenesis of avascular retina and neovascularization into the vitreous in peripheral severe retinopathy of prematurity (An American Ophthalmological Society Thesis). Trans Am Ophthalmol Soc. 2010;108:96-119.
• ²
  Gilbert C, Foster A. Childhood blindness in the context of VISION 2020: the right to sight. Bull World Health Organ. 2001;79(3):227-32.
• ³
  Sun H, Kang W, Cheng X, Chen C, Xiong H,Guo J, et al. The use of the WINROP screening algorithm for the prediction of retinopathy of prematurity in a Chinese population. Neonatology. 2013;104(2):127-32, http://dx.doi.org/10.1159/000351297
  » http://dx.doi.org/10.1159/000351297
• ⁴
  Kim TI, Sohn J,Pi SY,Yoon YH. Postnatal risk factors of retinopathy of prematurity. Paediatr Perinat Epidemiol. 2004;18(2):130-4, http://dx.doi.org/10.1111/j.1365-3016.2003.00545.x
  » http://dx.doi.org/10.1111/j.1365-3016.2003.00545.x
• ⁵
  Fortes Filho JB, Eckert GU, Valiatti FB, Dos Santos PG, da Costa MC, Procianoy RS. The influence of gestational age on the dynamic behavior of other risk factors associated with retinopathy of prematurity (ROP). Graefes Arch Clin Exp Ophthalmol. 2010;248(6):893-900, http://dx.doi.org/10.1007/s00417-009-1248-6
  » http://dx.doi.org/10.1007/s00417-009-1248-6
• ⁶
  Hellström A, Hård AL, Engström E, Niklasson A,Andersson E, Smith L, et al. Early weight gain predicts retinopathy in preterm infants: new, wimple, efficient approach to screening. Pediatrics. 2009;123(4):e638-45, http://dx.doi.org/10.1542/peds.2008-2697
  » http://dx.doi.org/10.1542/peds.2008-2697
• ⁷
  Binenbaum G, Ying GS, Quinn GE, Dreiseitl S, Karp K,Roberts RS, et al. A clinical prediction model to stratify retinopathy of prematurity risk using postnatal weight gain. Pediatrics. 2011;127(3):e607-14, http://dx.doi.org/10.1542/peds.2010-2240
  » http://dx.doi.org/10.1542/peds.2010-2240
• ⁸
  Fortes Filho JB, Bonomo PP, Maia M,Procianoy RS. Weight gain measured at 6 weeks after birth as a predictor for severe retinopathy of prematurity: study with 317 very low birth weight preterm babies. Graefes Arch Clin Exp Ophthalmol. 2009;247(6):831-6, http://dx.doi.org/10.1007/s00417-008-1012-3
  » http://dx.doi.org/10.1007/s00417-008-1012-3
• ⁹
  Piermarocchi S, Bini S, Martini F, Berton M, Lavini A, Gusson E, et al. Predictive algorithms for early detection of retinopathy of prematurity. Acta Ophthalmol. 2017;95(2):158-64, http://dx.doi.org/10.1111/aos.13117
  » http://dx.doi.org/10.1111/aos.13117
• ¹⁰
  [No authors listed]. Retinopathy of prematurity: guidelines for screening and treatment. The report of a Joint Working Party of The Royal College of Ophthalmologists and the British Association of Perinatal Medicine. Early Hum Dev. 1996;46(3):239-58, http://dx.doi.org/10.1016/S0378-3782(96)01747-1
  » http://dx.doi.org/10.1016/S0378-3782(96)01747-1
• ¹¹
  [No authors listed]. Guidelines for screening examinations for retinopathy of prematurity. Canadian Association of Pediatric Ophthalmologists Ad Hoc Committee on Standards of Screening Examination for Retinopathy of Prematurity. Can J Ophthalmol. 2000;35(5):251-2, http://dx.doi.org/10.1016/S0008-4182(00)80072-1
  » http://dx.doi.org/10.1016/S0008-4182(00)80072-1
• ¹²
  Section on Ophthalmology American Academy of Pediatrics; American Academy of Ophthalmology; American Association for Pediatric Ophthalmology and Strabismus. Screening examination of premature infants for retinopathy of prematurity. Pediatrics. 2006;117(2):572-6. Erratum in: Pediatrics. 2006;118(3):1324, http://dx.doi.org/10.1542/peds.2006-2162
  » http://dx.doi.org/10.1542/peds.2006-2162
• ¹³
  Zin A, Florêncio T, Fortes Filho JB, Nakanami CR, Gianini N, Graziano RM, et al. Brazilian guidelines proposal for screening and treatment of retinopathy of prematurity (ROP). Brazilian Society of Pediatrics, Brazilian Council of Ophthalmology and Brazilian Society of Pediatric Ophthalmology. Arq Bras Oftalmol. 2007;70(5):875-83, http://dx.doi.org/10.1590/S0004-27492007000500028
  » http://dx.doi.org/10.1590/S0004-27492007000500028
• ¹⁴
  Eckert GU, Fortes Filho JB, Maia M, Procianoy RS. A predictive score for retinopathy of prematurity in very low birth weight preterm infants. Eyel. 2012;26(3):400-6.
• ¹⁵
  Belda S, Pallas CR, De la Cruz J, Tejada P. Screening for retinopathy of prematurity: Is it painful? Biol Neonate. 2004;86(3):195-200, http://dx.doi.org/10.1159/000079542
  » http://dx.doi.org/10.1159/000079542
• ¹⁶
  Sun X, Lemyre B, Barrowman N, O’Connor M. Pain management during eye examinations for retinopathy of prematurity in preterm infants: a systematic review. Acta Paediatr. 2010;99(3):329-34, http://dx.doi.org/10.1111/j.1651-2227.2009.01612.x
  » http://dx.doi.org/10.1111/j.1651-2227.2009.01612.x
• ¹⁷
  Binenbaum G. Algorithms for the prediction of retinopathy of prematurity based on postnatal weight gain. Clin Perinatol. 2013;40(2):261-70, http://dx.doi.org/10.1016/j.clp.2013.02.004
  » http://dx.doi.org/10.1016/j.clp.2013.02.004
• ¹⁸
  International Committee for the Classification of Retinopathy of Prematurity. The International Classification of Retinopathy of Prematurity revisited. Arch Ophthalmol. 2005;123(7):991-9, http://dx.doi.org/10.1001/archopht.123.7.991
  » http://dx.doi.org/10.1001/archopht.123.7.991
• ¹⁹
  Early treatment for Retinopathy of Prematurity Cooperative Group. Revised indications for the treatment of retinopathy of prematurity: results of the early treatment for retinopathy of prematurity randomized trial. Arch Ophthalmol. 2003;121(12):1684-94, http://dx.doi.org/10.1001/archopht.121.12.1684
  » http://dx.doi.org/10.1001/archopht.121.12.1684
• ²⁰
  Zin A, Gole GA. Retinopathy of prematurity-incidence today. Clin Perinatol. 2013;40(2):185-200, http://dx.doi.org/10.1016/j.clp.2013.02.001
  » http://dx.doi.org/10.1016/j.clp.2013.02.001
• ²¹
  Hutchinson AK, Melia M, Yang MB, VanderVeen DK, Wilson LB, Lambert SR. Clinical Models and Algorithms for the Prediction of Retinopathy of Prematurity: A Report by the American Academy of Ophthalmology. Ophthalmology. 2016;123(4):804-16, http://dx.doi.org/10.1016/j.ophtha.2015.11.003
  » http://dx.doi.org/10.1016/j.ophtha.2015.11.003
• ²²
  Binenbaum G, Ying GS, Quinn GE, Huang J, Dreiseitl S, Antigua J, et al. The CHOP postnatal weight gain, birth weight, and gestational age retinopathy of prematurity risk model. Arch Ophthalmol. 2012;130(12):1560-5, http://dx.doi.org/10.1001/archophthalmol.2012.2524
  » http://dx.doi.org/10.1001/archophthalmol.2012.2524
• ²³
  Ko CH, Kuo HK, Chen CC, Chen FS, Chen YH, Huang HC, et al. Using WINROP as an adjuvant screening tool for retinopathy of prematurity in southern Taiwan. Am J Perinatol. 2015;30(2):149-54, http://dx.doi.org/10.1055/s-0034-1376389
  » http://dx.doi.org/10.1055/s-0034-1376389
• ²⁴
  Sun H, Kang W, Cheng X, Chen C, Xiong H, Guo J, et al. The use of the WINROP screening algorithm for the prediction of retinopathy of prematurity in a Chinese population. Neonatology. 2013;104(2):127-32, http://dx.doi.org/10.1159/000351297
  » http://dx.doi.org/10.1159/000351297
• ²⁵
  Hard AL, Löfqvist C, Fortes Filho JB, Procianoy RS, Smith L, Hellstrom A. Predicting Proliferative Retinopathy in a Brazilian Population of Preterm Infants With the Screening Algorithm WINROP. Arch Ophthalmol. 2010;128(11):1432-6, http://dx.doi.org/10.1001/archophthalmol.2010.255
  » http://dx.doi.org/10.1001/archophthalmol.2010.255
• ²⁶
  Choi JH, Löfqvist C, Hellström A, Heo H. Efficacy of the screening algorithm WINROP in a Korean population of preterm infants. JAMA Ophthalmol. 2013;131(1):62-6, http://dx.doi.org/10.1001/jamaophthalmol.2013.566
  » http://dx.doi.org/10.1001/jamaophthalmol.2013.566
• ²⁷
  Cao JH, Wagner BD, McCourt EA, Cerda A, Sillau S, Palestine A, et al. The Colorado-retinopathy of prematurity model (CO-ROP): postnatal weight gain screening algorithm. J AAPOS. 2016;20(1):19-24, http://dx.doi.org/10.1016/j.jaapos.2015.10.017
  » http://dx.doi.org/10.1016/j.jaapos.2015.10.017

Publication Dates

• Publication in this collection
  2018

History

• Received
  10 Oct 2017
• Accepted
  5 Mar 2018