Three decades of reference evapotranspiration estimates for a tropical watershed in the eastern Amazon

This study estimated the reference evapotranspiration rate (ETo) for the Itacaiúnas River Watershed (IRW), Eastern Amazonia, and measured the accuracy of eight empirical equations: Penman-Monteith (PM), Priestley-Taylor (PT), Hargreaves and Samani (HS), Camargo (CAM), Thornthwaite (TH), Hamon (HM), Kharrufa (KF) and Turc (TC) using monthly data from 1980 to 2013. In addition, it verifies the regional applicability to the IRW using a for the Marabá-PA station. The methods TC and PM (FAO56) presented the best results, which demonstrate that radiation and higher temperatures are the dominant drivers in the Evapotranspiration process, while relative humidity and wind speed have a much smaller impact. The temporal and spatial variability of ETo for IRW show has strong seasonality, increasing during the dry season and decreasing during the rainy season. The statistical analyses at 1% level of significance, indicates that there is no correlation of the residuals between the dry and rainy seasons, and test of the physical parameters such as mean temperature, solar radiation and relative air humidity explains the variations of ETo.


INTRODUCTION
The hydrological cycle represents the continuous movement of water on the Earth under the action of gravity and solar energy.Evaluating the terms that make up the water balance equation, especially evapotranspiration (ET), involves the survey of observed data or the development of expressions that represent the transport mechanism of water volumes.The reference evapotranspiration (ETo) represents the process of water loss to the atmosphere, considering a standard grassy surface covering the soil, with no humidity restriction.ETo is controlled by the energy balance, the atmospheric demand, and the supply of water from the soil to plants (Pereira et al. 1997).Xu andSingh (2001, 2002) divide the methods of estimating ETo into five different categories based on (i) water balance, RENATO O. DA SILVA JÚNIOR et al.
Various studies worldwide have demonstrated that the Penman-Monteith method (PM-FAO56) is quite accurate (Xu and Chen 2005, Yoder et al. 2005, López-Urrea et al. 2006, Jabloun and Sahli 2008, Barros et al. 2009, Carvalho et al. 2011, Xavier et al. 2015, Caporusso and Rolim 2015).This model has been validated in relation to the data measured by lysimeters under various climatic conditions.For this reason, it has been considered the best method to estimate ETo and is widely used as a standard for comparison with other empirical methods (Allen et al. 2005, 1998, ASCE-EWRI 2005, Berti et al. 2014, Djaman et al. 2015, Dehghani Sanij et al. 2004, Ghamarnia et al. 2015, Itenfisu et al. 2003, Jain et al. 2008, Lima et al. 2013, Pandey et al. 2014, Pereira et al. 2015, Tabari et al. 2013, Widmoser 2009, Mohan and Arumugam 1996, Xu et al. 2013).Empirical or deterministic models with a physical basis, with or without random or probabilistic components, are used to calculate ETo (Soares et al. 2003, Borges andMendiondo 2007).Nandagiri and Kovoor (2006) evaluated the performance of seven different empirical methods for the determination of ETo under different climatic conditions in India, and they reported that the empirical equation of Turc is the best option under humid conditions.Tabari et al. (2013) compared 31 different ETo equations, including two new radiometric equations they developed (similar to the work of Irmak et al. 2003) in the north of Iran (in a humid environment), considering the PM-FAO56 equation as the standard.The results revealed that the developed equation performed better than the other equations selected.Thus, the radiation-based models were the most appropriate options for estimating ETo. Carvalho et al. (2011), in turn, argued that some studies are variants of the PM-FAO method, seeking better fits for certain regions (Temesgen et al. 2005, Allen et al. 2006, Gavilán et al. 2007, 2008).
In Brazil, many studies have tested the accuracy of different models for determining ETo.In in the North region (Boa Vista -Roraima), using a monthly scale, the best results were obtained with the Blaney-Criddle (BC) method (Caporusso and Rolim 2015).In the Center-West region {Aquidauana -Mato Grosso, Oliveira et al. ( 2011)} obtained results with acceptable accuracy using the methods of Hargreaves and Samani (HS) and Camargo (CAM).In the South region (Santa Maria -Rio Grande do Sul), Medeiros (1998) concluded that on a daily scale, the methods of Penmam (PEN), Camargo (CAM), and Tanner and Pelton provide the best results.In the Southeast region (Mantiqueira mountain range -Minas Gerais), Pereira et al. (2009) concluded that the Haise, Penmam (PEN), Solar Radiation (SR), and Blaney-Criddle (BC) methods had the best accuracy.The differences among the ETo values estimated by the various methods in different regions of Brazil lie in the characteristics and specificities of the regional climate, as demonstrated by Camargo and Camargo (2000) after an analysis of some methods used to calculate ETo for different regions of São Paulo state.
Most Brazilian watersheds lack hydrometeorological monitoring stations suitable for obtaining reliable data that enable accurate estimates of evapotranspiration and, consequently, water availability.Unfortunately, this scenario is more pronounced in the Amazon region.The search for alternative solutions is essential, given the limited number of instruments in operation and the lack of historical data.Thus, the objectives of this study are to i) estimate the reference evapotranspiration (ETo) for the Itacaiúnas River Watershed (IRW), located in the eastern Amazon; ii) assess the accuracy of the following eight empirical equations, using mean monthly data for 1980-2013: Penman-Monteith (PM) -which was recommended by the FAO (Allen et al. 1998) -Priestley-Taylor (PT), Hargreaves and Samani (HS), Camargo (CAM), Thornthwaite (TH), Hamon (HM), Kharrufa (KF), and Turc (TC); and iii) test the regional applicability to the IRW, calibrating the selected methods using a data series  from the Marabá (Pará) station.

STUDY SITE
The IRW is located in the Tocantins-Araguaia hydrographic region (Brasil 2003), situated approximately 600 km south of the equator, draining an area of approximately 42,000 km 2 (Figure 1).The Carajás plateau is a prominent feature in the landscape of the area, whose altitude ranges from 600 to 900 m, which contrasts with the adjacent areas with altitudes ranging from 80 to 300 m.In the area of the basin, originally two types of land cover predominate -tropical rainforest and mountain savannah -but, at present, the land use is dominated by extensive pastures that surround a mosaic of forest remnants.The latter occupy indigenous lands and other protected conservation areas, which occupy cover 11,700 km 2 , or approximately a quarter of the area of the basin (Souza-Filho et al. 2016).The climate in the region is typical monsoon (Am) (Alvares et al. 2014).In the region, the rainy season (November to May) and dry season (June to October) are well defined -the rates for the total annual rainfall can vary between 1,800 and 2,300 mm during the rainy season and from less than 10 mm to a maximum of 350 mm during the dry season (Moraes et al. 2005, Silva Júnior et al. in press).
ENERGY BALANCE Surface radioactive processes can influence significantly the distribution of moisture and heat between soil and atmosphere, thus affecting the behavior of the weather, the climate, and the Earth's biosphere (Bastiaanssen et al. 1998, Roerink et al. 2000).The energy exchanges in the soil-vegetationatmosphere interface, which occur via the net radiation (Rn) and heat flux {soil (G), sensible (H), and latent (LE)} components, are essential for climate and hydrological modeling (Machado et al. 2014).The latent heat flux (LE), which represents the loss of water from the surface in the form of vapor, can be converted into evapotranspiration (ET) in units of mm.day -1 , which is an essential component for calculating the water balance.In turn, the term "LE", in units of W.m -2 , is used in studies of the energy balance (EB) of the Earth's surface and includes all the major sources of energy (Rn) and energy consumption (ET, G, and H).The LE is obtained as a residual from the classical surface energy balance equation (Liu 2007): in which Rn is the net radiation, H is the sensible heat flux density, and G is the heat flux density in the soil, all in W m -2 .The determination of the energy balance on the Earth's surface involves two parts: the first consists of quantifying the net energy (Rn) of the fluxes of the shortwave and longwave radiation received and emitted by the surface, and the second part involves estimating the fluxes (G, H, and LE) from utilization of the net radiation available on the Earth's surface (Liu 2007, Machado et al. 2014).The ETo can be quantified directly through lysimeter measurements or can be calculated indirectly using the energy balance approach (empirical models).The direct measurements using lysimeters are time consuming and require precise instrumentation.The indirect approach used in this work is based on meteorological data available at terrestrial stations.

DATA ACQUISITION AND METHODS FOR ESTIMATING ETO
Six variables were used to determine the reference evapotranspiration (ETo): maximum air temperature (T max , °C), minimum air temperature (T min , °C), mean air temperature (T mean , °C), wind velocity (u 2 , m.s -1 ) at a height of 2 m, solar radiation (Rs, MJ.m -2 ), and relative air humidity (RH, %).These data were extracted using the Grid Analysis and Display System (GrADS) software and were based on the grid-interpolated dataset from Xavier et al. (2015), which used the daily observation data of 3,625 conventional and/or automatic weather stations installed in the major Brazilian watersheds (for the period between January 1, 1980 and December 31, 2013) belonging to the Brazilian Meteorology Institute (Instituto Nacional de Meteorologia -INMET), the Brazilian Water Agency (Agência Nacional de Águas -ANA), and the São Paulo Department of Water and Electrical Energy (Departamento de Águas e Energia Elétrica de São Paulo -DAEE).The ETos were calculated using the methods described in Table I.To validate the regional applicability of this study, the daily records for the period between 01/01/1980 and 12/31/2013 of the Meteorological

STATISTICAL TESTS
Statistical tests were performed for the physical parameters mean temperature (T mean ), solar radiation (R s ), relative air humidity (RH), and wind velocity (V w ) to assess the level of contribution of each of these parameters to the estimation of the reference evapotranspiration (ETo).Subsequently, several methods were tested in order to define the method that best represents the behavior of the ETo in the IRW.This was done considering that the energy exchanges in the soil-vegetationatmosphere interface are determining factors in the behavior of the mentioned physical parameters and that they differ significantly during the rainy and dry seasons in the basin.
Significance tests were applied via the Ordinary Least Squares (OLS) method, Student's t-test (t), and other special tests such as the adjusted coefficient of determination (R 2 ), standard error of estimate (Se), Fisher's F-test (F), Kolmogorov-Smirnov test of normality (KS), and Durbin-Watson autocorrelation test (DW).It is important to note that the performance classification for model selection was based on the statistical results of the estimates of all of these tests.Thus, the best fitting model was chosen considering that the estimated model satisfies all the estimates.The correlation between the values estimated by the standard method and the values estimated by the other models was analyzed using the software SPSS v. 21.

SUMMARY OF PREVIOUS WORKS
Using the Surface Energy Balance Algorithm for Land (SEBAL) for the Caxiuanã National Forest in the eastern portion of the Amazon, Ferreira Junior et al. ( 2013) obtained results consistent with the values reported for the region (Souza Filho et al. 2005, Sousa et al. 2007), showing that the highest evapotranspiration values occur between June and December, especially during the dry season.In accordance with Negrón Juárez et al. (2007), the ET range at various points in the Amazon is 2.5 ± 0.4 to 4.1 ± 0.4 mm.d -1 in the rainy season and 3.8 ± 0.6 to 4.3 ± 0.9 mm.d -1 in the dry season.Additionally, when investigating the temporal and spatial variability of ET, using the eddy flux measurements from eight different towers of the Large-Scale Biosphere-Atmosphere Experiment in Amazonia (LBA), Hasler and Avissar (2007) concluded that the evapotranspiration in stations close to the equator (2-3° S) has strong seasonality, increasing during the dry season and decreasing during the rainy season.
Various studies have shown that the surface radiation balance is primarily responsible for ET (Ferreira Junior et al. 2013).In the dry season, the ET is more influenced by the amount of moisture stored in the soil during the previous rainy season than by rainfall events during the dry season.Furthermore, during the dry season, the stored soil moisture available for absorption by roots may be sufficient to keep the ET rate equal to or even greater than that during the rainy season (Shuttleworth 1988, Nepstad et al. 1994, Malhi et al. 2002, Sommer et al. 2002, Souza Filho et al. 2005, Negrón Juárez et al. 2007, Von Randow et al. 2011).Thus this suggest that in the dry season,

TABLE I (continuation)
transpiration is the main source of the regional ET, which would be linked to the primary forest.
All aspects of tropical hydrology -from fluxes of energy and water within the atmosphere,

MONTHLY ETO VALUES ESTIMATED FOR THE IRW
The monthly mean values (mm.d -1 ) estimated for all the methods, except the Karrufa (KF), establish a striking ETo signature throughout the year for the basin (Figure 2).Between January and April, the values are relatively constant -the minimum values oscillate between 3.31 and 3.43 mm d -1 , whereas the maximum values range from 4.81 to 4.94 mm d -1 .In May and June, there is a slight decline; however, beginning in July, the minimum (3.56 to 3.82 mm.d -1 ) and maximum (5.33 to 5.57 mm.d -1 ) values increase, with the peak occurring in September (3.82 to 5.57 mm.d -1 ), and then decline until December, when the lowest ETo value was recorded (3.24 mm.d -1 , Figure 2).The ETo values indicated by the KF method are higher and entirely discordant when compared with those derived from the other employed methods (Figure 2).For this reason they will not be further considered.The use of the PM-FAO56 reference equation resulted in relatively constant values between January and March (3.37 mm.d -1 ) and an increase starting in April (3.44 mm.d -1 ), with a peak in August (4.44 mm.d -1 ).There was a subsequent decline between September (4.27 mm.d -1 ) and December (3.38 mm.d -1 ).The equations of Thornthwaite (TH), Camargo (CAM), and Hargreaves and Samani (HS) showed very similar behavior.Between January and April, the ETo values were relatively constant, with the lowest values in June.From July to September, the values increased monthly and then declined between October and December.The equation of Camargo (CAM) estimated the highest ETo values for both the rainy (4.51 to 4.96 mm.d -1 ) and dry (4.38 to 5.43 mm.d -1 ) seasons with exception for the month of September when the TH method presented the highest estimate (5.57mm.d - 1 ).In turn, the equation of Turc (TC) had the lowest ETo values for both the rainy (3.24 to 3.61 mm.d -1 ) and dry (3.85 to 4.09 mm.d -1 ) seasons.
The behavior suggested by the mentioned authors before (Zhao et al. 2013, Zeng 1999, Costa and Foley 1999, Roads et al. 2002, Marengo 2005) is observed for the IRW in Figure 2, when comparing the curve of the mean monthly values of cumulative rainfall and the mean ETo values throughout the year.During the rainy season, between January and May (Moraes et al. 2005, Silva Júnior et al. in press), the ETo remains almost constant.Then, from the beginning of the dry season (June), when the lowest accumulated rainfall values are recorded, the ETo increases gradually and reaches a peak in September, specially the TH, HS and CAM methods.With the return of the rains, specifically starting in October, the ETo values begin to decline and then remain constant up to January.However, more studies are necessary to better define these relationships, for example, to determine the role of the forest in the production and/or storage of water and to determine the response of annual evapotranspiration to changes in the vegetation cover due to different types of land use and occupation in the IRW.
The temporal and spatial variability of ETo for IRW show has strong seasonality, increasing during the dry season and decreasing during the rainy season in accordance with Hasler and Avissar (2007).This study corroborates the observations of Zhao et al. (2013) -Figures 2 and 3 show that the TC and PT methods exhibit similar behavior throughout the year for both the Marabá station and the IRW.However, the PT method always overestimates the ETo values throughout the year compared to the PM and TC methods.
Figure 3 shows the estimated ETo values for the Marabá station.Among the eight equations compared, Kharrufa (KF) once again overestimates the ETo values for the whole year, extrapolating the mean behavior of the values generated by the other methods.For the other seven equations, the distribution of the mean monthly values establishes a signature whose maximum monthly ETo values are represented by the distribution of Camargo (CAM), which shows a higher mean value (5.19 mm.d -1 ) in the rainy season (November to May) than in the dry season (5.13 mm.d -1 , June to October).This behavior may be interpreted as irregular, as the ETo tends to be higher in environments in which solar radiation levels and mean temperatures are also high, in a directly proportional relationship.The monthly minima follow the distribution curve of the values estimated by Turc (TC), which accompanies the distribution of Penmam-Monteith (PM-FAO 56) -between January and June, the values are very close, and they increase until August.From July until December, Turc (TC) underestimates the values of the PM reference equation (FAO56), as evidenced by a separation of the curves.
The highest values of evapotranspiration observed in our studies occur during the dry season.These results, obtained through the PM-FAO56 and TC equations, based mainly on solar radiation and temperature, show great similarity with the results of other studies in the region (Souza Filho et al. 2005, Sousa et al. 2007).As well as the studies carried out by Pandey et al. (2016) in northeastern India, where the climate is predominantly humid subtropical, whose methods based on solar radiation -for example, Turc (TC) -were among the top three.The range obtained for IRW is from 3.3 to 3.8 mm.d -1 in the rainy season and from 3.8 to 4.6 mm.d -1 in the dry season, according to Negrón Juárez et al. (2007).
The temporal distribution of ETo compared to R s (Figure 4) showed similar behavior.It can be seen that R s can be considered as the predominant meteorological element on the ETo result.These results are in line with those found by Chang (1968) and Nandagiri and Kovoor (2005), who found that R s is the quantitative element in the ETo process.In Figure 4, it is also seen that, in general, the periods (between July and August) that present the highest values of R s (≈ 18-19 MJ.m 2 .d - ) correspond to the same periods where the highest values of Reference evapotranspiration.In other words, the behavior of the solar radiation (R s ) presented seasonal characteristics of the global radiation transmission in the local atmosphere, whose maximum values occur from the beginning (May) of the dry season and the minimum values (<16 MJ.m 2 .d - ) are recorded during the rainy season (November to April).

STATISTICAL ANALYSIS
It is important to note that the performance classification for model selection was based on the statistical results of the estimates of all the tests.Thus, the best fitting model was chosen considering that, the estimated model satisfies all the estimates.The options cited in the literature for linear and linearizable models were tested (Maddala andLahiri 2009, Gujarati andPorter 2011).
The dependent variable is the estimated reference evapotranspiration (ETo IRW ), and the explanatory variables are mean temperature (T mean = β1), solar radiation (R s = β2), relative air humidity (RH = β3), and wind velocity (V w = β4).The results suggest that the Turc (TC) model has the best fit.
Table II shows that the approximation using the TC equation has the smallest systematic error (Se = 0.00051), an excellent value for the adjusted coefficient of determination (R 2 = 1.00), a low value in the Kolmogorov-Smirnov test of normality (K-S = 0.01), and the best result in the Durbin-Watson autocorrelation test (D-W = 1.747).The PM and PT methods had the second and third best results, respectively.For the PM method, R 2 = 0.975, whereas for PT, R 2 = 0.94.The systematic error in (2) For the Marabá station, the results from the statistical tests suggest that the Penman-Monteith model (PM-FAO 56) has the best fit for the data recorded (Table III).The PM equation has the lowest systematic error (Se = 0.0041); an excellent value for the adjusted coefficient of determination (R 2 = 0.997); a suitable value in the Kolmogorov-Smirnov normality test (K-S = 0.663); and the best result in the Durbin-Watson autocorrelation test (D-W = 1.506), as per the range established for the four-parameter condition, in accordance with Gujarati and Porter (2011).
For the other models (Table III), the adjusted coefficients of determination (R 2 = 1.00, 0.999, and 0.999 for KF, PT, and HM, respectively) for the corresponding models are excellent -suggesting good correlation -and the systematic errors are very low (Se = 0.00035, 0.00119, and 0.00082 for KF, PT, and HM, respectively).However, the D-W autocorrelation test yields values that exceed the range established for the number of parameters used in each case.
Thus, at the 1% significance level, all the statistics of the PM model adjusted for ETo Marabá   solar radiation, relative air humidity, and wind velocity variables explain the variations recorded in the reference evapotranspiration (ETo).This is in agreement with the evidence that a 1% increase in the mean temperature results in a 0.358% increase in the ETo.The estimated β coefficients represent the climate elasticities for the Marabá station, as a positive variation of 1% in the solar radiation causes an almost proportional increase (β = 0.698) in the estimated ETo for said station, which can also be corroborated by the relevance in terms of estimating the standardized β values (standardized β = 0.469).A positive variation in the relative air humidity has a negative effect on the ETo estimated for the Marabá station.The Kolmogorov-Smirnov normality test indicates that at the 1% significance level, the errors are distributed normally, leading to the well-defined, or normal, behavior of the residuals in the area of the standard normal distribution (Figures 6a and 6b).
Thus, more detailed studies are needed on the behavior and temporal variability of meteorological parameters (R s , T mean , RH, and V w ) due to changes in land use and vegetation cover, as well as on the level of influence of El Niño and La Niña events or other climate drivers on the eastern Amazon and, in particular, the IRW.

CONCLUSIONS
The ETo for the IRW and the Marabá station can be reliably estimated from methods based on solar radiation (R s ) and mean air temperature (T mean ).
Among the eight methods evaluated, the Turc (TC), Penman-Monteith (PM-FAO 56) and Priestley-Taylor (PT) methods satisfy these requirements, but TC and PM methods showed the best fits.
The temporal and spatial variability of ETo for IRW show has strong seasonality, increasing during the dry season and decreasing during the rainy season.The statistical analyses at 1% level of significance, indicates that there is no correlation of the residuals between the dry and rainy seasons, and test of the physical parameters such as mean temperature, solar radiation and relative air humidity explains the variations of ETo.
When considering the energy exchanges in the soil-vegetation-atmosphere interface, our results, in particular the superior performance of the radiation-based models, demonstrate that the mean temperature and radiation are the dominant drivers of the evapotranspiration process in the region, whereas relative humidity and wind velocity have a much smaller impact.However, these equations may require calibrations when applied to another region so that they reflect local changes in the climatic variables.
Finally, it is important to emphasize that there were in the past few hydro meteorological stations in the IRW that monitor parameters such as solar radiation, temperature, relative humidity, and wind velocity.Besides the use of direct methods for determining evapotranspiration is non-existent.However, this reality is being transformed, because of the installation of eight automatic stations,

TABLE III (continuation)
which will enable the systematic monitoring of hydrometeorological data in the IRW from now.

Figure 1 -
Figure 1 -Location map of the Itacaiúnas River Watershed (IRW), showing the contrast in vegetation between protected areas and areas dominated by pastures (modified from Souza-Filho et al. 2016).
Abbreviations: T mean = mean air temperature (°C), T max = maximum air temperature (°C), T min = minimum air temperature (°C), RH max = maximum relative air humidity (%), RH min = minimum relative air humidity (%), RH mean = mean relative air humidity (%), R n = net radiation (MJ m -2 d -1), R a = incident solar radiation above the atmosphere (MJ to those within vegetation, land surface and subsurface systems, to stream outputs of water, sediment and solutes -are distinguished from other regions of the globe by substantially greater spatial and temporal variability, higher magnitudes, pronounced spatial gradients, and consequently the potential for rapid and significant change in response to anthropogenic alterations and associated water fluxes(Wohl et al. 2012).In accordance withZhao et al. (2013), in humid regions, evapotranspiration is responsible for approximately 50% of the annual rainfall, whereas in arid regions, the proportion reaches 90%.Studies on the atmospheric-hydrological balance of the Amazon(Zeng 1999, Costa and Foley 1999, Roads et al. 2002, Marengo 2005) concluded that the ET represents approximately 59 to 82% of the rainfall.Besides, they consider that ETo estimation methods based on the energy balance, such as Turc (areas of pasture) and Priestley-Taylor (moist surfaces), are the most suitable for humid regions.Finally, using meteorological data, Tabari (2010) tested the methods of Makkink, Turc, Priestley-Taylor, and Hargreaves in four climate types in northern Iran and found that the Turc (TC) model is the most suitable for estimating the ETo in climates that are cold, humid and arid.Using monthly meteorological data (1980-2010) from 30 stations located in the northeast of India, where the climate is predominantly humid subtropical, Pandey et al. (2016) showed that of the 18 methods evaluated, temperature and solar radiation based methods -for example, Turc (TC) -were among the three with the best performance.RENATO O. DA SILVA JÚNIOR et al.

Figure 5
Figure 5 -a) Histogram with normal distribution of the residuals of the fitted ETo model for the IRW, and b) observed and expected probabilities of the ETo model for the IRW.

Source:
Prepared by the authors based on annual data from the Marabá station (1980-2013).The models tested were the linear and the log models, in which β o = model constant; β 1 = mean air temperature; β 2 = solar radiation; β 3 = relative air humidity; β 4 = wind velocity; = adjusted coefficient of determination; Se = standard error of estimate; F = Fisher's F-test; K-S = Kolmogorov-Smirnov test of normality; D-W = Durbin-Watson autocorrelation test.*Method with best fit.

Figure 6
Figure 6 -a) Histogram with normal distribution of the residuals; b) observed and expected probabilities of the fitted ETo model for the IRW.

TABLE III Summary of the estimates and statistical tests of the ETo models for the Marabá station (N=34).
RENATO O. DA SILVA JÚNIOR et al.