Acessibilidade / Reportar erro

ALTIMETRY ASSESSMENT OF ASTER GDEM v2 AND SRTM v3 DIGITAL ELEVATION MODELS: A CASE STUDY IN URBAN AREA OF BELO HORIZONTE, MG, BRAZIL

Avaliação Altimétrica dos Modelos Digitais de Elevação ASTER GDEM v2 e SRTM v3: Um Estudo de Caso na Área Urbana de Belo Horizonte, MG, Brasil

Abstract:

This work is an altimetry evaluation study involving Digital Elevation Models ASTER GDEM version 2 and SRTM version 3. Both models are readily available free of charge, however as they are built from different remote sensing methods it is also expected that they present different data qualities. LIDAR data with 25 cm vertical accuracy were used as reference for assessment validation. The evaluation study, carried out in urbanized area, investigated the distribution of the residuals and the relationship between the observed errors with land slope classes. Remote sensing principles, quantitative statistical methods and the Cartographic Accuracy Standard of Digital Mapping Products (PEC-PCD) were considered. The results indicated strong positive linear correlation and the existence of a functional relationship between the evaluated models and the reference model. Residuals between -4.36 m and 3.11 m grouped 47.7% of samples corresponding to ASTER GDEM and 63.7% of samples corresponding to SRTM. In both evaluated models, Root Mean Square Error values ​​increased with increasing of land slope. Considering 1: 50,000 mapping scale the PEC-PCD classification indicated class B standard for SRTM and class C for ASTER GDEM. In all analyzes, SRTM presented smaller altimetry errors compared to ASTER GDEM, except in areas with steep relief.

Keywords:
Digital Elevation Models; ASTER GDEM v2; SRTM v3; Altimetry Assessment

Resumo:

Este trabalho aborda a avaliação altimétrica dos Modelos Digitais de Elevação ASTER GDEM v2 e SRTM v3, ambos são disponibilizados sem custos, porém obtidos por diferentes métodos de sensoriamento remoto, o que também sugere diferente qualidade dos dados. Como referência foram utilizados dados LIDAR de 25cm de precisão vertical. Na avaliação, desenvolvida em área urbana, investigaram-se a distribuição dos resíduos e a relação erros observados versus classes de declividade do terreno. Foram considerados aspectos físicos do sensoriamento remoto, utilizados métodos estatísticos e o Padrão de Exatidão Cartográfica dos Produtos Cartográficos Digitais (PEC-PCD). Os resultados apontaram forte correlação linear positiva e a existência de relação funcional entre os modelos avaliados e o modelo de referência. Os resíduos, entre -4.36 m e 3.11 m, agruparam 47.7% das amostras correspondentes ao ASTER GDEM e 63.7% das amostras correspondentes ao SRTM. Nos dois modelos avaliados, os valores de Erro Médio Quadrático cresceram com o aumento da declividade do terreno. Considerando a escala de 1:50,000 a classificação do PEC-PCD indicou padrão classe B para o SRTM e padrão classe C para o ASTER GDEM. Em todas análises realizadas, o SRTM apresentou erros de altimetria menores em relação ao ASTER GDEM, exceto em áreas de relevo escarpado.

Palavras-chave:
Modelos Digitais de Elevação; ASTER GDEM v2; SRTM v3, Avaliação Altimétrica

1. Introduction

Digital Elevation Models (DEM) are important geographic data arrangements for representing altimetry variations of the Earth surface. Although a DEM can be used to model almost any kind of attribute that has spatial distribution on the surface of the Earth, its most common use is in the topographic relief modeling (Burrough 1986Burrough, P. A. 1986. Principles of Geographical Information Systems for Land Resources Assessment. New York: Oxford University, pp. 333.).

The applications using the widespread free distribution DEM have gained great importance, especially among academic activities, given the wide range of possible applications, such as mapping hilltops environmental protected areas (Oliveira 2015Oliveira, G. C. 2015. Precisão de Modelos Digitais de Terreno, Mapeamento. Automático de Apps em Topos de Morros e a Eficácia do Novo Código Florestal. Master’s degree in Solos e Nutrição de Plantas. Viçosa - MG, Brazil: Universidade Federal de Viçosa, pp. 152.), monitoring forest biomass (Solberg et al. 2010Solberg, S., Astrup, R., Gobakken, T., Naesset, E. and Weydahl, D. J. 2010. Estimating spruce and pine biomass with interferometric X-band SAR. Remote Sensing of Environment , 114 (10), pp. 2353-2360.), hydrological modeling (Ludwig and Schneider 2006Ludwig, R. and Schneider, P. 2006. Validation of digital elevation models from SRTM X-SAR for applications in hydrologic modeling. Journal of Photogrammetry & Remote Sensing, 60(5), pp. 339-358.), soil losses estimation (Fornelos and Neves 2007Fornelos, F. L. and Neves, S. M. 2007. Uso de Modelos Digitais de Elevação (DEM) gerados a partir de imagens de Radar Interferométrico (SRTM) na estimativa e perdas de solo. Revista Brasileira de Cartografia, 59 (1), pp. 1808-0936.), aid in detecting neotectonic reactivations (Fonseca and Corrêa 2011Fonseca, D. N. and Corrêa, A. C. 2011. Uso de DEM na Extração de Lineamentos para Detecção de Reativações Neotectônicas na Bacia do Rio Preto, Serra do Espinhaço Meridional, MG. In: XV Simpósio Brasileiro de Sensoriamento Remoto (SBSR). Curitiba, Paraná, 30 Apr - 5 May 2011, São José dos Campos: INPE, pp. 3483-3490.), geomorphologic mapping (Camargo et al. 2011Camargo, F. F., Florenzano, T. G., Almeida, C. M. and Oliveira, C. G. 2011. Mapeamento Geomorfológico com Imagens Estereoscópicas Digitais do Sensor Aster/Terra. Revista Geociências, 30(1), pp. 95-104.), relief shapes classification (Manfré, Nóbrega and Quintanilha 2015Manfré, L. A, Nóbrega, R. A. A. and Quintanilha, J. A. 2015. Regional and local topography subdivision and landform mapping using SRTM-derived data: a case study in southeastern Brazil. Environmental Earth Sciences, 73 (10), pp. 6457-6475.), didactic resource for teaching and learning (Reis et al. 2005Reis, B. R., Medeiros, D. R., Lopes, M., Cruz, C. B. M. and Barros, R. S. 2005. O uso de produtos de Sensoriamento Remoto gratuitos na representação do Relevo - um potencial para a educação. In: XXII Simpósio Brasileiro de Sensoriamento Remoto (SBSR). Goiânia, Goiás, 16-21 Apr 2005, São José dos Campos: INPE, pp. 1337-1344.).

Considering the use of open source DEM data, the choice between ASTER GDEM v2 and SRTM v3 has been causing some doubts among users since both models present the same one arc second spatial resolution (approximately 30 meters), but they are obtained from different remote sensing sources. While the ASTER GDEM v2 was obtained by optical spectrum satellite images stereoscopy, the SRTM v3 was produced by radar images interferometry method based in microwave C band data. Depending on the DEM obtaining method, any errors that may affect the altimetry accuracy of these models tend to behave in different ways. Both models are available, free of charge, from the United States Geological Survey (USGS). ASTER GDEM v2 since October 2011 and SRTM v3 since September 2014. Detailed information on the ASTER GDEM DEM principles and concepts can be obtained from Lang and Welch (1999Lang, H. R. and Welch, R. 1999. Aster Digital Elevation Models - Algorithm Theoretical Basis Document (pdf). Available at: Available at: https://eospso.nasa.gov/sites/default/files/atbd/atbd-ast-14.pdf. Accessed 19 Set 2016.
https://eospso.nasa.gov/sites/default/fi...
) and the same on SRTM can be seen in Farr et al. (2007Farr, Tom G., Rosen, P. A., Caro, E., Crippen, R., Duren, R., Hensley, S., Kobrick, M., Paller, M., Rodriguez, E., Roth, L., Seal, D., Shaffer, S., Shimada, J., Umland, J., Werner, M., Oskin, M., Burbank, D., Alsdorf, D. 2007. The Shuttle Radar Topography Mission (pdf). Available at: Available at: http://www2.jpl.nasa.gov/srtm/SRTM_paper.pdf .Accessed 02 Feb 2016
http://www2.jpl.nasa.gov/srtm/SRTM_paper...
).

Several researches have been developed by scientific community to evaluate the altimetry accuracy of the free distribution DEM, as well as for identification of the possible factors that can influence this altimetry data quality. Gorokhovich and Voustianiouk (2006Gorokhovich, Y. and Voustianiouk, A. 2006. Accuracy assessment of the processed SRTM-based elevation data by CGIAR using field data from USA and Thailand and its relation to the terrain characteristics. Remote Sensing of Environment, 104 (4), pp. 409-415.) concluded that the altimetry accuracy of the 90 m resolution SRTM C band data are influenced by the gradient and azimuth of the terrain slopes, where the most significant errors occur in areas with hillside slopes greater than 10 degrees. Ludwig and Schneider (2006Ludwig, R. and Schneider, P. 2006. Validation of digital elevation models from SRTM X-SAR for applications in hydrologic modeling. Journal of Photogrammetry & Remote Sensing, 60(5), pp. 339-358.) evaluated SRTM data collected in the microwave X band (30 m resolution) for a smooth relief area reporting the smallest errors (RMSE = 9.85 m) and, also, for an area with mountainous relief, where the biggest errors were identified (RMSE = 22.96) caused by radar shadow effects that occurred during the imaging process. Chrysoulakis et al. (2011Chrysoulakis, N., Abrams, M., Kamarianakis, Y. and Stanislawski, M. 2011. Validation of ASTER GDEM for the Area of Greece. Photogrammetric Engineering & Remote Sensing, 77 (2), pp. 157-165.) validated ASTER GDEM data for areas with different types of relief and soil cover, concluding that the typical urban areas presented the highest altimetry errors (RMSE 21.21 m). Luana, Houa and Wang (2015Luana, S., Hou, X. and Wang, Y. 2015. Datasets for the Coastal Zone of Shandong Province. Polish Maritime Research, 22(special issue 1), pp.15-20.) identified a relation between the errors observed in the SRTM C band model (90 m resolution) and ASTER version 2 considering hillside slope and altitude of the terrain. They found RMSE of 13.74 m and 12.12 m for SRTM and ASTER, respectively.

The consistency of the altimetry errors observed in evaluated DEM for any application is directly related to the objective of the DEM use associated to the mapping scale applied. Barros (2006) and Dias et al. (2011Dias, M. F., Miceli, B. S., Seabra, F. M., Santos, P. R. A. and Fernandes, M. C. 2011. Avaliação Vertical de Modelos Digitais de Elevação (DEMs) em Diferentes Configurações Topográficas para Médias e Pequenas Escalas. In: XV Simpósio Brasileiro de Sensoriamento Remoto (SBSR). Curitiba, Paraná, 30 Apr - 5 May 2011, São José dos Campos: INPE, pp. 4110-4117.) indicate a Class A Cartographic Accuracy Standard (PEC), associated to 1: 100,000 mapping scale, for both SRTM C band (90 m resolution) and ASTER GDEM. Oliveira (2015Oliveira, G. C. 2015. Precisão de Modelos Digitais de Terreno, Mapeamento. Automático de Apps em Topos de Morros e a Eficácia do Novo Código Florestal. Master’s degree in Solos e Nutrição de Plantas. Viçosa - MG, Brazil: Universidade Federal de Viçosa, pp. 152.) found PEC, Class B, associated to mapping scale 1: 100,000 for ASTER and PEC, Class A, associated to mapping scale 1: 200,000 for the SRTM C band (90 m resolution). However, Ferreira (2014Ferreira, G. F. 2014. Emprego de simulação no controle de qualidade em cartografia aplicado a modelos digitais de superfícies oriundos de sensores orbitais segundo PEC-PCD. Master’s degree in Ciências Geodésicas e Tecnologias da Geoinformação. Recife, PE, Universidade Federal de Pernambuco - UFPE, pp. 140.) reported PEC, Class B, associated to scale 1: 50,000, after the application of systematic errors corrections for both ASTER and SRTM products.

In such a context of multiple sources, evaluation uncertainties and little convergence of assessment results reported by literature, this paper proposes to evaluate the altimetry accuracy of the ASTER GDEM v2 and SRTM v3 DEM (30 m resolution), as well as investigating the relationship between observed errors and the terrain slope ranges. The reference data used for validation of evaluated models come from Light Detection and Ranging (LIDAR) technology with, 25 cm altimetry accuracy. The assessment was applied in urban coverage areas and considered, in addition to quantitative methods, the general principles of Earth resources remote sensing. Validating quantitative methods involved histograms analysis, topographic profiles, correlation index, regression analysis, Root Mean Square Error (RMSE) analysis of the distribution of errors and the National Cartographic Accuracy Standard of Digital Cartographic Products - PEC-PCD.

2. Methodological Approach

The methodology is focused on the altimetry evaluation of free DEM originated from remote sensing data (ASTER GDEM v2 and SRTM v3) where the behavior of altimetry errors in different topographic configurations is analyzed. In the present approach, the characterization of the study area is proceeded, the cartographic and computational processes are described and the most important details of the DEM comparison methods are established.

2.1 Study area

The study area corresponds to Belo Horizonte city boundaries and its neighborhoods. It was chosen because the availability of LIDAR data that present optimal altimetry quality to carry out the validation. In addition, the local hillside slopes variation ranges from 0 to 159%, which favors the analysis relating land slope and altimetry accuracy. The region is a densely populated urban area, that presents varying types of land cover, such as: vegetation, buildings, water bodies, streets and uncovered soil. The study region is located at the intersection of four ASTER GDEM v2 scenes and four SRTM v3 scenes, as can be observed in Figure 1.

Figure 1:
Location of study area: Belo Horizonte city boundaries.

2.2 Data Processing

The ASTER GDEM version 2 and SRTM version 3 DEM to be evaluated were obtained from the United States Geological Survey (USGS) website. The LIDAR data used as reference were provided by the Computing and Information Company of Belo Horizonte Municipality (PRODABEL). The LIDAR survey was performed by airborne laser scanning, that provides a 25 cm vertical accuracy and an average density of 1.5 points per square meter.

The main processing steps applied to assessment data can be summarized as follow:

Projection and datum conversion: ASTER GDEM v2 (4 scenes) and SRTM v3 (4 scenes) were converted to UTM Projection, 23 zone, South hemisphere and the Geodetic Reference System was set to WGS 84.

Data resampling: for effective comparison of raster data, the pixels of different scenes or sensors should be resampled to the same spatial resolution (30 meters adopted), since the pixel sizes of different scenes or sensors are generally only approximate (not exactly the same size and/or geographic position). All resampling operations used the Nearest Neighbor interpolation method.

Mosaicking and clipping: individual image scenes of ASTER GDEM v2 and SRTM v3 were joined to encompass the full study area. Following mosaics building the data were clipped to cover only the useful size of study area.

In similar way, the reference data was submitted to the processing steps that follow:

Format conversion and interpolation: LIDAR data, originally arranged in point cloud format (.las), was converted to raster format, using the Nearest Neighbor interpolation method to result a 30 m pixel size compatible to evaluation data .

Datum conversion: The Geodetic Reference System was converted from South American Datum-1969 to WGS 84. Original UTM Projection features were maintained.

Given these former basic steps the following processing were applied to both the reference and the assessment data.

Raster to vector conversion: This step resulted in coordinate points data sets (E=X, N=Y, H=Z) corresponding to geographic positions of each center pixel for all DEM. Data were summarized in a unique attribute table containing the three models corresponding altimetry values for each geographic position.

2.3 Relating assessment and reference data in areas with different land slope gradients

In order to analyze the influence of the terrain slope on the altimetry accuracy of the assessment models, a declivity map with 30 m pixel size was extracted from the reference DEM. The slope values were classified according to Brazilian Agricultural Research Corporation (EMBRAPA, 1979Empresa Brasileira de Pesquisa Agropecuária - EMBRAPA. 1979, Reunião Técnica de Levantamento de Solos, Micelânea 1, SNLCS, Rio de Janeiro.) standards, presented in Table 1.

Table 1:
Amount of tested points by declivity class

2.4 Statistical analyzes

The Pearson correlation coefficient (r), given by Equation 1, is a measure of linear association between quantitative variables. The value ranges from 1 (indicating perfect positive correlation) to -1 (indicating perfect negative correlation) (Puth et al. 2014Puth, M. T., Neuhauser, M. and Ruxton, G. D. 2014. Effective use of Pearson’s product-moment correlation coefficient. Animal Behaviour, 93 (1), pp. 183-189.).

r = i n { ( X i X ¯ ) ( Y i Y ¯ ) } i = 1 n ( X i X ¯ ) 2 i = 1 n ( Y i Y ¯ ) 2 (1)

Where X¯=1ni=1nXi;Y¯=1ni=1nYi and n = total number of observations.

The regression analysis proposes to verify the existence of a functional relationship between a dependent variable and an independent variable. In the present analyzed situation, the altimetry values extracted from DEM ASTER GDEM v2 and SRTM v3 are the dependent variables and the altimetry values extracted from the LIDAR data are the independent variable. The functional relationship between these variables can be described by the regression line. According to Reis (2002Reis, E. 2002. Estatística Descritiva. 7rd ed. Lisboa: Edições Sílabo, pp. 245.) the explanatory power of the regression line can be measured by the coefficient of determination (R2), which shows how much the dependent variable Y is explained by the presence of variable X. The R2 value varies from 0 to 1, in such a way that the greater R2, the greater the adequacy of the function to describe the phenomenon.

In order to evaluate whether the distribution of the reference model data and of the assessment models are statistically the same, a frequency table of the residuals found from the differences between the LASER - ASTER GDEM v2 and LASER - SRTM v3 data was built. The Sturges formulation, given by Equation 2, was applied to find the number of classes to be used.

k = 1 + 3.3 × log 10 ( n ) (2)

Tables and graphs generated from the frequency distribution of residuals were used to effective analyze the data set.

The Root Mean Square Error (RMSE), given by Equation 3, was calculated by estimating the error between the observed values (ASTER GDEM v2 or SRTM v3) and the reference values (LIDAR) in relation to the number of points checked (Chrysoulakis et al. 2011Chrysoulakis, N., Abrams, M., Kamarianakis, Y. and Stanislawski, M. 2011. Validation of ASTER GDEM for the Area of Greece. Photogrammetric Engineering & Remote Sensing, 77 (2), pp. 157-165.). The calculation was performed for each relief declivity class.

R M S E = 1 n i = 1 n δ z i 2 (3)

Where: δzi= ZASTER GDEM v2 ZLASER or δzi= ZSRTM v3 ZLASER and n is the number of test points.

The National Cartographic Accuracy Standard for Digital Mapping Products - PEC-PCD is a statistical indicator adopted among Brazilian mapping community created by the ET-ADGV standard (DSG 2015). To be assigned a given class associated to a mapping scale the cartographic product must meet the conditions that follow: standard error (EP) * 1.6449 must be equal to or less than the tolerance value called PEC provided in the standard for each mapping scale; and EP equal to or lower than that value provided in the standard for the associated scale. The official PEC and EP tolerance values for DEM and the reference mapping scales can be seen in DSG (2015). According to the PEC-PCD digital cartographic products can be classified in classes A, B, C and D in the mapping scales of 1: 1,000, 1: 2,000, 1: 5,000, 1: 10,000, 1: 25,000, 1: 50,000, 1: 100,000 and 1: 250,000 (Pereira and Nero 2012Pereira, T. A. J and Nero, M. A. Análise de Normas de Controle de Qualidade Posicional em Cartografia ao Redor do Mundo: Exemplos Atuais de Alguns Países. In: IV Simpósio Brasileiro de Ciências Geodésicas e Tecnologias da Geoinformação. Recife, Pernambuco, 06 - 09 May 2012, Recife: UFPE, pp. 1-9.; DSG 2015; Santos et al. 2016Santos, A. P., Rodrigues, D. D., Santos, N. T. and Gripp Junior, J. 2016. Avaliação da Acurácia Posicional em Dados Espaciais Utilizando Técnicas de Estatística Espacial: Proposta de Método e Exemplo Utilizando a Norma Brasileira. Boletim de Ciências Geodésicas, 22(4), pp. 630-650.; Santos 2010Santos, A. P. 2010. Avaliação da Acurácia Posicional em Dados Espaciais com o Uso de Estatística Espacial. Master’s in degree Engenharia Civil. Viçosa - MG, Brazil: Universidade Federal de Viçosa, pp. 128.).

3. Analysis of results

The assessment DEM were analyzed in order to identify pixels failures related to any lack of elevation data. In ASTER GDEM this task can be accomplished by looking the raster file called QA, which accompanies the DEM data. In the QA file positive values ​​indicate the number of stereoscopic pairs used to calculate the DEM pixel elevation. So, the smaller the number of stereoscopic pairs used, the worse the accuracy of the recorded elevation. The negative values ​​indicate locations where it was not possible to collect enough ASTER GDEM data for performing pixel representation, so the altimetry value is accomplished by interpolation from other elevation sources such as the 3-second C-band SRTM (NASA and METI 2011National Aeronautics and Space Administration (NASA) and Ministry of Economy, Trade, and Industry (METI). 2011. ASTER GDEM 2 Readme. Sioux Falls, South Dakota: Sioux Falls, South Dakota. NASA EOSDIS Land Processes DAAC, USGS Earth Resources Observation and Science (EROS) Center, pp. 11.). Low accuracy occurrences in ASTER GDEM elevations may be related to sites with clouds, shades, water bodies and low contrast soil coverage areas (Lang and Welch 1999Lang, H. R. and Welch, R. 1999. Aster Digital Elevation Models - Algorithm Theoretical Basis Document (pdf). Available at: Available at: https://eospso.nasa.gov/sites/default/files/atbd/atbd-ast-14.pdf. Accessed 19 Set 2016.
https://eospso.nasa.gov/sites/default/fi...
). In the present case of study area a concentration of pixels with number of stereoscopic pairs used less than five was observed only on water bodies (Pampulha Lagoon). In areas with stereoscopic pairs less than 5, RMSE values ​​tend to increase (NASA and METI 2011National Aeronautics and Space Administration (NASA) and Ministry of Economy, Trade, and Industry (METI). 2011. ASTER GDEM 2 Readme. Sioux Falls, South Dakota: Sioux Falls, South Dakota. NASA EOSDIS Land Processes DAAC, USGS Earth Resources Observation and Science (EROS) Center, pp. 11.). Nevertheless, in the study area no pixels were identified, whose elevation origin is not from ASTER GDEM.

Pixels presenting extreme errors in SRTM are related to areas that the radar sensor could not capture response because of signal return absence or insufficiency in backscatter direction. These errors may be related to steep slope areas and low backscatter surfaces, such as water surface. In SRTM data processing gaps with less than 16 pixels were filled by interpolation methods. Those larger than 16 remained with gaps of altimetry representation being identified in the DEM by the pixel value -32768. No SRTM gaps were identified in the scenes of the study area.

The statistical tests were performed without considering the elevation data belonging to water bodies. It was observed that the presence of water bodies points influenced in a significant way the correlation and regression for the ASTER GDEM and in a significant way the values of RMSE obtained for the flat relief class were water surface is included. The RMSE of the ASTER GDEM flat relief class calculated taking into account the water bodies points resulted 7.05 m, while without considering water bodies points the RMSE value fell to 5.51 m. In the SRTM case water bodies points did not significantly influenced RMSE value. This problem is related to different water surface interaction with the different sensor systems that operate ASTER GDEM v2, SRTM v3 and LIDAR. Also, different processing methods are adopted in building process of each DEM type.

Figure 2 illustrates the above discussion, where the topographic profiles taken from de same path over the Pampulha Lagoon (starting coordinates: E = 605691.93 m, N = 7805001.28 m and ending coordinates: E = 606597.99 m; N = 7804578.14 m) show the different behavior among the three DEM. It can be seen that ASTER GDEM presented the largest discrepancies.

Figure 2:
Topographic profiles over water surface path

The LIDAR DEM used as reference in this research represents information about the behavior of the sensor and its interaction with water sheet, since the data collection used infrared laser beams with a wavelength of 1.064 nm (Temba 2008Temba, P. C. 2008. Ajustamento Simultâneo do Bloco de Faixas do Laser Scanner Aerotransportado (Als). Doctorate in Engenharia Civil. Florianópolis -SC, Brazil: Universidade Federal de Santa Catarina, pp. 250.). Analyzing Figure 2 it is possible to observe that the elevations in ASTER GDEM v2 profile show great variations. As pointed out previously, it is due to the low quality elevation measures caused by few stereoscopic pairs used to produce elevations in Pampulha Lagoon. The elevations of SRTM v3 presented a good similarity compared to reference model. However, these elevations are not exclusively based in SRTM original data, in fact this values can result of a masking process for water features applied on SRTM model generation that uses data from satellite images and complementary maps. This discussion supports the decision of excluding water bodies points in the statistical tests and quantitative calculations.

The models histogram analysis presented in Figure 3, shows the variability of elevations for the evaluated and reference data. It is observed that both elevation data do not match a normal distribution. In fact they are positively asymmetrical (positive skewness) and have similar flatness patterns (kurtosis). Presence of outliers can be observed in evaluated models comparing to the reference model. The different acquisition dates of the models data and the systemic errors associated to the acquisition process can contribute to this inconsistency. The basic statistics (maximum, minimum, mean and standard deviation) show close behavior between the three data types.

Figure 3:
DEM Histograms

The Pearson correlation analysis found a correlation coefficient of 0.9986 between ASTER GDEM v2 and the reference model whereas the correlation coefficient found between SRTM v3 and the reference model was 0.9999. These values indicate the existence of a strong positive linear correlation between the evaluated models and the reference model.

This relationship was confirmed by the simple linear regression analysis, demonstrated by means of scatter plots, in which the analysis of the determination coefficients (R2) of the regression line shows that the reference model is adequate to describe the ASTER model in 99.73% and the SRTM model in 99.84% (Figure 4).

Figure 4:
Scatter plot

A check sample is used to evaluate the positional accuracy of spatial data. The positions of the spatial data are confronted with the positions of the check sample, thus obtaining a set of positional discrepancies. (Santos et al. 2016Santos, A. P., Rodrigues, D. D., Santos, N. T. and Gripp Junior, J. 2016. Avaliação da Acurácia Posicional em Dados Espaciais Utilizando Técnicas de Estatística Espacial: Proposta de Método e Exemplo Utilizando a Norma Brasileira. Boletim de Ciências Geodésicas, 22(4), pp. 630-650.). So the elevation values (altimetry position) of the ASTER GDEM v2 and SRTM v3 were subtracted from the reference model elevation values (ASTER GDEM v2 - LIDAR) (SRTM v3 - LIDAR). This simple arithmetic operation produced the residuals between the models, in metric units. Table 2 and Figure 5 show the frequencies of the residuals grouped in 19 classes, according to the Sturges formula (Equation 2).

Table 2:
Distribution of residuals from assessment sources in relation to the reference source.

Figure 5:
Distribution of residuals from assessment sources in relation to reference source.

Table 2 and the Figure 5 show that class 9 grouped the smallest residuals and the highest frequencies. In the case of ASTER GDEM v2, 174,822 points out of a total 365,925, that is, 47.7% presented residuals between -4.36 m and 3.11 m. In the case of SRTM, 23,345 points out of a total 365,925, that is, 63.7% presented residuals between -4.36 m and 3.11 m. This evaluation highlights a gain of SRTM v3 over ASTER GDEM v2. Other significant percentages are located in class 8 that groups residuals between -11.83 m and -4.36 m and in class 10 that groups residuals between 3.11 m and 10.59 m. Adding the residuals of these two classes the ASTER GDEM grouped 44.44% of the residuals and the SRTM v3 33.18%.

The suitability of the errors observed in an evaluated DEM for an application is closely related to the objective of the DEM use and the mapping scale applied. The Cartographic Accuracy Standard calculations were supported by GeoPec software platform (Santos 2010Santos, A. P. 2010. Avaliação da Acurácia Posicional em Dados Espaciais com o Uso de Estatística Espacial. Master’s in degree Engenharia Civil. Viçosa - MG, Brazil: Universidade Federal de Viçosa, pp. 128.) which is based in the ET-ADGV standard, whose criteria were previously discussed in section 2.3. The most relevant results of classifications are presented in Table 3.

Table 3:
Classification of the ASTER GDEMv2 and SRTMv3 models as the PEC-PCD

ASTER GDEM v2 and SRTM v3 models RMSE, taking LIDAR model as reference, calculated for full study area (entire city of Belo Horizonte), corresponding to 365,925 sample points indicated smaller errors for SRTM v3 (RMSE = 4.95 m) and larger errors for ASTER GDEM v2 (RMSE = 6.44 m). So, it can be inferred that for the total study area it is more advantageous to use the DEM SRTM v3 than ASTER GDEM v2.

The RMSE were calculated separately for each relief declivity class for both models ASTER GDEM v2 and SRTM v3. The results indicated an increase of the errors as the slope also increases (Figure 6).

Figure 6:
RMSE values (m) for slope gradient classes.

A summary of ASTER GDEM v2 validations results presented by Tachikawa et al. (2011Tachikawa, T., Kaku, M., AIwasaki, A., Gesch, D., Oimoen, M., Zhang, Z., Danielson, J., Krieger, T., Curtis, B., Haase, J., Abrams, M., Crippen, R., Carabajal, C. 2011. ASTER Global Digital Elevation Model Version 2 - Summary of Validation Results. (pdf). Available at: Available at: https://lpdaacaster.cr.usgs.gov/GDEM/Summary_GDEM2_validation_report_final.pdf ;Accessed 10 Out 2015;
https://lpdaacaster.cr.usgs.gov/GDEM/Sum...
) reported for South America an RMSE of 8.68 m. In the present evaluation work, the Mountainous relief classes (RMSE = 12.13 m) and Steepest class (RMSE = 18.24) differ some degree from that perspective. The SRTM product description (Farr et al. 2007Farr, Tom G., Rosen, P. A., Caro, E., Crippen, R., Duren, R., Hensley, S., Kobrick, M., Paller, M., Rodriguez, E., Roth, L., Seal, D., Shaffer, S., Shimada, J., Umland, J., Werner, M., Oskin, M., Burbank, D., Alsdorf, D. 2007. The Shuttle Radar Topography Mission (pdf). Available at: Available at: http://www2.jpl.nasa.gov/srtm/SRTM_paper.pdf .Accessed 02 Feb 2016
http://www2.jpl.nasa.gov/srtm/SRTM_paper...
) reports an absolute accuracy of ± 16 m, 90% confidence level. Steepest relief class evaluated in this work is also out of this perspective.

The SRTM v3 presented better performance for relief representation than ASTER GDEM v2, except for the Steepest relief class (declivity above 75%), where ASTER GDEM v2 presented smaller errors. The slightly larger sensitivity of the SRTM to the steeper slopes may be related to the shadow effect caused by the side looking imaging geometry of radar, as reported by Ludwig and Schneider (2006Ludwig, R. and Schneider, P. 2006. Validation of digital elevation models from SRTM X-SAR for applications in hydrologic modeling. Journal of Photogrammetry & Remote Sensing, 60(5), pp. 339-358.). According to Rebelo (2007Rebelo, R. 2007. Aplicação do INSAR na Geração de Modelos Digitais do Terreno. Master. Universidade de Lisboa.) the shadow effect corresponds to areas that the microwave radar beam cannot illuminate the targets, occurring commonly behind (with respect to the sensor) mountains with steep slopes. Rebelo (2007Rebelo, R. 2007. Aplicação do INSAR na Geração de Modelos Digitais do Terreno. Master. Universidade de Lisboa.) also highlights the compression and inversion effects that cause erroneous representation of elevation values.

Topographic profiles were generated for the evaluated and reference DEM (Figure 7). The profile was drawn on relief that ranges from mountainous at the initial point (E = 605185.71 m; N = 7784553.89 m) to flat at the final point (E = 602685.71 m; N = 7784553.89 m). The visual analysis of these profiles reinforces the relationship between land slope and altimetry errors. In the flat relief, the profiles of evaluated data fit better to the profile generated from the reference data, whereas in the mountainous relief the disagreements are more evident.

Figure 7:
Topographic profiles in high and low land slope gradients.

4. Concluding remarks

Statistical methods and quantitative analyses were applied in this work to evaluate the embedded errors in the ASTER GDEM v2 and SRTM v3 DEM using LIDAR DEM as reference. Remote sensing principles and qualitative analyses concepts were also used to identify and understand the factors that influence these errors. So the concepts and results discussed in the present work can be worthy of value for driving studies addressing DEM ASTER GDEM v2 and SRTM v3 applications or its derivatives.

Quantitative tests indicated a high positive correlation between the evaluated and reference models. The regression analysis showed that the reference model is adequate to describe the ASTER GDEM v2 model in 99.73% and the SRTM v3 model in 99.84%.

The analysis of the frequency distribution of the residuals between the evaluated and reference sources indicates that these sources are statistically different from the reference source and therefore it is not possible to replace the reference source with one of the evaluated sources for medium and large surveys scales. The analysis of the errors distribution showed that in the case of ASTER GDEM 47.7% presented residuals between -4.36 m and 3.11 m. In the case of SRTM, 63.7% presented residuals between -4.36 and 3.11 m, indicating a gain of SRTM v3 in relation to ASTER GDEM v2.

The decision if errors are large or small is closely related to the purpose of the DEM use and the associated mapping scale. In the 1: 50,000 scale the evaluation of the PEC-PDC classified the DEM SRTM v3 as class B and the DEM ASTER GDEM v2 as class C. In the 1: 100,000 scale both models were assigned class A.

In both models, the altimetry errors increased as the terrain slope is accentuated. For the representation of flat, smooth corrugated, heavily corrugated and mountainous relief classes SRTM v3 presented smaller altimetry errors, whereas for representation of steepest relief class ASTER GDEM proved to be more advantageous.

The climatic conditions of the study area can be an additional factor that makes difference in obtaining better results. In rainy regions the SRTM may be more advantageous due to the nature of its active sensor system that operates in the microwave spectrum, being in no way affected by clouds and rainy weather. ASTER GDEM is based in passive sensor system that operates in the range of optical spectrum, and so is affected by clouds and rainy weather.

Both systems ASTER GDEM and SRTM presented some problems for mapping surfaces of low roughness such as water bodies.

Finally, it is also important to highlight some aspects that may affect the results of the evaluation proposed in this work. One is that the vertical datum used in ASTER GDEM v2 and SRTM v3 was EGM96, whereas in LIDAR it was used Imbituba-SC. The other is that difference of acquisition dates of evaluated and reference models may contribute to introduce unknown errors in the process. The dates of acquisition of the SRTM and LIDAR data were, respectively, February 2000 and November 2007. The ASTER GDEM was generated from multiple satellite scenes of different dates that are not published by system managers.

ACKNOWLEDGMENTS

A CAPES - Coordination of Improvement of Higher Level Personnel, for the financial incentive of the scholarship at the master’s level granted to one of the authors.

A PRODABEL by supporting the feasibility of this research with the availability of LIDAR data.

REFERENCES

  • Barros, R. S., Cruz, C. B. M., Reis, R. B. and Costa Júnior, N. A. 2005. Avaliação do modelo digital de elevação do SRTM na ortorretificação de imagens Landsat 7. In: XII Simpósio Brasileiro de Sensoriamento Remoto (SBSR) Goiânia, Goiás, 16-21 Apr 2005, São José dos Campos: INPE, pp. 3997-4004.
  • Burrough, P. A. 1986. Principles of Geographical Information Systems for Land Resources Assessment New York: Oxford University, pp. 333.
  • Camargo, F. F., Florenzano, T. G., Almeida, C. M. and Oliveira, C. G. 2011. Mapeamento Geomorfológico com Imagens Estereoscópicas Digitais do Sensor Aster/Terra. Revista Geociências, 30(1), pp. 95-104.
  • Chrysoulakis, N., Abrams, M., Kamarianakis, Y. and Stanislawski, M. 2011. Validation of ASTER GDEM for the Area of Greece. Photogrammetric Engineering & Remote Sensing, 77 (2), pp. 157-165.
  • Dias, M. F., Miceli, B. S., Seabra, F. M., Santos, P. R. A. and Fernandes, M. C. 2011. Avaliação Vertical de Modelos Digitais de Elevação (DEMs) em Diferentes Configurações Topográficas para Médias e Pequenas Escalas. In: XV Simpósio Brasileiro de Sensoriamento Remoto (SBSR) Curitiba, Paraná, 30 Apr - 5 May 2011, São José dos Campos: INPE, pp. 4110-4117.
  • DSG. 2015. Especificação Técnica Para a Aquisição de Dados Geoespaciais Vetoriais (ET-ADGV). (pdf). Brasil: Ministério de Defesa - Diretoria de Serviço Geográfico. Available at: Available at: http://www.geoportal.eb.mil.br/images/PDF/ADGV_Defesa-Forca_Terrestre_2015.pdf ;Accessed 6 Dez 2016
    » http://www.geoportal.eb.mil.br/images/PDF/ADGV_Defesa-Forca_Terrestre_2015.pdf
  • Empresa Brasileira de Pesquisa Agropecuária - EMBRAPA. 1979, Reunião Técnica de Levantamento de Solos, Micelânea 1, SNLCS, Rio de Janeiro.
  • Farr, Tom G., Rosen, P. A., Caro, E., Crippen, R., Duren, R., Hensley, S., Kobrick, M., Paller, M., Rodriguez, E., Roth, L., Seal, D., Shaffer, S., Shimada, J., Umland, J., Werner, M., Oskin, M., Burbank, D., Alsdorf, D. 2007. The Shuttle Radar Topography Mission (pdf). Available at: Available at: http://www2.jpl.nasa.gov/srtm/SRTM_paper.pdf .Accessed 02 Feb 2016
    » http://www2.jpl.nasa.gov/srtm/SRTM_paper.pdf
  • Ferreira, G. F. 2014. Emprego de simulação no controle de qualidade em cartografia aplicado a modelos digitais de superfícies oriundos de sensores orbitais segundo PEC-PCD Master’s degree in Ciências Geodésicas e Tecnologias da Geoinformação. Recife, PE, Universidade Federal de Pernambuco - UFPE, pp. 140.
  • Fonseca, D. N. and Corrêa, A. C. 2011. Uso de DEM na Extração de Lineamentos para Detecção de Reativações Neotectônicas na Bacia do Rio Preto, Serra do Espinhaço Meridional, MG. In: XV Simpósio Brasileiro de Sensoriamento Remoto (SBSR) Curitiba, Paraná, 30 Apr - 5 May 2011, São José dos Campos: INPE, pp. 3483-3490.
  • Fornelos, F. L. and Neves, S. M. 2007. Uso de Modelos Digitais de Elevação (DEM) gerados a partir de imagens de Radar Interferométrico (SRTM) na estimativa e perdas de solo. Revista Brasileira de Cartografia, 59 (1), pp. 1808-0936.
  • Gorokhovich, Y. and Voustianiouk, A. 2006. Accuracy assessment of the processed SRTM-based elevation data by CGIAR using field data from USA and Thailand and its relation to the terrain characteristics. Remote Sensing of Environment, 104 (4), pp. 409-415.
  • Lang, H. R. and Welch, R. 1999. Aster Digital Elevation Models - Algorithm Theoretical Basis Document (pdf). Available at: Available at: https://eospso.nasa.gov/sites/default/files/atbd/atbd-ast-14.pdf. Accessed 19 Set 2016.
    » https://eospso.nasa.gov/sites/default/files/atbd/atbd-ast-14.pdf.
  • Luana, S., Hou, X. and Wang, Y. 2015. Datasets for the Coastal Zone of Shandong Province. Polish Maritime Research, 22(special issue 1), pp.15-20.
  • Ludwig, R. and Schneider, P. 2006. Validation of digital elevation models from SRTM X-SAR for applications in hydrologic modeling. Journal of Photogrammetry & Remote Sensing, 60(5), pp. 339-358.
  • Manfré, L. A, Nóbrega, R. A. A. and Quintanilha, J. A. 2015. Regional and local topography subdivision and landform mapping using SRTM-derived data: a case study in southeastern Brazil. Environmental Earth Sciences, 73 (10), pp. 6457-6475.
  • National Aeronautics and Space Administration (NASA) and Ministry of Economy, Trade, and Industry (METI). 2011. ASTER GDEM 2 Readme Sioux Falls, South Dakota: Sioux Falls, South Dakota. NASA EOSDIS Land Processes DAAC, USGS Earth Resources Observation and Science (EROS) Center, pp. 11.
  • Oliveira, G. C. 2015. Precisão de Modelos Digitais de Terreno, Mapeamento. Automático de Apps em Topos de Morros e a Eficácia do Novo Código Florestal Master’s degree in Solos e Nutrição de Plantas. Viçosa - MG, Brazil: Universidade Federal de Viçosa, pp. 152.
  • Pereira, T. A. J and Nero, M. A. Análise de Normas de Controle de Qualidade Posicional em Cartografia ao Redor do Mundo: Exemplos Atuais de Alguns Países. In: IV Simpósio Brasileiro de Ciências Geodésicas e Tecnologias da Geoinformação Recife, Pernambuco, 06 - 09 May 2012, Recife: UFPE, pp. 1-9.
  • Puth, M. T., Neuhauser, M. and Ruxton, G. D. 2014. Effective use of Pearson’s product-moment correlation coefficient. Animal Behaviour, 93 (1), pp. 183-189.
  • Rebelo, R. 2007. Aplicação do INSAR na Geração de Modelos Digitais do Terreno Master. Universidade de Lisboa.
  • Reis, E. 2002. Estatística Descritiva 7rd ed. Lisboa: Edições Sílabo, pp. 245.
  • Reis, B. R., Medeiros, D. R., Lopes, M., Cruz, C. B. M. and Barros, R. S. 2005. O uso de produtos de Sensoriamento Remoto gratuitos na representação do Relevo - um potencial para a educação. In: XXII Simpósio Brasileiro de Sensoriamento Remoto (SBSR) Goiânia, Goiás, 16-21 Apr 2005, São José dos Campos: INPE, pp. 1337-1344.
  • Santos, A. P. 2010. Avaliação da Acurácia Posicional em Dados Espaciais com o Uso de Estatística Espacial Master’s in degree Engenharia Civil. Viçosa - MG, Brazil: Universidade Federal de Viçosa, pp. 128.
  • Santos, A. P., Rodrigues, D. D., Santos, N. T. and Gripp Junior, J. 2016. Avaliação da Acurácia Posicional em Dados Espaciais Utilizando Técnicas de Estatística Espacial: Proposta de Método e Exemplo Utilizando a Norma Brasileira. Boletim de Ciências Geodésicas, 22(4), pp. 630-650.
  • Solberg, S., Astrup, R., Gobakken, T., Naesset, E. and Weydahl, D. J. 2010. Estimating spruce and pine biomass with interferometric X-band SAR. Remote Sensing of Environment , 114 (10), pp. 2353-2360.
  • Tachikawa, T., Kaku, M., AIwasaki, A., Gesch, D., Oimoen, M., Zhang, Z., Danielson, J., Krieger, T., Curtis, B., Haase, J., Abrams, M., Crippen, R., Carabajal, C. 2011. ASTER Global Digital Elevation Model Version 2 - Summary of Validation Results (pdf). Available at: Available at: https://lpdaacaster.cr.usgs.gov/GDEM/Summary_GDEM2_validation_report_final.pdf ;Accessed 10 Out 2015;
    » https://lpdaacaster.cr.usgs.gov/GDEM/Summary_GDEM2_validation_report_final.pdf
  • Temba, P. C. 2008. Ajustamento Simultâneo do Bloco de Faixas do Laser Scanner Aerotransportado (Als). Doctorate in Engenharia Civil. Florianópolis -SC, Brazil: Universidade Federal de Santa Catarina, pp. 250.

Publication Dates

  • Publication in this collection
    Oct-Dec 2017

History

  • Received
    21 Feb 2017
  • Accepted
    02 May 2017
Universidade Federal do Paraná Centro Politécnico, Jardim das Américas, 81531-990 Curitiba - Paraná - Brasil, Tel./Fax: (55 41) 3361-3637 - Curitiba - PR - Brazil
E-mail: bcg_editor@ufpr.br