Acessibilidade / Reportar erro

Comparison between oil spill images and look-alikes: an evaluation of SAR-derived observations of the 2019 oil spill incident along Brazilian waters

Abstract

Three SAR-derived observations of dark surface patches along the Northeastern Brazilian coastline by the end of 2019 were misreported in the Brazilian media as oil spill-related. Unfortunately, these observations were misled by false positives or look-alikes. Therefore, this paper aims to technically evaluate these look-alike classes by analyzing image attributes found to be helpful to the identification of ocean targets, including oil spills, rain cells, biofilms, and low wind conditions. We use image augmentation to extend our dataset size and create the probability density function curves. The processing includes image segmentation, optimal attribute extraction, and classification with random forest classifiers. Our results contrast with the open-source oil spill detection system and patch classifier methodology called “RIOSS.” Analysis of the feature probability density functions based on optimal attributes is promising since we could capture most of the false positive targets in the three SAR-reported images in 2019. The only exception was the biofilm slick observed on October 28th, where the RIOSS mistakenly classified this organic patch as a low wind region with oil spots. This pitfall is acceptable at this project stage since we had only five biogenic film samples to train the algorithm.

Key words
decision-tree; false-positive; random-forest; RIOSS; Sentinel-1; SAR

INTRODUCTION

Vasconcelos et al. (2020)VASCONCELOS RN, LIMA ATC, LENTINI CAD, MIRANDA GV, MENDONÇA LF, SILVA MA, CAMBUÍ ECB, LOPES JM PORSANI MJ. 2020. Oil Spill Detection and Mapping: A 50-Year Bibliometric Analysis. Rem Sens 21: 3647. doi.org/10.3390/rs12213647.
https://doi.org/10.3390/rs12213647....
, using a bibliometric analysis with a systematic review, revisit the relevant literature on oil spill detection and mapping from the last fifty years (1970–2019). Their results prove that oil detection at sea has shown significant evolution in recent decades. This evolution is explained by the fact that there is a strong relationship between the technological evolution of detection and remote sensing data acquisition methods. Among the countries that contributed most to this field of science, China, Norway, the United States, and Canada stood out as the largest producers and disseminators of information in this research field.

Spaceborne Synthetic Aperture Radar (SAR) is more efficient than other commonly used satellite oceanography techniques to monitor oil spills and natural seeps over the ocean’s surface, like optical remote sensing, thermal infrared imaging, and passive microwave sensors (Fingas & Brown 2018FINGAS M BROWN CE. 2018. A Review of Oil Spill Remote Sensing. Sensors 18: 91. doi:10.3390/s18010091., Alpers et al. 2017ALPERS W, HOLT B ZENG K. 2017. Oil spill detection by imaging radars: Challenges and pitfalls. Rem Sens Environ 201: 133-147., Chaturvedi et al. 2020CHATURVEDI SK, BANERJEE S LELE S. 2020. An assessment of oil spill detection using Sentinel 1 SAR-C images. J Ocean Eng Sci 2: 116-135.). It is common sense that it is an excellent sensor for monitoring large maritime areas at regular intervals, all day (day/night), and foul weather detection due to its sensor characteristics.

SAR generates electromagnetic pulses that “illuminate” the ocean surface, and it receives a backscattered echo described by the Bragg scattering theory. In calm (rougher) seas, most of the transmitted energy is reflected away from (towards) the radar, and the backscattered signal towards it is very low (high). The backscattered pulse is known as “radar echo.” The lower (higher) the echo, the darker (brighter) a target will appear on a SAR image. This is how oil spills appear as “dark spots” on radar images. They damp the capillary and short gravity waves responsible for the Bragg scattering. Consequently, these oil surface features are detectable and appear as dark spots in radar imagery. Nevertheless, classifying actual oil areas from look-alikes in SAR images is still challenging (Fingas & Brown 2018FINGAS M BROWN CE. 2018. A Review of Oil Spill Remote Sensing. Sensors 18: 91. doi:10.3390/s18010091., Alpers et al. 2017ALPERS W, HOLT B ZENG K. 2017. Oil spill detection by imaging radars: Challenges and pitfalls. Rem Sens Environ 201: 133-147.), as these dark formations can be associated with oil spills, biogenic films, rain cells, low wind areas, and ship wakes (Singha et al. 2012SINGHA S, BELLERBY TJ TRIESCHMANN O. 2012. Detection and classification of oil spill and look-alike spots from SAR imagery using an artificial neural network. IEEE Int Geosc Rem Sens Symp 5630-5633. doi: 10.1109/IGARSS.2012.6352042., Chen et al. 2017CHEN G, LI Y, SUN G ZHANG Y. 2017. Application of Deep Networks to Oil Spill Detection Using Polarimetric Synthetic Aperture Radar Images. Appl Sci 7: 968. doi:10.3390/app7100968., Alpers et al. 2016ALPERS W, ZHANG B, MOUCHE A, ZENG K CHAN P. 2016. Rain footprints on C-band synthetic aperture radar images of the ocean – Revisited. Rem Sens Environ 187: 169-185., Eldhuset 1996ELDHUSET K. 1996. An automatic ship and ship wake detection system for spaceborne SAR images in coastal regions. IEEE Trans Geos Rem Sens 4: 1010-1019. doi: 10.1109/36.508418., Di Carro et al. 2018DI CARRO M, MAGI E, MASSA F, CASTELLANO M, MIRASOLE C, TANWAR S POVERO P. 2018. Untargeted approach for the evaluation of anthropic impact on the sheltered marine area of Portofino (Italy). Mar Poll Bull 131: 87-94., Espedal & Wahl 1999ESPEDAL HA WAHL T. 1999. Satellite SAR oil spill detection using wind history information. Int J Rem Sens 1: 49-65. doi: 10.1080/014311699213596.).

As mentioned before, oil spills appear as dark spots in SAR images due to their characteristic viscosity, which increases the surface tension and reduces the Bragg waves at the ocean’s surface, thus, its echo. According to Fingas & Brown (2018)FINGAS M BROWN CE. 2018. A Review of Oil Spill Remote Sensing. Sensors 18: 91. doi:10.3390/s18010091. and Alpers et al. (2017)ALPERS W, HOLT B ZENG K. 2017. Oil spill detection by imaging radars: Challenges and pitfalls. Rem Sens Environ 201: 133-147., nowadays, oil spill response includes remote sensing as an essential component. Users expect its extent and location to be mapped to implement counter-measurements to minimize pollution and hold illegal discharges from ships accountable. Indeed, a hot topic in satellite oil detection is still separating real oil spills from false positives or look-alikes (Brekke & Solberg 2005BREKKE C SOLBERG AHS. 2005. Oil spill detection by satellite remote sensing. Rem Sens Environ 95: 1-13., Svejkovsky et al. 2016SVEJKOVSKY J, HESS M, MUSKAT J, NEDWED TJ, MCCALL J GARCIA O. 2016. Characterization of surface oil thickness distribution patterns observed during the Deepwater Horizon (MC-252) oil spill with aerial and satellite remote sensing. Mar Poll Bull 110: 162-176.).

Biogenic films are not different. They also damp the Bragg waves, diminishing the radar echo. These films are natural surface slicks produced by fish or plankton activity (Alpers & Hühnerfuss 1988ALPERS W HÜHNERFUSS H. 1988. Radars signatures of oil films floating on the sea and the Marangoni effect, J Geophys Res 93: 3642-3648., 1989ALPERS W HÜHNERFUSS H. 1989. The damping of ocean waves by surface films: a new look at an old problem. J Geophys Res 94: 6251-6265., Gade et al. 1998GADE M, ALPERS W, HÜHNERFUSS H, MASUKO H KOBAYASHI T. 1998. Imaging of biogenic and anthropogenic ocean surface films by the multifrequency/ multipolarization SIR-C/X-SAR. J Geophys Res 103: 18851-18866.). Indeed, according to Alpers et al. (2017)ALPERS W, HOLT B ZENG K. 2017. Oil spill detection by imaging radars: Challenges and pitfalls. Rem Sens Environ 201: 133-147., the most challenging task is to separate radar signatures caused by mineral oil spills from those caused by biogenic surface films.

According to the scientific literature, rain leaves footprints on the sea surface that sometimes become visible on SAR images (Alpers et al. 2016ALPERS W, ZHANG B, MOUCHE A, ZENG K CHAN P. 2016. Rain footprints on C-band synthetic aperture radar images of the ocean – Revisited. Rem Sens Environ 187: 169-185.). Heavy rain often appears in the form of rain cells, especially in the tropics and subtropics. They can be seen on satellite pictures as bright patchy areas of augmented sea surface roughness due to a boost of sea surface wind speeds caused by the downdraft winds. However, rain cells are not always associated with downdrafts. They can also show dark patches in their centers, where the rain-induced turbulence in the ocean’s surface has damped the Bragg waves, i.e., the short surface waves responsible for the radar backscattering (Melsheimer et al. 1998MELSHEIMER C, ALPERS W GADE M. 1998. Investigation of multifrequency/multipolarization radar signatures of rain cells over the ocean using SIR-C/X-SAR data. J Geophys Res 103: 18867-18884.).

As presented for oil spills and biogenic films, radar imagery is also susceptible to look-alikes if the wind speed is lower than the 1.5 m/s limit (Fingas & Brown 2018FINGAS M BROWN CE. 2018. A Review of Oil Spill Remote Sensing. Sensors 18: 91. doi:10.3390/s18010091., Alpers et al. 2017ALPERS W, HOLT B ZENG K. 2017. Oil spill detection by imaging radars: Challenges and pitfalls. Rem Sens Environ 201: 133-147.). According to Gade et al. (1998)GADE M, ALPERS W, HÜHNERFUSS H, MASUKO H KOBAYASHI T. 1998. Imaging of biogenic and anthropogenic ocean surface films by the multifrequency/ multipolarization SIR-C/X-SAR. J Geophys Res 103: 18851-18866., who performed a series of slick controlled experiments with three different multifrequency/multipolarization SAR bands (i.e., L-, C-, and X-band), at high wind speeds (8-12 m/s), the ratio of the radar backscatter from a slick-free and a slick-covered water surface (damping ratio) is smaller than at low-to-moderate wind speeds (4-7 m/s).

According to Reed & Milgram (2002)REED AM MILGRAM JH. 2002. Ship wakes and their radar images. Ann Rev Fluid Mech 34: 469-502., SAR observations of ship wakes usually show a dark trailing centerline region, a bright V-shaped feature aligned at some angle to the ship’s path, and, sometimes, either the transverse or the diverging waves of the Kelvin-wave pattern. The dark region is usually associated with relatively low radar backscatter, whereas the bright line suggests a region of enhanced radar echo (Eldhuset 1996ELDHUSET K. 1996. An automatic ship and ship wake detection system for spaceborne SAR images in coastal regions. IEEE Trans Geos Rem Sens 4: 1010-1019. doi: 10.1109/36.508418.).

Therefore, one can see that classifying actual oil-like areas and separating them from look-alikes in SAR images is still challenging and not an easy task. Indeed, three divergent SAR-derived observations of the occurrence of dark surface patches along the Northeastern Brazilian coastline, when viscous crude oil reached over 200 locations along the coast, were reported in the Brazilian media (print and digital) erroneously as oil spill-related. To our knowledge, these are the only three displayed satellite images in the media. They were recorded during the austral spring of 2019 – 19/07/2019, 11/10/2019, and 28/10/2019. Unfortunately, these observations were misled by false positives or look-alikes. The purpose of this paper is to analyze these three look-alikes using an oil spill detection methodology called “RIOSS algorithm” proposed by Conceição et al. (2021)CONCEIÇÃO MR, MENDONÇA LFF, LENTINI CAD, LIMA ATC, LOPES JM, VASCONCELOS RN PORSANI MJ. 2021. SAR Oil Spill Detection System through Random Forest Classifiers. Rem Sens 13: 2044. doi.org/10.3390/rs13112044.
https://doi.org/10.3390/rs13112044....
. Indeed, knowledge about ocean SAR-derived targets is needed prior to press release notes and mainstream short communications.

MATERIALS AND METHODS

Satellite Data

Synthetic Aperture Radar (SAR) image data from Sentinel-1A and 1B satellites were acquired through the European Space Agency (ESA) website via the Copernicus Open Access Hub portal (https://scihub.copernicus.eu/). Sentinel-1, the first of the Copernicus Program satellite constellation, is on a sun-synchronous, near-polar (98.18°) orbit with a 12-day repeat cycle completing 175 orbits/cycle. Its SAR, which operates in the C-band and provides images in all-weather, daytime, or nighttime, has a spatial resolution of down to 5 m and a swath of up to 400 km. The first satellite, Sentinel-1A, was launched on April 3rd, 2014, and Sentinel-1B, on April 25th, 2016. For further details, the reader should refer to (https://sentinel.esa.int/web/sentinel/missions/sentinel-1).

These SAR images are available in Single Look Complex (SLC) format, with a 5m × 20m spatial resolution (azimuth and range) and 250km image range, level 1 processing, georeferenced, with satellite orbit and altitude provided in zero-Doppler inclined range geometry. Processed Level 1 SLC data, which have complex images with phase and amplitude, do not have all the corrections and pre-processing steps needed for the following analyses. Therefore, SAR data’s pre-processing steps included orbit correction, radiometric calibration in Sigma-zero , deburst, and multilook. After the multilook pre-processing is applied, the pos-processed images have a nominal resolution of 20m x 20m. Before the computational analyses, these steps were done using the SNAP Sentinel toolboxes software. During the development of the RIOSS Code (Conceição et al. 2021CONCEIÇÃO MR, MENDONÇA LFF, LENTINI CAD, LIMA ATC, LOPES JM, VASCONCELOS RN PORSANI MJ. 2021. SAR Oil Spill Detection System through Random Forest Classifiers. Rem Sens 13: 2044. doi.org/10.3390/rs13112044.
https://doi.org/10.3390/rs13112044....
), the analyzes were centered on radar backscattering values; however, the authors want to evolve to interferometry and polarimetry analyses soon. For this reason, we chose to use Single Look Complex (SLC) data from the first steps of the code.

For the random forest RIOSS model training, described by Conceição et al. (2021)CONCEIÇÃO MR, MENDONÇA LFF, LENTINI CAD, LIMA ATC, LOPES JM, VASCONCELOS RN PORSANI MJ. 2021. SAR Oil Spill Detection System through Random Forest Classifiers. Rem Sens 13: 2044. doi.org/10.3390/rs13112044.
https://doi.org/10.3390/rs13112044....
, 39 Sentinel-1 SLC SAR images were used. A total of 1,138 sub-image blocks were analyzed according to the seven target classes and the seven attributes from this dataset. They were all shown as probability density functions (PDF) of each selected feature. In addition, three Sentinel-1 SAR images were downloaded for feature analysis and further classification with the RIOSS algorithm. They are all Sentinel-1A SLC images, recorded in the Interferometric Wide (IW) swath mode during austral spring: a) October 11th, 2019 (11/10/2019) - S1A IW SLC recorded at 07h 54min 49s UTC; b) July 19th, 2019 (19/07/2019) - S1A IW SLC recorded at 07h 53min 30s UTC; and c) October 28th, 2019 (28/10/2019) - S1A IW SLC recorded at 08h 04min 30s UTC. Their geographic positions are displayed in Figure 1.

Figure 1
The study region shows oil spill landfall (orange circles) along the Northeastern Brazilian coastline for October 2019. The three Sentinel-1A SAR images used as test cases for look-alikes after the multilook processing.

Computational Analyses

The methodology used here is based on Solberg & Solberg (1996)SOLBERG AS SOLBERG R. 1996. A large-scale evaluation of features for automatic detection of oil spills in ERS SAR images. IEEE Int Geosc Rem Sens Symp 3: 1484-1486. doi: 10.1109/IGARSS.1996.516705. and Conceição et al. (2021)CONCEIÇÃO MR, MENDONÇA LFF, LENTINI CAD, LIMA ATC, LOPES JM, VASCONCELOS RN PORSANI MJ. 2021. SAR Oil Spill Detection System through Random Forest Classifiers. Rem Sens 13: 2044. doi.org/10.3390/rs13112044.
https://doi.org/10.3390/rs13112044....
. The former used three main steps for detecting oil spills - image segmentation, attribute extraction, and classification - while the latter also combines that methodology with an optimized feature space and Random Forest Classifiers (RFC) based on decision trees (e.g., Pal 2005PAL M. 2005. Random forest classifier for remote sensing classification. Int J Rem Sens 1: 217-222., Gislason et al. 2006GISLASON PO, BENEDIKTSSON JA SVEINSSON JR. 2006. Random forests for land cover classification. Patt Recog Lett 27: 294-300.). A Decision Tree Classifier (DTC) was the basis for random forest classification models. DTC separated a feature space into class domains. It took a feature vector as input into its root node, dividing the tree into two branches, representing two different classes. It was done by asking if one of the vector’s features was more significant than a previously trained one. The input vector kept walking through its branches and nodes until it got to “a leaf” or a final node, where the feature vector was finally classified between one of the predefined classes. The idea behind RFC models was to generate many trees trained on random subsets of a dataset. Each tree node can only choose a feature from a random subset of m elements from the selected attributes. The forest output was taken as the mode of its trees’ results. As DTC was considered a weak classifier, meaning that it usually offers considerable variance, using many of them in RFC often generated robust, lower variance outputs. For a detailed discussion about DTC and RFC methodologies, the reader should refer to Conceição et al. (2021)CONCEIÇÃO MR, MENDONÇA LFF, LENTINI CAD, LIMA ATC, LOPES JM, VASCONCELOS RN PORSANI MJ. 2021. SAR Oil Spill Detection System through Random Forest Classifiers. Rem Sens 13: 2044. doi.org/10.3390/rs13112044.
https://doi.org/10.3390/rs13112044....
.

Due to the limited number of images with targets of interest in Sentinel-1, we used the image augmentation technique. This methodology is essential in machine learning, providing a larger sample size. The application of this methodology makes it possible to multiply training data sets, creating more accurate models. In addition, this technique transforms the dataset images through spatial variations (Singh et al. 2011SINGH TR, ROY S, SINGH OI, SINAM T SINGH K. 2011. A new local adaptive thresholding technique in binarization. Int J Comp Sci 2: 271-277.). The result can train or test an algorithm, maximizing learning with each new sample. In practice, the images used were rotated to 15, -30, 60, and -75° to apply the image magnification concept and nearly quintuple our dataset training and testing.

The classification algorithm, developed by Conceição et al. (2021)CONCEIÇÃO MR, MENDONÇA LFF, LENTINI CAD, LIMA ATC, LOPES JM, VASCONCELOS RN PORSANI MJ. 2021. SAR Oil Spill Detection System through Random Forest Classifiers. Rem Sens 13: 2044. doi.org/10.3390/rs13112044.
https://doi.org/10.3390/rs13112044....
, was trained to identify seven target classes: oil spill, biofilms, rain cells, low wind conditions, ocean’s surface, ships, and land cover. These authors named this methodology the “Radar Image Oil Spill Seeker (RIOSS).” The code is written in Python language and can be downloaded from the GitHub site (https://github.com/los-ufba/rioss). For further information on the RIOSS algorithm, the reader should refer to Conceição et al. (2021)CONCEIÇÃO MR, MENDONÇA LFF, LENTINI CAD, LIMA ATC, LOPES JM, VASCONCELOS RN PORSANI MJ. 2021. SAR Oil Spill Detection System through Random Forest Classifiers. Rem Sens 13: 2044. doi.org/10.3390/rs13112044.
https://doi.org/10.3390/rs13112044....
.

The step before classification aims to separate the image into blocks and apply a mixed adaptive threshold segmentation to identify possible dark targets in the SAR images. First, image segmentation was performed based on an adaptive threshold value, described by Mera et al. (2012)MERA D, COTOS JM, VARELA-PET J GARCIA-PINEDA O. 2012. Adaptive thresholding algorithm based on SAR images and wind data to segment oil spills along the northwest coast of the Iberian Peninsula. Mar Poll Bull 10: 2090-2096. doi:10.1016/j.marpolbul.2012.07.018. for separating oil and ocean pixels on SAR images. Later, we compute a set of image features for each given block and provide them as input to a random forest model that has been tuned to classify its associated block. Finally, the method was applied to a backscattering level estimation over a 512 x 512 px² sub-image window. The window of 512 pixels was defined as the ideal average size to image the primary targets (oil spill and look-alikes) analyzed in the Sentinel-1 images. The result was a 512 x 512 px² Boolean mask that splits dark-spotted pixels from the background ocean. According to Conceição et al.’s (2021), 42 features were extracted initially and separated into five main categories: shape, complexity, statistics, gradient-based, and texture elements. These attributes were later reduced to 11 to eliminate data redundancy and unnecessary computational cost. Such attributes are: “pseudo-spectral density functions based on: fractal dimension (psdfd), lacunarity (bclac), gradient mean (gradmean), mean, skewness (skew), Shannon entropy (entropy), kurtosis (kurt), segmentation mask’s Shannon entropy (segentropy), segmentation mask’s energy (segener), and background mean (bgmean). Other two attributes used were the foreground mean (fgmean) in the case of the seven-class model and complexity (complex) in the case of the oil detector. Then, they were estimated and sequentially compared to the usual response of the analyzed phenomena using their probability density functions (PDF), as computed from our augmented image dataset (Figure 2) via kernel density estimation (KDE). According to Conceição et al. (2021)CONCEIÇÃO MR, MENDONÇA LFF, LENTINI CAD, LIMA ATC, LOPES JM, VASCONCELOS RN PORSANI MJ. 2021. SAR Oil Spill Detection System through Random Forest Classifiers. Rem Sens 13: 2044. doi.org/10.3390/rs13112044.
https://doi.org/10.3390/rs13112044....
, these were the most representative ones showing clear class separation between the seven different selected target classes. As the objective of this work was to show how the PDFs of such relevant attributes allow us to infer the phenomena present in the analyzed images, we selected the PDFs that could give the best insights to the analysis discussed here. The reader should refer to their paper for a detailed description of the RIOSS algorithm. After that, we compared our analyses to the RIOSS model outputs, which used the entire optimized feature space.

Figure 2
Number of block images in the augmented dataset used to estimate the probability density functions (PDFs) for the seven selected target classes.

According to Conceição et al. (2021)CONCEIÇÃO MR, MENDONÇA LFF, LENTINI CAD, LIMA ATC, LOPES JM, VASCONCELOS RN PORSANI MJ. 2021. SAR Oil Spill Detection System through Random Forest Classifiers. Rem Sens 13: 2044. doi.org/10.3390/rs13112044.
https://doi.org/10.3390/rs13112044....
, the Python machine learning library Scikit-learn (Pedregosa et al. 2011PEDREGOSA F, VAROQUAUX G, GRAMFORT A, MICHEL V, THIRION B, GRISEL O DUCHESNAY E. 2011. Scikit-learn: Machine Learning in Python. J Mach Learn Res 12: 2825-2830.) implementations were used to create and train decision trees and random forest models. Their random forest model had 60 decision trees and seven max depths to avoid overfitting. For the 7-class (oil, biofilm, rain, wind, sea, terrain, and ship) image labeling problem, the authors reported 79% and 85% accuracy for the decision tree and random forest models. On the other hand, they discussed that decision trees evaluated the oil detector (2-class problem) with an 86% precision. In contrast, precision was increased to 93% with the random forest model using just the 11 features.

Figure 3
Flowchart of the proposed methodology based on the RIOSS algorithm (Adapted from Conceição et al. 2021).

RESULTS AND DISCUSSION

Overall Performance

The seven attributes demonstrated relevant contributions to the separation between target classes, especially when they were analyzed together (Figure 4).

Figure 4
Feature probability density functions based on the seven target classes. The three black vertical lines show the average attribute values for the Sentinel-1A SAR images used as case studies: 11/10/2019 (continuous line), 19/07/2019 (dashed line), and 28/10/2019 (dotted line). The top first three panels (a, b, and c) showed a tendency to separate oil-related surface signature peaks. In contrast, the normalized Shannon entropy (d) showed that ship and land cover could be easily distinguished.

Although the top first three panels of Figure 4 (a to c) showed a tendency to separate oil-related surface signature peaks (red – except for Figure 4c) from biofilm (green), rain cells (light blue), low wind conditions (grey), and ocean’s surface (royal blue), one could not easily separate these last four classes from each other.

Although these last four panels (Figures 4d to 4g) gave different attribute values depending on the window size choice (not shown here), the normalized Shannon entropy (NSE) showed that ship and land cover could be easily distinguished from the remaining target classes. Albeit the NSE should range from 0 to 1 instead of -1 to +1 (Figure 4d), infinite computed NSE values were replaced here by -1 (land cover and ship curves). Both targets usually had relatively high reflectance values (i.e., echo) than their ocean counterparts. In our case, it turned out to be a valuable parameter if one was seeking ship detection, as we were further away from land. This kind of correlation had been previously reported by Shirvany et al. (2012)SHIRVANY R, CHABERT M TOURNERET JY. 2012. Ship and oil-spill detection using the degree of polarization in linear and hybrid/compact dual-pol SAR. IEEE J Sel Topics App Earth Obs Rem Sens 3: 885-892. doi: 10.1109/JSTARS.2012.2182760., Vespe & Greidanus (2012)VESPE M GREIDANUS H. 2012. SAR image quality assessment and indicators for vessel and oil spill detection. IEEE Trans Geosc Rem Sens 11: 4726-4734. doi: 10.1109/TGRS.2012.2190293., Yin et al. (2014)YIN J, YANG J, ZHOU ZS SONG J. 2014. The extended Bragg scattering model-based method for ship and oil-spill observation using compact polarimetric SAR. IEEE J Sel Topics App Earth Obs Rem Sens 8: 3760-3772. doi: 10.1109/ JSTARS.2014.2359141., Lupidi et al. (2017)LUPIDI A, STAGLIANÒ D, MARTORELLA M BERIZZI F. 2017. Fast detection of oil spills and ships using SAR images. Rem Sens 9: 230. doi:10.3390/rs9030230., and Gao et al. (2018)GAO G, GAO S, HE J LI G. 2018. Adaptive ship detection in hybrid-polarimetric SAR images based on the power–entropy decomposition. IEEE Trans Geos Rem Sens 9: 5394-5407.. Indeed, Gao et al. (2018)GAO G, GAO S, HE J LI G. 2018. Adaptive ship detection in hybrid-polarimetric SAR images based on the power–entropy decomposition. IEEE Trans Geos Rem Sens 9: 5394-5407. mentioned that the NSE was considered a versatile tool for separating ships and high backscattering targets in SAR images.

Just like complexity, the fractal dimension (FD) separated oil, land cover, and ship signatures from the other four target curves (Figures 4e and f). Ocean’s surface images were often easy to separate when considering the other classes based on these two attributes (Figures 4e and f).

The FD attribute played an excellent role in class separation. It was possible to observe that a homogeneous spatial distribution fitted the generated PDF values between the various target classes. A clear separation between oil, low wind conditions, rain cells, and biofilm values made this algorithm the tool that best adapted to the objectives proposed here, even without a detailed analysis of the σ0 backscatter coefficient. Furthermore, it initially allowed us to identify a potential oil spill in each SAR image. Figures 4a, b, and c were essential in separating oil spill images and the complexity concerning other features.

Low wind conditions (grey curve) and biofilms (green curve) were often easily confused, especially when using these attributes to detect look-alikes (Figures 4b, c, e, and f). However, their signatures were quite apart when the absolute gradient mean (AGM) was applied (Figure 4g). This attribute performed satisfactorily and quite effectively identified most of the analyzed look-alike classes.

The three case studies

The three SAR images used as case studies (19/07/2019, 11/10/2019, and 28/10/2019) were displayed in Fig. 4 as vertical black lines. These three values represented the mean attribute throughout these scenes. For each dark-spotted region observed in the original case study image, a subset was extracted, and then its corresponding attribute averaged over the entire subgroup. It was done by randomly subsampling the subset into 512 x 512-pixel blocks whose attributes were extracted and then averaged for the entire block, giving one value for each test case.

For the 28/10/2019 SAR image, the three averaged values (mean, spot mean, and background mean of 𝜎 0 [in dB] – Figure 4a, b, and c; vertical black dotted line, ~ -22 dB) showed relatively high probability density values for the biofilm class (green curve). It was also noticed that the ocean’s surface (royal blue), rain cells (light blue), low wind conditions (grey), and ship (magenta) curves showed relatively high probability density values too, which were also detached from the oil spill signature (red curve). Not only the 𝜎 curves’ peak in dB for biofilm (~ -22 dB) were different from the oil’s crest (-27 to -25 dB), but they do differ in terms of dB values too, with different values ranging approximately from 2 𝜎 5 dB.

The same behavior was observed for the rain cells in the 11/10/2019 SAR image (vertical black line, ~ -18 dB). It was also noticed that rain cells (light blue), ocean surface (royal blue), and low wind conditions (grey) curves stood out from the remaining four classes. Their PDF values and curves’ behavior were easily detached from the oil spill signatures (Figures 4a, b, and c). One striking result was the relative importance of the biofilm signature (green curve), especially in Figures 4b and c. Compared with these three target classes, it showed a relatively low probability density for this test case image, which corresponded to a 𝜎 value of ~ -18 dB.

Analogous to what was described for the previous image, the 19/07/2019 SAR image (vertical black line, ~ -19 dB) test case also showed the relative importance of biofilms on Figures 4b and c. In addition, it showed slightly higher PDF values for biofilm signature than for low wind conditions. Although we did not scrutinize this result, we believe that this was due to the ship wake signature (seen as a black angled straight line).

Moreover, according to Alpers et al. (2016)ALPERS W, ZHANG B, MOUCHE A, ZENG K CHAN P. 2016. Rain footprints on C-band synthetic aperture radar images of the ocean – Revisited. Rem Sens Environ 187: 169-185., the C-band 𝜎 rain signature can be enhanced (reduced) relative to its background. Enhancement (reduction) is caused by the backscattering of Bragg waves increase (attenuation) due to the raindrops and downdraft winds usually associated with rain cells (the turbulence generated by the raindrops) impinging onto the sea surface.

The analysis of complexity and FD could not distinguish the correct target class for each image (Figures 4e and f). Although the former attribute did quite well for the 11/10/2019 SAR image, it lacked adequately to deal with the biofilm signature (Figure 4e), which gave a probability density value higher than the observed actual conditions (i.e., presence of rain cells and low wind conditions). The same kind of behavior could be observed for the 19/07/2019 image. On the other hand, the FD seemed to capture low wind conditions from these two images and the ship detection of the last image.

Contrastingly, the AGM analysis gave better results than complexity and FD. It seemed to capture well low wind conditions on the first two images (11/10/2019 and 19/07/2019) and a ship in the second and third images. However, it could not capture the biofilm signature in the third image (28/10/2019).

According to our seven pre-selected target classes, figure 5 displayed the analysis of oil probability and classification maps, specifically for the three SAR test case images, both being outputs of RIOSS’ oil detector and its 7-class models, respectively. Except for the October 28th, 2019 SAR image (Figure 5c), the first two oil probability and classification maps could precisely reproduce the radar scenes observed on these two images.

Figure 5
Oil probability and target classification maps based on the three SAR image case studies as outputs of the RIOSS’s algorithm. Except for the October 28th, 2019, SAR image (c), the first two oil probability and classification maps (a and b) could reproduce the radar scenes observed on those two dates quite well.

For the first image (11/10/2019, Figure 5a), one could see that the overall oil probability for the whole picture is below 0.2, except close to 11.4oS-35.4oW, where two boluses with probabilities between 0.2 and 0.4 could be seen. Lower values (~ 0.2) were also seen in the upper right corner of the georeferenced image. Comparison between the actual SAR image (in 𝜎, dB) and its corresponding classification map showed good agreement, capturing the observed three rain cells and low wind conditions associated with these meteorological features. Although we did not investigate how sensible the RIOSS algorithm was to variable wind speeds, according to Alpers et al. (2016)ALPERS W, ZHANG B, MOUCHE A, ZENG K CHAN P. 2016. Rain footprints on C-band synthetic aperture radar images of the ocean – Revisited. Rem Sens Environ 187: 169-185., low wind conditions can prevail if the Bragg waves’ backscattering on the sea surface is damped by turbulence generated by raindrops impinging onto the sea surface. They also argue that enhancing or reducing the Bragg scattering depends on rain rate, wind speed, incidence angle, and raindrop distribution.

The July 19th, 2019 image (Figure 5b) showed an overall oil probability of less than 0.2 for the whole picture. As previously observed, the comparison between the SAR image and the classification map was in good agreement. The RIOSS algorithm captured and detected the ship’s presence (magenta, right panel), and the prevailed low wind conditions over the image. However, the algorithm misinterpreted the ship wake as low winds. This could be associated with the fact that the ship wake, seen as a dark angled straight line, had a small area compared to the low wind conditions, making it challenging to be accurately captured by the algorithm. Indeed, none of the 1,138 sub-image blocks used in this study had ship wake images to train the RIOSS algorithm.

Even though the algorithm could address low oil probability values (< 0.2) for the biofilm patch’s inner part, it failed to do it at its outer limits. As a result, this biofilm discontinuity with the ocean’s surface was mistakenly marked by high oil probabilities (> 0.6). Three key factors should be responsible for this misclassification. First, biofilms are the closest oil spill look-alikes in radar images, as seen in the PCA cross-plots in Conceição et al. (2021)CONCEIÇÃO MR, MENDONÇA LFF, LENTINI CAD, LIMA ATC, LOPES JM, VASCONCELOS RN PORSANI MJ. 2021. SAR Oil Spill Detection System through Random Forest Classifiers. Rem Sens 13: 2044. doi.org/10.3390/rs13112044.
https://doi.org/10.3390/rs13112044....
, making the confusion expected. However, the authors state that the precision metric was used to select the classification models. It means that the model was intentionally biased to be mistaken by false positives rather than false negatives (the most dangerous case). Second, their findings also indicate that gradient-dependent features were among the most important attributes when classifying oil spills, and those are especially anomalous in the dark-spotted borders. Third, it mistakenly addressed the biofilm’s inner portion as “low wind conditions” and its surroundings as discontinuity oil patches. On the other hand, the algorithm could register the ships’ presence in the SAR image (Figure 5c, right panel, magenta square).

This manuscript was developed during the first code version. Here, we used only five biogenic film images. The increase in the number of training images can reduce the biofilm class’s false positive classification values. However, according to Fiscella et al. (2000)FISCELLA B, GIANCASPRO A, NIRCHIO F, PAVESE P TRIVERO P. 2000. Oil spill detection using marine SAR images. Int J Rem Sens 18: 3561-3566. doi: 10.1080/014311600750037589., a manual inspection is essential in classifying oil spills and look-alikes. So, even with the ability of probability curves to separate false positives from ocean oil spill targets, the mathematical algorithms are susceptible to prediction errors, indicating the importance of a technical team to verify the positive responses of targets in marine environments. Indeed, we are now working on a more robust version of the RIOSS code under the CNPQ/MCTI 06/2020 call – Research and Development for Coping with Oil Spills on the Brazilian Coast – Ciências do Mar Program, grant #440852/2020-0.

CONCLUSIONS

This paper investigates the capability of detecting and classifying look-alikes on Sentinel-1A SAR images. Three SAR-derived observations of oil spill patches along the Northeastern Brazilian coastline, reported in the Brazilian media (print and digital) as oil spill pictures, were used as test cases. These look-alikes were evaluated and tested using an oil spill detection methodology called “the RIOSS algorithm.”

Our analyses based on optimal attributes are promising since we could capture most of the false positive targets in the three SAR-reported images in 2019. The only exception was the biofilm slick observed on October 28th, where the RIOSS algorithm mistakenly classified this organic patch as a low wind region with oil spots. However, this pitfall is acceptable at this project stage since we had only five biogenic film samples to train the algorithm. Further studies will be conducted by:

  1. increasing the number of target classes, especially for biofilm slicks;

  2. allowing the analysis for archived SAR images other than the Copernicus Program satellite constellation to increase the accuracy of the model;

  3. implementing an operational web-based oil spill warning framework for end-users and decision-makers.

These future steps are part of an ongoing project recently funded by the Brazilian Navy, the National Council for Scientific and Technological Development (CNPQ), and the Ministry of Science, Technology, and Innovation (MCTI), call CNPQ/MCTI 06/2020 – Research and Development for Coping with Oil Spills on the Brazilian Coast – Ciências do Mar Program, grant #440852/2020-0.

ACKNOWLEDGMENTS

This work is funded by the National Institute of Science and Technology – Petroleum Geophysics (INCT-GP) and MCTI/CNPQ/CAPES/FAPS Nº 16/2014 process 465517/2014-5, INCT PROGRAM and the additive project entitled “Modeling, remote sensing, and preventive detection of oil/fuel accidents” by MCTI/CNPQ/CAPES/FAPS 2019. During this work, the following authors are supported by the Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) research fellowships: CADL (grant #380671/2020-4), LFFM (grant #380652/2020-4), MRAC (grant #114259/2020-8), ATCL (grant #380653/2020-6), and RNV (grant #103189/2020-3). The first three authors would like to thank CNPQ for the financial support on the project entitled “Sistema de detecção de manchas de óleo na superfície do mar da bacia de cumuruxatiba por meio de técnicas de classificação textural de imagens de radar e modelagem numérica” (grant #424495/2018-0).

REFERENCES

  • ALPERS W, HOLT B ZENG K. 2017. Oil spill detection by imaging radars: Challenges and pitfalls. Rem Sens Environ 201: 133-147.
  • ALPERS W HÜHNERFUSS H. 1989. The damping of ocean waves by surface films: a new look at an old problem. J Geophys Res 94: 6251-6265.
  • ALPERS W HÜHNERFUSS H. 1988. Radars signatures of oil films floating on the sea and the Marangoni effect, J Geophys Res 93: 3642-3648.
  • ALPERS W, ZHANG B, MOUCHE A, ZENG K CHAN P. 2016. Rain footprints on C-band synthetic aperture radar images of the ocean – Revisited. Rem Sens Environ 187: 169-185.
  • BREKKE C SOLBERG AHS. 2005. Oil spill detection by satellite remote sensing. Rem Sens Environ 95: 1-13.
  • CHEN G, LI Y, SUN G ZHANG Y. 2017. Application of Deep Networks to Oil Spill Detection Using Polarimetric Synthetic Aperture Radar Images. Appl Sci 7: 968. doi:10.3390/app7100968.
  • CONCEIÇÃO MR, MENDONÇA LFF, LENTINI CAD, LIMA ATC, LOPES JM, VASCONCELOS RN PORSANI MJ. 2021. SAR Oil Spill Detection System through Random Forest Classifiers. Rem Sens 13: 2044. doi.org/10.3390/rs13112044.
    » https://doi.org/10.3390/rs13112044.
  • CHATURVEDI SK, BANERJEE S LELE S. 2020. An assessment of oil spill detection using Sentinel 1 SAR-C images. J Ocean Eng Sci 2: 116-135.
  • DI CARRO M, MAGI E, MASSA F, CASTELLANO M, MIRASOLE C, TANWAR S POVERO P. 2018. Untargeted approach for the evaluation of anthropic impact on the sheltered marine area of Portofino (Italy). Mar Poll Bull 131: 87-94.
  • ELDHUSET K. 1996. An automatic ship and ship wake detection system for spaceborne SAR images in coastal regions. IEEE Trans Geos Rem Sens 4: 1010-1019. doi: 10.1109/36.508418.
  • ESPEDAL HA WAHL T. 1999. Satellite SAR oil spill detection using wind history information. Int J Rem Sens 1: 49-65. doi: 10.1080/014311699213596.
  • FINGAS M BROWN CE. 2018. A Review of Oil Spill Remote Sensing. Sensors 18: 91. doi:10.3390/s18010091.
  • FISCELLA B, GIANCASPRO A, NIRCHIO F, PAVESE P TRIVERO P. 2000. Oil spill detection using marine SAR images. Int J Rem Sens 18: 3561-3566. doi: 10.1080/014311600750037589.
  • GADE M, ALPERS W, HÜHNERFUSS H, MASUKO H KOBAYASHI T. 1998. Imaging of biogenic and anthropogenic ocean surface films by the multifrequency/ multipolarization SIR-C/X-SAR. J Geophys Res 103: 18851-18866.
  • GAO G, GAO S, HE J LI G. 2018. Adaptive ship detection in hybrid-polarimetric SAR images based on the power–entropy decomposition. IEEE Trans Geos Rem Sens 9: 5394-5407.
  • GISLASON PO, BENEDIKTSSON JA SVEINSSON JR. 2006. Random forests for land cover classification. Patt Recog Lett 27: 294-300.
  • LUPIDI A, STAGLIANÒ D, MARTORELLA M BERIZZI F. 2017. Fast detection of oil spills and ships using SAR images. Rem Sens 9: 230. doi:10.3390/rs9030230.
  • MELSHEIMER C, ALPERS W GADE M. 1998. Investigation of multifrequency/multipolarization radar signatures of rain cells over the ocean using SIR-C/X-SAR data. J Geophys Res 103: 18867-18884.
  • MERA D, COTOS JM, VARELA-PET J GARCIA-PINEDA O. 2012. Adaptive thresholding algorithm based on SAR images and wind data to segment oil spills along the northwest coast of the Iberian Peninsula. Mar Poll Bull 10: 2090-2096. doi:10.1016/j.marpolbul.2012.07.018.
  • PAL M. 2005. Random forest classifier for remote sensing classification. Int J Rem Sens 1: 217-222.
  • PEDREGOSA F, VAROQUAUX G, GRAMFORT A, MICHEL V, THIRION B, GRISEL O DUCHESNAY E. 2011. Scikit-learn: Machine Learning in Python. J Mach Learn Res 12: 2825-2830.
  • REED AM MILGRAM JH. 2002. Ship wakes and their radar images. Ann Rev Fluid Mech 34: 469-502.
  • SHIRVANY R, CHABERT M TOURNERET JY. 2012. Ship and oil-spill detection using the degree of polarization in linear and hybrid/compact dual-pol SAR. IEEE J Sel Topics App Earth Obs Rem Sens 3: 885-892. doi: 10.1109/JSTARS.2012.2182760.
  • SINGHA S, BELLERBY TJ TRIESCHMANN O. 2012. Detection and classification of oil spill and look-alike spots from SAR imagery using an artificial neural network. IEEE Int Geosc Rem Sens Symp 5630-5633. doi: 10.1109/IGARSS.2012.6352042.
  • SINGH TR, ROY S, SINGH OI, SINAM T SINGH K. 2011. A new local adaptive thresholding technique in binarization. Int J Comp Sci 2: 271-277.
  • SOLBERG AS SOLBERG R. 1996. A large-scale evaluation of features for automatic detection of oil spills in ERS SAR images. IEEE Int Geosc Rem Sens Symp 3: 1484-1486. doi: 10.1109/IGARSS.1996.516705.
  • SVEJKOVSKY J, HESS M, MUSKAT J, NEDWED TJ, MCCALL J GARCIA O. 2016. Characterization of surface oil thickness distribution patterns observed during the Deepwater Horizon (MC-252) oil spill with aerial and satellite remote sensing. Mar Poll Bull 110: 162-176.
  • VASCONCELOS RN, LIMA ATC, LENTINI CAD, MIRANDA GV, MENDONÇA LF, SILVA MA, CAMBUÍ ECB, LOPES JM PORSANI MJ. 2020. Oil Spill Detection and Mapping: A 50-Year Bibliometric Analysis. Rem Sens 21: 3647. doi.org/10.3390/rs12213647.
    » https://doi.org/10.3390/rs12213647.
  • VESPE M GREIDANUS H. 2012. SAR image quality assessment and indicators for vessel and oil spill detection. IEEE Trans Geosc Rem Sens 11: 4726-4734. doi: 10.1109/TGRS.2012.2190293.
  • YIN J, YANG J, ZHOU ZS SONG J. 2014. The extended Bragg scattering model-based method for ship and oil-spill observation using compact polarimetric SAR. IEEE J Sel Topics App Earth Obs Rem Sens 8: 3760-3772. doi: 10.1109/ JSTARS.2014.2359141.

Publication Dates

  • Publication in this collection
    17 June 2022
  • Date of issue
    2022

History

  • Received
    30 Aug 2021
  • Accepted
    24 Jan 2022
Academia Brasileira de Ciências Rua Anfilófio de Carvalho, 29, 3º andar, 20030-060 Rio de Janeiro RJ Brasil, Tel: +55 21 3907-8100 - Rio de Janeiro - RJ - Brazil
E-mail: aabc@abc.org.br