Acessibilidade / Reportar erro

Automatic segmentation of brain tumors in magnetic resonance imaging

ABSTRACT

Objective

To develop a computational algorithm applied to magnetic resonance imaging for automatic segmentation of brain tumors.

Methods

A total of 130 magnetic resonance images were used in the T1c, T2 and FSPRG T1C sequences and in the axial, sagittal and coronal planes of patients with brain cancer. The algorithms employed contrast correction, histogram normalization and binarization techniques to disconnect adjacent structures from the brain and enhance the region of interest. Automatic segmentation was performed through detection by coordinates and arithmetic mean of the area. Morphological operators were used to eliminate undesirable elements and reconstruct the shape and texture of the tumor. The results were compared with manual segmentations by two radiologists to determine the efficacy of the algorithms implemented.

Results

The correlated correspondence between the segmentation obtained and the gold standard was 89.23%.

Conclusion

It is possible to locate and define the tumor region automatically with no the need for user interaction, based on two innovative methods to detect brain extreme sites and exclude non-tumor tissues on magnetic resonance images.

Diagnostic imaging; Brain neoplasms; Image processing, computer-assisted; Magnetic resonance imaging; Computer simulation

RESUMO

Objetivo

Desenvolver um algoritmo computacional aplicado a imagens de ressonância magnética, para segmentação automática de tumores cerebrais.

Métodos

Foram utilizadas 130 imagens de ressonância magnética nas sequências T1c, T2 e FSPRG T1c e nos planos axial, sagital e coronal de pacientes acometidos com câncer cerebral. Os algoritmos empregaram técnicas de correção de contraste, normalização de histograma e binarização, para desconectar estruturas adjacentes do cérebro e realçar a região de interesse. A segmentação automática foi realizada por meio da detecção por coordenadas e por média aritmética da área. Operadores morfológicos foram utilizados para eliminar elementos indesejáveis e reconstruir a forma e a textura do tumor. Os resultados foram comparados com as segmentações manuais de dois médicos radiologistas, para determinar a eficácia dos algoritmos implementados.

Resultados

Os acertos foram de 89,23% na correspondência entre a segmentação obtida e o padrão-ouro.

Conclusão

É possível localizar e delimitar a região tumoral de forma automática, sem necessidade de interação com o usuário baseado em dois métodos inovadores de detecção dos extremos do cérebro e de exclusão dos tecidos não tumorais em imagens de ressonância magnética.

Diagnóstico por imagem; Neoplasias encefálicas; Processamento de imagem assistida por computador; Imagem por ressonância magnética; Simulação por computador

INTRODUCTION

One of the most advanced and widely used techniques for viewing brain tumors is magnetic resonance imaging (MRI), ( 11. Jui SL, Zhang S, Xiong W, Yu F, Fu M, Wang D, et al. Brain MRI Tumor Segmentation with 3D Intracranial Structure Deformation Features. IEEE Intelligent Systems. 2016;31(2):66-76. ) due to its ability to differentiate between different types of tissues, and because it is a non-invasive method of high anatomical resolution, which makes diagnosis less traumatic to patients. Thus, MRI has been an important tool for detection, surveillance and early diagnosis of tumors. ( 22. Virupakshappa, Amarapur B. Cognition-based MRI brain tumor segmentation technique using modified level set method. Cognition, Technol Work. 2019; 21(3):357-69.

3. Szabó Z, Kapás Z, Lefkovits L, Gyõrfi Á, Szilágyi SM, Szilágyi L. Automatic segmentation of low-grade brain tumor using a random forest classifier and Gabor features.In:14th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD) [Internet]. Huangshan (CHN): ICNC-FSKD 2018 [cited 2019 Feb 6]. Available from: http://real.mtak.hu/86054/1/2023.pdf
http://real.mtak.hu/86054/1/2023.pdf...
- 44. Zhou M, Scott J, Chaudhury B, Hall L, Goldgof D, Yeom KW, et al. Radiomics in Brain Tumor: image assessment, quantitative feature descriptors, and machine-learning approaches. AJNR Am J Neuroradiol. 2018;39(2):208-16. Review. )

Although MRI is highly detailed, a diagnosis based only on human intelligence is cumbersome and time consuming, and subject to interpersonal variability, loss of information and eye fatigue. Also, during acquisition, images may show low quality, poor contrast, and the presence of artifacts, which pose difficulties to the human eye. ( 55. Goetz M, Weber C, Bloecher J, Stieltjes B, Meinzer HP, Maier-Hein KH. Extremely randomized trees based brain tumor segmentation [Internet]. Proceeding of MICCAI 2014 Brain Tumor Segmentation Challenge. 2014;6-11 [cited 2019 Feb 19]. Available from: http://people.csail.mit.edu/menze/papers/proceedings_miccai_brats_2014.pdf
http://people.csail.mit.edu/menze/papers...
) Moreover, the segmentation of tumor borders is usually a visual task and a manual procedure, which can only detect marked changes, ( 66. Schmidt M. Automatic brain tumor segmentation [Tese]. Edmonton: University of Alberta; 2005. 161f. ) and is subject to great variability when interpreted by different radiologists and long processing times to achieve detailed segmentation. ( 77. Clarke LP, Velthuizen RP, Clark M, Gaviria J, Hall L, Goldgof D, et al. MRI measurement of brain tumor response: comparison of visual metric and automatic segmentation. Magn Reson Imaging. 1998;16(3):271-9. , 88. Işın A, Direkoğlu C, Şah M. Review of MRI-based brain tumor image segmentation using deep learning methods. Procedia Computer Science. 2016;102:317-24. )

In this light, artificial intelligence-based image processing systems, known as CAD (computer-aided diagnosis) have been developed to detect and/or evaluate abnormalities on imaging examinations, and help physicians in precision diagnosis and neurosurgery. ( 99. Jorritsma W, Cnossen F, van Ooijen PM. Improving the radiologist–CAD interaction: designing for appropriate trust. Clin Radiol. 2015;70(2):115-22. Review. ) Image processing and analysis are used to develop the analytical skills of physicians ( 1010. Zhang J, Cui X, Li J, Wang R. Imbalanced classification of mental workload using a cost-sensitive majority weighted minority oversampling strategy. Cognition, Technol Work. 2017;19(4):633-53. ) and shorten the time required for accurate evaluation, therapy planning and tumor surveillance. ( 33. Szabó Z, Kapás Z, Lefkovits L, Gyõrfi Á, Szilágyi SM, Szilágyi L. Automatic segmentation of low-grade brain tumor using a random forest classifier and Gabor features.In:14th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD) [Internet]. Huangshan (CHN): ICNC-FSKD 2018 [cited 2019 Feb 6]. Available from: http://real.mtak.hu/86054/1/2023.pdf
http://real.mtak.hu/86054/1/2023.pdf...
, 1111. Doupi P, Svaar H, Bjørn B, Deilkås E, Nylén U, Rutberg H. Use of the global trigger tool in patient safety improvement efforts: nordic experiences. Cognition, Technol Work. 2015;17(1):45-54. ) These techniques provide radiologists with a second opinion to help understand medical images, improving diagnostic precision. ( 1212. Mohan G, Subashini MM. MRI based medical image analysis: survey on brain tumor grade classification. Biomedical Signal Processing Control. 2018;39:139-61. )

Although CAD systems have shown relative progress in their performance, there are still several issues to be overcome before its sensitivity can be improved. Also, automatic analysis of medical images has image-related issues that need to be overcome, such as noise that can affect pixel intensity and non-consistent image intensity. ( 1313. Clarke LP, Velthuizen RP, Camacho MA, Heine JJ, Vaidyanathan M, Hall LO, et al. MRI segmentation: methods and applications. Magn Reson Imaging. 1995;13(3):343-68. Review. ) Hence, a thorough investigation of alternative algorithms for all steps of a CAD system becomes relevant, from pre-processing to the final classification stage, using methods that can minimize MRI processing.

In this study, we developed a new algorithm for automatic segmentation of brain tumors on T1c, T2 and FSPGR T1c MRI sequences, using mathematical methods, as well as logical and morphological operations. After the analysis, the algorithm was able to segment the tumor region in agreement with the previous manual segmentation by radiologists (the gold standard).

OBJECTIVE

To develop and validate a set of computational tools for automatic segmentation of brain tumors on magnetic resonance images.

METHODS

The methodology was structured with a system consisting of 3 steps: pre-processing, segmentation and post-processing. This system operates with three different types of MRI: T1c, T2 and FSPRG T1c, in axial, coronal and sagittal views. Thus, all steps of the system were designed to operate with these three MRI modalities and any of the views. The system and its steps are described in table 1 .

Table 1
System steps and respective processes

This study was initiated after approval by the Institutional Review Board of Universidade Federal do Vale do São Francisco (UNIVASF), CAAE: 90399118.5.0000.5196 and opinion number 2.954.791.

Research setting

This study was conducted in the city of Juazeiro (BA), in the Electrical Engineering Laboratory at the UNIVASF campus.

Database

For this study, we reviewed 14 MRI images of brain tumors in real patients, confirmed by manual segmentation by specialist physicians, i.e. the gold standard, as marked on the images and described in the chart of each anonymous patients.

A database was built with 116 images provided by a radiology center in the city of Petrolina on an anonymous basis (private database). The machine used for examinations was the 1.5 T Intera by Philips Medical Systems, the slices were 3.5mm thick and the spacing between each slice was 3.85mm. Also, we used 14 images from the REpository of Molecular BRAin Neoplasia DaTa (public database), provided free-of-cost by The Cancer Imaging Archive (TCIA). Thus, the total sample consisted of 130 images (slices) from 14 patients of both sexes and different ages, of which 19 were T1c, 48 T2 and 63 FSPGR T1c sequences.

The images were in the Digital Imaging and Communications in Medicine (DICOM ® ) format, with different resolutions for each type of sequence, namely: 256×256 (T2), 512×512 (FSPGR T1c) and 704×704 (T1c). Algorithms were studied and implemented in the MATrix LABoratory ® (MATLAB ® ) system, which consists of a platform using high-level programming language and an environment for algorithm development, data analysis and visualization, and numerical computing.

Inclusion and exclusion criteria

We selected images previously diagnosed with hyperintense brain tumors in T1c, T2 and FSPGR T1c weightings and different planes (axial, sagittal and coronal), in patients of both sexes and different ages. The same number of images without tumors were included. Images with no previous diagnosis and with high noise density (extremely blurred) preventing visualization of brain structures were excluded from our cases.

Pre-processing

Pre-processing consists of applying techniques to reduce artifacts and enhance images, for improving their quality and highlighting a region of interest (ROI) for more detailed visualization and better segmentation precision. ( 1414. Gonzalez RC, Woods RE. Processamento de imagens digitais, tradução do original digital image processing. São Paulo: Edgard Blücher; 2000. p. 509. , 1515. Isa IS, Sulaiman SN, Mustapha M, Karim NK. Automatic contrast enhancement of brain MR images using Average Intensity Replacement based on Adaptive Histogram Equalization (AIR-AHE). Biocybernetics Biomedical Engineering. 2017;37(1):24-34. ) This step was based on image contrast enhancement to highlight the tumor region. All images have grey-level pixel intensities which were normalized between zero and 1.

Histogram equalization

Differently from other imaging techniques, in MRI, the pixel intensity has no fixed value in respect to the tissue image, i.e ., the same tissue could have different intensities, which makes it difficult to adopt intensity features as sources of information when segmenting images. ( 1616. Alegro MC. Segmentação computadorizada de tumores do encéfalo em imagens de ressonância magnética [Dissertação]. São Paulo: Universidade de São Paulo; 2009. ) The problem of non-standardized intensities is minimized by the process of normalization. Histogram equalization is applied to leave the desired areas brighter than the rest of the image, thus facilitating their extraction. ( 22. Virupakshappa, Amarapur B. Cognition-based MRI brain tumor segmentation technique using modified level set method. Cognition, Technol Work. 2019; 21(3):357-69. , 1717. Isselmou AE, Zhang S, Xu G. A novel approach for brain tumor detection using MRI Images. J Biomedical Sci Eng. 2016;9(10):44-52.

18. Ulku EE, Camurcu AY. Computer aided brain tumor detection with histogram equalization and morphological image processing techniques. In: International Conference on Electronics, Computer and Computation (ICECCO) [Internet]. Ancara:(TR); 2013 [cited 2019 Feb 6]. Available from: https://ieeexplore.ieee.org/document/6718225?tp=&arnumber=6718225
https://ieeexplore.ieee.org/document/671...
- 1919. Tharani SS, Sumathi B. A Novel Algorithm for Enhancing an Image of Brain Tumor. Int J Scientific Res Comput Sci Eng Inf Technol. 2018;3(3):186-90. ) The histeq function ( 2020. Thompson CM, Shure L. Image processing toolbox [for use with Matlab] (No. BOOK). The Math Works. 1995. ) is used to obtain said result.

Intensity adjustment

For intensity adjustment we used the imhmax and imhmin functions, ( 2020. Thompson CM, Shure L. Image processing toolbox [for use with Matlab] (No. BOOK). The Math Works. 1995. ) which suppress all maximums with grey values lower than a threshold h or all minimums higher than h . ( 2121. Kawaguchi K, Kageyama R, Sano M. Topological defects control collective dynamics in neural progenitor cell cultures. Nature. 2017;545 (7654):327-31. , 2222. Malhotra H, Naaz S. Analysis of MRI images using data mining for detection of brain tumor. Int J Advanced Res Comput Sci. 2018;9(2):15-8. ) These thresholds were pre-defined according to the occurrence of grey levels in the images (histogram), and two optimum intervals were defined for the set of images studied, based on the observation. Each MRI image varies with intensities closer to zero or 1, some being predominantly dark and others brighter. Therefore, according to the fragment area of imaging histograms, it was possible to determine the thresholds for intensity adjustment.

Binarization

To separate the background and the ROI, we applied binarization aided by the imregionalmax function, ( 2020. Thompson CM, Shure L. Image processing toolbox [for use with Matlab] (No. BOOK). The Math Works. 1995. ) which identifies the pixels of greater intensity and returns a binary image whose maximum pixels are assigned a value of 1, and all others are assigned as zero. ( 1515. Isa IS, Sulaiman SN, Mustapha M, Karim NK. Automatic contrast enhancement of brain MR images using Average Intensity Replacement based on Adaptive Histogram Equalization (AIR-AHE). Biocybernetics Biomedical Engineering. 2017;37(1):24-34. ) After this process, the image has a smaller number of subregions, mostly disconnected, resulting in less data and shorter processing times in the following steps.

Segmentation

The segmentation step separates the brain from adjacent areas, such as the meninges, skull bones and healthy tissues. ( 1616. Alegro MC. Segmentação computadorizada de tumores do encéfalo em imagens de ressonância magnética [Dissertação]. São Paulo: Universidade de São Paulo; 2009. ) One of the innovations in this study is the algorithm for automatic segmentation of brain tumors, consisting of two methods: detection by coordinates and detection by area.

Detection by coordinates

The first differentiator of this study is the detection-by-coordinates method (MDC), which automatically removes undesirable areas external to the brain, such as the skull bone, the meninges and subcutaneous fat, using only basic mathematical concepts and logical operations. The algorithm automatically marks four points around the brain known as top, bottom, left and right edges, and eliminates all regions located before the left-top edge and after the right-bottom edge. For this end, we considered that the head of the patient is in the central region of the image, which is the usual setting of an MRI, and the brain is delimited by pixels with intensities greater than zero.

Considering an image with dimensions X and Y, the coordinates of the left-top edge are determined by fixing the ordinate in the middle of the image (Y/2). For the top and bottom edges, the abscissa is fixed (X/2). The algorithm scans the row corresponding to Y/2 from left to right, and the column corresponding to X/2 from top to bottom, until it finds the first pixel greater than zero and creates two vectors with all pixels different than zero. The first element of each vector corresponds to the pixel of the left-top edge of the brain, and the last element corresponds to the opposite, i.e. , the right-bottom edge.

However, in most images, the skull bone has pixels with intensities greater than zero. The edges are marked in this region. Since the purpose is to define the brain, and the brain is at a small distance from the skull, which is virtually always the same from the anatomical standpoint, each edge is displaced by a value corresponding to such a distance, and fixed on the outer boundaries of the brain.

In addition, the algorithm also takes into consideration each type of view, since the brain will have different shapes in each situation. In the coronal and sagittal views, the images also contain the neck region, with pixels greater than zero. To avoid errors when marking the bottom edge, for instance, we estimate the distance between the lower part of the neck and the brain, displacing the bottom edge ordinate upwards, at a larger proportion.

After defining the brain by its edge points, the algorithm looks for subregions (labels) with coordinates lower than those of the left-top edge, and higher than those of the right-bottom edge. The labels are bounded by a rectangle using the bounding box parameter of the regionprops function. ( 2020. Thompson CM, Shure L. Image processing toolbox [for use with Matlab] (No. BOOK). The Math Works. 1995. ) The rectangle intercepts each label with at least two of its vertices. Thus, if at least one vertex of the bounding box containing the label is outside the limits of the brain edges, this indicates that the region is external to the brain and, therefore, a value of zero is assigned to all pixels of the corresponding label. This eliminates a great part of the skull, fat and meninges. Figure 1 illustrates the procedure for eliminating regions external to the brain using MDC.

Figure 1
Segmentation using detection by coordinates. On the left, the edge points of the brain are marked. The second image illustrates the location of the external and internal subregions of the brain. Finally, all subregions external to the brain are excluded

Detection by area

After applying detection by coordinates, the algorithm maintains the subregions inside the brain, which do not necessarily correspond to the tumor to be segmented. However, the tumor area resulting from detection by coordinates is, often times, larger than the arithmetic mean of the areas of all spurious elements that still remain. Thus, the second differentiator of this algorithm is the use of a two-dimensional parameter, i.e. , the area, to exclude non-tumor tissue inside the brain.

Before executing detection by area (MDA), the imerode function ( 2020. Thompson CM, Shure L. Image processing toolbox [for use with Matlab] (No. BOOK). The Math Works. 1995. ) was used to execute the erosion operation, which disconnects spurious elements and reduces their areas, forming new subregions with smaller areas. The MDA calculates the area of each resulting label and their arithmetic mean, assigning as zero the pixels of elements smaller than the arithmetic mean of the areas of all labels. This eliminates a great part or all of the brain tissue, leaving only the tumor.

Figure 2 illustrates the MDA, where the largest square in blue represents the tumor, other blue squares represent non-tumor tissue, and the green square represents the label corresponding to the arithmetic mean of the areas. Using logical operations (comparisons), the algorithm verifies the regions smaller than the mean area and excludes them, assigning a logical value of zero to their pixels. By doing so, ideally, one can eliminate as many undesirable elements as possible, and only the tumor remains.

Figure 2
Eliminating subregions through detection by area. In the first column, the subregions internal to the brain are detected. In the second column, the arithmetic mean of the subregion areas is calculated. In the third column, the size of each subregion is compared with the arithmetic mean. In the last column, all subregions smaller than the mean are eliminated

Post-processing

Morphological operators of dilation (imdilate) ( 2020. Thompson CM, Shure L. Image processing toolbox [for use with Matlab] (No. BOOK). The Math Works. 1995. ) were used to recover the tissues lost in the erosion process. To retain a larger region of the tumor, the binary mask is obtained by filling the holes in the dilated image (imfill). ( 2020. Thompson CM, Shure L. Image processing toolbox [for use with Matlab] (No. BOOK). The Math Works. 1995. ) Finally, the binary mask is applied to the original image by spatial convolution, to obtain a size close to the real size of the segmented elements, and then extract texture attributes. ( 1515. Isa IS, Sulaiman SN, Mustapha M, Karim NK. Automatic contrast enhancement of brain MR images using Average Intensity Replacement based on Adaptive Histogram Equalization (AIR-AHE). Biocybernetics Biomedical Engineering. 2017;37(1):24-34. , 2323. Alegro Mde C, Amaro Junior E, Lopes Rde D. Computerized brain tumor segmentation in magnetic resonance imaging. einstein (São Paulo). 2012; 10(2):158-63. )

Evaluation of results

Quantitative results of the automatic segmentation were calculated by comparison between the gold standard and the proposed segmentation method. The metrics commonly used in the literature ( 2424. Deng W, Luo L, Lin X, Fang T, Liu D, Dan G, et al. Head and neck cancer tumor segmentation using support vector machine in dynamic contrast-enhanced MRI. Contrast Media Mol Imaging. 2017;2017:8612519.

25. Vaibhavi P, Rupal K. Brain Tumor Segmentation Using K-means-FCM Hybrid Technique. In: Perez GM, Tiwari S, Trivedi MC, Mishra KK. Ambient Communications and Computer Systems. New York: Springer; 2018. p 341-52.
- 2626. Ma Z, Wu X, Song Q, Luo Y, Wang Y, Zhou J. Automated nasopharyngeal carcinoma segmentation in magnetic resonance images by combination of convolutional neural networks and graph cut. Experimental Therapeutic Medicine. 2016;16(3):2511-21. ) to assess performance are the hit rate (HR), calculated by the number of true positive (TP) of the method compared with the gold standard; and the matching rate (MR), based on the number of false positive results (FP). In the cited studies, the HR and MR are respectively defined as:

HR = TP gold standard × 100 %
MR = TP 0 . 5 × FP gold standard

Higher HR values indicate a higher number of true positive pixels in the segmented area. The MR value determines how distant from the gold standard (GS) the segmentation is. The ideal MR value is 1, which means a perfect match between the gold standard and the proposed segmentation. Matching rate values close to 1 suggest that the proposed segmentation has a much higher rate of true positive than false positive results. ( 1616. Alegro MC. Segmentação computadorizada de tumores do encéfalo em imagens de ressonância magnética [Dissertação]. São Paulo: Universidade de São Paulo; 2009. )

RESULTS

The pre-processing step was implemented following the previous description. The images obtained at the end were treated with these pre-processing techniques. Figure 3 shows the output of the final process, after using histogram equalization, intensity adjustment for contrast correction, and binarization. The images on the right are binarized (they only show pixels with intensity zero or 1). Here we present the three types of MRI sequences and the three types of views of the brains of different patients.

Figure 3
Results of pre-processing steps for different patients from the private database

The first, third and sixth columns show the images before processing, whereas the other columns show the images after pre-processing. The first row shows contrasted T1-weighted images, the second row shows T2-weighted images and the third row shows fast spoiled gradient echo T1-weighted images.

The segmentation step began with defining the brain by edge points and extraction of the regions external to them, followed by application of a morphological function of dilation, and finishing off with application of the MDA algorithm. Due to the erosion technique, which implies loss of pixels in certain regions, and the binarization process that converts the grey-scale image into only two levels of intensity, we used the morphological operations of dilation, hole filling and reconstruction, so that segmented regions could be rebuilt and returned to their original texture. The morphological procedure was used in these binary images to refine the margin and content of tumor images.

Figure 4 shows some final results after totally successful segmentation of MRI images of different patients, using T1c, T2 and FSPGR T1c sequences in the axial, coronal and sagittal planes. The first row shows segmentation of contrasted T1-weighted images of three different patients. The second row shows segmentation results for T2-weighted images. The third row shows segmentation results for fast spoiled gradient echo T1-weighted images.

Figure 4
Final result of automatic segmentation in T1-, T2- and spoiled gradient echo contrasted T1-weighted magnetic resonance imaging

Comparative performance analysis of automatic segmentation

The MRI images used in the test had been manually segmented by radiologists. These results were considered as gold standard and used to efficiently assess the system. Table 2 shows TP, FP, FN and HR compared with the gold standard, as well as the respective MR values. In similar studies, authors obtained a HR of 86% and MR of 0.79, which was considered satisfactory. ( 2424. Deng W, Luo L, Lin X, Fang T, Liu D, Dan G, et al. Head and neck cancer tumor segmentation using support vector machine in dynamic contrast-enhanced MRI. Contrast Media Mol Imaging. 2017;2017:8612519.

25. Vaibhavi P, Rupal K. Brain Tumor Segmentation Using K-means-FCM Hybrid Technique. In: Perez GM, Tiwari S, Trivedi MC, Mishra KK. Ambient Communications and Computer Systems. New York: Springer; 2018. p 341-52.
- 2626. Ma Z, Wu X, Song Q, Luo Y, Wang Y, Zhou J. Automated nasopharyngeal carcinoma segmentation in magnetic resonance images by combination of convolutional neural networks and graph cut. Experimental Therapeutic Medicine. 2016;16(3):2511-21. ) In this study, the HR was 89.23% and the MR was 0.70, i.e ., quantitatively similar to those of previous authors, which indicates good accuracy of the proposed segmentation method. The best HR results were obtained for T2 and FSPGR-T1c sequences.

Table 2
Performance of segmentation by sequence type

Matching rate results were satisfactory despite the significant number of FP. However, these FP were not more than the TPs, as seen in Alegro et al. ( 2323. Alegro Mde C, Amaro Junior E, Lopes Rde D. Computerized brain tumor segmentation in magnetic resonance imaging. einstein (São Paulo). 2012; 10(2):158-63. ) An innovative, robust image segmentation approach for extraction of brain tumors on MRI was developed by applying the Kernel function to the support vector machine (K-SVM), with HR and MR equivalent to 87.8% and 0.85, respectively. ( 2727. Singh R, Agarwal P, Bhattacharya M. MR brain tumor detection employing Laplacian Eigen maps and kernel support vector machine. In: 2016 IEEE International Conference On Bioinformatics And Biomedicine (BIBM). IEEE. 2016;827-30. ) To better compare the performance of the proposed segmentation algorithm and those found in the literature, the qualitative results of similar studies are presented in table 3 .

Table 3
Performance of segmentation algorithms used in the literature

DISCUSSION

Pre-processing techniques could successfully eliminate a great portion of the brain and some regions of the encephalon, however some spurious elements remained such as the skull bone, lateral ventricles and the corpus callosum, which, in some instances, correspond to pixels with intensities close to or higher than those of tumor tissue and, therefore, are difficult to exclude. Also, we tested using the median filter, a tool commonly used for filtering noise in brain MRI. ( 1717. Isselmou AE, Zhang S, Xu G. A novel approach for brain tumor detection using MRI Images. J Biomedical Sci Eng. 2016;9(10):44-52. , 3030. Anithadevi D, Perumal K. Brain tumour extraction based on segmentation. IJRITCC. 2014;2(9):2682-9. ) However, results were not superior to those of the proposed method, and the processing time of the algorithm was a downside. In fact, the convolution operation with masks requires great computational effort. ( 3131. Marques Filho O, Vieira Neto H. Processamento digital de imagens. Rio de Janeiro: Brasport; 1999. )

The color of tumor tissue on T1-weighted images was very close to that of the brain. This can render the pre-processing step very difficult, since the criteria and thresholds used to enhance the tumor region end up being applied to other regions of the brain which are not of interest. This can generate healthy tissues connected to the tumor, even after using morphological operations, as well as increase the number of false-positive results after segmentation. Pre-processing results were better on T2-weighted and FSPRG T1c images, due to their better contrast between the hyperintense region and the rest of the brain.

When looking at figures 3 and 4, one can see that pre-processing and segmentation based on the previously described techniques showed good results with the use of a simple algorithm using basic features and logical operations. Table 4 shows the method used by some authors to improve the quality of MRI images of brain tumors and strip the skull, with results qualitatively comparable to those of this study.

Table 4
Comparative analysis of the pre-processing methodology proposed and those present in the literature

The MDC algorithm can mark the extremities of the brain on any view (axial, coronal or sagittal) of the brain. This improves accuracy, since the geometrical shape of the brain varies in the three different views. It also works when the head is located asymmetrically in the image, either horizontally or vertically, which is a common occurrence. ( 3030. Anithadevi D, Perumal K. Brain tumour extraction based on segmentation. IJRITCC. 2014;2(9):2682-9. , 4141. Arunkumar N, Mohammed MA, Mostafa SA, Ibrahim DA, Rodrigues JJ, Albuquerque VH. Fully automatic model-based segmentation and classification approach for MRI brain tumor using artificial neural networks. Concurrency Computat Pract Exper. 2018;32:e4962. ) In addition, it offers different possibilities for extraction of regions outside the brain, and is applicable to images with hyperintense signal on different MRI weightings, since it does not depend on qualitative features, such as entropy and texture. Quite the opposite, it is based on the location of the brain inside the image, its anatomy and the intensity of surrounding pixels, similarly to the proposition of the S3 method. ( 3333. Roy S, Maji P. A simple skull stripping algorithm for brain MRI. In: Eighth International Conference On Advances In Pattern Recognition (ICAPR) [Internet]. Kolkata: (IN); 2015 [cited 2019 Aug 20]. Available from: https://ieeexplore.ieee.org/abstract/document/7050671/
https://ieeexplore.ieee.org/abstract/doc...
)

The MDC showed satisfactory results regarding its functionality and scope, and it can be qualitatively compared with the algorithms presented in table 4 , with good performance in skull stripping. In cases where the area outside the brain is not completely eliminated, the morphological operation of dilation can subdivide said “remainders” into smaller portions, which can be eliminated using MDA. Thus, MDA works as a complement to segmentation by detection of coordinates. It is directly linked with the number of FP in post-segmentation, since the more non-tumor tissue can be eliminated, the fewer FP and the better the segmentation.

However, the MDA is flawed in situations where there are post-processed regions larger than the tumor, since there is a chance the tumor be smaller than the mean area of the existing subregions and eliminated as a consequence, which would decrease the number of TP, or produce images with tumor and non-tumor, increasing the FP. This can happen in views where normal tissues have similar pixel intensities to those of tumors, and the differentiation of these regions is made difficult by the pre-processing techniques adopted. In addition to these limitations, MDC and MDA were developed to segment only MRI images with hyperintense tumors.

The T1c sequence had lower HR and MR compared with other MRI weightings, due to images in which the pixel intensity of the brain region was similar to that of the tumor. Therefore, this led to a high number of connected FP which, in some cases, had a much larger area than the tumor; in these cases, the tumor was excluded and the segmented image had no tumor tissue, resulting in FN.

The failed cases using T2-weighting were due to the presence of ventricles in some coronal slices, as well as axial slices of the eyes and nose, with very high pixel intensity (close to 1), leading to a high number of FP, in addition to the tumor not being detected in three FN slices. This issue also led to failure of some axial FSPGR T1c images, which explains the high number of FP in this category.

Despite the significant number of FP, the HR and MC results were satisfactory, with a mean hit rate of 89.23% between the automatically segmented areas and the gold standard, pointing to good accuracy of the proposed segmentation method.

CONCLUSION

The results obtained showed the proposed system was able to locate and define the tumor region without any user interaction, using an innovative method for automatic segmentation, simple and easy to implement.

ACKNOWLEDGMENTS

This study was financed in part by the Fundação de Amparo à Ciência e Tecnologia do Estado de Pernambuco (FACEPE) - Brazil - Finance code IBPG-0924-16.

REFERENCES

  • 1
    Jui SL, Zhang S, Xiong W, Yu F, Fu M, Wang D, et al. Brain MRI Tumor Segmentation with 3D Intracranial Structure Deformation Features. IEEE Intelligent Systems. 2016;31(2):66-76.
  • 2
    Virupakshappa, Amarapur B. Cognition-based MRI brain tumor segmentation technique using modified level set method. Cognition, Technol Work. 2019; 21(3):357-69.
  • 3
    Szabó Z, Kapás Z, Lefkovits L, Gyõrfi Á, Szilágyi SM, Szilágyi L. Automatic segmentation of low-grade brain tumor using a random forest classifier and Gabor features.In:14th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD) [Internet]. Huangshan (CHN): ICNC-FSKD 2018 [cited 2019 Feb 6]. Available from: http://real.mtak.hu/86054/1/2023.pdf
    » http://real.mtak.hu/86054/1/2023.pdf
  • 4
    Zhou M, Scott J, Chaudhury B, Hall L, Goldgof D, Yeom KW, et al. Radiomics in Brain Tumor: image assessment, quantitative feature descriptors, and machine-learning approaches. AJNR Am J Neuroradiol. 2018;39(2):208-16. Review.
  • 5
    Goetz M, Weber C, Bloecher J, Stieltjes B, Meinzer HP, Maier-Hein KH. Extremely randomized trees based brain tumor segmentation [Internet]. Proceeding of MICCAI 2014 Brain Tumor Segmentation Challenge. 2014;6-11 [cited 2019 Feb 19]. Available from: http://people.csail.mit.edu/menze/papers/proceedings_miccai_brats_2014.pdf
    » http://people.csail.mit.edu/menze/papers/proceedings_miccai_brats_2014.pdf
  • 6
    Schmidt M. Automatic brain tumor segmentation [Tese]. Edmonton: University of Alberta; 2005. 161f.
  • 7
    Clarke LP, Velthuizen RP, Clark M, Gaviria J, Hall L, Goldgof D, et al. MRI measurement of brain tumor response: comparison of visual metric and automatic segmentation. Magn Reson Imaging. 1998;16(3):271-9.
  • 8
    Işın A, Direkoğlu C, Şah M. Review of MRI-based brain tumor image segmentation using deep learning methods. Procedia Computer Science. 2016;102:317-24.
  • 9
    Jorritsma W, Cnossen F, van Ooijen PM. Improving the radiologist–CAD interaction: designing for appropriate trust. Clin Radiol. 2015;70(2):115-22. Review.
  • 10
    Zhang J, Cui X, Li J, Wang R. Imbalanced classification of mental workload using a cost-sensitive majority weighted minority oversampling strategy. Cognition, Technol Work. 2017;19(4):633-53.
  • 11
    Doupi P, Svaar H, Bjørn B, Deilkås E, Nylén U, Rutberg H. Use of the global trigger tool in patient safety improvement efforts: nordic experiences. Cognition, Technol Work. 2015;17(1):45-54.
  • 12
    Mohan G, Subashini MM. MRI based medical image analysis: survey on brain tumor grade classification. Biomedical Signal Processing Control. 2018;39:139-61.
  • 13
    Clarke LP, Velthuizen RP, Camacho MA, Heine JJ, Vaidyanathan M, Hall LO, et al. MRI segmentation: methods and applications. Magn Reson Imaging. 1995;13(3):343-68. Review.
  • 14
    Gonzalez RC, Woods RE. Processamento de imagens digitais, tradução do original digital image processing. São Paulo: Edgard Blücher; 2000. p. 509.
  • 15
    Isa IS, Sulaiman SN, Mustapha M, Karim NK. Automatic contrast enhancement of brain MR images using Average Intensity Replacement based on Adaptive Histogram Equalization (AIR-AHE). Biocybernetics Biomedical Engineering. 2017;37(1):24-34.
  • 16
    Alegro MC. Segmentação computadorizada de tumores do encéfalo em imagens de ressonância magnética [Dissertação]. São Paulo: Universidade de São Paulo; 2009.
  • 17
    Isselmou AE, Zhang S, Xu G. A novel approach for brain tumor detection using MRI Images. J Biomedical Sci Eng. 2016;9(10):44-52.
  • 18
    Ulku EE, Camurcu AY. Computer aided brain tumor detection with histogram equalization and morphological image processing techniques. In: International Conference on Electronics, Computer and Computation (ICECCO) [Internet]. Ancara:(TR); 2013 [cited 2019 Feb 6]. Available from: https://ieeexplore.ieee.org/document/6718225?tp=&arnumber=6718225
    » https://ieeexplore.ieee.org/document/6718225?tp=&arnumber=6718225
  • 19
    Tharani SS, Sumathi B. A Novel Algorithm for Enhancing an Image of Brain Tumor. Int J Scientific Res Comput Sci Eng Inf Technol. 2018;3(3):186-90.
  • 20
    Thompson CM, Shure L. Image processing toolbox [for use with Matlab] (No. BOOK). The Math Works. 1995.
  • 21
    Kawaguchi K, Kageyama R, Sano M. Topological defects control collective dynamics in neural progenitor cell cultures. Nature. 2017;545 (7654):327-31.
  • 22
    Malhotra H, Naaz S. Analysis of MRI images using data mining for detection of brain tumor. Int J Advanced Res Comput Sci. 2018;9(2):15-8.
  • 23
    Alegro Mde C, Amaro Junior E, Lopes Rde D. Computerized brain tumor segmentation in magnetic resonance imaging. einstein (São Paulo). 2012; 10(2):158-63.
  • 24
    Deng W, Luo L, Lin X, Fang T, Liu D, Dan G, et al. Head and neck cancer tumor segmentation using support vector machine in dynamic contrast-enhanced MRI. Contrast Media Mol Imaging. 2017;2017:8612519.
  • 25
    Vaibhavi P, Rupal K. Brain Tumor Segmentation Using K-means-FCM Hybrid Technique. In: Perez GM, Tiwari S, Trivedi MC, Mishra KK. Ambient Communications and Computer Systems. New York: Springer; 2018. p 341-52.
  • 26
    Ma Z, Wu X, Song Q, Luo Y, Wang Y, Zhou J. Automated nasopharyngeal carcinoma segmentation in magnetic resonance images by combination of convolutional neural networks and graph cut. Experimental Therapeutic Medicine. 2016;16(3):2511-21.
  • 27
    Singh R, Agarwal P, Bhattacharya M. MR brain tumor detection employing Laplacian Eigen maps and kernel support vector machine. In: 2016 IEEE International Conference On Bioinformatics And Biomedicine (BIBM). IEEE. 2016;827-30.
  • 28
    Hsieh TM, Liu YM, Liao CC, Xiao F, Chiang IJ, Wong JM. Automatic segmentation of meningioma from non-contrasted brain MRI integrating fuzzy clustering and region growing. BMC Medical Informatics Decision Making. 2011;11:54.
  • 29
    Gao F, Lin T. Application of Computer-Aided Diagnosis Technology in Brain Tumour Detection. NeuroQuantology. 2018;16(5):725-33.
  • 30
    Anithadevi D, Perumal K. Brain tumour extraction based on segmentation. IJRITCC. 2014;2(9):2682-9.
  • 31
    Marques Filho O, Vieira Neto H. Processamento digital de imagens. Rio de Janeiro: Brasport; 1999.
  • 32
    Sujan M, Alam N, Noman SA, Islam MJ. A Segmentation based Automated System for Brain Tumor Detection. IJCA. 2016;153(10):41-9.
  • 33
    Roy S, Maji P. A simple skull stripping algorithm for brain MRI. In: Eighth International Conference On Advances In Pattern Recognition (ICAPR) [Internet]. Kolkata: (IN); 2015 [cited 2019 Aug 20]. Available from: https://ieeexplore.ieee.org/abstract/document/7050671/
    » https://ieeexplore.ieee.org/abstract/document/7050671/
  • 34
    khandelwal P, Kaur G. Comparative study of different image enhancement technique. IJECT. 2016;7(2):116-21.
  • 35
    Kaur R, Chawla M, Khiva NK, Ansari MD. Comparative Analysis of Contrast Enhancement Techniques for Medical Images. Pertanika J Sci Technol. 2018;26(3):965-78.
  • 36
    Shattuck DW, Sandor-Leahy SR, Schaper KA, Rottenberg DA, Leahy RM. Magnetic resonance image tissue classification using a partial volume model. Neuroimage. 2001;13(5):856-76.
  • 37
    Smith SM. Fast robust automated brain extraction. Hum Brain Mapp. 2002;17(3):143-55. Review.
  • 38
    Roura E, Oliver A, Cabezas M, Vilanova JC, Rovira A, Ramió-Torrentà L, et al. MARGA: multispectral adaptive region growing algorithm for brain extraction on axial MRI. Comput Methods Programs Biomed. 2014;113(2):655-73.
  • 39
    Somasundaram K, Mercina JH, Magesh Kalaiselvi ST. Brain Portion Extraction Scheme using Region Growing and Morphological Operation from MRI of Human Head Scans. IJCSE. 2018;6(4):298-302.
  • 40
    Kalavathi P, Prasath VB. Methods on Skull Stripping of MRI Head Scan Images–a Review. J Digit Imaging. 2016;29(3):365-79. Review.
  • 41
    Arunkumar N, Mohammed MA, Mostafa SA, Ibrahim DA, Rodrigues JJ, Albuquerque VH. Fully automatic model-based segmentation and classification approach for MRI brain tumor using artificial neural networks. Concurrency Computat Pract Exper. 2018;32:e4962.

Publication Dates

  • Publication in this collection
    09 Mar 2020
  • Date of issue
    2020

History

  • Received
    16 Jan 2019
  • Accepted
    2 Sept 2019
Instituto Israelita de Ensino e Pesquisa Albert Einstein Avenida Albert Einstein, 627/701 , 05651-901 São Paulo - SP, Tel.: (55 11) 2151 0904 - São Paulo - SP - Brazil
E-mail: revista@einstein.br