Artificial intelligence, machine learning, computer-aided diagnosis, and radiomics: advances in imaging towards to precision medicine

Abstract

The discipline of radiology and diagnostic imaging has evolved greatly in recent years. We have observed an exponential increase in the number of exams performed, subspecialization of medical fields, and increases in accuracy of the various imaging methods, making it a challenge for the radiologist to “know everything about all exams and regions”. In addition, imaging exams are no longer only qualitative and diagnostic, providing now quantitative information on disease severity, as well as identifying biomarkers of prognosis and treatment response. In view of this, computer-aided diagnosis systems have been developed with the objective of complementing diagnostic imaging and helping the therapeutic decision-making process. With the advent of artificial intelligence, “big data”, and machine learning, we are moving toward the rapid expansion of the use of these tools in daily life of physicians, making each patient unique, as well as leading radiology toward the concept of multidisciplinary approach and precision medicine. In this article, we will present the main aspects of the computational tools currently available for analysis of images and the principles of such analysis, together with the main terms and concepts involved, as well as examining the impact that the development of artificial intelligence has had on radiology and diagnostic imaging.

Keywords:
Artificial intelligence; Machine learning; Computer aided diagnosis; Radiomics

Resumo

A disciplina de radiologia e diagnóstico por imagem evoluiu sobremaneira nos últimos anos. Temos observado o aumento exponencial do número de exames realizados, a subespecialização das disciplinas médicas e a maior acurácia dos métodos, tornando um desafio para o médico radiologista “saber tudo sobre todos exames e regiões”. Além disso, os exames de imagem deixaram de ser somente qualitativos e diagnósticos e passaram a fornecer informações quantitativas e de gravidade de doença, identificando biomarcadores prognósticos e de resposta ao tratamento. Diante disso, sistemas computadorizados de auxílio diagnóstico vêm sendo desenvolvidos com o objetivo dar suporte ao diagnóstico por imagem e à decisão terapêutica. Com o advento da inteligência artificial, do big data e do aprendizado de máquina, caminhamos para a rápida expansão do uso dessas ferramentas no dia-a-dia dos médicos, tornando cada paciente único, levando a radiologia ao encontro do conceito de abordagem multidisciplinar e medicina de precisão. Neste artigo serão abordados os principais aspectos das ferramentas computacionais atualmente disponíveis para análise das imagens médicas, apresentando os princípios de análise das imagens, os principais termos e conceitos envolvidos nesses processos, assim como o impacto do desenvolvimento da inteligência artificial na radiologia e diagnóstico por imagem.

Unitermos:
Inteligência artificial; Aprendizado de máquina; Diagnóstico auxiliado por computador; Radiômica

INTRODUCTION

The discipline of radiology and diagnostic imaging has evolved greatly in recent years. Radiological imaging can be extremely complex, and it is recognized that the analysis of exams that produce hundreds of images, such as computed tomography (CT) and magnetic resonance imaging (MRI), poses challenges, even for experienced specialists^(1-3). Those challenges have increased in recent years, with the exponential increase in the number of exams performed, subspecialization of medical fields, and increased accuracy of imaging methods, making it difficult for radiologists to “know everything about all exams and regions”. In addition, imaging exams are no longer only qualitative and diagnostic, having begun to provide quantitative information on disease severity, as well as identifying biomarkers of prognosis and treatment response^(4-6). Those changes have been especially prominent in oncology, showing that the information provided by imaging studies can go far beyond determining whether a lesion is benign or malignant, now being able to indicate the histological type of the tumor, staging, presence of mutations, chance of treatment response, risk of recurrence, and expected survival^(7-9).

Computer-aided diagnosis (CAD) systems have been developed with the objectives of improving the accuracy of exams, increasing consistency in interpretation of images, helping the prognostic evaluation, and supporting the therapeutic decision-making process. Although such tools have enormous potential, there are still limitations to their use in routine clinical practice. With the advent of artificial intelligence and “big data”, we are moving toward reducing those limitations, homogenizing and expanding the use of CAD tools in daily routine of physicians, making each patient unique, and leading radiology toward the concepts of a multidisciplinary approach and precision medicine^(10-14).

In this article, the main aspects of the computational tools currently available for image analysis will be discussed, as will the impact of the development of artificial intelligence and the role of imaging in precision medicine. Table 1 presents the main terms that will be used throughout this text, together with a brief definition of each.

Table 1
Key terms that have been used throughout the text, together with their short definitions.

Term	Definition
Machine learning	Field of computer science that involves the evolution of pattern recognition systems, allowing computers to learn from errors and predict outcomes.
Deep learning	Branch of machine learning that attempts to model large amounts of data using multiple processing layers.
Features of the image	Image characteristics used in computational analysis, classified into three groups: gray levels, texture, and shape.
Big data	Set of data and information that can be stored and analyzed by modern computational analysis tools-large in volume, speed, and variety.
Computer aided diagnosis/detection	Medical diagnosis/detection using the results of automated quantitative image analyses as a "second opinion".
Content based imaging retrieval	System that enables images or exams to be retrieved from information based on the pictorial content of a reference image or exam.
Artificial intelligence	Human-like intelligence displayed by machines or computer programs.
Precision medicine	Model of medicine that proposes the personalization of health care, with individualized diagnoses and treatments for each patient.
Radiomics	Massive extraction of measurable imaging data and their integration into multidisciplinary predictive models for the management of the diagnosis, treatment, and prognosis of patients.
Artificial neural network	Machine learning method based on the human central nervous system, with computational models made up of layers, each layer being composed of neurons.
Convolutional neural network	Class of artificial neural network designed to require as little preprocessing as possible..

PRINCIPLES OF COMPUTER-AIDED IMAGE ANALYSIS IN MEDICINE

Digital medical imaging is an f (x, y) function in a spatial coordinate-partitioned gray scale that can be represented by a matrix in which the intersection of each row and column identifies a single point (pixel) within an image. As depicted in Figure 1, the value of each pixel in the matrix identifies the gray level at that point (x, y) on a scale of integer values that represent black (the lowest value), white (the highest value), and shades of gray (intermediate values). With CT and MRI, images can be acquired volumetrically, in form of a volume of parallel, evenly spaced slices, so that a point in the image represents a voxel, with a “height” equal to the thickness of the slice^(15-17). The processing and analysis tools work with this matrix of numerical values that represent the image⁽¹⁸⁾.

Figure 1
Representation of the function (matrix) of a gray-scale digital image (axial slice of a chest CT).

There was a major technological revolution in radiology in the late 1990s and early 2000s, when filmless radiological environments that were fully digitized and integrated with other information systems were established within a model known as a digital hospital⁽¹⁹⁾. The foundation of filmless radiology is the picture archiving and communication system (PACS), which is a mean of receiving images in the standard digital imaging and communication in medicine (DICOM) format from the various acquisition devices (conventional radiography, ultrasound, CT, and MRI), making them available for specialists or other computer systems to access, and storing them in an organized way in large databases⁽²⁰⁾. The integration of the PACS with the clinical information systems known as hospital information systems (HIS) and radiology information systems (RIS) has also enabled the development of various CAD models^(21,22).

One of the key steps in image processing and analysis is segmentation, which often represents major challenges. The main objective of segmentation is to divide the image into parts that represent normal anatomy and those that are abnormal; to segment is to separate tissues and structures on the basis of their anatomical characteristics⁽²³⁾. In some cases, segmentation can be simplified by using shapes that are predefined (circles or rectangles) or outlined in the image, representing a region of interest (ROI) that does not necessarily encompass all of the tissue, structure, or organ. Techniques for the segmentation of images are generally based on basic properties of gray levels, discontinuity (edges), or similarity (after setting thresholds or using a region-growing algorithm), as shown in Figures 2 and 3. The segmentation process can be manual, semiautomated (the user intervenes at some point in the process), or fully automated⁽²⁴⁾.

Figure 2
Semiautomated segmentation of the lung on a CT scan of the chest with 256 gray levels and a user-defined threshold of 115 Hounsfield units: the original CT image (image on the left) is thresholded (to detect the edges) and transformed into a binary image (to separate the lungs).

Figure 3
Semiautomated segmentation, with region growing, of a neoplastic pulmonary nodule on chest CT after placement of a user-defined seed pixel (point at the center of the nodule in the first image on the left).

The process of feature extraction consists in calculating numerical values (descriptors) that represent the visual content of an image. Features are obtained by executing algorithms known as feature extractors. Feature extraction algorithms perform quantitative imaging procedures such as histogram construction, texture classification, shape recognition, and contour recognition, as well as area and volume estimates. After features have been extracted by these algorithms, the values are stored in a feature vector.

Features are basically classified into three main groups: gray level, texture, and shape. The extraction of gray-level features is the most widely used technique, which can be performed directly or by analysis of the histogram. As can be seen in Figure 4, a histogram is a description of the number of gray levels present in the image, and that calculation involves only the pixel/voxel count with the gray-scale intensities^(3,7,25). However, using only gray-level descriptors or histograms does not provide information on the spatial distribution of the content of an image, which can be determined by analyzing texture features^(24,26). In some images, regions that have similar pixels/voxels are distinguishable because of their different textures (Figure 5). Texture features have become particularly important because they can reflect the details of a lesion identified in an image^(1,2). Shape features describe the edge of the image and the geometric features extracted from the segmented object, such as its contours, junctions, curves, and polygonal regions^(2,27). Characterizing object shapes quantitatively is a complicated task because it depends on efficiency of the segmentation algorithms. Lesions seen in radiological images of the lung, for example, often have adjacent opacities or structures such as vessels and the mediastinum (Figure 5), which can lead to poor segmentation and, consequently, poorer characterization by shape features.

Figure 4
Example of the histogram of an axial CT scan of the chest with 256 gray levels. The histogram shows the distribution of pixels or voxels according to the gray levels (or Hounsfield units, if necessary).

Figure 5
Segmentation of pulmonary nodules on chest CT in two different patients, both nodules having irregular contours and being in proximity with adjacent vessels or chest wall, factors that make it difficult to segment the edges of lesions properly. In such cases, texture analysis can facilitate proper segmentation.

Selection of relevant features is another important step, given the wide range of features that can be extracted from the image. In many cases, some characteristics are irrelevant for a given analysis or data are redundant, introducing noise or inconsistencies into the feature vector⁽²⁸⁾. Therefore, it is necessary to select the most relevant characteristics according to clinical investigation class (diagnosis or outcome). Various algorithms have been created in order to reduce spatial dimensionality of the vector and can be classified into three main types: filter, wrapper, and embedded. Most algorithms use machine learning (ML) resources, and some perform feature selection by using artificial neural networks (ANNs), decision trees, and random forests⁽¹¹⁾.

IMAGE CLASSIFICATION, MACHINE LEARNING, AND DEEP LEARNING

Image classification typically involves defining the image within a pre-established category, such as normal versus pathological. One of the most widely studied areas in artificial intelligence and image classification is machine learning. Machine learning allows the identification of patterns seen in previous cases and experiments, as occurs with human intelligence⁽²⁹⁾.

Machine learning methods have been applied to classifying images acquired with various imaging modalities, using a variety of features, for various diseases, and with tools such as CAD and radiomics^(25,29,30). Developing a machine learning method involves creating a training function for a dataset (the feature vectors, in the case of image classification) and making use of logical inference. When classes (diagnoses or clinical outcomes) for final decision of the model are pre-established, the training process is supervised. When there is no defined class, the process is unsupervised. In the latter case, the algorithm is aimed at the formation of clusters of similar samples (“exams with a similar pattern”), which may or may not be related to a known condition or disease^(31,32).

One of the most traditional machine learning methods involves ANNs, which are widely used in image classification tasks^(25,29,30). These neural networks were projected with the structures of the human central nervous system as a reference⁽³³⁾ , the mathematical models being described in the form of layers, each layer consisting of N neurons. The best known type of ANN is the multilayer perceptron (MLP). Traditionally, the MLP network has an input layer (whose neurons correspond to features of the image), an output layer (whose neurons correspond to classes/outcomes), and a set of intermediate hidden layers (whose neurons correspond to fit points of the activation functions), as depicted in Figure 6.

Figure 6
Architecture of a multilayer ANN. The input layer receives the feature information. The output layer represents classes or outcomes (e.g., normal versus pathological).

One of the areas of artificial intelligence that has been gaining attention in the scientific community most recently is deep learning ⁽¹⁶⁾. Traditional machine learning methods have limitations in data processing, mainly related to the need for segmentation and development of feature extractors to represent images and serve as input for the classifiers⁽³⁴⁾. Therefore, researchers began to develop algorithms that integrated the processes of feature extraction and image classification within the ANN itself. Therefore, in deep learning technique, the need for preprocessing or segmentation is minimized. However, the method also has disadvantages, such as the need for a very large set of images (hundreds to thousands); greater dependence on exam quality and clinical data; and difficulty in identifying the logic used (“processing black box”). The most widely known method of deep learning in medicine is that involving a convolutional neural network (CNN). A CNN is basically composed of three types of layers⁽³⁵⁾: the first (convolutional layer) detects and extracts features; the second (pooling layer) selects and reduces the amount of features; and the third (fully connected layer) serves to integrate all of the features extracted by the previous layers, typically by using an MLP-like neural network to perform the final image classification, which is given by the prediction of the most likely class (Figure 7).

Figure 7
Chest CT image with a pulmonary nodule as input into a CNN for analysis using deep learning technique.

Another important step in the machine learning process is validation and performance assessment. Given a set of images, a machine learning classifier must use at least two different subsets to perform algorithm training and predictive model validation. A widely used strategy in radiology is cross validation. In cross validation, the samples are separated into N subsets^(13,36): N − 1 for training; and 1 for testing. Another strategy, which reduces the risk of model overfitting, is based on three subsets^(29,37): one for training, one for validation, and one (independent subset) for testing only. Performance is typically evaluated by calculating the accuracy, sensitivity, specificity, and area under the receiver operating characteristic (ROC) curve for the method in question. An area under the curve (AUC) closer to 1 (on a scale from 0 to 1) indicates greater the accuracy of the method (Figure 8).

Figure 8
Example of ROC curves: curve 1 represents a test with perfect performance (AUC = 1.0); curve 2 represents a test with intermediate performance (AUC = 0.75); and curve 3 represents a random test (AUC = 0.50).

Tools that employ artificial intelligence, machine learning, and deep learning can be used in different ways to analyze images. In the field of radiology and diagnostic imaging, such tools have been applied primarily in CAD, content-based image retrieval (CBIR), and radiomics/radiogenomics.

COMPUTER AIDED DETECTION

Tools of CAD were initially developed to aid in the interpretation of radiological findings and early identification of diseases, especially breast and lung cancer^(7,10).The aim of CAD is to improve the accuracy and consistency of diagnostic imaging by using suggestion of a response (“second opinion”) provided primarily by image processing, computer vision, and machine learning techniques^(1,3,38). Historically, the first CAD systems emerged in the late 1980s and were based on the processing of digitized radiography films. They were fundamentally designed to work as a second reading of exams in population-based cancer screening programs (helping detect nodules and microcalcifications on mammograms). Subsequently, similar systems were used in order to detect and classify pulmonary nodules on conventional radiographies and CT scans of the chest. More recently, these systems have been used to facilitate the diagnosis of Alzheimer’s disease in nuclear medicine exams. In these traditional CAD models^(25,29), the idea is for the second reading to be done by the computer rather than by a second radiologist (Figure 9).

Figure 9
Example of a CAD tool for detection and analysis of pulmonary nodules. The program not only indicates the presence of a right apical pulmonary nodule but also provides quantitative and three-dimensional information regarding that nodule.

With the development of artificial intelligence and new machine learning tools, auxiliary diagnostic systems have expanded greatly and have been used in many different tasks, with all medical imaging modalities. We can cite, for example, the surprising number of presentations (seminars, abstracts, and oral presentations) related to such systems at the 2018 Annual Meeting of the Radiological Society of North America, currently the largest radiology conference in the world, in terms of number of participants and number of presentations. That year, there were 237 registered events related to artificial intelligence, machine learning, or deep learning (https://rsna2018.rsna.org/program/index.cfm). Examples include the following: automated detection of pulmonary nodules, pneumonia, pneumothorax, and pleural effusion on conventional chest radiography; detection and quantification of emphysema, estimation of lung nodule malignancy risk, chance of local invasion by lung cancer, and cardiovascular risk on chest CT; and automated analysis of cardiac function on cardiac MRI. Therefore, possibilities for developing computerized auxiliary diagnostic tools have become almost unlimited^(39,40).

CONTENT-BASED IMAGE RETRIEVAL

The concept of CBIR refers to the search for images whose contents are similar to a reference case by using information derived from the images themselves, represented by their intrinsic content (feature vector), rather than associated texts (reports) or external annotations⁽⁴¹⁾. Because it has potential for clinical application, as well as for application in teaching and research, CBIR has been described as one of the most promising computational tool^(42,43). It can be a very useful tool in daily clinical practice, because it can aid radiologists in diagnostic interpretation of exams, or increase their confidence level, because it uses a decision model based on similar exams⁽²²⁾. Currently, the most common scenario is that the physician, in a case of a diagnostic uncertainty, searches the Internet via a browser or on specialized radiology sites for similar texts or cases, using keywords or using their diagnostic suspicion (e.g., Google searches for “lung nodule on chest CT” or “pulmonary hamartoma”). The use of CBIR takes the place of such strategies and is more effective, rapidly providing physicians with cases similar to that represented by the image for which they seek definition. Therefore, whereas CAD systems perform image classification tasks, generally providing a single response (lesion or no lesion, benign or malignant), CBIR systems perform image searches for similarity, providing a set of cases similar to an unknown case indicated by the physician.

RADIOMICS AND RADIOGENOMICS

The suffix -omics was first used in the field of molecular biology, to describe the detailed characterization of molecules such as DNA (genomics) and proteins (proteomics). Radiomics has been described as an extension of CAD that associates the quantitative characteristics (features) of images with patient data and clinical outcomes, not only allowing the diagnosis to be made but also providing information regarding the prognosis and treatment response^(7,25). In view of recent advances in targeted treatment and immunotherapy, particularly in the treatment of malignancies, the need for a robust approach to imaging analysis has become clear, and radiomics has the potential to provide this in a noninvasive, rapid, timely, and affordable manner⁽¹²⁾. Radiomic analysis is a process of massive extraction of features from tens to hundreds of exams, inserting these features into databases with patient clinical information, allowing them to be shared and analyzed⁽⁴⁴⁾.

The volume of health data has been growing at a rapid pace in recent years, characterizing what some authors call the “big data era” of health, and those electronic data are available in large quantities in information systems of large hospitals and other health care centers⁽⁴⁵⁾.

Given the large number of features and numerous processing possibilities, some authors have started to develop and suggest the use of a radiomic signature, in which the most significant features of different categories are chosen, analyzed, and tested with accurate protocols and reproducible algorithms⁽⁴⁶⁾.

In the medical literature, there are already many studies using radiomics in different types of imaging studies to evaluate different diseases. Most of those studies are related to oncology, such as the study of lung and kidney neoplasms on CT and positron-emission tomography/CT scans, as well as prostate cancer, breast cancer, glioma, and hepatocellular carcinoma on MRI^(7,14,36).

When the focus of radiomics is the study of correlation between radiological and genomic patterns (a set of genes), the process is known as radiogenomics⁽⁴⁷⁾. Many studies have shown that imaging features are significantly associated with patterns of gene expression and genetic mutations, demonstrating that radiogenomic analysis can identify different biological mechanisms by means of mathematical and computational devices, enabling the decoding of disease phenotypes by noninvasive methods^(48,49). Radiogenomics has also been used in studies that analyze tumor heterogeneity (i.e., the presence of multiple tissue and genetic subregions within the same tumor), which is related to disease recurrence and treatment resistance. Radiogenomics is able to quantify the spatial complexity of the tumor and identify these phenotypic/genotypic subregions⁽⁵⁰⁾ , as shown in Figure 10.

Figure 10
Quantification of the heterogeneity of a pulmonary adenocarcinoma on a CT scan of the chest by radiomic/radiogenomic evaluation. Color scale refers to a feature extracted from the image, reflecting tissue and genetic subregions of the tumor.

CONCLUSION

Radiology has undergone significant advances due to the technological revolution that is taking place in the world. First, there was the digitization of radiological environments. Then, evolution of computer vision techniques and artificial intelligence led to the development of auxiliary diagnostic systems. More recently, maturation of computational models has provided support to the clinical decision-making and prognostic prediction processes. In this paper, we have presented and discussed the main concepts related to computer-aided image analysis, including aspects of artificial intelligence applied to precision medicine.

We believe that artificial intelligence, machine learning, computer-aided diagnosis, and radiomics will change the way radiologists and other imaging specialists work and will likely, in the very near future, change the perspective that everyone in the health care field has on their work. However, some people fear that radiologists and other specialists will be completely replaced by computer algorithms. Although simple tasks and exams (e.g., the evaluation of scoliosis or bone age on conventional radiographies) might be performed and interpreted entirely by such algorithms, the role of the physician in verifying/validating the outcome, making the clinical-epidemiological correlation, and determining the best treatment regimen are unlikely to be threatened. Of course, there are also ethical and legal issues related to medical exam liability.

Artificial intelligence will certainly help “reduce the backlog” of exams; shorten the time to action in urgent cases; streamline interpretation and reporting; increase diagnostic confidence; make image analysis more objective and reproducible; offer more reliable prognostic information; assist in the teaching and learning of imaging techniques; and lead radiology definitively toward the concepts of precision medicine and multidisciplinary patient assessment. In practice, it is thought that the first change will be that the radiologists of today, who mostly use a workstation with two computer screens (one with the imaging tool, the other with the system for emitting the report and access to clinical and radiological data) will begin to work with three screens, the third being one that includes the artificial intelligence analysis. Rather than fearing what the future will bring, radiologists need to prepare, learn, and adapt, because change is inevitable.

• ERRATUM

  In the article Artificial intelligence, machine learning, computer-aided diagnosis, and radiomics: advances in imaging towards to precision medicine, DOI: http://dx.doi.org/10.1590/0100-3984.2019.0049, published in Radiologia Brasileira, 52(6):387-396, on page 387, line 7:
  where it reads:
  Marcello Henrique Nogueira Barbosa
  should read:
  Marcello Henrique Nogueira-Barbosa
  Prof. Dr. Edson Marchiori
  Editor-in-Chief of Radiologia Brasileira

REFERENCES

• ¹
  Azevedo-Marques PM, Mencattini A, Salmeri R, et al. Medical image analysis and informatics. Boca Raton, FL: CRC Press; 2017.
• ²
  Akgül CB, Rubin DL, Napel S, et al. Content-based image retrieval in radiology: current status and future directions. J Digit Imaging. 2011;24:208-22.
• ³
  Doi K. Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput Med Imaging Graph. 2007;31:198-211.
• ⁴
  Koenigkam-Santos M, Paula DW, Gompelmann D, et al. Endobronchial valves in severe emphysematous patients: CT evaluation of lung fissures completeness, treatment radiological response and quantitative emphysema analysis. Radiol Bras. 2013;46:15-22.
• ⁵
  Koenigkam-Santos M, Cruvinel DL, Menezes MB, et al. Quantitative computed tomography analysis of the airways in patients with cystic fibrosis using automated software: correlation with spirometry in the evaluation of severity. Radiol Bras. 2016;49:351-7.
• ⁶
  Wada DT, Pádua AI, Lima Filho MO, et al. Use of computed tomography and automated software for quantitative analysis of the vasculature of patients with pulmonary hypertension. Radiol Bras. 2017;50:351-8.
• ⁷
  Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, they are data. Radiology. 2016;278:563-77.
• ⁸
  Koenigkam Santos M, Muley T, Warth A, et al. Morphological computed tomography features of surgically resectable pulmonary squamous cell carcinomas: impact on prognosis and comparison with adenocarcinomas. Eur J Radiol. 2014;83:1275-81.
• ⁹
  Cooper WA, O'Toole S, Boyer M, et al. What's new in non-small cell lung cancer for pathologists: the importance of accurate subtyping, EGFR mutations and ALK rearrangements. Pathology. 2011;43:103-15.
• ¹⁰
  Aerts HJWL. The potential of radiomic-based phenotyping in precision medicine: a review. JAMA Oncol. 2016;2:1636-42.
• ¹¹
  Constanzo J, Wei L, Tseng HH, et al. Radiomics in precision medicine for lung cancer. Transl Lung Cancer Res. 2017;6:635-47.
• ¹²
  Giardino A, Gupta S, Olson E, et al. Role of imaging in the era of precision medicine. Acad Radiol. 2017;24:639-49.
• ¹³
  Aerts HJWL, Grossmann P, Tan Y, et al. Defining a radiomic response phenotype: a pilot study using targeted therapy in NSCLC. Sci Rep. 2016;6:33860.
• ¹⁴
  Keek SA, Leijenaar RT, Jochems A, et al. A review on radiomics and the future of theranostics for patient selection in precision medicine. Br J Radiol. 2018;91:20170926.
• ¹⁵
  MacMahon H, Naidich DP, Goo JM, et al. Guidelines for management of incidental pulmonary nodules detected on CT images: from the Fleischner Society 2017. Radiology. 2017;284:228-43.
• ¹⁶
  Bartholmai BJ, Koo CW, Johnson GB, et al. Pulmonary nodule characterization, including computer analysis and quantitative features. J Thorac Imaging. 2015;30:139-56.
• ¹⁷
  Truong MT, Ko JP, Rossi SE, et al. Update in the evaluation of the solitary pulmonary nodule. Radiographics. 2014;34:1658-79.
• ¹⁸
  Bushberg JT, Seibert JA, Leidholdt EM Jr, et al. The essential physics of medical imaging. 3rd ed. Philadelphia, PA: Lippincott Williams & Wilkins; 2012.
• ¹⁹
  Pavlopoulos SA, Delopoulos AN. Designing and implementing the transition to a fully digital hospital. IEEE Trans Inf Technol Biomed. 1999;3:6-19.
• ²⁰
  Ponciano-Silva M, Bugatti PH, Reis RM, et al. A differential method for representing spinal MRI for perceptual-CBIR. In: Ruiz-Shulcloper J, Sanniti di Baja, editors. Progress in pattern recognition, image analysis, computer vision, and applications. CIARP 2013. Berlin, Heidelberg: Springer-Verlag; 2013. p. 464-71.
• ²¹
  Traina AJM, Bedo MVN, Santos LFD, et al. Making content-based medical image retrieval systems worth for computer-aided diagnosis: from theory to application. In: Azevedo-Marques PM, Mencattini A, Salmeri M, et al., editors. Medical image analysis and informatics computer-aided diagnosis and therapy. Boca Raton, FL: CRC Press; 2017. p. 24.
• ²²
  Ponciano-Silva M, Souza JP, Bugatti PH, et al. Does a CBIR system really impact decisions of physicians in a clinical environment? In: Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems. IEEE; 2013. p. 41-6.
• ²³
  Sonka M, Hlavac V, Boyle R. Image processing, analysis and machine vision. Boston, MA: Springer; 1993.
• ²⁴
  Gonzalez RC, Woods RE. Digital image processing. Upper Saddle River, NJ: Prentice Hall; 2007.
• ²⁵
  Giger ML. Machine learning in medical imaging. J Am Coll Radiol. 2018;15(3 Pt B):512-20.
• ²⁶
  Parker JR. Algorithms for image processing and computer vision. 2nd ed. Indianapolis, IN: Wiley; 2011.
• ²⁷
  Echegaray S, Gevaert O, Shah R, et al. Core samples for radiomics features that are insensitive to tumor segmentation: method and pilot study using CT images of hepatocellular carcinoma. J Med Imaging (Bellingham). 2015;2:041011.
• ²⁸
  Frighetto-Pereira L, Rangayyan RM, Metzner GA, et al. Shape, texture and statistical features for classification of benign and malignant vertebral compression fractures in magnetic resonance images. Comput Biol Med. 2016;73:147-56.
• ²⁹
  Erickson BJ, Korfiatis P, Akkus Z, et al. Machine learning for medical imaging. Radiographics. 2017;37:505-15.
• ³⁰
  Choy G, Khalilzadeh O, Michalski M, et al. Current applications and future impact of machine learning in radiology. Radiology. 2018;288:318-28.
• ³¹
  Leger S, Zwanenburg A, Pilz K, et al. A comparative study of machine learning methods for time-to-event survival data for radiomics risk modelling. Sci Rep. 2017;7:13206.
• ³²
  Parmar C, Grossmann P, Bussink J, et al. Machine learning methods for quantitative radiomic biomarkers. Sci Rep. 2015;5:13087.
• ³³
  Haykin S. Neural networks: a comprehensive foundation. Upper Saddle River, NJ: Prentice Hall; 1994.
• ³⁴
  LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521: 436-44.
• ³⁵
  Soffer S, Ben-Cohen A, Shimon O, et al. Convolutional neural networks for radiologic images: a radiologist's guide. Radiology. 2019;290: 590-606.
• ³⁶
  Lambin P, Leijenaar RTH, Deist TM, et al. Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol. 2017;14:749-62.
• ³⁷
  Lee JG, Jun S, Cho YW, et al. Deep learning in medical imaging: general overview. Korean J Radiol. 2017;18:570-84.
• ³⁸
  Ferreira JR Jr, Azevedo-Marques PM, Oliveira MC. Selecting relevant 3D image features of margin sharpness and texture for lung nodule retrieval. Int J Comput Assist Radiol Surg. 2017;12:509-17.
• ³⁹
  Nam JG, Park S, Hwang EJ, et al. Development and validation of deep learning-based automatic detection algorithm for malignant pulmonary nodules on chest radiographs. Radiology. 2019;290: 218-28.
• ⁴⁰
  Tao Q, Yan W, Wang Y, et al. Deep learning-based method for fully automatic quantification of left ventricle function from cine MR images: a multivendor, multicenter study. Radiology. 2019;290:81-8.
• ⁴¹
  Souza JP. Modelo de qualidade para o desenvolvimento e avaliação da viabilidade clínica de sistemas de recuperação de imagens médicas baseadas em conteúdo (Tese). São Carlos, SP: Universidade de São Paulo; 2012. [cited 2019 April 1]. Available from: www.teses.usp.br/teses/disponiveis/82/82131/tde-15022013-142541/pt-br.psp
  » www.teses.usp.br/teses/disponiveis/82/82131/tde-15022013-142541/pt-br.psp
• ⁴²
  Ferreira Junior JR, Oliveira MC. Evaluating margin sharpness analysis on similar pulmonary nodule retrieval. In: 2015 IEEE 28th International Symposium on Computer-Based Medical Systems. IEEE; 2015. p. 60-5.
• ⁴³
  Bugatti PH, Kaster DS, Ponciano-Silva M, et al. PRoSPer: perceptual similarity queries in medical CBIR systems through user profiles. Comput Biol Med. 2014;45:8-19.
• ⁴⁴
  Larue RTHM, Defraene G, De Ruysscher D, et al. Quantitative radiomics studies for tissue characterization: a review of technology and methodological procedures. Br J Radiol. 2017;90:20160665.
• ⁴⁵
  Filonenko E, Seeram E. Big data: the next era of informatics and data science in medical imaging - a literature review. J Clin Exp Radiol. 2018;1(1).
• ⁴⁶
  Coroller TP, Grossmann P, Hou Y, et al. CT-based radiomic signature predicts distant metastasis in lung adenocarcinoma. Radiother Oncol. 2015;114:345-50.
• ⁴⁷
  Thawani R, McLane M, Beig N, et al. Radiomics and radiogenomics in lung cancer: a review for the clinician. Lung Cancer. 2018;115:34-41.
• ⁴⁸
  Gevaert O, Echegaray S, Khuong A, et al. Predictive radiogenomics modeling of EGFR mutation status in lung cancer. Sci Rep. 2017;7:41674.
• ⁴⁹
  Aerts HJWL, Velazquez ER, Leijenaar RTH, et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. 2014;5:4006.
• ⁵⁰
  Lee G, Lee HY, Park H, et al. Radiomics and its emerging role in lung cancer research, imaging biomarkers and clinical management: state of the art. Eur J Radiol. 2017;86:297-307.

Publication Dates

• Publication in this collection
  23 Sept 2019
• Date of issue
  Nov-Dec 2019

History

• Received
  29 Mar 2019
• Accepted
  15 Apr 2019