- Open Access
- Total Downloads : 14
- Authors : Roshan P Mathews , Dr. Greeta Mathews
- Paper ID : IJERTV8IS060243
- Volume & Issue : Volume 08, Issue 06 (June 2019)
- Published (First Online): 11-06-2019
- ISSN (Online) : 2278-0181
- Publisher Name : IJERT
- License: This work is licensed under a Creative Commons Attribution 4.0 International License
CAD in Medical Imaging: A Review of Current Trends and Future Directions
Roshan P Mathews
Student, Dept of Electrical Engg, IIT Palakkad, Kerala -678 623, India
Dr. Greeta Mathews
Asst Professor, Dept of Radiology, Dr BR Ambedkar
Medical college, Bangalore -560 045, India
Abstract: Computer Aided Detection (CAD) is a valuable technique for precisely interpreting medical images and it has a global business opportunity of about USD 1.8 billion. The current aspects with reference to the four sub stages such as image pre-processing, segmentation, feature extraction and classification and the future scope of CAD in medical imaging has been discussed in this paper. Many reviewers have emphasized the need for synergy between engineers and medical professionals for successful development of CAD systems and the current work is a move in that direction. The engineering aspects of the above four stages in four imaging modalities viz. computed tomography, magnetic resonance imaging, mammography and bone scintigraphy used in the diagnosis of five critical diseases have been discussed with a clinical background. Automatic classification of image can play an important role in preliminary screening of very critical ailments bringing down the cost of health care. Another recent advancement is using artificial intelligence and machine learning techniques. This paper reviews these engineering aspects with a view to explore the opportunities to researchers as well as the medical industry to offer affordable medical services with accessibility in even remote locations
Key Words: Computer Aided Detection (CAD), medical image processing, segmentation, feature extraction, classification
1. INTRODUCTION
The discipline of medical imaging has grown as an indispensible tool in identifying and recording the implicit conditions of the human body mostly in a non invasive manner. Computer aided detection (CAD) attempts to utilize the advancements in computational science to assist medical professionals in interpreting images leading to faster and effective diagnosis and are helpful in identifying anomalies that are sometimes difficult to notice [1 – 8]. Computer aided medical image analysis and identification of the abnormality involves a series of engineering activities e.g. image processing, pattern recognition etc. Different CAD systems handle different types of medical problems and varied types of data and images[917]. Hence any direct comparison based on a few parameters within the engineering domain may not be accurate. Joint project teams consisting of engineers and radiologists are the need of the hour to collaboratively develop systems that are useful in a clinical setup. In this study review of the following engineering aspects of CAD for a few common critical ailments has been done
-
Image pre-processing: This step aims to improve the image quality by denoising, enhancing edges and other features.
-
Segmentation: In this step the image is partitioned to select the structures of interest.
-
Feature extraction: In the third step characteristic features of the segmented image is extracted for the next step.
-
Classification: Based on the extracted features the segmented objects are assigned to specific classes.
This paper is concerned about the engineering aspects in four imaging modalities viz. computed tomography (CT), magnetic resonance image (MRI), mammography and scintigraphy used in the diagnosis of lung cancer, intra cranial aneurysms, breast cancer, prostate cancer and bone metastasis. In addition to the review of the research, extensive discussions were held with domain experts, both engineers and radiologists, on the following broad research question:- what are the recent trends especially in the engineering aspects of CAD systems and the computational techniques involved in the detection of a few of the most common cancers (lung, breast and prostate) and its bone metastasis and another critical pathology viz. intra cranial aneurysms. It is well known that in medical science, due to inherent heterogeneities in ailments and patients a uniform procedure cant be applied to all scenarios. An attempt has been made in this paper to comprehend current trends and future directions from a myriad techniques used in CAD systems. The review and discussions are based on the selected papers from Science Direct, PubMed, MEDLINE, NCBI data base, IEEE Xplore Digital Library etc. Recent studies were used for assessing the future trends in CAD.
-
DIAGNOSTIC MODALITIES
Many research papers are available on CAD for various ailments such as cancer, vascular abnormalities like aneurysms (which if ruptures could be catastrophic), osteoporosis (weakened bone) with increased risk of fractures etc which can cause mortality or morbidity. Review papers in this area [2, 24, 59] indicate that the main focus of CAD research has been on lung [19], breast [20] and colon [21] cancer (though other organs like brain [22], liver [13], skeletal system [23], skin [9], cell features in hematological malignancies [10] etc. are also a subject of study in CAD research). As each of these aliments are separate medical specialties and beyond the scope of the current work, a few specific cases as shown in Table 1 are taken up and a brief description of the modalities is given below. Detailed discussions on the computer aided
detection of these diseases will be taken up separately in section IV.
Table 1. Diseases and Diagnostic modalities considered
Disease
Imaging Modality
Lung Cancer
CT
Intra Cranial Aneurysms
MRI
Breast Cancer
Mammogram
Prostate Cancer
MRI
Bone Metastasis
Bone Scan
-
Computed Tomography (CT)
CT scans very simply use an X-ray source that sends x- rays through the patient and the emerging beam, that is attenuated by different structures differently, is detected by detectors on the opposite side and the X- ray source and detector(array) move around the patient during the scan. The 4th generation scanners are rotate-stationary where the X-ray source moves around the patient with a stationary complete circle of detector array outer to the X-ray source. CT is an imaging modality that enables the clinician to non-invasively visualize the pathology within the patient. The CT scanner obtains images in the axial plane and the computer can use the data to generate sagittal and coronal and also 3 dimensional (3D) reconstructions. CT machines are generally designated by the number of slices it can obtain in one gantry rotation e.g 16 slice / 64 slice /128 slice CT etc, which means that the particular machine is capable of acquiring that many images per gantry rotation. The CT scanners of today, with an array of multiple detectors, also acquire data from a volume of the patient (spiral CT) rather than sequential axial images (this can also still be taken for specific indications) and this allows very short scan times, procedures like angiography to be done (long scan times would lead to loss of data due to contrast wash out from the vascular system) and information can be reconstructed in very thin slices.
-
Magnetic Resonance Imaging (MRI)
MRI is an imaging technique which is not based on X- rays or other ionizing radiations but uses magnetic field, radio frequency (RF) pulses and magnetic encoding gradients. This technoloy utilizes the spin of hydrogen ions (protons) present abundantly in the body. The strong external magnetic field produces longitudinal magnetization, pulses of radio waves cause transverse magnetization which precesses generating current which is received as a signal by the coil, and encoding gradients localize the signal within the patient. By varying the time interval between the RF pulses and the time after the pulse that the signals received are read, tissues will show different intensities (and therefore contrast in the image) depending on their longitudinal (T1) and transverse (T2) relaxation times.
-
Mammography
This technique uses X-rays of low-energy (to increase inherent contrast and enhance detail within the breast tissue and for better visualization of micro-calcifications some patterns of which raise high suspicion for malignancy) for screening of the breast and diagnosis of breast pathology. Screening mammography programs aim for the early
detection of breast cancer as earlier detection improves prognosis. Patterns suggestive of malignancy on mammograms are a) mass with ill-defined or spiculated margins b) pleomorphic or linear branching microcalcifications in a cluster or with regional/ segmental distribution c) asymmetric density d) architectural distortion. The mammogram result is usually expressed as a BI-RADS (Breast Imaging Reporting And Data System) Category which ranges from 0 to 6, 0 denoting incomplete & needs further evaluation / comparison with previous studies, grade 1 denotes no abnormality detected, grade 2 is benign findings, for grade 3 follow up is needed, grade 4 is suspicious lesion needing FNAC/ biopsy, grade 5 is highly suspicious for malignancy with suggested biopsy and grade 6 denotes biopsy proven malignancy.
A few other modalities can also be used for breast imaging. For example, ultrasound is particularly useful in young patients with dense breast tissue. It is also used for further assessment of a palpable abnormality not seen on mammogram. Characterization of a lesion seen on mammogram especially to determine its solid or cystic nature is yet another area where ultrasound can be used for breast imaging. Another modality is MRI, particularly suitable for young patients with BRCA mutations who have dense breasts and higher chances of breast cancer in a younger age. MRI also finds use in suspected multicentric cancer and invasive lobular cancer or extensive Ductal Carcinoma In-situ (DCIS) (as the extent may be underestimated on ultrasound and mammograms and there is higher chance of bilateral disease). Ductography is used to rule out small intra ductal lesions like papillomas in cases presenting with nipple discharge and no abnormality detected with other modalities. As a recent trend, Positron Emission Mammography has been approved for assessment of breast.
-
Scintigraphy
A bone scan or bone scintigraphy is a bone imaging technique using nuclear medicine. It helps to diagnose pathologies like bone metastasis, fractures (subtle / stress fractures that may not be detected by traditional X-ray images), bone infection and show diffuse changes in metabolic bone disease. It uses small amounts of radioactive materials (most commonly technetium 99m phosphate labeled leucocytes) called radiotracers injected intravenously. The tracer tends to collect more where there is greater bone turnover (breakdown /repair). The radiotracer gives off gamma rays which are detected by a special gamma camera and the data is analyzed by the computer to generate images of the uptake. The areas of increased uptake are called hot spots and they show up on the scan as darker than other areas of bone.
-
-
ENGINEERING ASPECTS OF DETECTION The discussion on core engineering portion of CAD
systems is taken up in this section with the help of a typical flow chart shown in Figure 1. In this scheme four major steps are involved in the detection of ailments. The pre- processing stage involves cropping, noise removal etc. with a view to reducing the noise and improving the image for
further processing [18, 25]. It is followed by image enhancement in terms of improvement of contrast, edges, separating objects from the background etc. Further segmentation is done to clearly identify the region of interest of study followed by feature extraction. The final stage of the process is classification.
Though the above representation gives an overall idea of the sequence of activities, each of these stages employ various techniques in real life applications [26-28]. A brief discussion of each of these stages is given below:
Image Preprocessing
(remove noise and other artifacts and enhance the image quality)
Image Preprocessing
(remove noise and other artifacts and enhance the image quality)
Segmentation
(partition the image in order to isolate the organs or regions of interest)
Segmentation
(partition the image in order to isolate the organs or regions of interest)
Feature Extraction
(extracting the features from segmented region)
Feature Extraction
(extracting the features from segmented region)
Classification
(Objects are assigned to specific classes)
Classification
(Objects are assigned to specific classes)
Fig 1 Typical flow chart of a CAD System
-
Image Preprocessing
Pre-processing in medical imaging generally refers to a set of image manipulations to improve its quality and hence ease of detection of ailments. This objective is achieved by applying suitable transformations or mathematical operations on the captured image [18,19, 29]. In the clinical setup, noise can mix with the image during its capture or transmission owing to a variety of reasons. Ensuring the best quality images is a basic necessity for developing CAD systems for medical application with high detection capability. A brief discussion on image quality improvement techniques such as reduction of artifacts, denoising and image sharpening are taken up next.
-
Image Artifacts Reduction
Metallic implants appear as dark and bright streaks in CT and these artifacts spoil the quality of the image. To improve the image, artifact reduction methods are available in the latest CT machines. The algorithms for metal artifact reduction essentially recreate the original image in place of the corrupted ones using interpolation function from neighbouring uncorrupted areas. Another way for metal artifact reduction is using dual-energy CT where data is captured at two different energy spectra thereby reducing the effects of beam hardening. Advantage with artifact reduction algorithms is that it can be done after image acquisition.
-
Image Noise Reduction
Image intensity disturbances of a random nature and coarse grains unintentionally get added during image capture or transmission. Impulse noise, additive noise,
multiplicative noise etc are some common types of noise encountered in medical images. These noises misrepresent the true pixel values of the image and make it difficult to interpret the actual scenario intended for study. Hence denoising algorithms are applied to improve the image. Typically such algorithms smooth the image at overall level except the areas near boundaries of differential contrast.
-
Image Sharpening
The contrast at the edges of the features of interest plays a major role in image sharpness. It can be improved by using algorithms that increase edge contrast. There are many image processing techniques reported in the literature [52 – 55]. For example, sharpening filter is typically used in mammogram in order to maximize the contrast between the mass and the local background. Use of fuzzy histogram hyperbolization algorithm as a filter is reported to have provided better contrast[53].
From the literature, we can identify a few groups of preprocessing techniques. First one is denoising using different filters viz. mean filters, media filters [30, 31], wiener filtering [32], Gaussian filter [33], bilateral filtering
[34] etc. Some researchers combined median filters with Laplacian filters [36, 37]. The second group is enhancing the edges of image structures. This includes various sharpening techniques including wavelet transform and others. Another trend is focusing on enhancing image contrast that includes techniques like histogram equalization. Another area is enhancement of 3D images. An example is the filters developed on the basis of eigen values of the Hessian matrix [38, 39]. Similar approach was reported by Frangi et al. [40] for enhancement of vessels in the image. The choice of preprocessing method is dependent on many factors including the quality of the image captured and requirement of the intended application. From the foregoing discussion we can infer that image processing techniques are very important in the development of CAD systems. The effectiveness of the subsequent stages and eventually the accuracy of detection is dependent on the quality of the images used. This is even true for manual applications where radiologists are reading the images and making the diagnosis. -
-
Segmentation
Segmentation for different organs/structures in the image and matching with the anatomic data bank is the vital part of CAD. Basically in an automated process, algorithms are to be developed for identifying the edges or boundaries of the anatomical structures or organs. Unless the programme can recognize the objects of interest in an image, it is impossible to make an automated mining and retrieval of the required information from the image archives. One important challenge is decoding the image scans with missing edges or insufficient textural contrast between adjacent regions differentiating organs or body structures. Researchers [19,23,39] have studied such issues in segmentation and a few feasible techniques have been suggested. Compactness analysis, localization based on
form, size, location with reference to near by structures or organs, identification based on the gray level with reference to the border of certain areas of interest etc. are some of the techniques used to segment medical images. In general, segmentation models could be viewed as deformable models and machine learning based models which classify according to certain classification approach [23, 24]. It can be further classified as supervised models or unsupervised models. Another approach is to use automatic seed selection and segmentation by region growing method.
In the context of Lung cancer detection research, Mahersia et al [19] gives a detailed account on the segmentation approaches. The CT image after the pre- processing stage is partitioned into different regions so that the pixels or voxels representing the lung tissues can be identified from the surrounding anatomical structures. 2 dimensional (2D) studies and 3 dimensional (3D) studies are becoming the main sections of image segmentation exercise [35, 39]. The 2D and 3D approaches as detailed by Mahersia et al [19] are shown in Figure 2 and Figure 3 respectively.
Fig 2 2D Segmentation method for Lung CT
Fig 3 3D Based Segmentation methods
The region of interest (ROI) denotes a specified area selected in the image for further quantitative analysis and extraction of the distinguishing features. The predefined areas in the image can be delineated based on certain criteria such as individual pixel value or average pixel value. The region of interest can be manually drawn to denote the geometrical shape of the organ of interest or it can be done in an automatic manner during segmentation by specifying the shape of the organ of interest or the anatomical structure we are concerned about.
-
Feature extraction, Classification & Clustering
The features that are to be extracted from a segmented image are dependent on the case under investigation. Characteristic features of lung nodule on CT are totally different from features of interest we are looking for in intra cranial aneurysms on brain MRI. Given the
characteristic features of a case under investigation, the important element of the detection kernel is the classification algorithm that work based on the key features extracted from the regions of interest. There are classifier algorithms available for grey scale images and colour images. Other properties of these images like texture can be another means of achieving classification. Location can be another basis of classification of images. For example, in lung cancer detection, lung nodules, if they exist, are to be extracted from the location of interest. For detection of anomalies leading to ailments like lung cancer, classification and clustering are the commonly used CAD technique. This is generally accomplished using techniques such as K-nearest neighbour, Fuzzy and neural network, linear discriminant analysis, support vector machines etc as shown in Figure 4
Fig 4 Important methods for Lung Nodule detection [19]
Another well known classification techniques is based on neural network, either in a supervised mode or unsupervised mode. Yet another promising approach is based on data mining schemes. Several related techniques employing statistical tools, visualization techniques, data and knowledge extraction frameworks etc can be clubbed with the data mining schemes. The artificial intelligence and machine learning techniques have tremendous potential in revolutionizing the CAD prospects in medical imaging field [25, 37, 43-47].
-
-
CAD ANALYSIS OF DIFFERENT CONDITIONS Five critical and most common ailments viz., lung
cancer, intra cranial aneurysms, breast cancer, prostate cancer & metastatic bone cancer are selected for review and discussion on aspects of CAD systems. In addition, specific detectability issues of each ailment / modality is discussed from a clinical perspective.
-
Lung cancer.
CAD with chest radiographs and CT scan is used for detection of lung nodules that may be either (a) malignant (primary or metastatic) or (b) benign. In a clinical set up, some nodules may be missed even on CT scans because of their location ie., within airways, adjacent to vessels, extreme periphery of lungs, small in size, faint or inhomogeneous internal architecture or being located adjacent to other lung abnormalities such as fibrosis or pneumonia etc. A typical CT image of lung nodule is shown in Figure 5.
-
(b)
Fig 5 Typical CT images showing the difference between (a) Normal Lung (left) and (b) Lung Nodules
CAD systems perform a very useful role in preliminary screening for detection of lung nodules in CT scans where a large number of studies used to be normal with only a few cases being positive. CT scans generate a large volume of images and computers being able to process large volumes of information in a small time would be able to assist the radiologist in reading of the images quicker by highlighting abnormalities and with the effect of a double reading of the study. During a study on detection of lung cancers, Armato et al. [41] reported that CAD system could detect 84 percent of the 38 missed cases. Also, when CT scan follow up of indeterminate lesions is done, computer analysis can reduce the time taken to compare the change, if any, in the nodules in terms of size, internal characteristics etc, particularly when the nodules are multiple. Computer can automatically tack the changes in size and complexity of a particular nodule in the corresponding CT sections.
CAD systems are also used for differential diagnosis of lung nodules as benign and malignant eg. Systems that integrate CT and positron emission tomography (PET) studies can help in characterization. Incorporating features such as margin characteristics, peak enhancement, internal architecture etc. into CAD techniques can help in characterization. With progress in related areas of technology, picture archiving and communication system (PACS) have become popular in clinical imaging service and data management which helps in easy retrieval of cases for comparison by CAD and also matching cases with similar lesions for machine learning.
-
CAD Techniques for Lung Cancer:
Lung cancer detection schemes using different approaches of image processing and machine learning have been studied by many researchers and a prominent model is suggested by Aggarwal et.al [42]. In the particular model, multiple parameters such as geometrical features, statistical parameters and the gray levels are extracted to decide the distinction between nodules and normal lung structure. This model uses optimal thresholding algorithm for segmentation and linear discriminant analysis for classification. Under this setup the model is reported to have achieved accuracy of 84% with sensitivity of the order of 97% and specificity 53%. Another CAD system model using convolution neural network as classifier to detect the lung cancer reported in 2016 by Jin et. al [43] obtained similar levels of accuracy (84.6% ) but sensitivity was much less at 82.5%. But specificity of 86.7% was much
better than that of the model suggested by Aggarwal et.al [42]. Higher detection accuracy of 90.7% was reported by another model [44] with median filter for pre processing stage and K-mean unsupervised learning algorithm for clustering. Further accurate model (accuracy of 94.12%) using fuzzy interference system trained with extracted features like area, mean, entropy, correlation, length of major axis and minor axis has been reported by Roy et.al [45]. This model is reported to have used image contrast enhancement with gray transformation also. Another model developed by Ignatious and Joseph [46] used Gabor filter in pre-processing and watershed segmentation. Using the neural fuzzy model and region growing method the model achieved a nodule detection capability of about 90% accuracy. However the models suffered from the serious limitation that they cannot classify the detected lung nodule as a benign or a malignant nodule.
One of the major achievements in CAD system for lung cancer detection was the model proposed Gonzalez and Ponomaryvo [47] that could distinguish between benign and malignant nodules. This model uses Gabor filter in image pre-processing and marker controlled watershed method for segmentation. The region of interest is identified by the model using the priori information and the Hounsfield Unit (HU). It uses multiple characteristics such as area, perimeter, and eccentricity of the cancer nodules. For training the support vector machine in order to identify whether the given nodule is benign or malignant, a variety of characteristic features like area, circularity, eccentricity, fractal dimension etc. and key textural features such as mean, variance, skewness, energy, entropy, contrast etc. are used in the model. Even though this model [47] can classify cancer as benign or malignant, the need for prior information is a limitation. The model has been further refined by Suren Makaju et al [48] and the schematic view of the detection process using support vector machine is shown in Figure 6 below.
Fig 6 Lung Cancer Detection scheme [48]
-
Specific aspects of CAD Detectability of Lung Nodules As discussed above, detectability being the main issue, a few aspects that affect the detectability of lung nodule are discussed below. Considering these factors would help to
design robust CAD systems.
Size of lung nodules
Size of the lung nodule is an important factor and the CAD systems are typically designed to detect lung nodules in a specific range of diameters. For example, in screening for lung cancer, the system may be designed to detect nodules greater than or equal to 5mm and upto 20mm as larger nodules are easily detected by the radiologist and smaller nodules may not be significant for malignancy in a screening setting. This approach ensures in reducing the false-positive rate. However for a patient with a known malignancy, even a nodule smaller than 5mm is also significant. Therefore, it is a point for improvement that the target range (say 5-20mm) should be adjusted according to the program and the flexibility to keep surveillance at smaller size nodules to be built within the CAD system.
Non-solid or partly solid nodules
Another issue for automatic detection is the type of nodule such as a solid nodule, a partly solid nodule, or as a non-solid (ground glass) nodule as it appears on CT. It has been observed that these types of non-solid or partly solid nodules may be early forms indications or precursors of a particular type of cancer called as adenocarcinoma. It is a possibility that these nodules may often go undetected while screening CT with CAD as most of the computer detection programmes are aimed at detecting solid nodules. Therefore, developing a robust CAD system for detection of non solid nodules is another important area of improvement.
High false positives
In a screening setting, only a small proportion of nodules will be malignant while most are benign. To overcome this high false positive rate for lung cancer (which has undesirable effects of repeated follow ups of patient or invasive procedures like biopsies for benign lesions), the CAD system may consider other methods such as nodule characterization (margins, enhancement peak, internal characteristics etc) as an auxiliary confirmation mechanism to be incorporated into the current schemes. Reasons for false positives may be bronchovascular structure, fibrotic scar, pleural thickening and other causes such as subtle respiratory/ cardiac motion artifacts.
Co-existing lung disease
Underlying disease like pneumonia, fibrosis may cause CAD systems to not register adjacent / contiguous nodules.
-
-
-
CAD with MRA for Intra Cranial Aneurysms
Rupture of intra cranial aneurysms leading to hemorrhage is a very critical situation for the patient and a noninvasive test called Magnetic Resonance Angiogram (MRA) can help in studying the blood vessels in the head and neck and pre-empt a very dangerous situation. In clinical practice, MRA often acts as a complementary procedure to MRI scan. Magnetic resonance angiography with computer aided detection (CAD) of intra cranial aneurysms reduces the time taken by radiologists in reading a study and improves the detection rates. A number of recent studies have shown that 3T MRI scanners were quite
accurate for detection of even small (<5mm) intra cranial aneurysms. Figure 7 shows the typical images showing the normal Circle of Willis (left) and aneurysm.
-
(b)
Fig 7 Typical MIP images showing the (a) normal Circle of Willis
(left) and (b) aneurysm
MRA exhibits less sensitivity in the presence of overlapping vessels. The overlapping vessels often result in obscuring small aneurysms on maximum intensity projection (MIP) images and hence lead to failure of detection by radiologists. For achieving good sensitivity for detection it is recommended to assess both source and reconstructed images even at the cost of extra time spent. However, CAD systems can significantly reduce the time to read the study by highlighting abnormalities based on the parameters provided and a study by S. Miki et al. [49] found that in many cases post review of CAD results, the radiologists had revised and updated their prior negative diagnosis to a positive confirmation. This was reported to have happened many times and the CAD diagnosis was found be correct to the extent of 92% and in the balance 8% case studies aneurysms found by the first radiologist with the help of CAD system had been negated after consultation with other specialists. This study [49] made it amply clear that CAD system was helpful for the detection of initially missed aneurysms than introducing false positives.
-
CAD Methodologies for Intra Cranial Aneurysms MRA based computerized scheme for detection of intracranial aneurysms was developed by Arimura et al.[50]. At the image processing stage it uses a selective, multi-scale enhancement filter. The classification is based on linear discriminant analysis classifier. 207 cases of aneurysm images taken from three different types of MR equipment were used to evaluate the CAD model performance. The results were reported as having 96% sensitivity with 3.2 false positives per patient for detecting intracranial aneurysms in the range of 1 mm to 23 mm in
size.
Another improved CAD system was reported by S. Miki et al. [49] in 2016 with a provision to display top 3 likely lesion in the order of their likelihood. In another development Yang et al.[51] presented a fully automated CAD that detects aneurysms on 3D time-of-flight MRA images. This system adopts automatic segmentation of intracranial arteries and locates the points of interest from the segmented vessels. It can also identify points of interest
directly from the raw, (unsegmented) dataset. Regarding the performance of this CAD, it was reported that for a given operating point, overall sensitivity was 80% with three mean false positives per case. The sensitivity was 71% for aneurysms less than 5 mm size at the above test point. At another operating point the system achieved 95% overall sensitivity and sensitivity of 91% for aneurysms less than 5 mm, with nine mean false positives per case. The evaluation was based on 287 standard reference datasets which contained 147 aneurysms.
-
Detectability aspects of intra cranial aneurysms
From the practical point of view, the poor detection rates for cerebral aneurysms could be due to the following factors:
Size Effect: Size is an important parameter affecting detectability of aneurysms and small (<5mm) or very small (<3 mm) aneurysms are difficult to get detected on maximum- intensity- projection images. There are reports that sensitivity drops to the level of 50% even for the experienced radiologists checking with standard datasets for detecting small aneurysms less than 5mm. Further, it was also reported that detectability is limited in the case of time-of-flight-MRA. The reason could be low signal intensity within the aneurysm due to slow flow. CAD has lot of potential for advancement in this area.
Lack of 3T MR imaging systems: Aneurysms can show variability in signal intensities on MR images. This is very likely when using a lower strength MR imaging system. The typical source of errors could be flow-related enhancement causing high signal on T1-weighted image, turbulence and extensive wall calcification causing signal void and blood clots of different ages causing heterogeneous signal intensities.
Lack of optimal MR angiography imaging parameters: Specialized post processing techniques, including volume rendering and a single-artery highlighting approach, may improve the detection of small cerebral aneurysms. Also, detection of aneurysms and reducing false positives is improved by analysing the images on a work station with ability to see the images from different views rather than static MIP images.
Other Aspects: In addition, small aneurysms may be missed on maximum intensity projection images, and false- positive diagnoses may occur as a result of vessel looping/ tortuosity, vessel overlap, atherosclerotic plaques, turbulent flow. According to studies, the site of the aneurysm was also a major factor that influenced its detection or lead to false positives.
-
-
-
Mammography for Detection of Breast Cancer
The role of CAD is in improving the sensitivity by helping doctors to detect suspicious lesions as it decreases the likelihood of the radiologist making false negative diagnosis. Hence in clinical practice CAD performs the role of the second reader. The advent of CAD for clinical
practice was in 1985 when it was introduced in the University of Chicago. Later on in 1998, after completing all the required trials and tests, United States Food and Drug Administration (FDA) approved the CAD system in screening mammography. Subsequently many CAD systems came in to existence for clinical applications [68]. On mammograms, breast cancer may be seen as any of these conditions viz (a) mass, (b) microcalcification, (c) architectural distortion or (d) focal asymmetry. The computer detects these abnormalities and reports the results. The overall sensitivity of CAD was reported to be 91 % (139 of 152 cases) in the clinical study by Murakami et al.[52]. In their study, CAD detected all the 47 cases (ie.,100 %) of cancers manifested as microcalcifications and all the 15 (ie.,100 %) that appeared as masses with microcalcifications. The detection rate of 98 % (62/63) was reported for non-calcified masses. Further, the study reported that 75 % (12/16) of the cases appeared as architectural distortions and 69 % (18/26) cases as focal asymmetry.
Cancers like invasive lobular cancers (ILC) and Ductal Carcinoma In-situ (DCIS) may be missed on mammography due to poor margins between the lesion and normal breast parenchyma. It was found that CAD detection wasnt influenced by the histopathology of cancer
-
the rates of detection was not poorer for these above described poorly marginated lesions. It is well known that detection of small lesions in screening is the key for early detection and management of breast cancer.
Murakami et al.[52] showed that CAD with full field digital mammography improves early detection of tumours in the range of 1 to 10 mm size by identifying 83 % of cases (10 out of 12). For lesions larger than 10 mm size the sensitivity was 92 % (ie., 129 out of 140). Thus, CAD would help in reducing chances of missed cancers and thus improve the prognosis. CAD systems are also used with MRI and ABUS (automated breast ultrasound) for breast cancer detection and the results are reported to be excellent.
-
Types of Tissues / Tumors in Breast Cancer:
In mammography, the term mass means a space- occupying lesion commonly described in terms of its imaging features like margin, location, density and associated calcifications if any. The masses observed can be either benign or malignant. Normally, round shaped lesion with smooth, well defined margins / low-density are considered benign. On the contrary, high-density masses with spiculated or ill-defined margins are recognized as malignant. Other indications of underlying tumours are architectural distortion and focal asymmetry. A comprehensive account on the mammography images of circumscribed masses, spiculated masses and microcalcifications are reported in the work of Rafayah et al.[53]. Typical images showing normal mammogram(left) and mass in breast(right) are shown in Figure 8 for illustration.
-
(b)
Fig 8 Typical images showing (a) Normal mammogram (left) and (b) mass in breast
Microcalcifications are seen as tiny bright specks in the mammogram which are tiny calcium deposits. Their average size is about 0.3 mm according to the publication of Arianna et al.[54] and they may present as an isolated finding or be associated with mass. Malignant microcalcifications are cluster of pleomorphic or linear branching type and focal / regional /segmental in distribution. If more than five micro calcifications are found in a cluster, that is suspicious for malignancy. Benign calcifications are macrocalcifications and appear larger in size (around 14 mm in size), coarse or popcorn type or peripheral calification with a lucent centre, similar in shape, rounded, diffusely scattered. Punctate, diffusely scattered, bilateral microcalcifications are usually benign.
-
-
CAD Methodologies
After the acquisition of images, the mammogram images are pre-processed to eliminate or diminish the noise that may be present in the image. Filtering techniques can be utilized for this purpose. It also involves elimination of unwanted structures such as background. Further, to improve the quality of the image through increasing the contrast between structures, contrast enhancement techniques are adopted. Certain specific and nove pre- processing techniques have also been proposed in the literature for this purpose. The pre-processed image is further considered for processing. In certain cases, image transformation techniques are applied to transform the image to a different domain such that the region of interest (tumor in this case) is exposed more clearly. Wavelet transformation, curvelet transformation, Fourier transform etc. are commonly used for this purpose [55]. The process of image segmentation is then performed on the obtained transformed image or the pre-processed image or both to delineate the region of interest. The most commonly used segmentation technique is thresholding, where the region of interest is depicted with white pixels and the other regions with black pixels. Once the region is segmented, morphological operations are executed to remove some false positive regions and to clean the image. Pertaining to execution of image processing techniques alone, the process of detection ends here and the detected region of interest is highlighted as the tumor. In the case of incorporating pattern recognition techniques also, further steps have to be performed. To implement pattern recognition techniques, expressive features are extracted from the segmented region, pre-processed images, transformed images or all of them. Then, significant
features are selected from the extracted features with respect to distinguishability. The selected features are then fed into machine learning procedures such as classification and clustering to generate a learning model that predicts if the image contains tumor or not. Classification techniques demand training data with ground truth for building the learning model while clustering techniques do not require ground truth. The pattern recognition procedures [20] can be adopted at pixel level, component level or image level. In the case of pixel level, the feature set represents the pixel values from various transformed domains whereas in the context of component level, the properties of the detected regions of interest such as its area, perimeter, mean etc., forms the feature set while in image level, aggregated features of the entire image form the feature vector. In pixel level analysis, the prediction refers to whether the pixel is a tumor pixel or background pixel; in component analysis, the prediction refers to whether the component is a tumor or false lesion whereas in image level the prediction denotes if the image is normal or diseased.
-
Specific aspects of Detectability of Breast Cancer with mammography
-
From the clinical perspective, detection rate of breast cancer by mammography may reduce due to the following factors:
Dense breasts: the lesion would be obscured by increased density of normal breast parenchyma
Architectural distortion, focal asymmetry/density As the edges are ill defined and contrast from the background density is poor, accurate measurement of size / extent is not possible. Hence, it is difficult for the radiologists or CAD system to detect these changes.
Poor radiographic technique: Following radiographic factors affect the accuracy of detection of anomalies in the mammogram. a] positioning b] inadequate compression c] immobilisation d] exposure factors
Location: Location of the tumor such as deep retroglandular /subareolar locations also affect the detectability.
Presence of Scars: Malignancy in area where surgery or biopsy has been previously performed due to post procedure scarring (this should reduce with time on comparison studies)
Small size: As in other techniques, detectability in mammography is also affected by the nodule size. Very small nodules are unlikely to be picked up.
-
-
CAD with MRI for Prostate Cancer
As in the case of any other cancer, early detection and accurate diagnosis can improve survival chances in prostate cancer. Advent of multi-parametric magnetic resonance imaging (MP-MRI) has been a major advancement in prostate cancer imaging. This modality consists of T2- weighted sequences, dynamic contrast-enhanced MRI, diffusion-weighted sequences and spectroscopy. It is observed that large amount of data and differences in imaging sequences used affect detection due to the associated factors like as inter observer variability, underlying complexity and visibility of the lesions etc.
Properly designed and implemented CAD systems can improve quantitative assessment of the disease in a significant manner. Typical images showing the contrast between normal prostate MRI image and prostatic cancer are shown in Figure 9 for general understanding.
-
(b)
Fig 9 Contrast between (a) Normal prostate MRI image (left) and (b) prostatic cancer (right).
-
MRI-based prostate CAD
Dutch investigators have reported that MRI-based prostate cancer CAD system is performing well for detecting intermediate-to-aggressive prostate cancers noninvasively. Their study results from 130 prostate cancer patients reported sensitivity of more than 80% which is similar to the pickup by radiologists. According to the group from Radboud University Medical Center in Netherlands, when CAD was used as a second reader, the sensitivity almost reached 100% and the addition of CAD improved sensitivity for non aggressive versus aggressive tumors and particularly for PI-RADS 4 tumours [56]. Some other studies (Anika Thon et al.[57]) were not able to replicate such a high success rate which indicates a need for further improvement.
-
CAD Methodology
In 2015, auntminnieeurope.com forum had reported the development of a functional prostate cancer CAD. Their feature extraction maintains quality and texture features and a voxel classifier is used for tumour candidate detection and segmentation. This feature, tested on 348 cases with cross validation, showed 82% sensitivity. CAD got validated using datasets and logistic regression analysis to arrive at a standalone CAD score, a radiologist score, and a combined score. 347 patients were used for training the system and 130 patients for the evaluation of CAD. For both groups, analysis was followed by MRI-guided biopsy and pathology. The results showed high sensitivity at a low false-positive rate. CAD performed at about the level of radiologists, and it provides complementary information so that combined, the result is significantly better.
-
Specific aspects of detectability Prostate Cancer
Prostate cancer is hard to diagnose because even the gold-standard diagnostic method is not so reliable. With a high PSA (prostatic specific antigen) suspicious for malignancy, sometimes even transrectal ultrasound (TRUS) of prostate and biopsy may be negative. MRI can reduce the need for biopsy by 80%, but there are still cases where individuals with high PSA results undergo MRI, but the cancer cannot be found. To improve the chances of finding
cancer, prostate cancer CAD was devised. A few years ago a functional prostate cancer CAD was developed in the Netherlands and showed good results. However, this CAD still needs fine tuning as the results could not be replicated by other authors and universal acceptability has not yet been achieved.
-
-
-
Bone Scan of bony metastasis
Detection and response of bony metastasis to treatment (radiotherapy or chemotherapy) is assessed by bone scans which have high sensitivity. Typical images showing normal bone scan and multiple sites of bony metastasis is shown in Figure 10.
-
(b)
-
Figure 10 Typical images showing Normal (left) and Abnormal (multiple sites of bony metastasis) bone scan
Faster computational ability by machines reduces the time taken for comparing multiple areas of bone metastasis and to detect even subtle interval changes using a CAD scheme. Several studies have been reported in this area of research [69-74]. There are different CAD systems available for bone scan as given below:
CADBOSS: This is a software based system hat comprises of basic parts of CAD algorithms for hotspot segmentation, feature extraction and/or selection and classification [58]. A level set active contour segmentation algorithm was used for the detection of hotspots. Moreover, a novel image gridding method was proposed for feature extraction of metastatic regions. An artificial neural network classifier was used to determine whether metastases were present. Performance evaluation of CADBOSS using an image database comprising of 30 non- metastases and 100 metastases revealed that the software system identified 120/130 images. The typical performance measures of the CADBOSS were reported as accuracy of 92.30% with sensitivity of 94% and specificity of 86.67%. The incorporation of CADBOSS system into the clinical framework was reported to have increased the clinician's success in detecting metastases from 95.38% to 96.9% [58] and help in decision making.
CAD using temporal subtraction technique
In certain cases, CAD is used for detecting interval changes in successive whole-body bone scans employing temporal- subtraction methodology. It is obtained with a nonlinear image-warping technique [58]. This scheme consists of several steps viz., (a) initial image density normalization on each image, (b) image matching for paired images, (c) temporal subtraction by use of the nonlinear image-warping technique, (d) detection of
interval changes by use of temporal-subtraction images, (e) image feature extraction corresponding to interval changes,
(f) minimize false positives with the help decision criteria developed based on image extracted features and (g) display of the output for the highlighted interval changes. The temporal subtraction images obtained from previous and current bone scan and the correct detection of one cold lesion and two hot lesions by computer system as reported in [59] is shown in Figure 11 as an illustration of the capability and relevance of the CAD programme developed. This type of CAD software tools not only improves the detection rate but also make reporting much faster.
Fig 11 Illustration of temporal subtraction image [59].
-
-
QUALITY OF DETECTION
The most important challenge in developing Computer Aided Detection (CAD) systems is ensuring that they are accurate and easily adaptable in clinical setup. In medical imaging, accurate diagnosis among other things depends mainly on image acquisition and its interpretation. The discipline of medical diagnosis has advanced multifold in the recent past, owing to evolutionary changes in many areas of digital imaging technology be it image quality, image capture systems, other digital systems. Recently data driven approaches and algorithms found a niche application in medical data in image interpretation. However a lot of things are yet to be realized in this area. For example, we found it very difficult to compare the performance of various CAD systems reported in literature as each system uses a different database and hence one to one comparison on a basis of reported accuracy and sensitivity wont represent the true performance and utility. To get a rough idea on the comparative evaluation of performance of various CAD systems, the papers by Petrick et al.[60], Novak et al.[61], and Kim et al.[62] are useful.
Having touched upon the quality measures of some of the CAD systems along with the case studies discussed in the previous section, let us illustrate the real meaning of these performance measures such as sensitivity, specificity, accuracy etc using a typical scenario of tumor detection. The results obtained from CAD system typically fall into any one of the four scenarios namely, true positive (T+) denotes a tumor being correctly detected as tumor while true negative (T-) refers to a non-tumor being correctly detected as non-tumor. It may be noted that both (T+) and (T-) signifies a correct detection while false positive (F+)
and false negative (F-) signifies a wrong detection. False positive (F+) refers to a non-tumor condition being predicted as tumor and false negative (F-) represents a tumor condition being denoted as non-tumor. With these notations, metrics such as accuracy, sensitivity, specificity, true positive rate etc. can be estimated as illustrated in Table 3 which is self explanatory.
Patients Clinical condition =>
Clinically ill (Tumor Present)
Clinically well (No Tumor)
CAD
system Performance Measures
CAD System Result
Positive (+)
No. of true positive (T+) CAD
report ()
No. of false positive (F+) CAD
report ()
Positive Predictive Value
PPV= / (+)
Negative (+
)
No. of false negative (F-
) CAD
report ()
No. of true negative (T-
) CAD
report ()
Negative Predictive Value
NPV=
/(+ )
Cumulative Clinical cases
Actual No. of Tumor present cases = ( + )
Actual No. of Tumor Absent cases = ( + )
Total No of cases = ( +
+ + )
CAD system Performance Measures
Sensitivit y = / ( + )
Specificit y= / ( + )
Accuracy = ( + ) / ( +
+ + )
Table 3 Quality Performance measures Sensitivity of the CAD system is the ratio of number of
cases where presence of pathology is correctly detected to the actual numbers of pathology present cases screened. The next performance measure is called specificity that gives an idea about the systems capability to rule out pathology when the patient is healthy. Accuracy is the overall measure defined as the ratio of sum of true diagnosis (both true positive and true negative) to the total number of cases diagnosed. From the point of view of the development of algorithms for diagnostic capability in CAD system, we can define a positive predictive value (PPV) as the ratio of the number of true positive cases to the total number of positive diagnosis made by the CAD system. Similarly, negative predictive value (NPV) is the ratio of the number of true negative cases to the total number of negative diagnosis made by the CAD system. Even though these two measures are not very significant in the clinical aspect, it is very much helpful for the engineers who develop and fine tune the algorithms.
Processing time could be another quality characteristic of a CAD system which is the time taken by the system to give diagnostic results, that includes the processing time taken by sub modules such as image pre-processor, segmentation, features extraction, classification, evaluation etc. Ideally one should expect faster processing leading to shorter time elapsed per case without sacrificing the other quality characteristics discussed above.
While discussing the quality characteristics of a CAD system, one must keep a few background points in mind. Firstly the performance measures are liable to be a function of the test method. For example same CAD tested with different databases may show different performance levels. It is quite possible that a given detection algorithm is capable of producing 100% sensitivity result at 2 false- positives (F+) per image for a particular database. The same algorithm may report a sensitivity of 75% at two (F+) per image when applied to another database. Sometimes training dataset can also act as a confounding variable thus creating a large difference in tested performance level. This common problem can be rectified if features of the database images can be standardized in terms of its characteristics namely size of the lesion, contrast applied etc. Similarly a few subjective measures (eg. lesion subtlety rating, orientation of image etc.) can also serve as standardization parameter. The performance repored in the literature by various researchers may differ due to the non- standardized reporting format. One may report sensitivity in terms of percentage of detected abnormalities per image or the total number of abnormalities per case, which would result in different numerical values. Another source of variability in the reported performance of CAD system is use of different scoring criteria. Use of imprecise definitions, subjective classification rules etc make the comparison of CAD systems difficult. In addition, different investigators may use different detection criteria in evaluating CAD algorithms. Obviously detecting a malignant lesion is different from just reporting lesion/ abnormality in an image. Therefore, we must evaluate the computer programme in a holistic perspective and acknowledge that we need to compare it not only on the technical performance, but also the ease of integration into clinical practice.
-
FUTURE TRENDS
-
CAD has gained considerable acceptance as a reliable tool that helps in the faster and more accurate detection of many diseases. CAD can help radiologists by highlighting subtle changes to avoid false negatives and quickly assess changes in serial follow up scans, thereby achieving accurate diagnosis [63]. The global CAD market size was roughly valued at USD 402.9 million in 2014 and its is expected to grow to the value of USD 3.9 billion by 2022 and to be worth USD 5.6 billion by the end of 2025. Many factors including increasing incidence of cancer, technological advances, rising awareness in the population for regular health check-ups due to the benefit of early detection of disease, technological advancements in CAD, its use in several diseases other than cancer and its easy integration with imaging technology are drivers for the growth of the global CAD industry. With newer techniques leading to large number of images requiring interpretation, CAD software tools support radiologists to read studies faster and more effectively. Applying CAD to newer areas in imaging, vigorous research and development, hospitals increasingly requiring automated workflow integration and PACS in their work environment to provide faster and more efficient care, increasing number of CAD systems in
hospitals etc. are further expected to boost this market. Some of the firms developing CAD solutions in the global market are Toshiba Medical Systems, Siemens Healthcare, Philips, GE Healthcare, Esaote, AGFA etc.
-
Segment wise Trends:
-
CAD system to detect prostate cancer:
As per the open source information available on the internet, the number of cancer patients is increasing globally as also prostate cancer cases among men. This increased the load on the healthcare system to have periodic screening which in turn sky rocketed the demand for CAD systems to be able to conduct periodic scans for a large population of men as part of the public health programme for prostate cancer detection.
-
CAD system to detect breast cancer:
According to the World Health Organisation data, breast cancer affects about 2.1 million women each year. Regular check-ups are necessary for early detection and management of breast cancer. CAD is expected to completely replace the role of the second reader radiologist in screening mammography. This would result in saving of the radiologists time and also result in cost savings for the healthcare provider, insurer and therefore ultimately the patient. Currently, CAD in mammography is dominating the market due to the fact that breast cancer incidence is high and as there is a long period of research in this field with CAD software for mammography being the first commercially available computer detection programme. Recently many CAD systems were introduced for mammography and reported to have demonstrated good performance particularly in breast cancer detection for patients with dense breasts. CAD with other modalities (ultrasound, magnetic resonance imaging, positron emission mammography) etc. are also picking up momentum and a lot of research work is going on at various institutes.
-
CAD system to detect lung conditions.
Lung cancer is among the top fatal diseases and has become a major cause of concern for public health authorities. Incidentally, mortality rate in women from smoking is increasing at a rapid rate. The role for CAD as second reader in areas such as low-dose lung cancer CT screening is promising with good performance seen with CAD for solid nodules. CAD research also seems promising in the detection and monitoring of other lung diseases such as pneumonia, acute pulmonary embolism, interstitial lung diseases etc. These areas are open for future research and development activities.
-
CAD system with Other Modalities:
Even though our discussion in this paper is limited to a few important imaging modalities, CAD finds application in other areas also as in the beginning of section II of this paper. To name a few X-ray, ultrasound (e.g.ABUS), electro cardiogram etc. use computer based detection. This list is expanding rapidly in covering a host of modalities
that use CAD for fast and accurate detection of anomalies in various disciplines of medical science. One of the important advancements is in the detection of vertebral fractures due to osteoporosis on lateral chest radiograph.
-
-
Future Trends in Technology
Assessing future trends in computer application connected with medical imaging has been an interesting topic to engineers, medical equipment manufacturers, and clinicians as well. Kunio Doi [59] reviewed the prospects in medical imaging science and technology and published the significant progress made in the field of diagnostic imaging. He opines that the future of research in this area has a good potential and there is enough scope for improvements in improving image quality in various methodologies, developing interconnectivity between medical data bases, newer methods for data storage and development of algorithms for data mining and classification etc. leading to improved speed and reliability. To build a successful CAD program, he suggested close coordination between radiologists who interpret the images and engineers who improve the physics of image generation, detection and classification. Edwards et al [64] also emphasized this point regarding increased collaborations between medical experts and engineers to facilitate development for techniques and efficient algorithms. Hence the current work reported in this paper can be considered as a right move towards that direction.
Artificial intelligence and deep learning techniques [64- 67] are likely to dominate the future research trends in CAD and probably transform it into the next higher domain called computer aided diagnosis (CADx). Further, Goncalves et.al, [1] conducted a systematic review of the evaluation of CAD systems and found that most studies explored breast and lung cancers. So they emphasize the need for CAD in diagnosis of other diseases that are responsible for human morbidity and mortality worldwide. Also most of the CAD systems are limited by the use of only one type of image. The need of the hour is to combine multiple images from various modalities to evaluate the patients condition holistically. This may be an interesting area for future research.
Edwards et al.[64] has reviewed the recent trends based on the research work reported in selected top journals and conferences. One of the major observations was the recent emergence of deep neural network and the associated machine learning algorithms used for computer-aided diagnosis (CADx) which is the next step after detection of anomalies in the image. In [64], 29 studies were reviewed to identify trends in this field. It was found that the research has focused mostly on cancer-related diseases while gynaecology / pediatrics have not received similar attention. Most of the current studies employ convolution neural network (CNN) architecture and it is xpected to grow further in future.
Advancements in digital image acquisition and processing have helped health care business in general and particularly medical imaging industry to grow at a fast
pace. The data generated in medical imaging is so large that the conventional data handling modalities may not be able to cope up. The state of the art big data approach and data mining techniques are essential to handle day to day requirements of medical image analysis. The opinion and judgment by human experts can be subjective and prone to error or likely to have variations from person to person. Automation is an effective method of alleviating subjectivity from the diagnosis process. However conventional automation techniques cannot handle the highly complex process of medical diagnosis through interpretation of images. High performance computers with self learning algorithms are required for extracting the relevant information and classifying it for making intelligent decisions leading to accurate, reliable and efficient diagnosis.
Deep learning has made a paradigm shift in computation such that it extracts the known features of the anomaly from the image as well as identify and construct new combination of features leading to easy and accurate diagnosis. This opens up an area of predictive diagnosis where based on the current condition of the patient revealed through the acquired images combined with other health indicators, the software can make an assessment of progression of disease and guide the doctors in effective patient care and management of the ailment. With the introduction of artificial intelligence (AI) and machine learning (ML) in medical imaging, engineers have a major role to play in medical image processing, image interpretation and classification, data fusion from various modalities, detection, diagnosis and progressive assessment of various ailments using different modalities.
Machine learning and artificial Intelligence techniques can also enhance the understanding of a given condition and interpret the impact of various contributing factors and implication of different treatment modalities. The research on the development and use of various algorithms and techniques for image processing, segmentation, classification, detection and diagnosis are growing at an exponential rate and all the aspects of their future trends and potential cannot be fully covered in this section. Interested readers are requested to peruse the list of relevant literature cited herein for further information. Notwithstanding the fact that there are many areas of uncertainties to be addressed and further refinements required to be made in many of the engineering aspects of detection and diagnosis, the recent developments in computational science and medical imaging have shown significant promise in automated detection and diagnosis. We are currently on the cusp of a new era which is just beginning in medical image diagnosis employing new knowledge in machine learning techniques initiated from the advances in deep learning.
REFERENCES
-
Vagner Mendonça Goncalves, Marcio Eduardo Delamaro, Fatima de Lourdes dos Santos Nunes, A systematic review on the evaluation and characteristics of computer aided diagnosis systems, Braz. J. Biom. Eng., 30(4), 355-383, Dec. 2014 pp 355- 383
-
Kunio Doi, Diagnostic imaging over the last 50 years: research and development in medical imaging science and technology, Phys. Med. Biol. 51 (2006) R5R27 doi:10.1088/0031- 9155/51/13/R02
-
Rajaa Faraj Mahmoud Suleiman, Computer Aided Diagnosis of Breast Cancer Using Image Processing Techniques and Neural Networks with Logistic Regression, Master Thesis in Computer Science Faculty of Information Technology, Middle East University, Amman, Jordan, January 2015
-
Yanhui Guo, Computer Aided Detection of Breast Cancer Using Ultrasound Images, Thesis – Utah State University, 2010. Graduate Theses and Dissertations 635. https://digitalcommons.usu.edu/etd/635
-
Sheenum Marwaha, Himanshu Monga, Shelza, Automatic Diagnosis Systems Using Image Processing- A systematic Study, IRACST – International Journal of Computer Science and Information Technology & Security (IJCSITS), Vol. 2, No.2, April 2012. pp 388-391. ISSN: 2249-9555,
-
Priya Darshini Velusamy, Medical Image Processing Schemes for Cancer Detection: A Survey, Amrita School of Engineering,
Bangalore, Karnataka, India, darshinime@gmail.com
-
Vadi Hena, Pooja Vasani, Ashish Kothari, Computer Aided Cancer Detection and Diagnosis Using Image Processing, Atmiya Institute of Technology and Science Rajkot, India (email: hena6991@gmail.com)
-
Nikolaos Dellios, Ulf Teichgraeber, Robert Chelaru, Ansgar Malich, Ismini E Papageorgiou, Computer-aided Detection Fidelity of Pulmonary Nodules in Chest Radiograph, J Clin Imaging Sci 2017;7:8. Available in open access from: http://www. clinicalimagingscience.org /text.asp? 2017/7/1/8/200572
-
Shivangi Jain, Vandana jagtap, Nitin Pise, Computer aided Melanoma skin cancer detection using Image Processing, International Conference on Intelligent Computing, Communication & Convergence, (ICCC-2014), Procedia Computer Science 48, 2015 pp 735 740 (Available online at www.sciencedirect.com)
-
Jyoti Rawat, Annapurna Singh, H S Bhadauriac, Jitendra Virmanid, Computer Aided Diagnostic System for Detection of Leukemia using Microscopic Image 4th International Conference on Eco-friendly Computing and Communication Systems, Procedia Computer Science 70, 2015 pp 748 756 (Available online at www.sciencedirect.com)
-
Lorenzo Putzu, Computer Aided Diagnosis Algorithms for Digital Microscopy, University of Cagliari, 2015
-
Sarmad Shafique and Samabia Tehsin, Computer-Aided Diagnosis of Acute Lymphoblastic Leukaemia, Computational and Mathematical Methods in Medicine, Volume 2018, Article ID 6125289, 13 pages https://doi.org/10.1155/2018/6125289
-
Megha P. Arakeri and Ram Mohana Reddy G, Recent Advances and Future Potential of Computer Aided Diagnosis of Liver Cancer on Computed Tomography Images, Recent Advances and Future Potential of CAD of Liver Cancer, K.R. Venugopal and L.M. Patnaik (Eds.): ICIP 2011, CCIS 157, pp. 246251, 2011. Springer-Verlag Berlin Heidelberg 2011.
-
Lei Chen, Computer Aided Detection of Parkinsons Disease Using Transcranial Sonography, Thesis submitted to Institute for Signal Processing of the University of Lübeck, Germany, 2013
-
Palak Mehta, Bhumika Shah, Review on Techniques and Steps of Computer Aided Skin Cancer Diagnosis, International Conference on Computational Modeling and Security (CMS 2016), Procedia Computer Science 85 ( 2016 ) 309 316. (Available online at www.sciencedirect.com)
-
Sameena Pathan, K. Gopalakrishna Prabhu, P.C. Siddalingaswamy, Techniques and algorithms for computer aided diagnosis of pigmented skin lesionsA review, Biomedical Signal Processing and Control 39 (2018) 237262
-
Germán Capdehourat, Andrés Corez, Anabella Bazzano, Rodrigo Alonso, Pablo Musé, Toward a combined tool to assist
dermatologists in melanoma detection from dermoscopic images of pigmented skin lesions, Pattern Recognition Letters 32 (2011) 21872196
-
P. Thamilselvan, J. G. R.Sathiaseelan, A Novel Profuse Clustering Technique for Image Denoising, 6th International Conference on Smart Computing and Communications, ICSCC 2017, 7-8 December 2017, Kurukshetra, India, Procedia Computer Science 125 (2018) 132142. Procedia Computer Science 125 (2018) 132142 (Available online at www.sciencedirect.com)
-
H. Mahersia, M. Zaroug, L. Gabralla, Lung Cancer Detection on CT Scan Images: A Review on the Analysis Techniques, International Journal of Advanced Research in Artificial Intelligence (IJARAI), Vol. 4, No.4, 2015 pp 38-45
-
Muhander Lal Oad, Jherna Devi, Sajida Parveen, A review on computer aided diagnosis of breast cancer using image processing and pattrn recognition techniques, International Journal of Electrical, Electronics and Data Communication, ISSN(p): 2320- 2084, ISSN(e): 2321-2950 Volume-6, Issue-2, Feb.-2018, http://iraj.in
-
Marius George Linguraru, Shan Zhao, Robert L. Van Uitert, Jiamin Liu, Joel G.Fletcher, Armando Manduca, and Ronald M. Summers, CAD of Colon Cancer on CT Colonography Cases without Cathartic Bowel Preparation, Conf Proc IEEE Eng Med Biol Soc. 2008; 1: 29962999
-
Jean Marie Vianney-Kinani, Alberto J. Rosales-Silva, Francisco J. Gallegos-Funes, Alfonso Arellano, Computer-Aided Diagnosis of Brain Tumors Using Image Enhancement And Fuzzy Logic, Dyna, year 81, no. 183, pp. 148-157. Medellin, February, 2014.
ISSN 0012-7353
-
Ali Aslantas, Dandil Emre, Murat Çakirolu, Comparison of segmentation algorithms for detection of hotspots in bone scintigraphy images and effects on CAD systems, Biomedical Research 2017; 28 (2): pp 676-683
-
Toto Haryanto, Heru Suhartanto, Xue Li, Past, Present, and Future Trend of GPU Computing in Deep Learning on Medical Images, Conference Paper · October 2017, DOI: 10.1109/ICACSIS. 2017. 8355007.
-
Priyanjana Sharma, Shagun Malik, Surbhi Sehgal and Jyotika Pruthi, Computer Aided Diagnosis Based on Medical Image Processing and Artificial Intelligence Methods, International Journal of Information and Computation Technology. ISSN 0974- 2239 Volume 3, Number 9 (2013), pp. 887-892
-
Abhishek Raj, Alankrita, Akansha Srivastava, and Vikrant Bhateja, Computer Aided Detection of Brain Tumor in Magnetic Resonance Images, IACSIT International Journal of Engineering and Technology, Vol. 3, No. 5, October 2011.
-
Amit Verma and Gayatri Khanna, Survey on Digital Image Processing Techniques for Tumor Detection, Indian Journal of Science and Technology, Vol 9(14), April 2016 pp 1-15 DOI: 10.17485/ijst/2016/v9i14/84976, www.indjst.org
-
Seda Kazdal, Buket Dogan, Ali Ylmaz Camurcu, Computer- Aided Detection of Brain Tumors Using Image Processing Techniques, University of Istanbul, Turkey. (email: seda.kazdal@uskudar.edu.tr) 978-1-4799-4874-1/14/$31.00
-
Steven Schalekamp,et al., Computer-aided Detection Improves Detection of Pulmonary Nodules in Chest Radiographs beyond the Support by Bone-suppressed Images, Radiology: Volume 272:
Number 1July 2014 pp 252-261
-
H. Kim, T. Nakashima and Y. Itai, Automatic detection of ground glass opacity from the thoracic MDCT images by using density features. In proc. of the International Conference on Control, Automation and Systems, pp. 1274-1277. Seoul, 2007.
-
S. Ashwin, S.A. Kumar, J. Ramesh and K. Gunavathi, Efficient and Reliable Lung Nodule Detection using a Neural Network Based Computer Aided Diagnosis System, In Proc. of the International Conference on Emerging Trends in Electrical Engineering and Energy Management (ICETEEEM 2012), pp. 135-142, Chennai, 13-15 Dec. 2012.
-
A. Farag, J Graham, A. Farag and R. Falk, Lung Nodule Modelling A Data-Driven approach, Advances in Visual Computing, Vo. 5875, pp 347-356, 2009
-
Retico, P. Delogu, M. E. Fantacci, Lung nodule detection in low- dose and thin-slice computed tomography, Comput. Biol. Med., Vol. 38, pp. 525- 534, 2008
[34] |
G. Vijaya and A. Suhasini, An Adaptive Pre-processing of Lung CT Images with Various Filters for Better Enhancement, |
Digit Imaging. 2011 Feb; 24(1): 8695. Published online 2009 Nov 24. doi: 10.1007/s10278-009-9254-0 |
|
Academic Journal of Cancer Research, Vol. 7, No. 3, pp. 179- |
[52] |
Ryusuke Murakami, Shinichiro Kumita, Hitomi Tani, Tamiko |
|
[35] |
184, 2014. T. Gao, X. Sun, Y. Wang and S. Nie, A Pulmonary Nodules |
Yoshida, Kenichi Sugizaki, Tomoyuki Kuwako, Tomonari Kiriyama, Kenta Hakozaki, Emi Okazaki, Keiko Yanagihara, |
|
Detection Method Using 3D Template Matching, Foundations of |
Shinya Iida, Shunsuke Haga, Shinichi Tsuchiya, Detection of |
||
[36] |
Intelligent Systems, AISC, Vol. 122, pp. 625633, 2012. M.L. Giger, N. Ahn, K. Doi, H. MacMahon and C.E. Metz, |
Breast Cancer with a Computer-Aided Detection Applied to Full- Field Digital Mammography, J Digit Imaging (2013) 26:768773 |
|
Computerized Detection of Pulmonary Nodules in Digital Chest |
DOI 10.1007/s10278-012-9564-5 |
||
Images: Use of Morphological Filters in Reducing False-Positive Detections, Med. Phys., Vol. 17, pp. 861-865, 1990 |
[53] |
Rafayah M, Qutaishat M, Abdallah M. Breast Cancer Diagnosis System Based on Wavelet Analysis and Fuzzy-Neural. Expert |
|
[37] |
Y. S. Chiou, Y.-M. Fleming Lure, M. T. Freedman and S. Fritz, |
Systems with Applications. 2005 May; 28(4):71323. |
|
Application of Neural Network Based Hybrid System for Lung Nodule Detection, In. proc of the Sixth Annual IEEE Symposium |
[54] |
Arianna M, Marcello S, Roberto L, Manuela F, Federica C. Mammographic Images Enhancement and Denoising for Breast |
|
on Computer-Based Medical Systems, pp. 216-216, Ann Arbor, |
Cancer Detection Using Dyadic Wavelet Processing. IEEE |
||
[38] |
13-16 Jun 1993 H. Haussecker and B. Jahne, A tensor approach for local structure |
Transactions on Instrumentation and Measurement. 2008 July; 57(7): 142230. |
|
analysis in multidimensional images in 3-D, Image Anal. |
[55] |
Mohamed ME, Ibrahima F, Brahim BS. Breast Cancer Diagnosis |
|
[39] |
Synthesis, pp. 171-178, 1996 T. Koller, G. Gerig, G. Szekely, and D. Dettwiler, Multiscale |
in Digital Mammogram Using Multiscale Curvelet Transform. Computerized Medical Imaging and Graphics. 2010 June; 34(4): |
|
detection of curvilinear structures in 2-D and 3-D image data, in |
26976. |
||
[40] |
Int. Conf. Computer Vision, pp. 864-869, 1995 Frangi, W. Niessen, K. Vincken, and M. Viergever, Multiscale |
[56] |
Eric Barnes (AuntMinnieEurope.com staff writer), MRI-based prostate CAD shows high sensitivity for cancer, Accessed from |
vessel enhancement filtering, Med. Image Computing Computer |
the web site www. auntminnieeurope.com |
||
[41] |
Assisted Intervention, vol. 1496, pp. 130-137, 1998 Armato SG, Li F, Giger ML, MacMahon H, Sone S, Doi K. Lung |
[57] |
Anika Thon, Ulf Teichgräber,Cornelia Tennstedt-Schenk,Stathis Hadjidemetriou,Sven Winzler,Ansgar Malich,Ismini |
cancer: performance of automated lung nodule detection applied to cancers missed in a CT screening program. Radiology 2002; |
Papageorgiou. Computer aided detection in prostate cancer diagnostics: A promising alternative to biopsy? A retrospective |
||
225:685 692. |
study from 104 lesions with histological ground truth, Accessed |
||
[42] |
Aggarwal, T., Furqan, A., Kalra, K. Feature extraction and LDA based classification of lung nodules in chest CT scan images. |
[58] |
from website Ali Aslantas, Emre Dandil, Semahat Salam, Murat Çakirolu, |
International Conference On Advances In Computing, |
CADBOSS: A computer-aided diagnosis system for whole-body |
||
Communications And Informatics (ICACCI), 2015. DOI: 10.1109/ICACCI.20157275773 |
bone scintigraphy scans, Volume : 12, Issue : 2, 2016, Page : 787-792 |
||
[43] |
Jin, X., Zhang, Y., Jin, Q. Pulmonary Nodule Detection Based on |
[59] |
Kunio Doi, Computer-Aided Diagnosis in Medical Imaging: |
CT Images Using Convolution Neural Network. 9th International Symposium On Computational Intelligence And Design (ISCID), |
Historical Review, Current Status and Future Potential, Comput Med Imaging Graph. 2007; 31(4-5): 198211. Published online |
||
2016. DOI: 10.1109/ISCID.2016.1053 |
2007 Mar 8. doi: 10.1016/j.compmedimag.2007.02.002 |
||
[44] |
Sangamithra, P., Govindaraju, S. Lung tumour detection and classification using EK-Mean clustering. International |
[60] |
Petrick et al.: Evaluation of computer-aided detection and diagnosis systems, Medical Physics, Vol. 40, No. 8, August 2013, |
Conference On Wireless Communications, Signal Processing And |
pp 0870011 – 08700117 |
||
Networking (Wispnet), 2016. DOI: 10.1109/WiSPNET.2016.7566533. |
[61] |
Ronald D. Novak & Nicholas J. Novak & Robert Gilkeson & Bahar Mansoori & Gunhild E. Aandal, A Comparison of |
|
[45] |
Roy, T., Sirohi, N., Patle, A. Classification of lung image and |
Computer-Aided Detection (CAD) Effectiveness in Pulmonary |
|
nodule detection using fuzzy inference system. International Conference On Computing, Communication & Automation, 2015. |
Nodule Identification Using Different Methods of Bone Suppression in Chest Radiographs, J Digit Imaging (2013) 26 |
||
DOI: 10.1109/CCAA.2015.7148560. |
pp651656, DOI 10.1007/ s10278-012 -9565-4 |
||
[46] |
Ignatious, S., Joseph, R. Computer aided lung cancer detection system. Global Conference On Communication Technologies |
[62] |
Seung Ja Kim, Woo Kyung Moon, Soo-Yeon Kim, Jung Min Chang, Sun Mi Kim & Nariya Cho (2010) Comparison of two |
(GCCT), 2015. DOI: 10.1109/GCCT.2015.7342723. |
software versions of a commercially available computer-aided |
||
[47] |
Rendon-Gonzalez, E., Ponomaryov, V. Automatic Lung nodule segmentation and classification in CT images based on SVM. 9Th |
detection (CAD) system for detecting breast cancer, Acta Radiologica, 51:5, 482-490, |
|
International Kharkiv Symposium On Physics And Engineering |
doi.org/10.3109/02841851003709490 |
||
Of Microwaves, Millimeter And Submillimeter Waves (MSMW), 2016. DOI: 10.1109/MSMW.2016.7537995. |
[63] |
Hiroshi Fujitaa, Yoshikazu Uchiyamaa, Toshiaki Nakagawaa, Daisuke Fukuokab, Yuji Hatanakac, Takeshi Haraa, Gobert N. |
|
[48] |
Suren Makaju, P.W.C. Prasad, Abeer Alsadoon, A. K. Singh, A. |
Leea, Yoshinori Hayashia, Yuji Ikedoa, Xin Gaoa, Xiangrong |
|
Elchouemi, Lung Cancer Detection using CT Scan Images, 6th International Conference on Smart Computing and |
Zhoua, Computer-aided diagnosis: The emerging of three CAD systems induced by Japanese health care needs, computer |
||
Communications, ICSCC 2017, 7-8. December 2017, |
methods and programs in biomedicine 9 2 ( 2 0 0 8 ) 238248. |
||
Kurukshetra, India, Procedia Computer Science 125 (2018) 107 114 (Available online at www.sciencedirect.com) |
[64] |
Bosede Iyiade Edwards, Nosiba Hisham Osman Khougali and Adrian David Cheok, Trends in Computer-Aided Diagnosis Using |
|
[49] |
S. Miki, N. Hayashi, Y. Masutani, Y. Nomura, T. Yoshikawa, S. |
Deep Learning Techniques: A Review of Recent Studies on |
|
Hanaoka, M. Nemoto, and K. Ohtomo Computer-Assisted Detection of Cerebral Aneurysms in MR Angiography in a |
Algorithm Development, Preprints (www.preprints.org) October 2017, doi:10.20944/preprints201710.0117.v1 |
||
Routine Image-Reading Environment: Effects on Diagnosis by |
[65] |
Holger R. Roth, Le Lu, Jiamin Liu, Jianhua Yao, Ari Seff, Kevin |
|
[50] |
Radiologists, Published February 18, 2016 as 10.3174/ajnr.A4671 Arimura H, Li Q, Korogi Y, Hirai T, Abe H, Yamashita Y, |
Cherry, Lauren Kim, and Ronald M. Summers, Improving Computer-aided Detection using Convolutional Neural Networks |
|
Katsuragawa S, Ikeda R, Doi K. Automated computerized scheme |
and Random View Aggregation, arXiv:1505.03046v2 [cs.CV] 15 |
||
for detection of unruptured intracranial aneurysms in three- dimensional magnetic resonance angiography, Acad Radiol. 2004 |
Sep 2015. (Imaging Biomarkers and Computer-Aided Diagnosis Laboratory, Radiology and Imaging Sciences Department, |
||
Oct;11(10):1093-1104. |
National Institutes of Health Clinical Center, Bethesda, MD |
||
[51] |
Xiaojiang Yang, Daniel J. Blezek, Lionel T. E. Cheng, William J. Ryan, David F. Kallmes, and Bradley J. Erickson Computer- |
[66] |
20892-1182, USA, e-mail: holger.roth@nih.gov) Muhammad Imran Razzak, Saeeda Naz and Ahmad Zaib, Deep |
Aided Detection of Intracranial Aneurysms in MR Angiography, J |
Learning for Medical Image Processing: Overview, Challenges |
||
and Future (e-mail: mirpake@gmail.com) |
-
Sunny S. A Review on Efficacy of Artificial Neural Networks in Medical and Business Areas. International Journal of Recent Trends in Engineering and Research. 2016 April; 2(04).
-
Susama Bagchi and Audrey Huong, Signal Processing Techniques and Computer-Aided Detection Systems for Diagnosis of Breast Cancer A Review Paper, Indian Journal of Science and Technology, Vol 10(3), January 2017 pp 1-6. DOI: 10.17485/ijst/2017/v10i3/110640
-
Nisthula P, Yadhu.R.B., A Novel Method to Detect Bone Cancer Using Image Fusion And Edge Detection, International Journal Of Engineering And Computer Science ISSN:2319-7242 Volume 2 Issue 6 June, 2013 Page No. 2012-2018
-
Kishor Kumar Reddy C, Anisha P R, ,Narasimha Prasad L V, A Novel Approach for Detecting the Bone Cancer and its Stage based on Mean Intensity and Tumor Size, Recent Researches in Applied Computer Science, pp 162-171. ISBN: 978-1-61804- 307-8
-
Ali Aslantas, Dandil Emre, Murat Çakirolu, Comparison of segmentation algorithms for detection of hotspots in bone scintigraphy images and effects on CAD systems, Biomedical Research 2017; 28 (2): 676-683
-
Sravanthi Vallaboju, P.W.C. Prasad, Abeer Alsadoon, Manoranjan Paul, Bioinformatics Image based Decision Support system for Bone Cancer Detection, School of Computing and Mathematics, Charles Sturt University, Australia,
-
Sinthia P and K. Sujatha, A Novel Approach To Detect Bone Cancer Using K-Means Clustering Algorithm And Edge Detection Method, ARPN Journal of Engineering and Applied Sciences, Vol. 11, No. 13, July 2016, pp 8002 -8007
-
Anu T C, Mallikarjunaswamy M.S., Rajesh Raman, Detection of Bone Fracture using Image Processing Methods, International Journal of Computer Applications (0975 8887) National Conference on Power Systems & Industrial Automation (NCPSIA 2015) www.ijcaonline.org