- •Biological and Medical Physics, Biomedical Engineering
- •Medical Image Processing
- •Preface
- •Contents
- •Contributors
- •1.1 Medical Image Processing
- •1.2 Techniques
- •1.3 Applications
- •1.4 The Contribution of This Book
- •References
- •2.1 Introduction
- •2.2 MATLAB and DIPimage
- •2.2.1 The Basics
- •2.2.2 Interactive Examination of an Image
- •2.2.3 Filtering and Measuring
- •2.2.4 Scripting
- •2.3 Cervical Cancer and the Pap Smear
- •2.4 An Interactive, Partial History of Automated Cervical Cytology
- •2.5 The Future of Automated Cytology
- •2.6 Conclusions
- •References
- •3.1 The Need for Seed-Driven Segmentation
- •3.1.1 Image Analysis and Computer Vision
- •3.1.2 Objects Are Semantically Consistent
- •3.1.3 A Separation of Powers
- •3.1.4 Desirable Properties of Seeded Segmentation Methods
- •3.2 A Review of Segmentation Techniques
- •3.2.1 Pixel Selection
- •3.2.2 Contour Tracking
- •3.2.3 Statistical Methods
- •3.2.4 Continuous Optimization Methods
- •3.2.4.1 Active Contours
- •3.2.4.2 Level Sets
- •3.2.4.3 Geodesic Active Contours
- •3.2.5 Graph-Based Methods
- •3.2.5.1 Graph Cuts
- •3.2.5.2 Random Walkers
- •3.2.5.3 Watershed
- •3.2.6 Generic Models for Segmentation
- •3.2.6.1 Continuous Models
- •3.2.6.2 Hierarchical Models
- •3.2.6.3 Combinations
- •3.3 A Unifying Framework for Discrete Seeded Segmentation
- •3.3.1 Discrete Optimization
- •3.3.2 A Unifying Framework
- •3.3.3 Power Watershed
- •3.4 Globally Optimum Continuous Segmentation Methods
- •3.4.1 Dealing with Noise and Artifacts
- •3.4.2 Globally Optimal Geodesic Active Contour
- •3.4.3 Maximal Continuous Flows and Total Variation
- •3.5 Comparison and Discussion
- •3.6 Conclusion and Future Work
- •References
- •4.1 Introduction
- •4.2 Deformable Models
- •4.2.1 Point-Based Snake
- •4.2.1.1 User Constraint Energy
- •4.2.1.2 Snake Optimization Method
- •4.2.2 Parametric Deformable Models
- •4.2.3 Geometric Deformable Models (Active Contours)
- •4.2.3.1 Curve Evolution
- •4.2.3.2 Level Set Concept
- •4.2.3.3 Geodesic Active Contour
- •4.2.3.4 Chan–Vese Deformable Model
- •4.3 Comparison of Deformable Models
- •4.4 Applications
- •4.4.1 Bone Surface Extraction from Ultrasound
- •4.4.2 Spinal Cord Segmentation
- •4.4.2.1 Spinal Cord Measurements
- •4.4.2.2 Segmentation Using Geodesic Active Contour
- •4.5 Conclusion
- •References
- •5.1 Introduction
- •5.2 Imaging Body Fat
- •5.3 Image Artifacts and Their Impact on Segmentation
- •5.3.1 Partial Volume Effect
- •5.3.2 Intensity Inhomogeneities
- •5.4 Overview of Segmentation Techniques Used to Isolate Fat
- •5.4.1 Thresholding
- •5.4.2 Selecting the Optimum Threshold
- •5.4.3 Gaussian Mixture Model
- •5.4.4 Region Growing
- •5.4.5 Adaptive Thresholding
- •5.4.6 Segmentation Using Overlapping Mosaics
- •5.6 Conclusions
- •References
- •6.1 Introduction
- •6.2 Clinical Context
- •6.3 Vessel Segmentation
- •6.3.1 Survey of Vessel Segmentation Methods
- •6.3.1.1 General Overview
- •6.3.1.2 Region-Growing Methods
- •6.3.1.3 Differential Analysis
- •6.3.1.4 Model-Based Filtering
- •6.3.1.5 Deformable Models
- •6.3.1.6 Statistical Approaches
- •6.3.1.7 Path Finding
- •6.3.1.8 Tracking Methods
- •6.3.1.9 Mathematical Morphology Methods
- •6.3.1.10 Hybrid Methods
- •6.4 Vessel Modeling
- •6.4.1 Motivation
- •6.4.1.1 Context
- •6.4.1.2 Usefulness
- •6.4.2 Deterministic Atlases
- •6.4.2.1 Pioneering Works
- •6.4.2.2 Graph-Based and Geometric Atlases
- •6.4.3 Statistical Atlases
- •6.4.3.1 Anatomical Variability Handling
- •6.4.3.2 Recent Works
- •References
- •7.1 Introduction
- •7.2 Linear Structure Detection Methods
- •7.3.1 CCM for Imaging Diabetic Peripheral Neuropathy
- •7.3.2 CCM Image Characteristics and Noise Artifacts
- •7.4.1 Foreground and Background Adaptive Models
- •7.4.2 Local Orientation and Parameter Estimation
- •7.4.3 Separation of Nerve Fiber and Background Responses
- •7.4.4 Postprocessing the Enhanced-Contrast Image
- •7.5 Quantitative Analysis and Evaluation of Linear Structure Detection Methods
- •7.5.1 Methodology of Evaluation
- •7.5.2 Database and Experiment Setup
- •7.5.3 Nerve Fiber Detection Comparison Results
- •7.5.4 Evaluation of Clinical Utility
- •7.6 Conclusion
- •References
- •8.1 Introduction
- •8.2 Methods
- •8.2.1 Linear Feature Detection by MDNMS
- •8.2.2 Check Intensities Within 1D Window
- •8.2.3 Finding Features Next to Each Other
- •8.2.4 Gap Linking for Linear Features
- •8.2.5 Quantifying Branching Structures
- •8.3 Linear Feature Detection on GPUs
- •8.3.1 Overview of GPUs and Execution Models
- •8.3.2 Linear Feature Detection Performance Analysis
- •8.3.3 Parallel MDNMS on GPUs
- •8.3.5 Results for GPU Linear Feature Detection
- •8.4.1 Architecture and Implementation
- •8.4.2 HCA-Vision Features
- •8.4.3 Linear Feature Detection and Analysis Results
- •8.5 Selected Applications
- •8.5.1 Neurite Tracing for Drug Discovery and Functional Genomics
- •8.5.2 Using Linear Features to Quantify Astrocyte Morphology
- •8.5.3 Separating Adjacent Bacteria Under Phase Contrast Microscopy
- •8.6 Perspectives and Conclusions
- •References
- •9.1 Introduction
- •9.2 Bone Imaging Modalities
- •9.2.1 X-Ray Projection Imaging
- •9.2.2 Computed Tomography
- •9.2.3 Magnetic Resonance Imaging
- •9.2.4 Ultrasound Imaging
- •9.3 Quantifying the Microarchitecture of Trabecular Bone
- •9.3.1 Bone Morphometric Quantities
- •9.3.2 Texture Analysis
- •9.3.3 Frequency-Domain Methods
- •9.3.4 Use of Fractal Dimension Estimators for Texture Analysis
- •9.3.4.1 Frequency-Domain Estimation of the Fractal Dimension
- •9.3.4.2 Lacunarity
- •9.3.4.3 Lacunarity Parameters
- •9.3.5 Computer Modeling of Biomechanical Properties
- •9.4 Trends in Imaging of Bone
- •References
- •10.1 Introduction
- •10.1.1 Adolescent Idiopathic Scoliosis
- •10.2 Imaging Modalities Used for Spinal Deformity Assessment
- •10.2.1 Current Clinical Practice: The Cobb Angle
- •10.2.2 An Alternative: The Ferguson Angle
- •10.3 Image Processing Methods
- •10.3.1 Previous Studies
- •10.3.2 Discrete and Continuum Functions for Spinal Curvature
- •10.3.3 Tortuosity
- •10.4 Assessment of Image Processing Methods
- •10.4.1 Patient Dataset and Image Processing
- •10.4.2 Results and Discussion
- •10.5 Summary
- •References
- •11.1 Introduction
- •11.2 Retinal Imaging
- •11.2.1 Features of a Retinal Image
- •11.2.2 The Reason for Automated Retinal Analysis
- •11.2.3 Acquisition of Retinal Images
- •11.3 Preprocessing of Retinal Images
- •11.4 Lesion Based Detection
- •11.4.1 Matched Filtering for Blood Vessel Segmentation
- •11.4.2 Morphological Operators in Retinal Imaging
- •11.5 Global Analysis of Retinal Vessel Patterns
- •11.6 Conclusion
- •References
- •12.1 Introduction
- •12.1.1 The Progression of Diabetic Retinopathy
- •12.2 Automated Detection of Diabetic Retinopathy
- •12.2.1 Automated Detection of Microaneurysms
- •12.3 Image Databases
- •12.4 Tortuosity
- •12.4.1 Tortuosity Metrics
- •12.5 Tracing Retinal Vessels
- •12.5.1 NeuronJ
- •12.5.2 Other Software Packages
- •12.6 Experimental Results and Discussion
- •12.7 Summary and Future Work
- •References
- •13.1 Introduction
- •13.2 Volumetric Image Visualization Methods
- •13.2.1 Multiplanar Reformation (2D slicing)
- •13.2.2 Surface-Based Rendering
- •13.2.3 Volumetric Rendering
- •13.3 Volume Rendering Principles
- •13.3.1 Optical Models
- •13.3.2 Color and Opacity Mapping
- •13.3.2.2 Transfer Function
- •13.3.3 Composition
- •13.3.4 Volume Illumination and Illustration
- •13.4 Software-Based Raycasting
- •13.4.1 Applications and Improvements
- •13.5 Splatting Algorithms
- •13.5.1 Performance Analysis
- •13.5.2 Applications and Improvements
- •13.6 Shell Rendering
- •13.6.1 Application and Improvements
- •13.7 Texture Mapping
- •13.7.1 Performance Analysis
- •13.7.2 Applications
- •13.7.3 Improvements
- •13.7.3.1 Shading Inclusion
- •13.7.3.2 Empty Space Skipping
- •13.8 Discussion and Outlook
- •References
- •14.1 Introduction
- •14.1.1 Magnetic Resonance Imaging
- •14.1.2 Compressed Sensing
- •14.1.3 The Role of Prior Knowledge
- •14.2 Sparsity in MRI Images
- •14.2.1 Characteristics of MR Images (Prior Knowledge)
- •14.2.2 Choice of Transform
- •14.2.3 Use of Data Ordering
- •14.3 Theory of Compressed Sensing
- •14.3.1 Data Acquisition
- •14.3.2 Signal Recovery
- •14.4 Progress in Sparse Sampling for MRI
- •14.4.1 Review of Results from the Literature
- •14.4.2 Results from Our Work
- •14.4.2.1 PECS
- •14.4.2.2 SENSECS
- •14.4.2.3 PECS Applied to CE-MRA
- •14.5 Prospects for Future Developments
- •References
- •15.1 Introduction
- •15.2 Acquisition of DT Images
- •15.2.1 Fundamentals of DTI
- •15.2.2 The Pulsed Field Gradient Spin Echo (PFGSE) Method
- •15.2.3 Diffusion Imaging Sequences
- •15.2.4 Example: Anisotropic Diffusion of Water in the Eye Lens
- •15.2.5 Data Acquisition
- •15.3 Digital Processing of DT Images
- •15.3.2 Diagonalization of the DT
- •15.3.3 Gradient Calibration Factors
- •15.3.4 Sorting Bias
- •15.3.5 Fractional Anisotropy
- •15.3.6 Other Anisotropy Metrics
- •15.4 Applications of DTI to Articular Cartilage
- •15.4.1 Bovine AC
- •15.4.2 Human AC
- •References
- •Index
158 |
M.A. Dabbah et al. |
7.5Quantitative Analysis and Evaluation of Linear Structure Detection Methods
7.5.1 Methodology of Evaluation
The performance of the dual-model detector and the other methods described in Sect. 7.2 is obtained by validating the extracted nerve fibers in comparison with an expert manual delineation using CCMetrics.4 Only the raw response of each method is taken into account without any further postprocessing operations or shade correction methods as shown in Fig. 7.9. Binary images are obtained by a simple uniform thresholding operation that is followed by a thinning operation to achieve a one-pixel-wide skeleton image.
To be consistent in this comparison of different methods, the detection algorithm did not include any pixel classifications. Responses from techniques with multiscale analysis, such as LinOp, Hessian, DTCWT, and Monogenic Signal, were considered by taking the maximum magnitude of all levels.
Three measures have been used to quantify the evaluation: the false-positive (FPR), the true-positive (TPR), and the equal-error rate (EER), which is the average of optimal FPR and false-negative rate at minimal difference between both. A receiver operating characteristic (ROC) analysis was conducted by comparing the generated skeleton at different threshold intervals of the methods’ responses with the manually delineated ground-truth. A tolerance of ±3.141 μm (3 pixels) was allowed in determining coincidence between the ground-truth and the detected nerve fibers.
The peak signal to noise ratio (PSNR) in (7.18) is also used to evaluate the performance of all methods.
MAXI |
|
PSNRdB = 20 log √e |
(7.18) |
The PSNR is computed with respect to the mean squared error e, which is the mean square difference between the detected nerve fibers and the ground-truth manual delineation. MAXI is the maximum possible intensity (fixed) and e is the mean square error. The practical implementations of the Hessian, the DTCWT, and the Monogenic Signal were obtained from public domain sources [44–46], while the rest were implemented by our research group.
4CCMetrics is a purpose built interactive graphical interface which helps in the analysis undertaken by experts to manually delineate nerve fibers in CCM images.
7 Detecting and Analyzing Linear Structures in Biomedical Images: A Case Study... |
159 |
Fig. 7.9 Example response images for all different detection methods. The responses were taken as a raw output from the detector without any postprocessing and converted to binary images and then to skeleton images for fair comparison
7.5.2 Database and Experiment Setup
The evaluation has been conducted on a database of 525 CCM images captured using the HRT-III5 microscope from 69 subjects (20 controls and 49 diabetic patients). The pixel size is 1.0417 μm and the field of view is 400 × 400 μm2 of
5Heidelberg Engineering Inc. modified to acquire corneal confocal images.
160 |
M.A. Dabbah et al. |
Fig. 7.10 The receiver operating characteristic (ROC) curves of all five detectors. The dual-model performance of detecting nerve fibres has clearly outperformed the other methods
the cornea. For each individual, several fields of view are selected manually in the centre of the cornea from the Bowman’s layer showing recognizable nerve fibers.
Using the neuropathy disability score (NDS) [47], 48 patients were categorized into four groups according to severity of neuropathy (nonneuropathic: 0 ≤ NDS ≤ 2(n = 26), mild: 3 ≤ NDS ≤ 5(n = 9), moderate: 6 ≤ NDS ≤ 8(n = 10) and severe:
9≤ NDS ≤ 10(n = 3).
7.5.3Nerve Fiber Detection Comparison Results
The superior performance of the dual-model is borne out by the ROC curves of Fig. 7.10 in which the dual-model shows improved detection at all operation points. The EER and PSNR values for all the methods are presented in the box-plots in Fig. 7.11 and Table 7.1. Each data point in Fig. 7.11 corresponds to the evaluation on one of the 525 CCM images in the database.
The dual-model shows lower EER and higher PSNR than all other methods (Table 7.1). These improvements are statistically significant (p ≈0 using three different nonparametric tests). The table also shows that the standard deviations of both EER and PSNR are low for the dual-model, which indicates a more stable and robust behavior.
7 Detecting and Analyzing Linear Structures in Biomedical Images: A Case Study... |
161 |
Fig. 7.11 The box-plots of the EER (left) and the PSNR (right) are shown for all methods. The box-plots indicate the upper and the lower quartiles as well as the median (the bar) of the EER and PSNR values respectively; whiskers show the extent of the rest of the data while crosses indicate outliers for (a) dual-model, (b) LinOp, (c) 2D Gabor, (d) Hessian, (e) DTCWT, and (f) Monogenic
Table 7.1 A comparison of mean EER and PSNR and their standard deviations for all five detection methods; the dual-model has achieved the lowest EER and the highest PSNR
|
|
EER(%) |
|
|
PSNR(dB) |
|
|
|
μ |
σ |
|
μ |
σ |
Dual-model |
17.79 |
10.58 |
19.0774 |
2.16 |
||
LinOp |
22.65 |
10.76 |
18.5132 |
2.09 |
||
2D Gabor |
24.15 |
10.74 |
18.8042 |
2.11 |
||
Hessian |
23.14 |
11.53 |
17.9269 |
2.27 |
||
DTCWT |
34.17 |
10.43 |
17.0045 |
2.23 |
||
Monogenic |
26.50 |
12.58 |
18.1084 |
2.20 |
||
|
|
|
|
|
|
|
The closest performance to the dual-model has been achieved by LinOp, which has 4.86% greater EER on average. The performance of the Hessian methods is also similar with an average EER of 23.14% (Table 7.1). The poorest performance is obtained with the DTCWT and Monogenic Signal, as these are general-purpose methods. The dual-model has also shown a superior performance in terms of achieving higher PSNR values for the response images. As shown in the box-plot (Fig. 7.11), the average PSNR of the dual-model is 19.08 dB, while all PSNR groups have means smaller than the dual-model as indicated by Table 7.1, which shows a summary of the comparison. The closest PSNR is at 18.80 dB.
7.5.4 Evaluation of Clinical Utility
Of the several features listed in Sect. 7.3.3, which may be used to quantify the nerve fibers, NFL has been shown to be the most discriminating, and it is that feature that
162 |
M.A. Dabbah et al. |
Fig. 7.12 The scatter plot of the manually and the automatically computed NFL metrics. There is clearly a very strong correlation (r = 0.93)
Table 7.2 A comparison of the manual and the automated analysis; unlike manual analysis, the automated analysis is insensitive to observer variability and can be much quicker
|
Manual |
Automated |
p-value(×10−8) |
0.03 |
2.03 |
Coefficient of variation |
0.34 |
0.29 |
Observer variability |
Yes |
No |
Processing time |
5–10 min |
≈ 5 s |
we use to compare automatic detection with expert manual analysis (ground-truth). NFL is measured as the total number of pixels in the nerve fiber skeleton after the postprocessing of Sect. 7.4.4.
Figure 7.12 shows a scatter plot of manual vs. automatic measurements of NFL. There is clearly a strong correlation (r = 0.93) indicating that the automated system is successfully identifying the correct nerve fibers. The coefficient of variation cv = σ /μ of the manual analysis is 0.34, reducing for the automated analysis to 0.29, which indicates more reliability and robustness of the results (Table 7.2).
The box-plots in Fig. 7.13 shows NFL measured manually and automatically for the stratified group of subjects. There is a strong similarity between the manual and the automated analysis. However, the scale of the NFL has slightly changed from