- •Biological and Medical Physics, Biomedical Engineering
- •Medical Image Processing
- •Preface
- •Contents
- •Contributors
- •1.1 Medical Image Processing
- •1.2 Techniques
- •1.3 Applications
- •1.4 The Contribution of This Book
- •References
- •2.1 Introduction
- •2.2 MATLAB and DIPimage
- •2.2.1 The Basics
- •2.2.2 Interactive Examination of an Image
- •2.2.3 Filtering and Measuring
- •2.2.4 Scripting
- •2.3 Cervical Cancer and the Pap Smear
- •2.4 An Interactive, Partial History of Automated Cervical Cytology
- •2.5 The Future of Automated Cytology
- •2.6 Conclusions
- •References
- •3.1 The Need for Seed-Driven Segmentation
- •3.1.1 Image Analysis and Computer Vision
- •3.1.2 Objects Are Semantically Consistent
- •3.1.3 A Separation of Powers
- •3.1.4 Desirable Properties of Seeded Segmentation Methods
- •3.2 A Review of Segmentation Techniques
- •3.2.1 Pixel Selection
- •3.2.2 Contour Tracking
- •3.2.3 Statistical Methods
- •3.2.4 Continuous Optimization Methods
- •3.2.4.1 Active Contours
- •3.2.4.2 Level Sets
- •3.2.4.3 Geodesic Active Contours
- •3.2.5 Graph-Based Methods
- •3.2.5.1 Graph Cuts
- •3.2.5.2 Random Walkers
- •3.2.5.3 Watershed
- •3.2.6 Generic Models for Segmentation
- •3.2.6.1 Continuous Models
- •3.2.6.2 Hierarchical Models
- •3.2.6.3 Combinations
- •3.3 A Unifying Framework for Discrete Seeded Segmentation
- •3.3.1 Discrete Optimization
- •3.3.2 A Unifying Framework
- •3.3.3 Power Watershed
- •3.4 Globally Optimum Continuous Segmentation Methods
- •3.4.1 Dealing with Noise and Artifacts
- •3.4.2 Globally Optimal Geodesic Active Contour
- •3.4.3 Maximal Continuous Flows and Total Variation
- •3.5 Comparison and Discussion
- •3.6 Conclusion and Future Work
- •References
- •4.1 Introduction
- •4.2 Deformable Models
- •4.2.1 Point-Based Snake
- •4.2.1.1 User Constraint Energy
- •4.2.1.2 Snake Optimization Method
- •4.2.2 Parametric Deformable Models
- •4.2.3 Geometric Deformable Models (Active Contours)
- •4.2.3.1 Curve Evolution
- •4.2.3.2 Level Set Concept
- •4.2.3.3 Geodesic Active Contour
- •4.2.3.4 Chan–Vese Deformable Model
- •4.3 Comparison of Deformable Models
- •4.4 Applications
- •4.4.1 Bone Surface Extraction from Ultrasound
- •4.4.2 Spinal Cord Segmentation
- •4.4.2.1 Spinal Cord Measurements
- •4.4.2.2 Segmentation Using Geodesic Active Contour
- •4.5 Conclusion
- •References
- •5.1 Introduction
- •5.2 Imaging Body Fat
- •5.3 Image Artifacts and Their Impact on Segmentation
- •5.3.1 Partial Volume Effect
- •5.3.2 Intensity Inhomogeneities
- •5.4 Overview of Segmentation Techniques Used to Isolate Fat
- •5.4.1 Thresholding
- •5.4.2 Selecting the Optimum Threshold
- •5.4.3 Gaussian Mixture Model
- •5.4.4 Region Growing
- •5.4.5 Adaptive Thresholding
- •5.4.6 Segmentation Using Overlapping Mosaics
- •5.6 Conclusions
- •References
- •6.1 Introduction
- •6.2 Clinical Context
- •6.3 Vessel Segmentation
- •6.3.1 Survey of Vessel Segmentation Methods
- •6.3.1.1 General Overview
- •6.3.1.2 Region-Growing Methods
- •6.3.1.3 Differential Analysis
- •6.3.1.4 Model-Based Filtering
- •6.3.1.5 Deformable Models
- •6.3.1.6 Statistical Approaches
- •6.3.1.7 Path Finding
- •6.3.1.8 Tracking Methods
- •6.3.1.9 Mathematical Morphology Methods
- •6.3.1.10 Hybrid Methods
- •6.4 Vessel Modeling
- •6.4.1 Motivation
- •6.4.1.1 Context
- •6.4.1.2 Usefulness
- •6.4.2 Deterministic Atlases
- •6.4.2.1 Pioneering Works
- •6.4.2.2 Graph-Based and Geometric Atlases
- •6.4.3 Statistical Atlases
- •6.4.3.1 Anatomical Variability Handling
- •6.4.3.2 Recent Works
- •References
- •7.1 Introduction
- •7.2 Linear Structure Detection Methods
- •7.3.1 CCM for Imaging Diabetic Peripheral Neuropathy
- •7.3.2 CCM Image Characteristics and Noise Artifacts
- •7.4.1 Foreground and Background Adaptive Models
- •7.4.2 Local Orientation and Parameter Estimation
- •7.4.3 Separation of Nerve Fiber and Background Responses
- •7.4.4 Postprocessing the Enhanced-Contrast Image
- •7.5 Quantitative Analysis and Evaluation of Linear Structure Detection Methods
- •7.5.1 Methodology of Evaluation
- •7.5.2 Database and Experiment Setup
- •7.5.3 Nerve Fiber Detection Comparison Results
- •7.5.4 Evaluation of Clinical Utility
- •7.6 Conclusion
- •References
- •8.1 Introduction
- •8.2 Methods
- •8.2.1 Linear Feature Detection by MDNMS
- •8.2.2 Check Intensities Within 1D Window
- •8.2.3 Finding Features Next to Each Other
- •8.2.4 Gap Linking for Linear Features
- •8.2.5 Quantifying Branching Structures
- •8.3 Linear Feature Detection on GPUs
- •8.3.1 Overview of GPUs and Execution Models
- •8.3.2 Linear Feature Detection Performance Analysis
- •8.3.3 Parallel MDNMS on GPUs
- •8.3.5 Results for GPU Linear Feature Detection
- •8.4.1 Architecture and Implementation
- •8.4.2 HCA-Vision Features
- •8.4.3 Linear Feature Detection and Analysis Results
- •8.5 Selected Applications
- •8.5.1 Neurite Tracing for Drug Discovery and Functional Genomics
- •8.5.2 Using Linear Features to Quantify Astrocyte Morphology
- •8.5.3 Separating Adjacent Bacteria Under Phase Contrast Microscopy
- •8.6 Perspectives and Conclusions
- •References
- •9.1 Introduction
- •9.2 Bone Imaging Modalities
- •9.2.1 X-Ray Projection Imaging
- •9.2.2 Computed Tomography
- •9.2.3 Magnetic Resonance Imaging
- •9.2.4 Ultrasound Imaging
- •9.3 Quantifying the Microarchitecture of Trabecular Bone
- •9.3.1 Bone Morphometric Quantities
- •9.3.2 Texture Analysis
- •9.3.3 Frequency-Domain Methods
- •9.3.4 Use of Fractal Dimension Estimators for Texture Analysis
- •9.3.4.1 Frequency-Domain Estimation of the Fractal Dimension
- •9.3.4.2 Lacunarity
- •9.3.4.3 Lacunarity Parameters
- •9.3.5 Computer Modeling of Biomechanical Properties
- •9.4 Trends in Imaging of Bone
- •References
- •10.1 Introduction
- •10.1.1 Adolescent Idiopathic Scoliosis
- •10.2 Imaging Modalities Used for Spinal Deformity Assessment
- •10.2.1 Current Clinical Practice: The Cobb Angle
- •10.2.2 An Alternative: The Ferguson Angle
- •10.3 Image Processing Methods
- •10.3.1 Previous Studies
- •10.3.2 Discrete and Continuum Functions for Spinal Curvature
- •10.3.3 Tortuosity
- •10.4 Assessment of Image Processing Methods
- •10.4.1 Patient Dataset and Image Processing
- •10.4.2 Results and Discussion
- •10.5 Summary
- •References
- •11.1 Introduction
- •11.2 Retinal Imaging
- •11.2.1 Features of a Retinal Image
- •11.2.2 The Reason for Automated Retinal Analysis
- •11.2.3 Acquisition of Retinal Images
- •11.3 Preprocessing of Retinal Images
- •11.4 Lesion Based Detection
- •11.4.1 Matched Filtering for Blood Vessel Segmentation
- •11.4.2 Morphological Operators in Retinal Imaging
- •11.5 Global Analysis of Retinal Vessel Patterns
- •11.6 Conclusion
- •References
- •12.1 Introduction
- •12.1.1 The Progression of Diabetic Retinopathy
- •12.2 Automated Detection of Diabetic Retinopathy
- •12.2.1 Automated Detection of Microaneurysms
- •12.3 Image Databases
- •12.4 Tortuosity
- •12.4.1 Tortuosity Metrics
- •12.5 Tracing Retinal Vessels
- •12.5.1 NeuronJ
- •12.5.2 Other Software Packages
- •12.6 Experimental Results and Discussion
- •12.7 Summary and Future Work
- •References
- •13.1 Introduction
- •13.2 Volumetric Image Visualization Methods
- •13.2.1 Multiplanar Reformation (2D slicing)
- •13.2.2 Surface-Based Rendering
- •13.2.3 Volumetric Rendering
- •13.3 Volume Rendering Principles
- •13.3.1 Optical Models
- •13.3.2 Color and Opacity Mapping
- •13.3.2.2 Transfer Function
- •13.3.3 Composition
- •13.3.4 Volume Illumination and Illustration
- •13.4 Software-Based Raycasting
- •13.4.1 Applications and Improvements
- •13.5 Splatting Algorithms
- •13.5.1 Performance Analysis
- •13.5.2 Applications and Improvements
- •13.6 Shell Rendering
- •13.6.1 Application and Improvements
- •13.7 Texture Mapping
- •13.7.1 Performance Analysis
- •13.7.2 Applications
- •13.7.3 Improvements
- •13.7.3.1 Shading Inclusion
- •13.7.3.2 Empty Space Skipping
- •13.8 Discussion and Outlook
- •References
- •14.1 Introduction
- •14.1.1 Magnetic Resonance Imaging
- •14.1.2 Compressed Sensing
- •14.1.3 The Role of Prior Knowledge
- •14.2 Sparsity in MRI Images
- •14.2.1 Characteristics of MR Images (Prior Knowledge)
- •14.2.2 Choice of Transform
- •14.2.3 Use of Data Ordering
- •14.3 Theory of Compressed Sensing
- •14.3.1 Data Acquisition
- •14.3.2 Signal Recovery
- •14.4 Progress in Sparse Sampling for MRI
- •14.4.1 Review of Results from the Literature
- •14.4.2 Results from Our Work
- •14.4.2.1 PECS
- •14.4.2.2 SENSECS
- •14.4.2.3 PECS Applied to CE-MRA
- •14.5 Prospects for Future Developments
- •References
- •15.1 Introduction
- •15.2 Acquisition of DT Images
- •15.2.1 Fundamentals of DTI
- •15.2.2 The Pulsed Field Gradient Spin Echo (PFGSE) Method
- •15.2.3 Diffusion Imaging Sequences
- •15.2.4 Example: Anisotropic Diffusion of Water in the Eye Lens
- •15.2.5 Data Acquisition
- •15.3 Digital Processing of DT Images
- •15.3.2 Diagonalization of the DT
- •15.3.3 Gradient Calibration Factors
- •15.3.4 Sorting Bias
- •15.3.5 Fractional Anisotropy
- •15.3.6 Other Anisotropy Metrics
- •15.4 Applications of DTI to Articular Cartilage
- •15.4.1 Bovine AC
- •15.4.2 Human AC
- •References
- •Index
354 |
K.I. Momot et al. |
shown in a DWI phantom that it is possible to resolve two fiber orientations with a crossing angle as small as 30◦.
15.3 Digital Processing of DT Images
The raw data set obtained from a DTI measurement described in Sect. 15.2 contains one or more zero-gradient images and six or more diffusion-weighted images corresponding to distinct diffusion directions. To render this data in a form amenable to interpretation, the following processing steps are usually performed:
(I)For each voxel in the image, the six independent components of the DT (DT) are calculated. The tensor obtained in this step is the so-called laboratory-frame DT: it is linked to laboratory-based coordinate axes, which may be defined as the directions of the hardware X, Y, Z gradient coils or the Read, Phase, and Slice directions of the image.
(II)The laboratory-frame DT can then be diagonalized. The diagonalization procedure yields:
(i)The principal diffusivities oreigenvalues D1, D2 and D3 of the DT;
(ii)The orientation of the principal axes oreigenvectors of the DT with respect to the laboratory frame.
This represents the DT in the ‘sample’ frame linked with the physical alignment order in the tissue. The relationship between the laboratory-frame and the diagonalized DT is illustrated in Fig. 15.9 and discussed in detail later in this section.
Steps (I) and (II) can be regarded as the primary DTI processing. These steps are common to all DTI processing and carried out irrespective of the tissue imaged.
Fig. 15.9 Diagonalization of the diffusion tensor involves finding the rotation of the coordinate frame that aligns the coordinate axes with the principal axes of the ellipsoid
15 Digital Processing of Diffusion-Tensor Images of Avascular Tissues |
355 |
(III)In “secondary” processing, the DT image obtained in step (II) is represented as a voxel-by-voxel map of one or more of the following parameters:
Direction of the principal eigenvector.
Angle between the principal eigenvector and a specified axis. Principal eigenvalue (maximum diffusivity).
Mean eigenvalue (mean diffusivity). Fractional anisotropy.
The nonaxial anisotropy parameters of the DT.
The user must decide what DT parameters best enable visualization of the image acquired.
(IV) In “tertiary” processing, the information from individual voxels is translated into “global” characteristics describing the image as a whole. An example of such analysis is the nerve fiber tracking used in DTI of the brain or the spinal cord. The voxels of the image are grouped into tracts such that the principal eigenvectors of the voxels within a tract form continuous “flow lines” representing a large bundle of axons.
Unlike the primary DTI processing, the secondary and tertiary processing is organor tissue dependent. The choice of the processing approaches and the DT metrics is determined by the morphology of the tissue and the information sought about the tissue. In avascular tissues, the objective is to characterize the overall alignment order in the tissue rather than identify individual fibers. (The latter is not possible because of the huge number of fibers within a single voxel.) Examples of secondary processing of DT images of cartilage will be presented in Sect. 15.4.
In the following, we provide an overview of the basic principles and the mathematics underlying DT image processing. The processing techniques are described without reference to a specific platform and are generally applicable.
15.3.1Primary DTI Processing: Calculation of the Laboratory-Frame DT
In Sect. 15.2, the signal intensity was represented as a function of the diffusion gradient as shown in (15.20). This representation provides an intuitive and visual explanation of the diffusive attenuation of the signal in DT images. In practice, it is more convenient to base DTI processing on the so-called B matrix. Equation(15.20) can be rewritten as follows (15.24):
S(g) |
3 |
3 |
|
|
ln |
|
= − ∑ ∑ bijDij ≡ −b : D, |
(15.23) |
|
S0 |
||||
|
|
i=1 j=1 |
|
356 |
K.I. Momot et al. |
where the indices i, j take the values of x, y, or z. The B matrix, b, is a 3 × 3 real symmetric matrix. In the spin-echo experiment, its values are given by
bij = γ2gig jδ2( −δ/3), |
(15.24) |
where gi, g j are the components of the diffusion gradient vector g. The B matrix is an extension of the quantity b introduced in (15.18) to multiple gradient directions.
There are two main advantages to using the B matrix rather than the gradient vectors for processing of DT images. First, the functional form of the signal attenuation is dependent on the DTI pulse sequence used. Equation(15.20) applies to the basic spin-echo pulse-sequence with rectangular diffusion gradients. The attenuation expression is different if a different pulse sequence or nonrectangular diffusion gradients are used [25]. Calculation of the attenuation factor can be difficult and time-consuming for the general pulse sequence [26]. Fortunately, the attenuation equation is amenable to algorithmic, software-based calculation. When the attenuation factor is kept in the simple and general form given by (15.23), any pulse sequence-specific factors can be incorporated into the B matrix as part of the algorithm. The software of most modern MRI spectrometers is capable of automatic calculation of the B matrix for any pulse sequence installed on the spectrometer, eliminating the need for the operator to perform this time-consuming calculation manually.
The second advantage of using the B matrix is that it facilitates accounting for contribution to the diffusive attenuation due to the imaging gradients. This source usually leads to much smaller attenuation than the diffusion gradients. However, it can be important when an accurate DT is sought or when imaging at high spatial resolution. As with diffusion-gradient attenuation factors, the spectrometer software can automatically build all the pulse sequence-specific corrections to the diffusion attenuation factor into the B matrix. Once the B matrix for each diffusion gradient is known, the calculation of the DT can be performed in a way that is independent of the measurement method. Automatic calculation of the B matrix means that DTI processing is greatly simplified from the operator’s point of view.
Equation (15.23) yields the signal attenuation for a known B matrix and a known DT. In DTI measurements, where the DT is not known a priori, the inverse problem must be solved: the DT needs to be determined from a set of NG ≥ 7 measurements of the signal intensity. In this inverse problem, the inputs are NG distinct 3 × 3 B matrices (one B matrix for each diffusion gradient vector) and the corresponding NG measured signal values. The DT is the output. In DT imaging, this problem is solved for each voxel in the image, yielding a separate DT for each voxel (see Fig. 15.10).
In practice, two typical scenarios are encountered:
(1)The diffusion gradient directions correspond to the “pure” elements of the laboratory-frame DT: Dxx, Dxy, . . . , as shown in (15.21) and Fig. 15.2a.
15 Digital Processing of Diffusion-Tensor Images of Avascular Tissues |
357 |
Fig. 15.10 Schematic illustration of a DTI dataset. Each voxel in the image is characterized by a unique diffusion tensor: three eigenvalues (the principal diffusivities) and three mutually perpendicular eigenvectors. In this illustration, the lengths of the eigenvectors are proportional to the corresponding eigenvalues
In this scenario, the diagonal elements of the laboratory-frame DT are simply the diffusivities along the respective gradient directions:
1 |
|
Sii |
i = x, y, z. |
|
|
Dii = − |
|
ln |
|
(15.25) |
|
b |
S0 |
The off-diagonal elements are given by [27]:
Dxy = − |
1 |
|
Sxx |
+ ln |
Syy |
1 |
|
Sxy |
|
|
|
|
ln |
|
|
+ |
|
ln |
|
, etc. |
(15.26) |
||
2b |
S0 |
S0 |
b |
S0 |
Equations (15.25) and (15.26) are applicable only in the special case when the gradient directions are given by (15.21). This special case is very instructive for beginners because it visually and simply illustrates the meaning of the diagonal and the off-diagonal elements of the DT.
(2)The second scenario is a data set containing more than the minimal number of diffusion gradient directions, as illustrated in Fig. 15.2b.
In this case, the signal corresponding to each direction depends on a combination of several (potentially all) elements of the DT. The DT is determined using leastsquares fitting of (15.23) to all the measured signal values simultaneously:
(i)Create a vector of length NG containing the signal values from the NG measurements: s = (S1 . . . SNG).
(ii)For each n = 1 . . . NG, calculate yn = −ln(Sn);
(iii)Set up the linearized least-squares fit equation:
3 |
3 |
|
yn = A + ∑ ∑ (bij)nDij. |
(15.27) |
i=1 j=1