- •Biological and Medical Physics, Biomedical Engineering
- •Medical Image Processing
- •Preface
- •Contents
- •Contributors
- •1.1 Medical Image Processing
- •1.2 Techniques
- •1.3 Applications
- •1.4 The Contribution of This Book
- •References
- •2.1 Introduction
- •2.2 MATLAB and DIPimage
- •2.2.1 The Basics
- •2.2.2 Interactive Examination of an Image
- •2.2.3 Filtering and Measuring
- •2.2.4 Scripting
- •2.3 Cervical Cancer and the Pap Smear
- •2.4 An Interactive, Partial History of Automated Cervical Cytology
- •2.5 The Future of Automated Cytology
- •2.6 Conclusions
- •References
- •3.1 The Need for Seed-Driven Segmentation
- •3.1.1 Image Analysis and Computer Vision
- •3.1.2 Objects Are Semantically Consistent
- •3.1.3 A Separation of Powers
- •3.1.4 Desirable Properties of Seeded Segmentation Methods
- •3.2 A Review of Segmentation Techniques
- •3.2.1 Pixel Selection
- •3.2.2 Contour Tracking
- •3.2.3 Statistical Methods
- •3.2.4 Continuous Optimization Methods
- •3.2.4.1 Active Contours
- •3.2.4.2 Level Sets
- •3.2.4.3 Geodesic Active Contours
- •3.2.5 Graph-Based Methods
- •3.2.5.1 Graph Cuts
- •3.2.5.2 Random Walkers
- •3.2.5.3 Watershed
- •3.2.6 Generic Models for Segmentation
- •3.2.6.1 Continuous Models
- •3.2.6.2 Hierarchical Models
- •3.2.6.3 Combinations
- •3.3 A Unifying Framework for Discrete Seeded Segmentation
- •3.3.1 Discrete Optimization
- •3.3.2 A Unifying Framework
- •3.3.3 Power Watershed
- •3.4 Globally Optimum Continuous Segmentation Methods
- •3.4.1 Dealing with Noise and Artifacts
- •3.4.2 Globally Optimal Geodesic Active Contour
- •3.4.3 Maximal Continuous Flows and Total Variation
- •3.5 Comparison and Discussion
- •3.6 Conclusion and Future Work
- •References
- •4.1 Introduction
- •4.2 Deformable Models
- •4.2.1 Point-Based Snake
- •4.2.1.1 User Constraint Energy
- •4.2.1.2 Snake Optimization Method
- •4.2.2 Parametric Deformable Models
- •4.2.3 Geometric Deformable Models (Active Contours)
- •4.2.3.1 Curve Evolution
- •4.2.3.2 Level Set Concept
- •4.2.3.3 Geodesic Active Contour
- •4.2.3.4 Chan–Vese Deformable Model
- •4.3 Comparison of Deformable Models
- •4.4 Applications
- •4.4.1 Bone Surface Extraction from Ultrasound
- •4.4.2 Spinal Cord Segmentation
- •4.4.2.1 Spinal Cord Measurements
- •4.4.2.2 Segmentation Using Geodesic Active Contour
- •4.5 Conclusion
- •References
- •5.1 Introduction
- •5.2 Imaging Body Fat
- •5.3 Image Artifacts and Their Impact on Segmentation
- •5.3.1 Partial Volume Effect
- •5.3.2 Intensity Inhomogeneities
- •5.4 Overview of Segmentation Techniques Used to Isolate Fat
- •5.4.1 Thresholding
- •5.4.2 Selecting the Optimum Threshold
- •5.4.3 Gaussian Mixture Model
- •5.4.4 Region Growing
- •5.4.5 Adaptive Thresholding
- •5.4.6 Segmentation Using Overlapping Mosaics
- •5.6 Conclusions
- •References
- •6.1 Introduction
- •6.2 Clinical Context
- •6.3 Vessel Segmentation
- •6.3.1 Survey of Vessel Segmentation Methods
- •6.3.1.1 General Overview
- •6.3.1.2 Region-Growing Methods
- •6.3.1.3 Differential Analysis
- •6.3.1.4 Model-Based Filtering
- •6.3.1.5 Deformable Models
- •6.3.1.6 Statistical Approaches
- •6.3.1.7 Path Finding
- •6.3.1.8 Tracking Methods
- •6.3.1.9 Mathematical Morphology Methods
- •6.3.1.10 Hybrid Methods
- •6.4 Vessel Modeling
- •6.4.1 Motivation
- •6.4.1.1 Context
- •6.4.1.2 Usefulness
- •6.4.2 Deterministic Atlases
- •6.4.2.1 Pioneering Works
- •6.4.2.2 Graph-Based and Geometric Atlases
- •6.4.3 Statistical Atlases
- •6.4.3.1 Anatomical Variability Handling
- •6.4.3.2 Recent Works
- •References
- •7.1 Introduction
- •7.2 Linear Structure Detection Methods
- •7.3.1 CCM for Imaging Diabetic Peripheral Neuropathy
- •7.3.2 CCM Image Characteristics and Noise Artifacts
- •7.4.1 Foreground and Background Adaptive Models
- •7.4.2 Local Orientation and Parameter Estimation
- •7.4.3 Separation of Nerve Fiber and Background Responses
- •7.4.4 Postprocessing the Enhanced-Contrast Image
- •7.5 Quantitative Analysis and Evaluation of Linear Structure Detection Methods
- •7.5.1 Methodology of Evaluation
- •7.5.2 Database and Experiment Setup
- •7.5.3 Nerve Fiber Detection Comparison Results
- •7.5.4 Evaluation of Clinical Utility
- •7.6 Conclusion
- •References
- •8.1 Introduction
- •8.2 Methods
- •8.2.1 Linear Feature Detection by MDNMS
- •8.2.2 Check Intensities Within 1D Window
- •8.2.3 Finding Features Next to Each Other
- •8.2.4 Gap Linking for Linear Features
- •8.2.5 Quantifying Branching Structures
- •8.3 Linear Feature Detection on GPUs
- •8.3.1 Overview of GPUs and Execution Models
- •8.3.2 Linear Feature Detection Performance Analysis
- •8.3.3 Parallel MDNMS on GPUs
- •8.3.5 Results for GPU Linear Feature Detection
- •8.4.1 Architecture and Implementation
- •8.4.2 HCA-Vision Features
- •8.4.3 Linear Feature Detection and Analysis Results
- •8.5 Selected Applications
- •8.5.1 Neurite Tracing for Drug Discovery and Functional Genomics
- •8.5.2 Using Linear Features to Quantify Astrocyte Morphology
- •8.5.3 Separating Adjacent Bacteria Under Phase Contrast Microscopy
- •8.6 Perspectives and Conclusions
- •References
- •9.1 Introduction
- •9.2 Bone Imaging Modalities
- •9.2.1 X-Ray Projection Imaging
- •9.2.2 Computed Tomography
- •9.2.3 Magnetic Resonance Imaging
- •9.2.4 Ultrasound Imaging
- •9.3 Quantifying the Microarchitecture of Trabecular Bone
- •9.3.1 Bone Morphometric Quantities
- •9.3.2 Texture Analysis
- •9.3.3 Frequency-Domain Methods
- •9.3.4 Use of Fractal Dimension Estimators for Texture Analysis
- •9.3.4.1 Frequency-Domain Estimation of the Fractal Dimension
- •9.3.4.2 Lacunarity
- •9.3.4.3 Lacunarity Parameters
- •9.3.5 Computer Modeling of Biomechanical Properties
- •9.4 Trends in Imaging of Bone
- •References
- •10.1 Introduction
- •10.1.1 Adolescent Idiopathic Scoliosis
- •10.2 Imaging Modalities Used for Spinal Deformity Assessment
- •10.2.1 Current Clinical Practice: The Cobb Angle
- •10.2.2 An Alternative: The Ferguson Angle
- •10.3 Image Processing Methods
- •10.3.1 Previous Studies
- •10.3.2 Discrete and Continuum Functions for Spinal Curvature
- •10.3.3 Tortuosity
- •10.4 Assessment of Image Processing Methods
- •10.4.1 Patient Dataset and Image Processing
- •10.4.2 Results and Discussion
- •10.5 Summary
- •References
- •11.1 Introduction
- •11.2 Retinal Imaging
- •11.2.1 Features of a Retinal Image
- •11.2.2 The Reason for Automated Retinal Analysis
- •11.2.3 Acquisition of Retinal Images
- •11.3 Preprocessing of Retinal Images
- •11.4 Lesion Based Detection
- •11.4.1 Matched Filtering for Blood Vessel Segmentation
- •11.4.2 Morphological Operators in Retinal Imaging
- •11.5 Global Analysis of Retinal Vessel Patterns
- •11.6 Conclusion
- •References
- •12.1 Introduction
- •12.1.1 The Progression of Diabetic Retinopathy
- •12.2 Automated Detection of Diabetic Retinopathy
- •12.2.1 Automated Detection of Microaneurysms
- •12.3 Image Databases
- •12.4 Tortuosity
- •12.4.1 Tortuosity Metrics
- •12.5 Tracing Retinal Vessels
- •12.5.1 NeuronJ
- •12.5.2 Other Software Packages
- •12.6 Experimental Results and Discussion
- •12.7 Summary and Future Work
- •References
- •13.1 Introduction
- •13.2 Volumetric Image Visualization Methods
- •13.2.1 Multiplanar Reformation (2D slicing)
- •13.2.2 Surface-Based Rendering
- •13.2.3 Volumetric Rendering
- •13.3 Volume Rendering Principles
- •13.3.1 Optical Models
- •13.3.2 Color and Opacity Mapping
- •13.3.2.2 Transfer Function
- •13.3.3 Composition
- •13.3.4 Volume Illumination and Illustration
- •13.4 Software-Based Raycasting
- •13.4.1 Applications and Improvements
- •13.5 Splatting Algorithms
- •13.5.1 Performance Analysis
- •13.5.2 Applications and Improvements
- •13.6 Shell Rendering
- •13.6.1 Application and Improvements
- •13.7 Texture Mapping
- •13.7.1 Performance Analysis
- •13.7.2 Applications
- •13.7.3 Improvements
- •13.7.3.1 Shading Inclusion
- •13.7.3.2 Empty Space Skipping
- •13.8 Discussion and Outlook
- •References
- •14.1 Introduction
- •14.1.1 Magnetic Resonance Imaging
- •14.1.2 Compressed Sensing
- •14.1.3 The Role of Prior Knowledge
- •14.2 Sparsity in MRI Images
- •14.2.1 Characteristics of MR Images (Prior Knowledge)
- •14.2.2 Choice of Transform
- •14.2.3 Use of Data Ordering
- •14.3 Theory of Compressed Sensing
- •14.3.1 Data Acquisition
- •14.3.2 Signal Recovery
- •14.4 Progress in Sparse Sampling for MRI
- •14.4.1 Review of Results from the Literature
- •14.4.2 Results from Our Work
- •14.4.2.1 PECS
- •14.4.2.2 SENSECS
- •14.4.2.3 PECS Applied to CE-MRA
- •14.5 Prospects for Future Developments
- •References
- •15.1 Introduction
- •15.2 Acquisition of DT Images
- •15.2.1 Fundamentals of DTI
- •15.2.2 The Pulsed Field Gradient Spin Echo (PFGSE) Method
- •15.2.3 Diffusion Imaging Sequences
- •15.2.4 Example: Anisotropic Diffusion of Water in the Eye Lens
- •15.2.5 Data Acquisition
- •15.3 Digital Processing of DT Images
- •15.3.2 Diagonalization of the DT
- •15.3.3 Gradient Calibration Factors
- •15.3.4 Sorting Bias
- •15.3.5 Fractional Anisotropy
- •15.3.6 Other Anisotropy Metrics
- •15.4 Applications of DTI to Articular Cartilage
- •15.4.1 Bovine AC
- •15.4.2 Human AC
- •References
- •Index
8 High-Throughput Detection of Linear Features: Selected Applications... |
189 |
Table 8.3 Features developed specifically to characterize linear structures in the astrocyte cytoskeleton
lineNo |
Number of lines detected within cell |
lineMean |
Mean brightness of lines within cell |
lineLength |
Length of lines within cell |
lineDensity |
Density of lines within cell |
lineAngle |
Mean orientation angle of lines Within cell |
lineAngleVar |
Variance of orientation angle of lines within cell |
lineWidthMean |
Mean width of lines within cell |
lineWidthMedian |
Median width of lines within cell |
lineStar |
“Starriness” measure based on how much linear structure is |
|
removed by an opening of a specific radius |
lineWeb |
“Webbiness” measure based on how much the gaps between |
|
lines are filled in by a closing of specific radius |
linear structures within a cell are generally aligned in a particular direction, whereas a high value indicates that the linear structures are randomly oriented. In addition, the lineDensity measure (the density of these “lines” within cells) also decreased (to 44 ±5% of control, p < 0.05), demonstrating a decrease in the cellular area labelled by GFAP.
8.5.3Separating Adjacent Bacteria Under Phase Contrast Microscopy
In bacterial cultures, cells tend to come in very close proximity to each other, such that the contrast between individual cells is sometimes minute (see Fig. 8.11). This makes bacterial counting and measurement of size and shape difficult. We have found that our linear feature detector was capable of detecting the very weak linear features that separate adjacent bacteria (see Fig. 8.11). By combining this tool with a standard Canny edge detector, a system was put together that permitted counting and segmenting bacteria with over 97% reliability [18]. We expect this new capability to be generally useful for microbial studies and we are planning to extend this work to allow tracking of bacterial cells with a comparable reliability. This work is motivated by the need to understand how bacterial films are able to spread quickly over tissue surfaces and thus cause infections.
8.6 Perspectives and Conclusions
Our approach to linear feature is both conceptually simple and very fast. It is fairly general – independent of any model assumption about linear features. This also means that the approach is not recommended for very noisy images. In the
190 |
L. Domanski et al. |
rare instances where noise was an issue, we found that it was often possible to use a preliminary processing step to increase the contrast of linear features, for example, using the technique of anisotropic filtering [19]. Another promising tool to preprocess linear feature images in this manner is afforded by so-called flexible path openings, which aim to identify paths along which the intensity remains high on average [20].
There are also instances where the contrast mechanism of the optical instrument makes the analysis difficult. This is the case with Differential Interference Contrast (DIC) microscopy. For such images, the Hilbert transform can be used to create images that are suitable for analysis.
In the case of very noisy images, the potential of more global methods, such as “shortest paths” [7], or even “linear paths” [9], has been explored. While useful, these more complex approaches may also represent warnings that the experimenter should go back to the bench to produce better data. With the availability of EMMCD camera and the availability of bright and photostable dyes, such as the AlexaTM dyes, this is often the best course of action.
This is an exciting time for image analysis, with a growing number of applications that can be automated. The samples presented in this chapter only touch the surface, as illustrated by the content of other exciting chapters in this book.
Acknowledgements The authors would like to thank the following people for allowing us to use their images as sample images: Marjo Gotte,¨ Novartis Institutes for BioMedical Research; Dr. Myles Fennell, Wyeth Research, Princeton, NJ, USA; Dr. Xiaokui Zhang, Helicon Therapeutics, Inc., USA; Prof. Pat Doherty, Kings College, London, UK; Dr. Jenny Gunnersen, Prof. Seong-Seng Tan, and Dr. Ross O’Shea Howard Florey Institute, Melbourne; Ass. Prof. Cynthia Whitchurch, UTS, Sydney.
References
1.Palmer, S.E.: Vision science. MIT, MA (1999)
2.Sun, C., Vallotton, P.: Fast linear feature detection using multiple directional non-maximum suppression. J. Microsc. 234, 147–57 (2009)
3.Kirbas, C., Quek, F.: A review of vessel extraction techniques and algorithms. ACM Comput. Surv. 36, 81–121 (2004)
4.Meijering, E.: Neuron tracing in perspective. Cytometry 77, 693–704 (2010)
5.Neubeck, A., Van Gool, L.: Efficient non-maximum suppression. In: Tang, Y.Y., Wang, S.P., Lorette, G., Yeung, D.S., Yan, H. (eds.) Proceedings of 18th International Conference on Pattern Recognition, vol. 3, pp. 850–855. IEEE Computer Soc, Los Alamitos (2006)
6.Soille, P.: Morphological image analysis, 2nd edn. Springer, Heidelberg (2004)
7.Sun, C., Pallottino, S.: Circular shortest path in images. Pattern Recogn. 36, 709–719 (2003)
8.Dorst, L., Smeulders, A.W.M.: Length estimators for digitized contours. Comput. Vis. Graph. Image Process. 40, 311–333 (1987)
9.Lagerstrom, R., Sun, C., Vallotton, P.: Boundary extraction of linear features using dual paths through gradient profiles. Pattern Recogn. Lett. 29, 1753–1757 (2008)
10.Owens, J.D., Luebke, D., Govindaraju, N., Harris, M., Kruger, J., Lefohn, A.E., Purcell, T.J.: A survey of general-purpose computation on graphics hardware. Comput. Graph. Forum 26, 80–113 (2007)
11.Harris, M.: Optimizing parallel reduction in CUDA. NVIDIA SDK white paper (2007)
8 High-Throughput Detection of Linear Features: Selected Applications... |
191 |
12.Hakura, Z.S., Gupta, A.: The design and analysis of a cache architecture for texture mapping. In: 24th Annual International Symposium on Computer Architecture, Conference Proceedings, pp. 108–120. Assoc Computing Machinery, New York (1997)
13.Cox, M., Bhandari, N., Shantz, M.. Multi-level texture caching for 3D graphics hardware. In: Proceedings of the 25th Annual International Symposium on Computer Architecture. IEEE Computer Soc, Los Alamitos, pp. 86–97 (1998)
14.Domanski, L.: Linear feature detection on GPUs. In: International Conference on Digital Image Computing: Techniques and Applications (DICTA), Sydney (2010)
15.Vallotton, P., Lagerstrom, R., Sun, C., Buckley, M., Wang, D., De Silva, M., Tan, S.S., Gunnersen, J.M.: Automated analysis of neurite branching in cultured cortical neurons using HCA-Vision. Cytometry A 71, 889–895 (2007)
16.Conrad, C., Gerlich, D.W.: Automated microscopy for high-content RNAi screening. J. Cell Biol. 188, 453–461 (2010)
17.Lau, C., O’Shea, R., Broberg, B., Bischof, L., Beart, P.: The Rho kinase inhibitor Fasudil up-regulates astrocytic glutamate transport subsequent to actin remodelling in murine cultured astrocytes. https://nsw.owa.csiro.au/pubmed/21309758. Br. J. Pharmacol. 163, 533–545 (2011)
18.Vallotton, P., Sun, C., Wang, D., Ranganathan, P., Turnbull, L. Whitchurch, C.: Segmentation and tracking of individual Pseudomonas aeruginosa bacteria in dense populations of motile cells. In: Image and Vision Computing New Zealand Wellington, New Zealand (2009)
19.Orkisz, M.M., Bresson, C., Magnin, I.E., Champin, O., Douek, P.C.: Improved vessel visualization in MR angiography by nonlinear anisotropic filtering. Magn. Reson. Med. 37, 914–919 (1997)
20.Heijmans, H., Buckley, M., Talbot, H.: Path-based morphological openings. In: ICIP: 2004 International Conference on Image Processing, vol. 1–5, pp. 3085–3088. IEEE, New York (2004)