Index

3D Morphable Model, see Morphable Model

3D face rendering, 226

3D laser scan, 218, 221

3D reconstruction, 231, 237

Emotional-based expressions, 249

AAM (Active Appearance Models), 52 Access Control, 373

Action Units, 68, 69

Active Appearance Models, 52, 236 for tracking, 77, 84

Active Shape Models, 49 AdaBoost, 14, 19

Learning algorithm, 23 Strong classifier, 19 Weak Classifier, 19

AFEA, 247 Aligning Shapes, 41

Analysis by synthesis, 226, 229 analysis by synthesis, 217 Appearance feature, 263 Appearance modeling, 182 Appearance Models, 39, 46 Appearance-based, 8, 13

tracking, 72, 76, 82 Appearance-based representation, 219 AR, 302

ASM (Active Shape Models), 49

BANCA, 303

Basis functions, 142

KLT, 143

Bayes rule, 230

Bayesian face subregions, 205

BioID face database, 322

Biometric sample, 329

Bootstrapping, 225

Camera models, 70 Candide, 69, 73, 77 Caricature, 224 Caricatures, 356 CAS-PEAL, 304 Cascade of Classifiers, 26 Categorization, 352 Children’s faces, 353

Closed-set identification, 334 CMC, 334

CMU

Hyperspectral, 306 PIE, 307

CMU test set II, 321

Cohn-Kanade AU-Coded facial expression database, 324

Color correction and skin detection, 121 Color models, 119

Color models for sequences, 121 Color spaces, 114

Combined MIT/CMU test set, 320 Compositional AAM, 56 Configuration, 351

Convex combination, 288, 289 Correspondence, 217

based representation, 219 estimation of, 221

Cumulative match characteristic, 334 Cyberware scanner, 220

392 Index

Database, 255 Databases

face detection, 319 face recognition, 301

facial expression analysis, 322 Deliberate expression, 253 Dimension

intrinsic, 142 Dimensionality, 141 Direct AAM, 57

Eigen light-fields classification, 201 definition, 197 estimation algorithm, 198

face recognition across pose, 200 Eigenface, 219

Eigenfaces, 67, 78, 145 Bayesian, 148 probabilistic, 145

Eigenfeatures, 164

EKF, see Extended Kalman Filter Elastic graph matching, 189 EM-Algorithm, 225

Entropy, 173

Equinox infrared database, 309 Evaluation of tracking quality, 129 Expression details, 289, 291 Expression editing, 295, 297 Expression intensity, 252 Expression mapping, 288, 290 Expression Models, 47

Expression ratio image(ERI), 289, 290 Expression recognition, 265

Extended Kalman Filter, 73, 75 Extrapersonal variations, 148

Face Acquisition, 248 Face acquisition, 257 Face age, 358

Face Databases, 380 Face detection, 3, 13, 258

Merge, 29 Nonfrontal faces, 26 Preprocessing, 16

Face Identification, 372 Face image variations, 218 Face modeling, 67, 277

from a single image, 278, 282 from an image sequence , 278

from two orthogonal views, 278, 282 Face prototype, 355

Face Recognition, 59

Video-based, 169 Face recognition, 3, 193

across illumination, 195 across pose, 193

across pose and illumination, 196 multiview, 193

Still-to-video , 169 system, 1, 2 technologies, 9

under varying illumination, 286 Video-to-video, 190

Face Recognition Vendor Test

Face Recognition Vendor Test 2000, 343 Face Recognition Vendor Test 2002, 344

Face Recognition Vendor Test 2002 (FRVT02), 241

Face recognition with spherical harmonic representations, 102

Face relighting, 277, 282 from a single image, 284

Face Space, 356

Face space, 68, 219, 222 face space, 142

Face subregions, 205 Face typicality, 355 Face Verification, 59

Facial Action Coding System, 68 Facial Animation Parameters, 66, 68

Facial Data Extraction and Representation, 248 Facial Definition Parameters, 68

Facial Expression, 353 Facial expression, 366

Facial Expression Analysis, 247 Facial expression recognition, 248 Facial expression synthesis, 277, 287 Facial feature extraction, 261

Facial feature Representation, 261 Facial motion, 364

Facial speech, 366

FACS, see Facial Action Coding System FACS action units, 249

Familiarity, 360

FAP, see Facial Animation Parameters FDP, see Facial Definition Parameters Feature selection, 21

Feature-based, 8

Feature-based tracking, 73, 82 Featureless, see Appearance-based FERET, 238, 310, 329

FERET data set, 156 Fisher light-fields

definition, 209

face recognition across pose and illumination, 210

Fisherfaces, 147

kernel Fisherfaces, 156 Fitting algorithm, 218, 229

features, 229 initialization, 229

Fitting Score, 241 FloatBoost, 24

Learning algorithm, 25 Focal length, 227

FRVT, 371

FRVT 2000, 343

FRVT 2002, 344

functional magnetic resonance imaging, 364 Functional Neuroimaging, 364

Funk-Hecke theorem, 94 Fusiform face area, 364

Gallery, 329 Gaze, 366

Gender Classification, 353 Generative model, 217 Geometric feature, 262 Geometric warping, 288

Geometry-driven expression synthesis, 290 Ground truth, 255

Haar-like features, 20 Harmonic reflectances, 99

Harvard Robotics Lab database, 317 Head orientation, 253

Head pose estimation, 259 Head rotations, 26

Hierarchical principal component analysis, 293 Human-Computer Interactions, 384

ICA, 150 Identification, 330, 350

across pose, 238

across Pose and illumination, 240 confidence, 241

Identity Variation, 47

Illumination, 114, 361

Index 393

Illumination Cone, 93 Illumination modeling, 227 Illumination normalization, 211 Image space, 141

Image synthesis, 228 importance sampling, 174 Indentification, 352

Independent Component Analysis, 150 Interior point method, 292 Interpolation models, 360 intrapersonal variations, 148

Inverse Compositional Image Alignment, 232 Inverse rendering, 283

Iterative closest point, 278

JAFFE database, 322

Karhunen-Loeve` Transform, 143

Kernel machines, 19

KLT, 143

Korean face database, 312

Laser scans, 358

Law Enforcement, 379 LDA, 8, 147 Learning, 8 Light-Field, 197

Linear class of face geometries, 279 Linear Discriminant Analysis, 147 Linear Gaussian model, 224

Magnocellular stream, 366

Maximum a posteriori estimation, 230 Metric, 279

MIT CBCL face database #1, 322 MIT database, 318

Model space, 279

Model-based bundle adjustment, 281 Model-based tracking, 71 Model-driven bundle adjustment, 278 Monte Carlo method, 174

Morph targets, 69

Morph-based facial expression synthesis, 288 Morphable Model, 217

construction of, 220 Regularized, 224 Segmented, 225

Motion propagation, 293 Motion-based tracking, 71 MPEG-4 Facial Animation, 66, 68

394 Index

MPI database, 313

Multimedia Management, 381

Multiple Gaussians, 17

Neural networks, 19

Neural response, 363

NIST mugshot database, 318

Non-additive combinations, 252

Nonfrontal, 15

Nonlinear Manifolds, 6

Normalization, 335

Notre Dame HID database, 314

Object centered representation, 219

Open-set identification, 330

Optical axis, 227

Optical Flow, 221

ORL database, 318

Other-race effect, 358

Parametric face model, 278 Parvocellular stream, 366 PCA, 8, 41, 142

kernel-PCA, 155 nonlinear, 154

Perspective projection, 70, 226 weak, 226

Phong model, 227 Photometric stereo, 106

Physically-based facial expression synthesis, 287 PIE, 231, 237, 238, 240

Plenoptic function, 197 Pose normalization, 241

Principal Component Analysis, 142 Principal component analysis, 92, 353, 356 Principal Components Analysis, 222

Probabilistic, 224 principal curves, 154

Principle Component Analysis, 41 Probe, 330

Probe sets, 329 Projection models, 70 Prosopagnosia, 362

Quadratic programming, 292

Quality of Model Match, 52

Quotient image, 284

Radiance environment map, 284

RANSAC, 82

Ratio image, 284–286, 289 Re-rendering across pose, 199 Receiver operator characteristic, 331 Recognition, 352

Region based color models, 121 Relighting From A Single Image, 284 Representation, 360

Rigid transformation, 226 ROC, 331

Score

Match, 330 Nonmatch, 330 Similarity, 330

Security, 375

sequential importance sampling, 169, 173 SfM, see Structure from Motion

Shape AAM, 55

Shape Models, 39

Shape reconstruction, 106

Singular Value Decomposition, 143 Skin Color, 16

Skin locus, 122

Skin locus from images, 124 Skin locus from spectra, 123 Skin reflectances, 116 Smart Cards, 379

Specular reflectance, 104 Spherical harmonic basis, 284

Spherical harmonic representations, 94 Spontaneous expression, 253

Statistics based color models, 120 Stochastic Newton Optimization (SNO), 230 Strong classifiers, 22

Structural theories, 360 Structure from Motion, 73, 75 Subspace, 3

Subsurface scattering, 91 Superior temporal sulcus, 364 Surveillance, 378

SVD, 143

Synthetic face image, 226

Tensorfaces, 152 Texture Mapping, 228 Texture mapping, 69, 78 Texture Models, 44

Texture Representation, 57 Thatcher Illusion, 351

three-dimensional representation, 217

Time series state space model, 169, 171 Tracking-and-recognition, 170 Tracking-then-recognition, 170 Transitions, 252

Triangle list, 227, 228

UMIST database, 318

University of Maryland database, 323 University of Oulu Physics-Based database, 318 University of Texas video database, 315

Vectorization, 200

Verification, 333

View-based representation, 234

Viewpoint, 360

Index 395

Virtual view, 241

Visual recognition, 187

Visual tracking, 183

Weak classifier, 21

Decision tree, 22

Stump, 21

Weak perspective projection, 71

XM2VTS, 319

Yale

face database, 319 face database B, 316