- •Introduction
- •Who This Book Is For
- •What This Book Covers
- •How This Book Is Structured
- •What You Need to Use This Book
- •Conventions
- •Source Code
- •Errata
- •p2p.wrox.com
- •What Are Regular Expressions?
- •What Can Regular Expressions Be Used For?
- •Finding Doubled Words
- •Checking Input from Web Forms
- •Changing Date Formats
- •Finding Incorrect Case
- •Adding Links to URLs
- •Regular Expressions You Already Use
- •Search and Replace in Word Processors
- •Directory Listings
- •Online Searching
- •Why Regular Expressions Seem Intimidating
- •Compact, Cryptic Syntax
- •Whitespace Can Significantly Alter the Meaning
- •No Standards Body
- •Differences between Implementations
- •Characters Change Meaning in Different Contexts
- •Regular Expressions Can Be Case Sensitive
- •Case-Sensitive and Case-Insensitive Matching
- •Case and Metacharacters
- •Continual Evolution in Techniques Supported
- •Multiple Solutions for a Single Problem
- •What You Want to Do with a Regular Expression
- •Replacing Text in Quantity
- •Regular Expression Tools
- •findstr
- •Microsoft Word
- •StarOffice Writer/OpenOffice.org Writer
- •Komodo Rx Package
- •PowerGrep
- •Microsoft Excel
- •JavaScript and JScript
- •VBScript
- •Visual Basic.NET
- •Java
- •Perl
- •MySQL
- •SQL Server 2000
- •W3C XML Schema
- •An Analytical Approach to Using Regular Expressions
- •Express and Document What You Want to Do in English
- •Consider the Regular Expression Options Available
- •Consider Sensitivity and Specificity
- •Create Appropriate Regular Expressions
- •Document All but Simple Regular Expressions
- •Document What You Expect the Regular Expression to Do
- •Document What You Want to Match
- •Test the Results of a Regular Expression
- •Matching Single Characters
- •Matching Sequences of Characters That Each Occur Once
- •Introducing Metacharacters
- •Matching Sequences of Different Characters
- •Matching Optional Characters
- •Matching Multiple Optional Characters
- •Other Cardinality Operators
- •The * Quantifier
- •The + Quantifier
- •The Curly-Brace Syntax
- •The {n} Syntax
- •The {n,m} Syntax
- •Exercises
- •Regular Expression Metacharacters
- •Thinking about Characters and Positions
- •The Period (.) Metacharacter
- •Matching Variably Structured Part Numbers
- •Matching a Literal Period
- •The \w Metacharacter
- •The \W Metacharacter
- •Digits and Nondigits
- •The \d Metacharacter
- •Canadian Postal Code Example
- •The \D Metacharacter
- •Alternatives to \d and \D
- •The \s Metacharacter
- •Handling Optional Whitespace
- •The \S Metacharacter
- •The \t Metacharacter
- •The \n Metacharacter
- •Escaped Characters
- •Finding the Backslash
- •Modifiers
- •Global Search
- •Case-Insensitive Search
- •Exercises
- •Introduction to Character Classes
- •Choice between Two Characters
- •Using Quantifiers with Character Classes
- •Using the \b Metacharacter in Character Classes
- •Selecting Literal Square Brackets
- •Using Ranges in Character Classes
- •Alphabetic Ranges
- •Use [A-z] With Care
- •Digit Ranges in Character Classes
- •Hexadecimal Numbers
- •IP Addresses
- •Reverse Ranges in Character Classes
- •A Potential Range Trap
- •Finding HTML Heading Elements
- •Metacharacter Meaning within Character Classes
- •The ^ metacharacter
- •How to Use the - Metacharacter
- •Negated Character Classes
- •Combining Positive and Negative Character Classes
- •POSIX Character Classes
- •The [:alnum:] Character Class
- •Exercises
- •String, Line, and Word Boundaries
- •The ^ Metacharacter
- •The ^ Metacharacter and Multiline Mode
- •The $ Metacharacter
- •The $ Metacharacter in Multiline Mode
- •Using the ^ and $ Metacharacters Together
- •Matching Blank Lines
- •Working with Dollar Amounts
- •Revisiting the IP Address Example
- •What Is a Word?
- •Identifying Word Boundaries
- •The \< Syntax
- •The \>Syntax
- •The \b Syntax
- •The \B Metacharacter
- •Less-Common Word-Boundary Metacharacters
- •Exercises
- •Grouping Using Parentheses
- •Parentheses and Quantifiers
- •Matching Literal Parentheses
- •U.S. Telephone Number Example
- •Alternation
- •Choosing among Multiple Options
- •Unexpected Alternation Behavior
- •Capturing Parentheses
- •Numbering of Captured Groups
- •Numbering When Using Nested Parentheses
- •Named Groups
- •Non-Capturing Parentheses
- •Back References
- •Exercises
- •Why You Need Lookahead and Lookbehind
- •The (? metacharacters
- •Lookahead
- •Positive Lookahead
- •Negative Lookahead
- •Positive Lookahead Examples
- •Positive Lookahead in the Same Document
- •Inserting an Apostrophe
- •Lookbehind
- •Positive Lookbehind
- •Negative Lookbehind
- •How to Match Positions
- •Adding Commas to Large Numbers
- •Exercises
- •What Are Sensitivity and Specificity?
- •Extreme Sensitivity, Awful Specificity
- •Email Addresses Example
- •Replacing Hyphens Example
- •The Sensitivity/Specificity Trade-Off
- •Sensitivity, Specificity, and Positional Characters
- •Sensitivity, Specificity, and Modes
- •Sensitivity, Specificity, and Lookahead and Lookbehind
- •How Much Should the Regular Expressions Do?
- •Abbreviations
- •Characters from Other Languages
- •Names
- •Sensitivity and How to Achieve It
- •Specificity and How to Maximize It
- •Exercises
- •Documenting Regular Expressions
- •Document the Problem Definition
- •Add Comments to Your Code
- •Making Use of Extended Mode
- •Know Your Data
- •Abbreviations
- •Proper Names
- •Incorrect Spelling
- •Creating Test Cases
- •Debugging Regular Expressions
- •Treacherous Whitespace
- •Backslashes Causing Problems
- •Considering Other Causes
- •The User Interface
- •Metacharacters Available
- •Quantifiers
- •The @ Quantifier
- •The {n,m} Syntax
- •Modes
- •Character Classes
- •Back References
- •Lookahead and Lookbehind
- •Lazy Matching versus Greedy Matching
- •Examples
- •Character Class Examples, Including Ranges
- •Whole Word Searches
- •Search-and-Replace Examples
- •Changing Name Structure Using Back References
- •Manipulating Dates
- •The Star Training Company Example
- •Regular Expressions in Visual Basic for Applications
- •Exercises
- •The User Interface
- •Metacharacters Available
- •Quantifiers
- •Modes
- •Character Classes
- •Alternation
- •Back References
- •Lookahead and Lookbehind
- •Search Example
- •Search-and-Replace Example
- •Online Chats
- •POSIX Character Classes
- •Matching Numeric Digits
- •Exercises
- •Introducing findstr
- •Finding Literal Text
- •Quantifiers
- •Character Classes
- •Command-Line Switch Examples
- •The /v Switch
- •The /a Switch
- •Single File Examples
- •Simple Character Class Example
- •Find Protocols Example
- •Multiple File Example
- •A Filelist Example
- •Exercises
- •The PowerGREP Interface
- •A Simple Find Example
- •The Replace Tab
- •The File Finder Tab
- •Syntax Coloring
- •Other Tabs
- •Numeric Digits and Alphabetic Characters
- •Quantifiers
- •Back References
- •Alternation
- •Line Position Metacharacters
- •Word-Boundary Metacharacters
- •Lookahead and Lookbehind
- •Longer Examples
- •Finding HTML Horizontal Rule Elements
- •Matching Time Example
- •Exercises
- •The Excel Find Interface
- •Escaping Wildcard Characters
- •Using Wildcards in Data Forms
- •Using Wildcards in Filters
- •Exercises
- •Using LIKE with Regular Expressions
- •The % Metacharacter
- •The _ Metacharacter
- •Character Classes
- •Negated Character Classes
- •Using Full-Text Search
- •Using The CONTAINS Predicate
- •Document Filters on Image Columns
- •Exercises
- •Using the _ and % Metacharacters
- •Testing Matching of Literals: _ and % Metacharacters
- •Using Positional Metacharacters
- •Using Character Classes
- •Quantifiers
- •Social Security Number Example
- •Exercises
- •The Interface to Metacharacters in Microsoft Access
- •Creating a Hard-Wired Query
- •Creating a Parameter Query
- •Using the ? Metacharacter
- •Using the * Metacharacter
- •Using the # Metacharacter
- •Using the # Character with Date/Time Data
- •Using Character Classes in Access
- •Exercises
- •The RegExp Object
- •Attributes of the RegExp Object
- •The Other Properties of the RegExp Object
- •The test() Method of the RegExp Object
- •The exec() Method of the RegExp Object
- •The String Object
- •Metacharacters in JavaScript and JScript
- •SSN Validation Example
- •Exercises
- •The RegExp Object and How to Use It
- •Quantifiers
- •Positional Metacharacters
- •Character Classes
- •Word Boundaries
- •Lookahead
- •Grouping and Nongrouping Parentheses
- •Exercises
- •The System.Text.RegularExpressions namespace
- •A Simple Visual Basic .NET Example
- •The Classes of System.Text.RegularExpressions
- •The Regex Object
- •Using the Match Object and Matches Collection
- •Using the Match.Success Property and Match.NextMatch Method
- •The GroupCollection and Group Classes
- •The CaptureCollection and Capture Class
- •The RegexOptions Enumeration
- •Case-Insensitive Matching: The IgnoreCase Option
- •Multiline Matching: The Effect on the ^ and $ Metacharacters
- •Right to Left Matching: The RightToLeft Option
- •Lookahead and Lookbehind
- •Exercises
- •An Introductory Example
- •The Classes of System.Text.RegularExpressions
- •The Regex Class
- •The Options Property of the Regex Class
- •Regex Class Methods
- •The CompileToAssembly() Method
- •The GetGroupNames() Method
- •The GetGroupNumbers() Method
- •GroupNumberFromName() and GroupNameFromNumber() Methods
- •The IsMatch() Method
- •The Match() Method
- •The Matches() Method
- •The Replace() Method
- •The Split() Method
- •Using the Static Methods of the Regex Class
- •The IsMatch() Method as a Static
- •The Match() Method as a Static
- •The Matches() Method as a Static
- •The Replace() Method as a Static
- •The Split() Method as a Static
- •The Match and Matches Classes
- •The Match Class
- •The GroupCollection and Group Classes
- •The RegexOptions Class
- •The IgnorePatternWhitespace Option
- •Metacharacters Supported in Visual C# .NET
- •Using Named Groups
- •Using Back References
- •Exercise
- •The ereg() Set of Functions
- •The ereg() Function
- •The ereg() Function with Three Arguments
- •The eregi() Function
- •The ereg_replace() Function
- •The eregi_replace() Function
- •The split() Function
- •The spliti() Function
- •The sql_regcase() Function
- •Perl Compatible Regular Expressions
- •Pattern Delimiters in PCRE
- •Escaping Pattern Delimiters
- •Matching Modifiers in PCRE
- •Using the preg_match() Function
- •Using the preg_match_all() Function
- •Using the preg_grep() Function
- •Using the preg_quote() Function
- •Using the preg_replace() Function
- •Using the preg_replace_callback() Function
- •Using the preg_split() Function
- •Supported Metacharacters with ereg()
- •Using POSIX Character Classes with PHP
- •Supported Metacharacters with PCRE
- •Positional Metacharacters
- •Character Classes in PHP
- •Documenting PHP Regular Expressions
- •Exercises
- •W3C XML Schema Basics
- •Tools for Using W3C XML Schema
- •Comparing XML Schema and DTDs
- •How Constraints Are Expressed in W3C XML Schema
- •W3C XML Schema Datatypes
- •Derivation by Restriction
- •Unicode and W3C XML Schema
- •Unicode Overview
- •Using Unicode Character Classes
- •Matching Decimal Numbers
- •Mixing Unicode Character Classes with Other Metacharacters
- •Unicode Character Blocks
- •Using Unicode Character Blocks
- •Metacharacters Supported in W3C XML Schema
- •Positional Metacharacters
- •Matching Numeric Digits
- •Alternation
- •Using the \w and \s Metacharacters
- •Escaping Metacharacters
- •Exercises
- •Introduction to the java.util.regex Package
- •Obtaining and Installing Java
- •The Pattern Class
- •Using the matches() Method Statically
- •Two Simple Java Examples
- •The Properties (Fields) of the Pattern Class
- •The CASE_INSENSITIVE Flag
- •Using the COMMENTS Flag
- •The DOTALL Flag
- •The MULTILINE Flag
- •The UNICODE_CASE Flag
- •The UNIX_LINES Flag
- •The Methods of the Pattern Class
- •The compile() Method
- •The flags() Method
- •The matcher() Method
- •The matches() Method
- •The pattern() Method
- •The split() Method
- •The Matcher Class
- •The appendReplacement() Method
- •The appendTail() Method
- •The end() Method
- •The find() Method
- •The group() Method
- •The groupCount() Method
- •The lookingAt() Method
- •The matches() Method
- •The pattern() Method
- •The replaceAll() Method
- •The replaceFirst() Method
- •The reset() Method
- •The start() Method
- •The PatternSyntaxException Class
- •Using the \d Metacharacter
- •Character Classes
- •The POSIX Character Classes in the java.util.regex Package
- •Unicode Character Classes and Character Blocks
- •Using Escaped Characters
- •Using Methods of the String Class
- •Using the matches() Method
- •Using the replaceFirst() Method
- •Using the replaceAll() Method
- •Using the split() Method
- •Exercises
- •Obtaining and Installing Perl
- •Creating a Simple Perl Program
- •Basics of Perl Regular Expression Usage
- •Using the m// Operator
- •Using Other Regular Expression Delimiters
- •Matching Using Variable Substitution
- •Using the s/// Operator
- •Using s/// with the Global Modifier
- •Using s/// with the Default Variable
- •Using the split Operator
- •Using Quantifiers in Perl
- •Using Positional Metacharacters
- •Captured Groups in Perl
- •Using Back References in Perl
- •Using Alternation
- •Using Character Classes in Perl
- •Using Lookahead
- •Using Lookbehind
- •Escaping Metacharacters
- •A Simple Perl Regex Tester
- •Exercises
- •Index
Chapter 21
The Classes of System.Text.RegularExpressions
The following table lists the classes that are contained in the System.Text.RegularExpressions namespace. The properties and methods of several of the classes listed are described in detail later in this chapter, together with examples demonstrating how to use some of the properties and methods.
Class |
Description |
|
|
Capture |
Represents the text captured by a single set of parentheses surround- |
|
ing a subexpression |
CaptureCollection |
Represents a collection of Capture objects |
Group |
Represents the result of a single capturing group of paired parentheses |
GroupCollection |
Represents a collection of Group objects |
Match |
Represents the result of a single regular expression match |
MatchCollection |
Represents a collection of Match objects |
Regex |
The class that contains the regular expression pattern |
RegexCompilationInfo |
Provides information that the compiler uses to compile a regular |
|
expression into an assembly |
|
|
You may find it useful to think of the Regex object as containing all the information relating to a regular expression. The MatchesCollection object contains all the matches for a matching process, with information about each match being contained in a Match object. A GroupsCollection object contains information about all the groups in a match, with each group being represented by a Group object. The CapturesCollection object contains information about all captures for a group, with information about each capture being held in a Capture object.
The following sections take a closer look at several of these members of the System.Text
.RegularExpressions namespace.
In the following sections, classes will be referred to simply by their class name (for example, Regex) rather than using the fully qualified name, such as System.Text.RegularExpressions.Regex.
The Regex Object
The Regex object can be instantiated to make its properties and methods accessible to programmatic manipulation. In addition, three of the methods of the Regex class are available as shared methods. The use of these shared methods is described and demonstrated later.
490
Visual Basic .NET and Regular Expressions
The Regex object has two public properties, described briefly in the following table.
Property |
Description |
|
|
Options |
Contains information about the options passed to the Regex object. |
RightToLeft |
Returns a Boolean value indicating whether or not right-to-left |
|
processing of matching is operative. A value of True indicates |
|
right-to-left matching. |
|
|
If you are used to creating regular expression objects in JScript or VBScript where the regular expression object is the RegExp object, be careful to spell the .NET Regex object correctly in your code.
The following table summarizes the Regex object’s methods. Some of the concepts and techniques of the Regex object are not found in standard regular expressions. Therefore, some of the concepts summarized in the table may usefully be clarified for you when you read following sections that further describe the methods and/or demonstrate how they are used.
Method |
Description |
|
|
CompileToAssembly |
Compiles a regular expression to an assembly (the default behavior |
|
of a regular expression is not to compile to an assembly) |
Equals |
Determines whether two objects are equal |
Escape |
Escapes a set of metacharacters, replacing the metacharacter with the |
|
corresponding escaped character |
GetGroupNames |
Returns an array of capturing group names |
GetGroupNumbers |
Returns an array of capturing group numbers |
GetHashCode |
Inherited from the Object class |
GetType |
Gets the type of the current instance |
GroupNameFromNumber |
Gets a group name that corresponds to the group number supplied |
|
as an argument |
GroupNumberFromName |
Gets a group number that corresponds to the group name supplied |
|
as an argument |
IsMatch |
Returns a Boolean value indicating whether the regular expression |
|
pattern is matched in the string that is the argument to the |
|
IsMatch() method |
Match |
Returns zero or one Match object, depending on whether or not the |
|
string supplied to the method as its argument contains a match |
Matches |
Returns a MatchCollection object containing zero or more Match |
|
objects, which contain all matches (or none) in the string that is the |
|
argument to the Matches() method |
|
|
|
Table continued on following page |
491
Chapter 21
Method |
Description |
|
|
Replace |
Replaces all occurrences of a regular expression pattern with a speci- |
|
fied character sequence |
Split |
Splits an input string into an array of strings; the split occurs at a |
|
position indicated by a regular expression pattern |
ToString |
Returns a string that contains the regular expression passed into the |
|
Regex object in its constructor |
Unescape |
Unescapes any escaped characters in the input string |
|
|
Using the Match Object and Matches Collection
The Match() method returns a Match object if there is a successful match. If there are potentially multiple matches, the Match() method only matches once and stops.
Try It Out |
The Match() Method |
The sample code is contained in Module1.vb in the MatchMethodDemo project:
Imports System.Text.RegularExpressions Module Module1
Dim myRegex = New Regex(“[A-Z]\d”) Sub Main()
Console.WriteLine(“Enter a string on the following line:”) Dim inputString = Console.ReadLine()
Dim myMatch = myRegex.Match(InputString)
Console.WriteLine(“The match, ‘“ & myMatch.Value & “‘ was found.”) Console.WriteLine(“Press Return to close this application.”) Console.ReadLine()
End Sub
End Module
1.Create a new project in Visual Studio 2003. If you are unused to creating projects, refer to the detailed description in the first example in this chapter.
2.Name the project MatchMethodDemo.
3.Edit Module1.vb so that the content is as shown in the preceding code.
4.Save the project, and press F5 to run it. If you entered the code correctly, you should see a command window displaying the following text:
Enter a string on the following line:
5.Enter the text Hello K9 and K10, and press Return. Inspect the results.
There are two potential matches for the pattern [A-Z]\d in the string you entered: K9 and K10. Notice in Figure 21-5 that only one match is displayed, K9, which is the first match in the string.
492
Visual Basic .NET and Regular Expressions
Figure 21-5
How It Works
The variable myRegex is dimensioned and assigned the pattern [A-Z]\d, which matches an uppercase alphabetic character followed by a numeric digit:
Dim myRegex = New Regex(“[A-Z]\d”)
After the test string has been read from the command line, the myRegex variable’s Match() method is applied to InputString, and the result is assigned to the myMatch variable:
Dim myMatch = myRegex.Match(InputString)
The value of InputString is the string Hello K9 and K10.. There are two matches for the pattern [A-Z]\d: the character sequences K9 and K1.
The value of the myMatch object’s Value property is concatenated to some explanatory text and is written to the display:
Console.WriteLine(“The match, ‘“ & myMatch.Value & “‘ was found.”)
The first match, K9, is displayed. The second potential match K1 is not matched and is not displayed. To match and display all matches in a test string, you need to use the Matches() method of the Regex object.
The Matches() method, however, returns a MatchCollection object, which can contain Match objects for all the matches in the test string. The following example looks at how the Matches() method can be used.
Try It Out |
The Matches() Method |
The sample code is contained in Module1.vb in the MatchesMethodDemo project:
Imports System.Text.RegularExpressions
Module Module1
Sub Main()
Dim myRegex = New Regex(“[A-Z]\d”) Console.WriteLine(“Enter a string on the following line:”) Dim inputString = Console.ReadLine()
Dim myMatchCollection = myRegex.Matches(inputString) Console.WriteLine()
Console.WriteLine(“There are {0} matches.”, myMatchCollection.Count) Console.WriteLine()
493
Chapter 21
Dim myMatch As Match
For Each myMatch In myMatchCollection
Console.WriteLine(“At position {0}, the match ‘{1}’ was found”, myMatch.Index, myMatch.ToString)
Next Console.WriteLine()
Console.WriteLine(“Press Return to close this application.”) Console.ReadLine()
End Sub
End Module
1.Create a new Visual Basic .NET console project in Visual Studio 2003. Name the project
MatchesMethodDemo.
2.Edit the code in Module1.vb so that it appears as in the preceding code.
3.Press Ctrl+S to save the code. Press F5 to run it.
4.In the command window, type Hello K9, K10 and K21., and press Return.
5.Inspect the displayed results, as shown in Figure 21-6. Notice that there are now three matches:
K9, K1, and K2.
Figure 21-6
How It Works
The myRegex variable is dimensioned, and a new Regex object is instantiated and is assigned the pattern
[A-Z]\d:
Dim myRegex = New Regex(“[A-Z]\d”)
After the user is invited to enter a string, a myMatchCollection variable is dimensioned and assigned the match collection produced by the Matches() method with the inputString variable as its argument.
Dim myMatchCollection = myRegex.Matches(inputString)
A count of the Match objects in the match collection represented by the myMatchCollection object is displayed, using the MatchCollection object’s Count property:
Console.WriteLine(“There are {0} matches.”, myMatchCollection.Count)
494