{"id":2270,"date":"2016-12-12T17:15:31","date_gmt":"2016-12-12T15:15:31","guid":{"rendered":"http:\/\/www.systemcodegeeks.com\/?p=2270"},"modified":"2017-12-04T16:12:14","modified_gmt":"2017-12-04T14:12:14","slug":"bash-regular-expressions-example","status":"publish","type":"post","link":"https:\/\/www.systemcodegeeks.com\/shell-scripting\/bash\/bash-regular-expressions-example\/","title":{"rendered":"Bash Regular Expressions Example"},"content":{"rendered":"

A regular expression is a pattern that describes a set of strings. Regular expressions are constructed analogously to arithmetic expressions by using various operators to combine smaller expressions.
\n 
\n 
\n 
\n 
\n 
\n 
\n 
\n 
\n 
\n[ulp id=’SG9vnnKgRCD7iZxf’]
\n 
\nThe fundamental building blocks are the regular expressions that match a single character. Most characters, including all letters and digits, are regular expressions that match themselves. Any metacharacter with special meaning may be quoted by preceding it with a backslash.<\/p>\n

The following table shows an overview of the whole article:<\/p>\n

\n

Table Of Contents<\/h3>\n
\n
1. Regular expression metacharacters<\/a><\/dt>\n
2. Examples using grep<\/a><\/dt>\n
\n
\n
2.1 Line and word anchors<\/a><\/dt>\n<\/dl>\n<\/dd>\n
\n
\n
2.2 Character classes<\/a><\/dt>\n<\/dl>\n<\/dd>\n
\n
\n
2.3 Wildcards<\/a><\/dt>\n<\/dl>\n<\/dd>\n
3. Pattern matching using Bash features<\/a><\/dt>\n
\n
\n
3.1 Character ranges<\/a><\/dt>\n<\/dl>\n<\/dd>\n
\n
\n
3.2 Character classes<\/a><\/dt>\n<\/dl>\n<\/dd>\n
4. Summary<\/a><\/dt>\n<\/dl>\n<\/div>\n

<\/a>1. Regular expression metacharacters<\/h2>\n

A regular expression may be followed by one of several repetition operators (metacharacters):<\/p>\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
Operator<\/th>\nEffect<\/th>\n<\/tr>\n
.<\/td>\nMatches any single character.<\/td>\n<\/tr>\n
?<\/td>\nThe preceding item is optional and will be matched, at most, once.<\/td>\n<\/tr>\n
*<\/td>\nThe preceding item will be matched zero or more times.<\/td>\n<\/tr>\n
+<\/td>\nThe preceding item will be matched one or more times.<\/td>\n<\/tr>\n
{N}<\/td>\nThe preceding item is matched exactly N times.<\/td>\n<\/tr>\n
{N,}<\/td>\nThe preceding item is matched N or more times.<\/td>\n<\/tr>\n
{N,M}<\/td>\nThe preceding item is matched at least N times, but not more than M times.<\/td>\n<\/tr>\n
–<\/td>\nrepresents the range if it’s not first or last in a list or the ending point of a range in a list.<\/td>\n<\/tr>\n
^<\/td>\nMatches the empty string at the beginning of a line; also represents the characters not in the range of a list.<\/td>\n<\/tr>\n
$<\/td>\nMatches the empty string at the end of a line.<\/td>\n<\/tr>\n
\\b<\/td>\nMatches the empty string at the edge of a word.<\/td>\n<\/tr>\n
\\B<\/td>\nMatches the empty string provided it’s not at the edge of a word.<\/td>\n<\/tr>\n
\\<<\/td>\nMatch the empty string at the beginning of word.<\/td>\n<\/tr>\n
\\><\/td>\nMatch the empty string at the end of word.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

Two regular expressions may be concatenated; the resulting regular expression matches any string formed by concatenating two substrings that respectively match the concatenated subexpressions.<\/p>\n

Two regular expressions may be joined by the infix operator “|”. The resulting regular expression matches any string matching either subexpression.<\/p>\n

Repetition takes precedence over concatenation, which in turn takes precedence over alternation. A whole subexpression may be enclosed in parentheses to override these precedence rules.<\/p>\n

<\/a>2. Examples using grep<\/h2>\n

The command grep searches the input files for lines containing a match to a given pattern list. When it finds a match in a line, it copies the line to standard output (by default), or whatever other sort of output you have requested with options.<\/p>\n

Though grep expects to do the matching on text, it has no limits on input line length other than available memory, and it can match arbitrary characters within a line. If the final byte of an input file is not a newline, grep silently supplies one. Since newline is also a separator for the list of patterns, there is no way to match newline characters in a text.<\/p>\n

The following Textfile will be used for the next examples:<\/p>\n

Text.txt<\/em><\/span><\/p>\n

 \r\nWe shall not spend a large expense of time\r\nBefore we reckon with your several loves,\r\nAnd make us even with you. My thanes and kinsmen,\r\nHenceforth be earls, the first that ever Scotland\r\nIn such an honour named. What's more to do,\r\nWhich would be planted newly with the time,\r\nAs calling home our exiled friends abroad\r\nThat fled the snares of watchful tyranny;\r\nProducing forth the cruel ministers\r\nOf this dead butcher and his fiend-like queen,\r\nWho, as 'tis thought, by self and violent hands\r\nTook off her life; this, and what needful else\r\nThat calls upon us, by the grace of Grace,\r\nWe will perform in measure, time and place:\r\nSo, thanks to all at once and to each one,\r\nWhom we invite to see us crown'd at Scone.\r\nMacbeth, William Shakespeare\r\n<\/pre>\n
With the first command, the lines from Test.txt containing the string with will be displayed.<\/p>\n
The next command displays the line numbers containing this search string.<\/p>\n
\"A<\/a>
A simple Regular Expression Example using grep<\/figcaption><\/figure>\n
<\/a>2.1 Line and word anchors<\/h3>\n
In the following example, we now exclusively want to display lines starting with the string “We”.<\/p>\n
In the next example, we search for lines ending in “:”.<\/p>\n
\"A<\/a>
A Regular Expression Line Anchor Example<\/figcaption><\/figure>\n
<\/a>2.2 Character classes<\/h3>\n
A bracket expression is a list of characters enclosed by “[” and “]”. It matches any single character in that list.<\/p>\n
If the first character of the list is the caret, “^”, then it matches any character NOT in the list. For example, the regular expression “[0123456789]” matches any single digit.<\/p>\n
Within a bracket expression, a range expression consists of two characters separated by a hyphen. It matches any single character that sorts between the two characters, inclusive, using the locale’s collating sequence and character set.<\/p>\n
For example, in the default C locale, “[a-d]” is equivalent to “[abcd]”. Many locales sort characters in dictionary order, and in these locales “[a-d]” is typically not equivalent to “[abcd]”; it might be equivalent to “[aBbCcDd]”, for example.<\/p>\n
To obtain the traditional interpretation of bracket expressions, you can use the C locale by setting the LC_ALL environment variable to the value “C”.<\/p>\n
In the following example, all the lines containing either a “y” or “c” character are displayed:<\/p>\n
\"A<\/a>
A Regular Expression Character Class Example<\/figcaption><\/figure>\n
<\/a>2.3 Wildcards<\/h3>\n
Use the “.” for a single character match. If you want to get a list of all five-character English dictionary words starting with “c” and ending in “s” (handy for solving crosswords):<\/p>\n
\"A<\/a>
A Regular Expression Wildcards Example<\/figcaption><\/figure>\n
If you want to display lines containing the literal dot character, use the -F option to grep.<\/p>\n
For matching multiple characters, use the asterisk. This example selects all words starting with “c” and ending in “s” from the system’s dictionary:<\/p>\n
\"A<\/a>
A Regular Expression Wildcards Example<\/figcaption><\/figure>\n
<\/a>3. Pattern matching using Bash features<\/h2>\n
<\/a>3.1 Character ranges<\/h3>\n
Apart from grep and regular expressions, there’s a good deal of pattern matching that you can do directly in the shell, without having to use an external program.<\/p>\n
As you already know, the asterisk (*) and the question mark (?) match any string or any single character, respectively. Quote these special characters to match them literally:<\/p>\n
\"A<\/a>
A Regular Expression Character Range Example<\/figcaption><\/figure>\n
This lists all files in the current directory, starting with “A”, “B” or “C”.<\/p>\n
If the first character within the braces is “!” or “^”, any character not enclosed will be matched. To match the dash (“-“), include it as the first or last character in the set.<\/p>\n
The sorting depends on the current locale and of the value of the LC_COLLATE variable, if it is set. Mind that other locales might interpret “[a-cx-z]” as “[aBbCcXxYyZz]” if sorting is done in dictionary order.<\/p>\n
If you want to be sure to have the traditional interpretation of ranges, force this behavior by setting LC_COLLATE or LC_ALL to “C”.<\/p>\n
<\/a>3.2 Character classes<\/h3>\n
Character classes can be specified within the square braces, using the syntax [:CLASS:], where CLASS is defined in the POSIX standard and has one of the values:<\/p>\n