» RegExpr (String)
This site relies heavily on Javascript. You should enable it if you want the full experience. Learn more.

RegExpr (String)

Help returns the matches of a certain pattern in the incoming string
Author vvvv group

Here you are supposed to see an image (rendered with SVG) describing the pins of this node. However, this does not work with Internet Explorer. You may want to consider using another browser, like FireFox, Chrome, Safari or Opera that do support SVG.

Credits TRegExpr Library Version 0.947; Copyright © 1999-2000 by Andrey V. Sorokin, St-Petersburg, Russia; library derived from sources by Henry Spencer; http://anso.da.ru, http://anso.virtualave.net anso@mail.ru, anso@usa.net
Warnings
Bugs

related discussions

start a forum thread about this node

about RegExpr (String)

What are Regular Expressions?

Regular Expressions are a widely-used method of specifying patterns of text to search for. Special metacharacters allow you to specify, for instance, that a particular string you are looking for occurs at the beginning or end of a line, or contains n recurrences of a certain character. The RegExpr node is highly useful for splitting up strings into individual parts.

Tutorial 1 - Decoding Strings

Question

The string i receive from another application (for example written in PD) is as follows

 ID_number value

example

 id_1 234
 id_3 12

What is the best way to split this string into id an the corresponding value?

Answer

Create a regexpr node. Note that this node has an elaborate help patch - select the node and press F1.
Open up Herr Inspektor and enter the following string in the regular expression configuration input:

 id_ ( \d+ ) \s ( \d+ )

You will now notice two additional outputs of the node.
Put your string in the input of the regexpr. for example:

 id_1 234 id_3 12 

You will notice two spreads at the outputs - the left containing 1 and 3, the right containing 234 and 12.

The AsValue node will come handy next.

But how does it work?

where does this cryptic character sequence

 id_ ( \d+ ) \s ( \d+ )

comes from?

The sequence translates to the following instructions for vvvv:

Go through the whole input. look for the following combination of things:

id_ the letters i and d and underscore in that order
(\d+) one or more numerical characters. the brackets indicate that these characters will be put into an individual output pin
\s a single space
(\d+) one or more numerical characters. also in a separate pin do this as often as possible and pile up all matches in individual slices.

-
all codes are explained in detail in the reference section below.
-

Tutorial 2 - How can I read lines of a text file line by line?

-
use the inspector to enter
-

 (.*?) \n

-
in the Regular expression pin of the regexpr node - you will notice a new output pin. this pin contains all lines of the file as slices.
-
the syntax is nearly as dense as possible:

. means "any character"
.*
means "none or any number of any characters"
.* \n
means "none or any number of any characters, followed by a line break"
.*? \n
means "the shortest possible sequence of none or any number of any characters, followed by a line break"
(.*?) \n
means "return the shortest possible sequence of none or any number of any characters on an output pin, followed by a line break which doesnt get an output pin"

to split into words use

 (\S*) \s*

similarily you will get a pin containing all individual words.

The + (String Spectral) might help you getting things together again.

Tutorial 3: How can i remove characters from a strings

I want to subtract all numbers of each index. For example take this spread (abcd23, xyz12, 34qwertz)
i want to get (abcd, xyz, qwertz)

Answer:
feed regexpr with the regular expression

 (\D*)

this will return all character blocks which are not composed of numbers (this is the meaning of the capital D). all other chars are ignored and dont make it to the output.

RegExpr Reference

The following reference is very much based of the description of the original freeware component by Andrey V. Sorokin but is updated for the use of the component within vvvv.

How to create output pins

Use round brackets (...) in the regular expressions to define subexpressions. For each subexpression an output pin is created.

The SliceCount of the output will change according to the number of matches. If there is no match, the output slice count will be zero. Output Pins are numbered based on the left to right order of their opening parenthesis.

Examples

 (.* ?)
will return any text which is written between and

-
<a (.* ?) > (.* ?) </a>

will return the content of the a tag on the first output, and the text inbetween on the second output
( foob [0-9]|a+ r ) will return all words like 'foob0r', 'foob1r' , 'foobar', 'foobaar', 'foobaar' which will appear in the input text.
( [_a-zA-Z\d\-\.]+ @ [_a-zA-Z\d\-]+ (\.[_a-zA-Z\d\-]+)+ ) will return all email addresses in a text.

-

Simple matches

-
Any single character matches itself (unless it is a metacharacter with a special meaning described below). A series of characters matches that series of characters in the target string, so the pattern "bluh" would match "bluh" in the target string. Quite simple. You can cause characters that normally function as metacharacters or escape sequences to be interpreted literally by 'escaping' them by preceding them with a backslash "\", for instance: metacharacter "^ " match beginning of string, but "\^ " match character "^ ", "\\" match "\" and so on.
-
Examples

foobar matchs string 'foobar'
\^ FooBarPtr
matchs '^ FooBarPtr'

Escape sequences

Characters may be specified using a escape sequences syntax much like that used in C and Perl: "\n matches a newline, "\t a tab, etc. More generally, \xnn, where nn is a string of hexadecimal digits, matches the character whose ASCII value is nn.

\xnn char with hex code nn
\t tab (HT/TAB), same as \x09
\n newline (NL), same as \x0a
\r carriage return (CR), same as \x0d
\f form feed (FF), same as \x0c
\a alarm (bell) (BEL), same as \x07
\e escape (ESC), same as \x1b

-
Examples

foo\x20bar matchs 'foo bar' (note space in the middle)
\tfoobar
matchs 'foobar' predefined by tab

Character classes

You can specify a character class, by enclosing a list of characters in [], which will match any one character from the list. If the first character after the "[ is "^ , the class matches any character not in the list.

Examples

foob[aeiou]r finds strings 'foobar', 'foober' etc. but not 'foobbr', 'foobcr' etc.
foob[^ aeiou]r find strings 'foobbr', 'foobcr' etc. but not 'foobar', 'foober' etc.

-
Within a list, the "- character is used to specify a range, so that a-z represents all characters between "a and "z, inclusive. If you want "- itself to be a member of a class, put it at the start or end of the list, or escape it with a backslash. If you want ']' you may place it at the start of list or escape it with a backslash.
-
Examples

[-az] matchs 'a', 'z' and '-'
[az-]
matchs 'a', 'z' and '-'
[a\-z]
matchs 'a', 'z' and '-'
[a-z]
matchs all twenty six small characters from 'a' to 'z'
[\n-\x0D]
matchs any of #10,#11,#12,#13.
[\d-t]
matchs any digit, '-' or 't'.
[]-a]
matchs any char from ']'..'a'.

White Space

All whitespace in the regexp is ignored. You can use this to break up your regular expression into (slightly) more readable parts. The # character is also treated as a meta character introducing a comment, for example:

((abc) # comment 1

| # You can use spaces to format regexp´s

(efg) # comment 2 )

This also means that if you want real white space or # characters in the pattern that you'll either have to escape them.

Line separators

^ start of line
$ end of line
\A start of text
\Z end of text
. any character in line

-
Examples

^ foobar matchs string 'foobar' only if it's at the beginning of line
foobar$
matchs string 'foobar' only if it's at the end of line
^ foobar$
matchs string 'foobar' only if it's the only string in line
foob.r
matchs strings like 'foobar', 'foobbr', 'foob1r' and so on

"^ " is at the beginning of a input string, and also immediately following any occurrence of \x0D\x0A or \x0A or \x0D.
Note that there is no empty line within the sequence \x0D\x0A. "$" is at the end of a input string, and also immediately preceding
any occurrence of \x0D\x0A or \x0A or \x0D.
Note that there is no empty line within the sequence \x0D\x0A. "." matchs any character (also \x0D\x0A and \x0A and \x0D)
Note that "^ .* $" (an empty line pattern) does not match the empty string within the sequence \x0D\x0A,
but matchs the empty string within the sequence \x0A\x0D.

Predefined classes

\w an alphanumeric character (including "_")
\W a non-alphanumeric
\d a numeric character
\D a non-numeric
\s any space (same as [ \t\n\r\f])
\S a non space

-
You may use \w, \d and \s within custom character classes.
-
The alphanumeric characters include also
-
Š Œ Ž š œ ž Ÿ À Á Â Ã Ä Å Æ Ç È É Ê Ë Ì Í Î Ï Ð Ñ Ò Ó Ô Õ Ö × Ø Ù Ú Û Ü Ý Þ ß à á â ã ä å æ ç è é ê ë ì í î ï ð ñ ò ó ô õ ö ÷ ø ù ú û ü ý þ ÿ
-
Examples

foob\dr matchs strings like 'foob1r', foob6r' and so on but not 'foobar', 'foobbr' and so on
foob[\w\s]r
matchs strings like 'foobar', 'foob r', 'foobbr' and so on but not 'foob1r', 'foob=r' and so on

Word boundaries

\b Match a word boundary
\B Match a non-word boundary

-
A word boundary (\b) is a spot between two characters that has a \w on one side of it and a \W on the other side of it (in either order), counting the imaginary characters off the beginning and end of the string as matching a \W.
-

Iterators & Greediness

-
Any item of a regular expression may be followed by another type of metacharacters: iterators. Using this metacharacters You can specify number of occurences of previous character, metacharacter or subexpression.

* zero or more ("greedy"), similar to {0,}
+
one or more ("greedy"), similar to {1,}
?
zero or one ("greedy"), similar to {0,1}
{n}
exactly n times ("greedy")
{n,}
at least n times ("greedy")
{n,m}
at least n but not more than m times ("greedy")
* ?
zero or more ("non-greedy"), similar to {0,}?
+?
one or more ("non-greedy"), similar to {1,}?
??
zero or one ("non-greedy"), similar to {0,1}?
(n}?
exactly n times ("non-greedy")

 {n,}?
at least n times ("non-greedy") {n,m}?at least n but not more than m times ("non-greedy")

So, digits in curly brackets of the form {n,m}, specify the minimum number of times to match the item n and the maximum m. The form {n} is equivalent to {n,n} and matches exactly n times. The form {n,} matches n or more times. There is no limit to the size of n or m, but large numbers will chew up more memory and slow down r.e. execution. If a curly bracket occurs in any other context, it is treated as a regular character.

A little explanation about greediness: "Greedy" takes as many as possible; "non-greedy" takes as few as possible. For example, 'b+' and 'b* ' applied to string 'abbbbc' return 'bbbb', 'b+?' returns 'b', 'b* ?' returns empty string, 'b{2,3}?' returns 'bb', 'b{2,3}' returns 'bbb'.

Examples

foob.* r matchs strings like 'foobar', 'foobalkjdflkj9r' and 'foobr'
foob.+r matchs strings like 'foobar', 'foobalkjdflkj9r' but not 'foobr'
foob.?r matchs strings like 'foobar', 'foobbr' and 'foobr' but not 'foobalkj9r'
fooba{2}r matchs the string 'foobaar' fooba{2,}r matchs strings like 'foobaar', 'foobaaar', 'foobaaaar' etc.
fooba{2,3}r matchs strings like 'foobaar', or 'foobaaar' but not 'foobaaaar'

-

Excourse

-
Q: Why does non-greedy iterators sometimes work as in greedy mode? For example, the r.e. 'a+?,b+?' applied to string 'aaa,bbb' matches 'aaa,b', but should it not match 'a,b' because of non-greediness of first iterator? A. This is the limitation of used by TRegExpr (and Perl's and many UNIX’s regular expressions) mathematics - r.e. performe only 'simple' search optimization, and do not try to do the best optimization. In some cases it's bad, but in common it's rather advantage then limitation - because of perfomance and predictability reasons. The main rule - r.e. first of all try to match from current place and only if it's completely impossible move forward by one char and try again from that place. So, if You use 'a,b+?' it match 'a,b', but in case of 'a+?,b+?' it's 'not recommended' (due to non-greediness) but possible to match more then one 'a', so TRegExpr do it and at last obtaines correct (but non optimum) match. TRegExpr like Perl's or Unix's r.e. doesn't attempt to move forward and check - would it be 'better' match. Moreover, it cannot be compared in terms 'more or less good match' at all.
-

Alternatives

-
You can specify a series of alternatives for a pattern using "| to separate them, so that fee|fie|foe will match any of "fee, "fie, or "foe in the target string (as would f(e|i|o)e). The first alternative includes everything from the last pattern delimiter ("(, "[, or the beginning of the pattern) up to the first "|, and the last alternative contains everything from the last "| to the next pattern delimiter. For this reason, it's common practice to include alternatives in parentheses, to minimize confusion about where they start and end. Alternatives are tried from left to right, so the first alternative found for which the entire expression matches, is the one that is chosen. This means that alternatives are not necessarily greedy. For example: when matching foo|foot against "barefoot, only the "foo part will match, as that is the first alternative tried, and it successfully matches the target string. (This might not seem important, but it is important when you are capturing matched text using parentheses.) Also remember that "| is interpreted as a literal within square brackets, so if You write [fee|fie|foe] You're really only matching [feio|].
-
Examples
-
foo(bar|foo) matchs strings 'foobar' or 'foofoo'.
-

Back references

-
Metacharacters \1 through \9 are interpreted as back references. \<n> matches previously matched subexpression #<n>. Examples

(.)\1+ matchs 'aaaa' and 'cc'.
(.+)\1+
also match 'abab' and '123123'
(['"]?)(\d+)\1
matchs '"13" (in double quotes), or '4' (in single quotes) or 77 (without quotes) etc

Comments

(?#text) A comment, the text is ignored. Note that the node closes the comment as soon as it sees a ")", so there is no way to put a literal ")" in the comment.

Perl extensions

(?imsxr-imsxr) You may use the above syntax to set modifiers in the regexp on the fly. Use this at your own risk and consult the original documentation from Andrey V. Sorokin.

Useful expressions / examples

  d(.*?)d_t(.*?)t

"so the filename must contain a string like dXXXXXXd_tYYYYYYt, where YYYYYY is meant to be a time value"

related modules/patches

a very experimental of
RegExpr (String Advanced).v4p
can be downloaded here.
made some effort with SetPatch (VVVV) etc. to add a real input pin for the expression.
buggy.
use careful and don't destroy your patches/projects.

related vvvorumthread:
tiki-view_forum_thread.php?forumId=12&comments_parentId=3091#threadId17143


anonymous user login

Shoutbox

~2h ago

joreg: @cznickesz: we're hoping this week. but depends on feedback. please test your project and let us know if it works.

~2h ago

cznickesz: @joreg: I should stop asking my questions so cryptic ;-) So right away: is final Beta39 hours, days or weeks away?

~3h ago

joreg: @cznickesz: the idea of an RC is exactly to make sure your projects will work with it. your last chance to report problems with b39.

~5h ago

cznickesz: So how "RC" is the "RC3"? I have to update an old project soon and I´m wondering if I should wait and directly update to Beta39

~6h ago

joreg: @takuma, the "one frame" issue was fixed in RC3 for beta39, see: beta39-release-candidate

~7h ago

Takuma: @joreg thank!! Ill try this. Are there a way to send video texture from vvvv to vl? fromimage node in vl somehow only sends 1 frame

~8h ago

cznickesz: @ravasquez thx, so I need to stop avoiding nuget in the end ;-)

~9h ago

joreg: Reminder: Are you teaching #vvvv or with vvvv? We're curious to hear from you: teaching-patching-a-mini-conference

~9h ago

joreg: @takuma am afraid no blackmagic in vl yet. probly possible via VL.NDI? https://discourse.vvvv.org/t/vl-ndi/16733

~10h ago

ravazquez: @cznickesz beta39: VL.Skia (shipped with installer), VL.OpenCV (needs nuget install). As for gamma, both ship with it.