Function Dump/String Manipulation: Difference between revisions
>MrNicNac Added explanation of patterns in parenthesis. |
>Legend26 Removed numerous, redundant links. Moved pattern section to top so readers know what a pattern is in a basic sense before looking at the functions. |
||
(41 intermediate revisions by 6 users not shown) | |||
Line 1: | Line 1: | ||
{{ | {{CatUp|Function Dump}} | ||
This library provides generic functions for string manipulation, such as finding and extracting substrings, and pattern matching. When indexing a string in Lua, the first character is at position 1 (not at 0, as in some other languages). Indices are allowed to be negative and are interpreted as indexing backwards, from the end of the string. Thus, the last character is at position -1, and so on. | |||
The string library provides all its functions inside the table string. It also sets a metatable for strings where the __index field points to the string table. Therefore, you can use the string functions in object-oriented style. For instance, {{`|string.byte(s, i)}} can be written as {{`|s:byte(i)}}, and {{`|string.byte("literal", i)}} can be written as {{`|("literal"):byte(i)}}. Parameters written in brackets are optional. | |||
==Patterns== | |||
Patterns are the most useful things in string manipulation. The string library would, for the most part, be useless without them. What are patterns? Patterns are strings consisting of a series of character classes and pattern items that are used in many of the string functions. For instance, %a+ represents a word. The tutorials listed below explain patterns in their fullest with examples showing their use with the string library. | |||
*[[Patterns|Patterns]] | |||
*[[String_Patterns|A Beginner's Guide to String Patterns]] | |||
Returns | ==string.byte (''s'' [, ''i'' = 1 [, ''j'' = i]])== | ||
Returns [[:File:Ascii_Table.png|ascii values]] of the characters ''s[i]'', ''s[i+1]'', all the way until ''s[j]''. The default value for ''i'' is 1; the default value for ''j'' is i. | |||
Note that numerical codes are not necessarily portable across platforms. | Note that numerical codes are not necessarily portable across platforms. | ||
{{ | {{code and output|code = | ||
print( string.byte("d") ) | |||
print(string.byte ("abc", 1, 3)) | print( string.byte("abc", 1, 3) ) | ||
|output = | |||
100 | |||
97 98 99 | 97 98 99 | ||
}} | }} | ||
==string.char (···)== | |||
Receives zero or more integers. Returns a string with length equal to the number of arguments, in which each character | Receives zero or more integers. Returns a string with length equal to the number of arguments, in which each character is the [http://wiki.roblox.com/index.php/Image:Ascii_Table.png ascii representation] equal to its corresponding number. | ||
Note that numerical codes are not necessarily portable across platforms. | Note that numerical codes are not necessarily portable across platforms. | ||
{{ | {{code and output|code = | ||
print( string.char(97, 98, 99, 100) ) | |||
print(string.char (97, 98, 99, 100)) | |output = | ||
abcd | abcd | ||
}} | }} | ||
==string.dump (''function'')== | |||
Returns a string containing a binary representation of | Returns a string containing a binary representation of ''function'', so that a later loadstring on this string returns a copy of ''function''. string.dump is commonly used in [[Script Obfuscation|script obfuscation]]. | ||
{{ | {{code and output|code = | ||
function f() | |||
function f () | print "hello, world" | ||
print "hello, world" | |||
end | end | ||
s = string.dump (f) | s = string.dump(f) | ||
loadstring(s)() | |||
|output = | |||
hello, world | |||
hello, world | |||
}} | }} | ||
[http://www.gammon.com.au/scripts/doc.php?lua=string.dump] | |||
==string.find (''s'', ''pattern'' [, ''init'' = 1 [, ''plain'' = false]])== | |||
Looks for the first match of ''pattern'' in string ''s''. If a match is found, then string.find returns the '''locations''' (1, 3, etc.) of ''s'' where this occurrence starts and ends; otherwise, it returns nil. A third, optional numerical argument, ''init'', specifies where to start the search in the string; its default value is 1 and may be negative. A value of true as a fourth, optional argument, ''plain'', turns off the pattern matching facilities, so the function does a plain "find substring" operation, with no characters in pattern being considered "magic". Note that if ''plain'' is given, then ''init'' must be given as well. | |||
If ''substring'' has captures, then in a successful match the captured values are also returned, after the two locations. | |||
{{code and output|code = | |||
print( string.find("blahblah", "bla")) | |||
print( string.find("roblox and lua", "(%w+) and (%w+)") ) | |||
|output = | |||
1 3 | 1 3 | ||
1 14 roblox lua | |||
}} | }} | ||
==string.format (''formatstring'', ···)== | |||
Returns a formatted version of its variable number of arguments following the description given in its first argument (which must be a string). Here is a link to [[String Formatting|string formatting]]. | |||
{{ | {{code and output|code = | ||
print( string.format("%c",65) ); | |||
print (string.format (" | |output= | ||
A | |||
}} | }} | ||
==string.len (''s'')== | |||
Receives ''s'' (a string) and returns its length. The empty string "" has length 0. Embedded zeros ([http://wiki.roblox.com/index.php/Image:Ascii_Table.png the null terminator]) are counted, so "a\000bc\000" has length 5. | |||
{{ | {{code and output|code = | ||
print( string.len("") ) | |||
print( string.len("a") ) | |||
print( string.len("ab") ) | |||
print( string.len("abc") ) | |||
|output = | |||
print(string.len ("")) | |||
print(string.len ("a")) | |||
print(string.len ("ab")) | |||
print(string.len ("abc")) | |||
0 | 0 | ||
1 | 1 | ||
2 | 2 | ||
3 | 3 | ||
}} | }} | ||
==string.lower (''s'')== | |||
Receives a string and returns a copy of | Receives ''s'' (a string) and returns a copy of ''s'' with all uppercase letters changed to lowercase. All other characters are left unchanged. | ||
{{ | {{code and output|code = | ||
print(string.lower ("Hi Mom!")) | print(string.lower ("Hi Mom!")) | ||
|output = | |||
hi mom! | hi mom! | ||
}} | }} | ||
==string.match (''s'', ''pattern'' [, ''init''])== | |||
Looks for the first match of string ''pattern'' in string ''s''. If it finds one, then match returns the captures from ''pattern''; otherwise, it returns nil. If ''pattern'' specifies no captures, then the whole match is returned. A third, optional numerical argument ''init'' specifies where to start the search; its default value is 1 and may be negative. | |||
{{code and output|code = | |||
pizza | print( string.match("I like pepperoni pizza", "p%w+") ) | ||
|output = | |||
pepperoni | |||
}} | }} | ||
In the above example, the {{`|p%w+}} represented a string that started with a p and goes until the end of a word. | |||
==string.rep (''s'', ''n'')== | |||
Returns a string that is the | Returns a string that is the combination of ''n'' copies of the string ''s''. | ||
{{ | {{code and output|code = | ||
print( string.rep("Blarg, ", 4) ) | |||
|output = | |||
Blarg, Blarg, Blarg, Blarg, | |||
}} | }} | ||
==string.reverse (''s'')== | |||
Returns a string that is the string ''s'' reversed. | Returns a string that is the string ''s'' reversed. | ||
{{ | {{code and output|code = | ||
print( string.reverse("!moM ,olleH") ) | |||
print(string.reverse ("!moM ,olleH")) | |output = | ||
Hello, Mom! | Hello, Mom! | ||
}} | }} | ||
==string.sub (''s'', ''i'' [, ''j''])== | |||
Returns the substring of ''s'' that starts at ''i'' and continues until ''j''; ''i'' and ''j'' may be negative. If ''j'' is absent, then it is assumed to be equal to the length of ''s''. In particular, the call string.sub(''s'',1,''j'') returns ''s'' until as many characters as ''j'', and string.sub(''s'', -''i'') returns a suffix of ''s'' with length ''i''. | |||
{{code and output|code = | |||
print( string.sub("Hi Mom!", 1, 4) ) | |||
print( string.sub("Hi Mom!", 2) ) | |||
|output= | |||
Hi M | |||
i Mom! | |||
}} | |||
==string.upper (''s'')== | |||
Receives a string and returns a copy of this string with all lowercase letters changed to uppercase. All other characters are left unchanged. | |||
{{code and output|code = | |||
Hi Mom! | print( string.upper("Hi Mom!") ) | ||
|output = | |||
HI MOM! | |||
}} | }} | ||
==string.gmatch (''s'', ''pattern'')== | |||
Returns an iterator function that, each time it is called, returns the next captures from ''pattern'' over string ''s''. If ''pattern'' specifies no captures, then the whole match is produced in each call. | |||
As an example, the following loop: | |||
{{code and output|code = | |||
s = "hello world from Lua" | |||
for w in string.gmatch(s, "%a+") do | |||
print(w) | |||
end | |||
|output = | |||
hello | |||
world | |||
from | |||
Lua | |||
}} | }} | ||
will iterate over all the words from string ''s'', printing one per line. The next example collects all pairs index=value from the given string into a table: | |||
{{code and output|code = | |||
t = {} | |||
s = "from=world, to=Lua" | |||
for k, v in string.gmatch(s, "(%w+)=(%w+)") do -- k and v are the returned captures | |||
t[k] = v | |||
end | |||
print(t.from, t.to) | |||
|output = | |||
world Lua | |||
}} | |||
For this function, a '^' at the start of ''pattern'' does not work as an anchor, as this would prevent the iteration. Here are some examples: | |||
{{Example| | |||
{{code and output|code = | |||
local t={} | |||
for matchedValue in string.gmatch("alphabet and numbers 1234-4321", "a") do -- Search for a in that string | |||
table.insert(t, matchedValue) | |||
end | |||
print("The letter a was found " .. #t.." times.") | |||
|output = | |||
The letter a was found 3 times. | |||
}} | |||
<br/> | |||
{{code and output|code = | |||
for x in string.gmatch("Numbers", "b") do -- Search for b in Numbers | |||
print(x) | |||
end | |||
|output = | |||
b | |||
}} | |||
}} | |||
Alright, that was searching for plain text. Here are some examples with [[Function_Dump/String_Manipulation#Patterns|patterns]]: | |||
{{code and output|code= | |||
for q in string.gmatch ("send money mom", "%a+") do | |||
print (q) | |||
end | |||
|output= | |||
send | |||
money | |||
mom | |||
}} | |||
{{code and output|code= | |||
for value in string.gmatch("Once upon a time, there were 34 fairies, 20 of which were smart.", "%d+") do -- Find numbers | |||
print("At least "..value.." of the fairies are magical.") | |||
end | |||
|output= | |||
At least 34 of the fairies are magical. | |||
At least 20 of the fairies are magical. | |||
}} | |||
{{code and output|code= | |||
for q in string.gmatch("My name is merlin11188", "(%a+)%d+") do | |||
print("The letter part of my name is "..q) | |||
end | |||
|output= | |||
The letter part of my name is merlin | |||
}} | |||
==string.gsub (''s'', ''pattern'', ''repl'' [, ''n''])== | |||
Returns a copy of ''s'' in which all (or the first ''n'', if given) occurrences of ''pattern'' have been replaced by replacement string ''repl'', which may be a string, a table, or a function. string.gsub also returns, as its second value, the total number of matches that occurred. | |||
If ''repl'' is a string, then its value is used for replacement. The character % works as an escape character: any sequence in ''repl'' of the form %n, with n between 1 and 9, stands for the value of the n-th captured substring. The sequence %0 stands for the whole match. | |||
If ''repl'' is a table, then the table is queried for every match, using the first capture as the key; if ''pattern'' specifies no captures, then the whole match is used as the key. | |||
If ''repl'' is a function, then this function is called every time a match occurs, with all captured substrings passed as arguments, in order; if ''pattern'' specifies no captures, then the whole match is passed as the sole argument. | |||
If the value returned by the table query or by the function call is a string or a number, then it is used as the replacement string; otherwise, if it is false or nil, then there is no replacement (that is, the original match is kept in the string). | |||
Here are some examples using plain character replacement: | |||
{{code and output|code= | |||
print( | print( string.gsub("hello world", "hello", "goodbye") ) | ||
print( string.gsub("Bonjour!", "Bonjour", "Hello") ) | |||
print( string.gsub("Avada Kedavra", "Avada Kedavra", "Abracadabra") ) | |||
print( string.gsub("I like to munch numbers 1234", "1234", "and words.") ) | |||
|output= | |||
goodbye world | |||
Hello! | |||
Abracadabra | |||
I like to munch numbers and words.}} | |||
Those were all examples using plain character replacements. Here are some using [[Function_Dump/String_Manipulation#Patterns|patterns]]: | |||
{{code and output|code= | |||
print( string.gsub("hello world from Lua", "(%w+)%s*(%w+)", "%2 %1") ) | |||
print( string.gsub("I found an imaginary hex number: F243BC234AD234Ei", "%x+i", "Yeah right. That's not real.") ) | |||
print( string.gsub("home = $HOME, user = $USER", "%$(%w+)", {USER="Merlin", HOME="Camelot"}) ) | |||
print( string.gsub("$name-$version.tar.gz", "%$(%w+)", {name="lua", version="5.1"}) ) | |||
print( string.gsub("4+5 = $return 4+5$", "%$(.-)%$", function (s) | |||
return loadstring(s)() | |||
end) ) | |||
|output= | |||
world hello Lua from | |||
I found an imaginary hex number: Yeah right. That's not real. | |||
home = Camelot, user = Merlin | |||
lua-5.1.tar.gz | |||
4+5 = 9 | |||
}} |
Latest revision as of 21:58, 4 May 2012
This library provides generic functions for string manipulation, such as finding and extracting substrings, and pattern matching. When indexing a string in Lua, the first character is at position 1 (not at 0, as in some other languages). Indices are allowed to be negative and are interpreted as indexing backwards, from the end of the string. Thus, the last character is at position -1, and so on.
The string library provides all its functions inside the table string. It also sets a metatable for strings where the __index field points to the string table. Therefore, you can use the string functions in object-oriented style. For instance, string.byte(s, i) can be written as s:byte(i), and string.byte("literal", i) can be written as ("literal"):byte(i). Parameters written in brackets are optional.
Patterns
Patterns are the most useful things in string manipulation. The string library would, for the most part, be useless without them. What are patterns? Patterns are strings consisting of a series of character classes and pattern items that are used in many of the string functions. For instance, %a+ represents a word. The tutorials listed below explain patterns in their fullest with examples showing their use with the string library.
string.byte (s [, i = 1 [, j = i]])
Returns ascii values of the characters s[i], s[i+1], all the way until s[j]. The default value for i is 1; the default value for j is i.
Note that numerical codes are not necessarily portable across platforms.
string.char (···)
Receives zero or more integers. Returns a string with length equal to the number of arguments, in which each character is the ascii representation equal to its corresponding number.
Note that numerical codes are not necessarily portable across platforms.
string.dump (function)
Returns a string containing a binary representation of function, so that a later loadstring on this string returns a copy of function. string.dump is commonly used in script obfuscation.
string.find (s, pattern [, init = 1 [, plain = false]])
Looks for the first match of pattern in string s. If a match is found, then string.find returns the locations (1, 3, etc.) of s where this occurrence starts and ends; otherwise, it returns nil. A third, optional numerical argument, init, specifies where to start the search in the string; its default value is 1 and may be negative. A value of true as a fourth, optional argument, plain, turns off the pattern matching facilities, so the function does a plain "find substring" operation, with no characters in pattern being considered "magic". Note that if plain is given, then init must be given as well.
If substring has captures, then in a successful match the captured values are also returned, after the two locations.
string.format (formatstring, ···)
Returns a formatted version of its variable number of arguments following the description given in its first argument (which must be a string). Here is a link to string formatting.
string.len (s)
Receives s (a string) and returns its length. The empty string "" has length 0. Embedded zeros (the null terminator) are counted, so "a\000bc\000" has length 5.
string.lower (s)
Receives s (a string) and returns a copy of s with all uppercase letters changed to lowercase. All other characters are left unchanged.
string.match (s, pattern [, init])
Looks for the first match of string pattern in string s. If it finds one, then match returns the captures from pattern; otherwise, it returns nil. If pattern specifies no captures, then the whole match is returned. A third, optional numerical argument init specifies where to start the search; its default value is 1 and may be negative.
In the above example, the p%w+ represented a string that started with a p and goes until the end of a word.
string.rep (s, n)
Returns a string that is the combination of n copies of the string s.
string.reverse (s)
Returns a string that is the string s reversed.
string.sub (s, i [, j])
Returns the substring of s that starts at i and continues until j; i and j may be negative. If j is absent, then it is assumed to be equal to the length of s. In particular, the call string.sub(s,1,j) returns s until as many characters as j, and string.sub(s, -i) returns a suffix of s with length i.
string.upper (s)
Receives a string and returns a copy of this string with all lowercase letters changed to uppercase. All other characters are left unchanged.
string.gmatch (s, pattern)
Returns an iterator function that, each time it is called, returns the next captures from pattern over string s. If pattern specifies no captures, then the whole match is produced in each call.
As an example, the following loop:
will iterate over all the words from string s, printing one per line. The next example collects all pairs index=value from the given string into a table:
For this function, a '^' at the start of pattern does not work as an anchor, as this would prevent the iteration. Here are some examples:
Alright, that was searching for plain text. Here are some examples with patterns:
string.gsub (s, pattern, repl [, n])
Returns a copy of s in which all (or the first n, if given) occurrences of pattern have been replaced by replacement string repl, which may be a string, a table, or a function. string.gsub also returns, as its second value, the total number of matches that occurred.
If repl is a string, then its value is used for replacement. The character % works as an escape character: any sequence in repl of the form %n, with n between 1 and 9, stands for the value of the n-th captured substring. The sequence %0 stands for the whole match.
If repl is a table, then the table is queried for every match, using the first capture as the key; if pattern specifies no captures, then the whole match is used as the key.
If repl is a function, then this function is called every time a match occurs, with all captured substrings passed as arguments, in order; if pattern specifies no captures, then the whole match is passed as the sole argument.
If the value returned by the table query or by the function call is a string or a number, then it is used as the replacement string; otherwise, if it is false or nil, then there is no replacement (that is, the original match is kept in the string).
Here are some examples using plain character replacement:
Those were all examples using plain character replacements. Here are some using patterns: