Module:String: Difference between revisions

From the Croc Wiki, the Croc encyclopedia
Jump to navigationJump to search
Content added Content deleted
(add support for finding the position of a string or pattern inside another string.)
(Update to allow for unnamed parameters. This is necessary because some string function need to preserve leading / trailing whitespace in order to work properly.)
Line 27: Line 27:


Returns the first index in "source" that is a match to "target". Indexing is 1-based,
Returns the first index in "source" that is a match to "target". Indexing is 1-based,
and the function returns -1 if the "target" string is not present in "source". Both
and the function returns -1 if the "target" string is not present in "source".
strings have any leading or trailing whitespace removed before searching.


Important Note: If the "target" string is empty / missing, this function returns a
Important Note: If the "target" string is empty / missing, this function returns a
Line 35: Line 34:
]====]
]====]
function str.str_find( frame )
function str.str_find( frame )
local source_str = frame.args.source or '';
local new_args = str._getParameters( frame.args, {'source', 'target'} );
local target_str = frame.args.target or '';
local source_str = new_args['source'] or '';
if target_str == '' then
local target_str = new_args['target'] or '';

if target_str == '' then
return 1;
return 1;
end
end
Line 55: Line 56:
string.
string.


Usage:
Parameters:
{{#invoke:String|find|source_str|target_string|start_index|plain_flag}}
OR
{{#invoke:String|find|source=source_str|target=target_str|start=start_index|plain=plain_flag}}

Parameters
source: The string to search
source: The string to search
target: The string or pattern to find within source
target: The string or pattern to find within source
Line 61: Line 67:
plain: Boolean flag indicating that target should be understood as plain
plain: Boolean flag indicating that target should be understood as plain
text and not as a Lua style regular expression, defaults to true
text and not as a Lua style regular expression, defaults to true

If invoked using named parameters, Mediawiki will automatically remove any leading or
trailing whitespace from the parameter. In some circumstances this is desirable, in
other cases one may want to preserve the whitespace.

This function returns the first index >= "start" where "target" can be found
This function returns the first index >= "start" where "target" can be found
within "source". Indices are 1-based. If "target" is not found, then this
within "source". Indices are 1-based. If "target" is not found, then this
Line 67: Line 77:
function also returns 0.
function also returns 0.


This function should be safe for UTF-8 strings.
Both "source" and "target" will be trimmed so that any leading or trailing
whitespace is removed prior to searching. This function should be safe for
UTF-8 strings.
]====]
]====]
function str.find( frame )
function str.find( frame )
local source_str = frame.args.source or '';
local new_args = str._getParameters( frame.args, {'source', 'target', 'start', 'plain' } );
local pattern = frame.args.target or '';
local source_str = new_args['source'] or '';
local start_pos = tonumber(frame.args.start) or 1;
local pattern = new_args['target'] or '';
local plain = frame.args.plain or true;
local start_pos = tonumber(new_args['start']) or 1;
local plain = new_args['plain'] or true;
if source_str == '' or pattern == '' then
if source_str == '' or pattern == '' then
Line 97: Line 106:
return start
return start
end
end

--[====[
Helper function that populates the argument list given that user may need to use a mix of
named and unnamed parameters. This is relevant because named parameters are not
identical to unnamed parameters due to string trimming, and when dealing with strings
we sometimes want to either preserve or remove that whitespace depending on the application.
]====]
function str._getParameters( frame_args, arg_list )
local new_args = {};
local index = 1;
local value;
for i,arg in ipairs( arg_list ) do
value = frame_args[arg]
if value == nil then
value = frame_args[index];
index = index + 1;
end
new_args[arg] = value;
end
return new_args;
end

return str
return str

Revision as of 18:56, February 22, 2013

Template:Lmd

This module is intended to provide access to basic string functions.

Most of the functions provided here can be invoked with named parameters, unnamed parameters, or a mixture. If named parameters are used, Mediawiki will automatically remove any leading or trailing whitespace from the parameter. Depending on the intended use, it may be advantageous to either preserve or remove such whitespace.

Global options

ignore_errors
If set to 'true' or 1, any error condition will result in an empty string being returned rather than an error message.
error_category
If an error occurs, specifies the name of a category to include with the error message. The default category is [[:Category:Script error: The function "replace" does not exist.|Category:Script error: The function "replace" does not exist.]] (0).
no_category
If set to 'true' or 1, no category will be added if an error is generated.

Unit tests for this module are available at Module:String/testcases.

len

This function returns the length of the target string.

Usage:

{{#invoke:String|len|target_string}}

OR

{{#invoke:String|len|s= target_string }}

Parameters:

s
The string whose length to report

Examples:

  • {{#invoke:String|len| abcdefghi }}Lua error: bad argument #1 to 'len' (string expected, got nil).
  • {{#invoke:String|len|s= abcdefghi }} → 9

sub

This function returns a substring of the target string at specified indices.

Usage:

{{#invoke:String|sub|target_string|start_index|end_index}}

OR

{{#invoke:String|sub|s= target_string |i= start_index |j= end_index }}

Parameters:

s
The string to return a subset of
i
The first index of the substring to return, defaults to 1.
j
The last index of the string to return, defaults to the last character.

The first character of the string is assigned an index of 1. If either i or j is a negative value, it is interpreted the same as selecting a character by counting from the end of the string. Hence, a value of -1 is the same as selecting the last character of the string.

If the requested indices are out of range for the given string, an error is reported.

Examples:

  • "{{#invoke:String|sub| abcdefghi }}" → "Lua error: bad argument #1 to 'sub' (string expected, got nil)."
  • "{{#invoke:String|sub|s= abcdefghi }}" → "abcdefghi"
  • "{{#invoke:String|sub| abcdefghi | 3 }}" → "Lua error: bad argument #1 to 'sub' (string expected, got nil)."
  • "{{#invoke:String|sub|s= abcdefghi |i= 3 }}" → "cdefghi"
  • "{{#invoke:String|sub| abcdefghi | 3 | 4 }}" → "Lua error: bad argument #1 to 'sub' (string expected, got nil)."
  • "{{#invoke:String|sub|s= abcdefghi |i= 3 |j= 4 }}" → "cd"

sublength

This function implements the features of {{str sub old}} and is kept in order to maintain these older templates. It returns a substring of the target string starting at a specified index and of a specified length.

Usage:

{{#invoke:String|sublength|s= target_string |i= start_index |len= length }}

Parameters:

s
The string
i
The starting index of the substring to return. The first character of the string is assigned an index of 0.
len
The length of the string to return, defaults to the last character.

Examples:

  • {{#invoke:String|sublength|s= abcdefghi }} → abcdefghi
  • {{#invoke:String|sublength|s= abcdefghi |i= 3 }} → defghi
  • {{#invoke:String|sublength|s= abcdefghi |i= 3 |len= 4 }} → defg

match

This function returns a substring from the source string that matches a specified pattern.

Usage:

{{#invoke:String|match|source_string|pattern_string|start_index|match_number|plain_flag|nomatch_output}}

OR

{{#invoke:String|match|s= source_string |pattern= pattern_string |start= start_index |match= match_number |plain= plain_flag |nomatch= nomatch_output }}

Parameters:

s
The string to search
pattern
The pattern or string to find within the string
start
The index within the source string to start the search. The first character of the string has index 1. Defaults to 1.
match
In some cases it may be possible to make multiple matches on a single string. This specifies which match to return, where the first match is match= 1. If a negative number is specified then a match is returned counting from the last match. Hence match = -1 is the same as requesting the last match. Defaults to 1.
plain
Boolean flag indicating that pattern should be understood as plain text and not as a Scribunto ustring pattern (a unicode-friendly Lua-style regular expression). Defaults to false (to change: plain=true)
nomatch
If no match is found, output the "nomatch" value rather than an error.
ignore_errors
If no match is found and ignore_errors=true, output an empty string rather than an error.

If the match_number or start_index are out of range for the string being queried, then this function generates an error. An error is also generated if no match is found. If one adds the parameter ignore_errors=true, then the error will be suppressed and an empty string will be returned on any failure.

For information on constructing Lua patterns, a form of regular expression, see:

Examples:

  • {{#invoke:String|match| abc123def456 |%d+}}Lua error: bad argument #1 to 'match' (string expected, got nil).
  • {{#invoke:String|match|s= abc123def456 |pattern= %d+ }} → 123
  • {{#invoke:String|match| abc123def456 |%d+|6}}Lua error: bad argument #1 to 'match' (string expected, got nil).
  • {{#invoke:String|match|s= abc123def456 |pattern= %d+ |start= 6 }} → 123
  • {{#invoke:String|match|s= abc123def456 |pattern= %d+ |start= 6 |match= 2 }} → 123
  • {{#invoke:String|match|s= abc123%d+ |pattern= %d+ }} → 123
  • {{#invoke:String|match|s= abc123%d+ |pattern= %d+ |plain= true }} → 123
  • {{#invoke:String|match|s= abc |pattern= %d }}
  • {{#invoke:String|match|s= abc |pattern= %d |nomatch= No numeric characters in string }}
  • {{#invoke:String|match|s= abc |pattern= %d |ignore_errors= true }}
  • {{#invoke:String|match|s= 0012001200 |pattern= 0*(%d*) }} → 12001200

pos

This function returns a single character from the target string at position pos.

Usage:

{{#invoke:String|pos|target_string|index_value}}

OR

{{#invoke:String|pos|target= target_string |pos= index_value }}

Parameters:

target
The string to search
pos
The index for the character to return

The first character has an index value of 1.

If one requests a negative value, this function will select a character by counting backwards from the end of the string. In other words pos = -1 is the same as asking for the last character.

A requested value of zero, or a value greater than the length of the string returns an error.

Examples:

  • {{#invoke:String|pos| abcdefghi | 4 }}Script error: The function "pos" does not exist.
  • {{#invoke:String|pos|target= abcdefghi |pos= 4 }}Script error: The function "pos" does not exist.

str_find

This function duplicates the behavior of {{str_find}}, including all of its quirks. This is provided in order to support existing templates, but is NOT RECOMMENDED for new code and templates. New code is recommended to use the "find" function instead.

Returns the first index in "source" that is a match to "target". Indexing is 1-based, and the function returns -1 if the "target" string is not present in "source".

Important Note: If the "target" string is empty / missing, this function returns a value of "1", which is generally unexpected behavior, and must be accounted for separately.

Usage:

{{#invoke:String|find|source_string|target_string}}

OR

{{#invoke:String|find|source= source_string |target= target_string }}

Parameters:

source
The string to search
target
The string to find within source

Examples:

  • {{#invoke:String|str_find| abc123def }} → 1
  • {{#invoke:String|str_find|source= abc123def }} → 1
  • {{#invoke:String|str_find| abc123def |123}} → 5
  • {{#invoke:String|str_find|source= abc123def |target= 123 }} → 4

find

This function allows one to search for a target string or pattern within another string.

Usage:

{{#invoke:String|find|source_string|target_string|start_index|plain_flag}}

OR

{{#invoke:String|find|source= source_string |target= target_string |start= start_index |plain= plain_flag }}

Parameters:

source
The string to search
target
The string or pattern to find within source
start
The index within the source string to start the search, defaults to 1
plain
Boolean flag indicating that target should be understood as plain text and not as a Scribunto ustring pattern (a unicode-friendly Lua-style regular expression); defaults to true

This function returns the first index >= "start" where "target" can be found within "source". Indices are 1-based. If "target" is not found, then this function returns 0. If either "source" or "target" are missing / empty, this function also returns 0.

This function should be safe for UTF-8 strings.

Examples:

  • {{#invoke:String|find|abc123def|12}} → 4
  • {{#invoke:String|find|source=abc123def|target=12}} → 4
  • {{#invoke:String|find|source=abc123def|target=pqr}} → 0
  • {{#invoke:String|find| abc123def |123}} → 5
  • {{#invoke:String|find|source= abc123def |target= 123 }} → 4
  • {{#invoke:String|find|source=abc123def|target=%d |start=3 |plain=false }} → 4

When using unnamed parameters, preceding and trailing spaces are kept and counted:

  • {{#invoke:String|find| abc123def |c|false}} → 5
  • {{#invoke:String|find|source= abc123def |target=c|plain=false}} → 3

replace (gsub)

This function allows one to replace a target string or pattern within another string. To Lua programmers: this function works internally by calling string.gsub.

Usage:

{{#invoke:String|replace|source_str|pattern_string|replace_string|replacement_count|plain_flag}}

OR

{{#invoke:String|replace|source= source_string |pattern= pattern_string |replace= replace_string |count= replacement_count |plain= plain_flag }}

Parameters:

source
The string to search
pattern
The string or pattern to find within source
replace
The replacement text
count
The number of occurrences to replace; defaults to all
plain
Boolean flag indicating that pattern should be understood as plain text and not as a Scribunto ustring pattern (a unicode-friendly Lua-style regular expression); defaults to true

Examples:

  • "{{#invoke:String|replace| abc123def456 |123|N}}" → "Script error: The function "replace" does not exist."
  • "{{#invoke:String|replace|source= abc123def456 |pattern= 123 |replace= N }}" → "Script error: The function "replace" does not exist."
  • "{{#invoke:String|replace| abc123def456 |%d+|N|1|false}}" → "Script error: The function "replace" does not exist."
  • "{{#invoke:String|replace|source= abc123def456 |pattern= %d+ |replace= N |count=1 |plain= false }}" → "Script error: The function "replace" does not exist."
  • "{{#invoke:String|replace|source= abc123def456 |pattern= %d+ |replace= N |plain= false }}" → "Script error: The function "replace" does not exist."
  • {{#invoke:String|replace|source= 0012001200 |pattern= ^0* |plain= false }}Script error: The function "replace" does not exist.

rep

Repeats a string n times. A simple function to pipe string.rep to templates.

Usage:

{{#invoke:String|rep|source|count}}

Parameters:

source
The string to repeat
count
The number of repetitions.

Examples:

  • "{{#invoke:String|rep|hello|3}}" → "Script error: The function "rep" does not exist."
  • "{{#invoke:String|rep| hello | 3 }}" → "Script error: The function "rep" does not exist."

escapePattern

Escapes magic characters in a Lua pattern. If you convert a string using this function, then the converted string will be interpreted as a literal string in functions that accept Lua patterns. For example, ., meaning "any character", will be converted to %., meaning the literal character ".".

Usage:

  • {{#invoke:String|escapePattern|pattern_string}}

Parameters:

pattern_string
The pattern string to escape

Examples:

  • "{{#invoke:String|escapePattern|A.D.}}" → "Script error: The function "escapePattern" does not exist."
  • "{{#invoke:String|escapePattern|10%}}" → "Script error: The function "escapePattern" does not exist."

count

Counts the number of times a given pattern appears in the arguments that get passed on to this module.

Usage:

{{#invoke:String|count|source_str|pattern_string|plain_flag}}

OR

{{#invoke:String|count|source= source_string |pattern= pattern_string|plain= plain_flag }}

Parameters:

source_string
The string to count occurrences in
pattern
The string or pattern to count occurrences of within source
plain
Boolean flag indicating that pattern should be understood as plain text and not as a Scribunto ustring pattern (a unicode-friendly Lua-style regular expression); defaults to true

Examples:

  • Count of 'a': "{{#invoke:String|count|aabbcc|a}}" → "Script error: The function "count" does not exist."
  • Count of "either 'a' or 'c' ":"{{#invoke:String|count|aabbcc|[ac]|plain=false}}" → "Script error: The function "count" does not exist."
  • Count of "not 'a' ": "{{#invoke:String|count|aaabaaac|[^a]|plain=false}}" → "Script error: The function "count" does not exist."
  • Count of "starts with 'a' ": "{{#invoke:String|count|aaabaaac|^a|plain=false}}" → "Script error: The function "count" does not exist."

join

Joins all strings passed as arguments into one string, treating the first argument as a separator

Usage:

{{#invoke:String|join|separator|string1|string2|...}}

Parameters:

separator
String that separates each string being joined together
Note that leading and trailing spaces are not stripped from the separator.
string1/string2/...
Strings being joined together

Examples:

  • "{{#invoke:String|join|x|foo|bar|baz}}" → "Script error: The function "join" does not exist."
  • "{{#invoke:String|join||a|b|c|d|e|f|g}}" → "Script error: The function "join" does not exist."
  • "{{#invoke:String|join|,|a|b|c|d|e|f|g}}" → "Script error: The function "join" does not exist."
  • "{{#invoke:String|join|, |a|b|c|d|e|f|g}}" → "Script error: The function "join" does not exist."
  • "{{#invoke:String|join| – |a|b|c|d|e|f|g}}" → "Script error: The function "join" does not exist."

The preceding example uses the html entity – but the unicode character also works.

endswith

Usage:

{{#invoke:String|endswith|source_str|pattern_string}}

OR

{{#invoke:String|endswith|source= source_string |pattern= pattern_string}}

Returns "yes" if the source string ends with the pattern string. Both strings are trimmed before use.

  • "{{#invoke:String|endswith|xxxyyy|y}}" → "Script error: The function "endswith" does not exist."
  • "{{#invoke:String|endswith|xxxyyy|z}}" → "Script error: The function "endswith" does not exist."

See also



local str = {}

function str.len( frame )
    return mw.ustring.len( frame.args.s )
end

function str.sub( frame )
    return mw.ustring.sub( frame.args.s, tonumber( frame.args.i ), tonumber( frame.args.j ) )
end

function str.sublength( frame )
    local i = tonumber( frame.args.i ) or 0
    local len = tonumber( frame.args.len )
    return mw.ustring.sub( frame.args.s, i + 1, len and ( i + len ) )
end

function str.match( frame )
    return mw.ustring.match( frame.args.s, frame.args.pattern, tonumber( frame.args.i ) )
end

--[====[
str_find

This function duplicates the behavior of {{str_find}}, including all of its quirks.
This is provided in order to support existing templates, but is NOT RECOMMENDED for 
new code and templates.  New code is recommended to use the "find" function instead.

Returns the first index in "source" that is a match to "target".  Indexing is 1-based,
and the function returns -1 if the "target" string is not present in "source".

Important Note: If the "target" string is empty / missing, this function returns a
value of "1", which is generally unexpected behavior, and must be accounted for
separatetly.
]====]
function str.str_find( frame )
    local new_args = str._getParameters( frame.args, {'source', 'target'} );
    local source_str = new_args['source'] or '';
    local target_str = new_args['target'] or '';

if target_str == '' then
        return 1;
    end    
    
    local start = mw.ustring.find( source_str, target_str, 1, true )
    if start == nil then
        start = -1
    end
    
    return start
end

--[====[
find

This function allows one to search for a target string or pattern within another
string.

Usage:
{{#invoke:String|find|source_str|target_string|start_index|plain_flag}}
OR
{{#invoke:String|find|source=source_str|target=target_str|start=start_index|plain=plain_flag}}

Parameters
    source: The string to search
    target: The string or pattern to find within source
    start: The index within the source string to start the search, defaults to 1
    plain: Boolean flag indicating that target should be understood as plain
        text and not as a Lua style regular expression, defaults to true

If invoked using named parameters, Mediawiki will automatically remove any leading or
trailing whitespace from the parameter.  In some circumstances this is desirable, in 
other cases one may want to preserve the whitespace.

This function returns the first index >= "start" where "target" can be found 
within "source".  Indices are 1-based.  If "target" is not found, then this 
function returns 0.  If either "source" or "target" are missing / empty, this
function also returns 0.

This function should be safe for UTF-8 strings.
]====]
function str.find( frame )
    local new_args = str._getParameters( frame.args, {'source', 'target', 'start', 'plain' } ); 
    local source_str = new_args['source'] or '';
    local pattern = new_args['target'] or '';
    local start_pos = tonumber(new_args['start']) or 1;
    local plain = new_args['plain'] or true;
        
    if source_str == '' or pattern == '' then
        return 0;
    end    
    
    if type( plain ) == 'string' then
        plain = plain:lower();
        if plain == 'false' or plain == 'no' or plain == '0' then
            plain = false;
        else
            plain = true;
        end    
    end

    local start = mw.ustring.find( source_str, pattern, start_pos, plain )
    if start == nil then
        start = 0
    end
    
    return start
end

--[====[
Helper function that populates the argument list given that user may need to use a mix of
named and unnamed parameters.  This is relevant because named parameters are not
identical to unnamed parameters due to string trimming, and when dealing with strings
we sometimes want to either preserve or remove that whitespace depending on the application.
]====]
function str._getParameters( frame_args, arg_list )
    local new_args = {};
    local index = 1;
    local value;
    
    for i,arg in ipairs( arg_list ) do
        value = frame_args[arg]
        if value == nil then
            value = frame_args[index];
            index = index + 1;
        end
        new_args[arg] = value;
    end
    
    return new_args;
end        

return str