Namespace: Consultingwerk
Class 
Tokenizer Copy to Clipboard
Parent classes:
Progress.Lang.Object
Consultingwerk.Tokenizer

Inherits: Progress.Lang.Object


Navigate to: Methods | Constructors | Events | Properties | ProDatasets | Temp-Tables



Top Method Summary
Options Name Purpose
Consultingwerk.Framework.Collections.CharacterList Tokenize (character) Splits a string into individual tokens
Consultingwerk.Framework.Collections.CharacterList Tokenize (character, logical) Splits a string into individual tokens
Consultingwerk.Framework.Collections.CharacterList Tokenize (character, logical, character) Splits a string into individual tokens


Method Detail
Top

Consultingwerk.Framework.Collections.CharacterList Tokenize (character)
Purpose: Splits a string into individual tokens
Notes:

Parameters:
pcString CHARACTER
The string to split into tokens
Returns Consultingwerk.Framework.Collections.CharacterList
A CharacterList of individual tokens
Top

Consultingwerk.Framework.Collections.CharacterList Tokenize (character, logical)
Purpose: Splits a string into individual tokens
Notes: When plKeepQuotes is passed as TRUE, then leading ( and trailing ) on
tokens will be added to the CharacterList as separate Tokens as it's expected
that this will simplify the interpretation of a Query String

Parameters:
pcString CHARACTER
The string to split into tokens
plKeepQuotes LOGICAL
True to leave the quotes in the tokens, false to omit quotes
Returns Consultingwerk.Framework.Collections.CharacterList
A CharacterList of individual tokens
Top

Consultingwerk.Framework.Collections.CharacterList Tokenize (character, logical, character)
Purpose: Splits a string into individual tokens
Notes: When plKeepQuotes is passed as TRUE, then leading ( and trailing ) on
tokens will be added to the CharacterList as separate Tokens as it's expected
that this will simplify the interpretation of a Query String

Parameters:
pcString CHARACTER
The string to split into tokens
plKeepQuotes LOGICAL
True to leave the quotes in the tokens, false to omit quotes
pcOtherDelimiters CHARACTER
A single character string containing other characters that are used as additional token delimiters, e.g. ",="
Returns Consultingwerk.Framework.Collections.CharacterList
A CharacterList of individual tokens


©2006-2026 Consultingwerk Ltd.         info@consultingwerk.de         http://www.consultingwerk.de       13.04.2026 10:30:09