Defined in header file: hzTokens.h
Enumeration of different tokenization regimes
Enum definition:
enum hzTokMode
{
| TOK_MO_WHITE | Split into words separated by whitespace | ||
| TOK_MO_FTEXT | Split into words according to free text rules | ||
| TOK_MO_BOOL | Tokenize into boolean expression of operators and operands | ||
| TOK_MO_CPP | Tokenize into C++ classes, functions, operators and operands |
} ;