Column of the last character of the Token.
Line of the last character of the Token.
Offset of the last character of the Token.
The textual representation of the Token as it appeared in the text.
this marks if a Token does not really exist and has been inserted "artificially" during parsing in rule error recovery.
Column of the first character of the Token.
Line of the first character of the Token.
Offset of the first character of the Token.
The actual Token Type of this Token "instance" This is the same Object returned by the "createToken" API. This property is very useful for debugging the Lexing and Parsing phases.
An number index representing the type of the Token use
Generated using TypeDoc
* Things to note:
startColumn : 1, endColumn: 2, startOffset: x, endOffset: x +1} --> the range is inclusive to exclusive 1...2 (2 chars long).
"\n" {startLine : 1, endLine: 1} --> a lineTerminator as the last character does not effect the Token's line numbering.
"'hello\tworld\uBBBB'" {image: "'hello\tworld\uBBBB'"} --> a Token's image is the "literal" text
(unicode escaping is untouched).