I need to sleep
This commit is contained in:
parent
f8ca067f54
commit
c7c56dcb39
|
@ -27,7 +27,7 @@ The lexer follows this general flow:
|
|||
1. Upon creation, grab the first rune to initialize the lexer state
|
||||
2. When next is called...
|
||||
3. Create a new token
|
||||
4. Set out the token's position
|
||||
4. Set the token's position
|
||||
5. Switch off of the current rune to set the token's kind and invoke specific
|
||||
lexing behavior
|
||||
6. Expand the token's position to cover the full range
|
||||
|
@ -39,4 +39,4 @@ the EOF was unexpected.
|
|||
The lexer also keeps track of its current position in order to embed it into
|
||||
tokens, and to print errors. It is important that the lowest level operation
|
||||
used to advance the lexer's position is fsplLexer.nextRune(), as it contains
|
||||
logic for keeping the position correct.
|
||||
logic for keeping the position correct and maintaining the current lexer state.
|
||||
|
|
Loading…
Reference in New Issue