fspl/fspl
fspl/fspl
1
0
Fork 0
Code Issues 16 Pull Requests Packages Projects 1 Releases 6 Wiki Activity

I need to sleep

Browse Source
This commit is contained in:
Sasha Koshka 2024-02-09 04:44:09 -05:00
parent f8ca067f54
commit c7c56dcb39
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
lexer/DESIGN.md
View File

@ -27,7 +27,7 @@ The lexer follows this general flow:
1. Upon creation, grab the first rune to initialize the lexer state 1. Upon creation, grab the first rune to initialize the lexer state
2. When next is called... 2. When next is called...
3. Create a new token 3. Create a new token
4. Set out the token's position 4. Set the token's position
5. Switch off of the current rune to set the token's kind and invoke specific 5. Switch off of the current rune to set the token's kind and invoke specific
lexing behavior lexing behavior
6. Expand the token's position to cover the full range 6. Expand the token's position to cover the full range
@ -39,4 +39,4 @@ the EOF was unexpected.
The lexer also keeps track of its current position in order to embed it into The lexer also keeps track of its current position in order to embed it into
tokens, and to print errors. It is important that the lowest level operation tokens, and to print errors. It is important that the lowest level operation
used to advance the lexer's position is fsplLexer.nextRune(), as it contains used to advance the lexer's position is fsplLexer.nextRune(), as it contains
logic for keeping the position correct. logic for keeping the position correct and maintaining the current lexer state.