sashakoshka/arf
Archived
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

pass-test-tokenize-all #1

Merged
sashakoshka merged 20 commits from pass-test-tokenize-all into main 2022-08-11 03:07:36 -06:00
Conversation 0 Commits 20 Files Changed 7
+491 -50
sashakoshka commented 2022-08-11 03:07:18 -06:00
Owner
Copy Link
Copy Source

Lexer now passes the TokenizeAll test.

Lexer now passes the TokenizeAll test.
sashakoshka added 20 commits 2022-08-11 03:07:19 -06:00
Lexer no longer hangs when encountering letters 314c045e65
Fixed error formatting column indicator d43a2540cf
Lexer can now tokenize 9c1baf8216 
minus
decrement
return direction
separator
Name and permission tokens are now supported 2220b95cd2
Test now prints out list of tokens 040e14d27c
Added lexing hexidecimal numbers 77f3c590c6
Added support for binary literals 8f38203684
Added support for decimal and octal numbers 3d610df44e
Reduced code du0plicaion with number lexing functions 7a45224449
I am an idiot 0f603e3bf7
Negative numbers are now supported 8813928b68
Number tokenizing functions use one digit conversion functions 9e4684dbed
Collapsed all number tokenization functions into just one 40ad569870
Added float support 3768e3454f
Added naieve string and char literal parsing 758b85e735
Support for digraphs such as &&, <<, ++ 0a31ea7bf8
Normalized whitespace tokens af6f170833
Fixed PermissionFrom() bef5b0328e
Fixed equality issue with int 4d73fa4b83
Added basic escape sequences to string parser a0d5b3a1a2
sashakoshka merged commit 92c3e41810 into main 2022-08-11 03:07:36 -06:00
sashakoshka deleted branch pass-test-tokenize-all 2022-08-11 03:07:36 -06:00
This repo is archived. You cannot comment on pull requests.
Reviewers
No Reviewers
Labels
No items
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
sashakoshka (Sasha Koshka)
No Assignees
1 Participants
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: sashakoshka/arf#1