Commit Graph

218 Commits

Author SHA1 Message Date
Sasha Koshka 7914f0df45 Location now stores width instead of Error 2022-08-12 13:43:09 -05:00
Sasha Koshka 050c956787 Added expect and nextToken methods to parser 2022-08-12 13:33:21 -05:00
Sasha Koshka 18bd681082 Parser now understands the separation between files
This needs to be done because each file has a metadata section at the top.
2022-08-12 12:02:20 -05:00
Sasha Koshka 2019c67bbb Created basic test for parser 2022-08-12 11:55:17 -05:00
Sasha Koshka f4f19a809a Lexer now eats :arf symbol at file beginning 2022-08-12 10:38:23 -05:00
Sasha Koshka c09c9860b8 Parser tests are now arf files 2022-08-12 10:26:16 -05:00
Sasha Koshka 81b47f7734 Replaced all occurences of github.com with git.tebibyte.media 2022-08-12 10:21:36 -05:00
Sasha Koshka 09170e390d Created base for parser
The parser now handles file opening and invokes the lexer.
2022-08-12 10:11:43 -05:00
Sasha Koshka 5a55c9ac87 Check off lexer in readme 2022-08-11 18:37:00 -05:00
Sasha Koshka 31a2d84483 Removed erroneous indentation from indent test file
Need to find a more controlled and accurate way to test erroneous indentation.
Possibly by analyzing the returned error object.
2022-08-11 18:34:02 -05:00
Sasha Koshka 2a7111e700 Colored error line/column numbers as well 2022-08-11 13:16:59 -05:00
Sasha Koshka dfa64f3c3d Added color to errors 2022-08-11 13:15:57 -05:00
Sasha Koshka ee9fa3a766 Indentation tokens now carry their indentation level
They are no longer stored in sequence
2022-08-11 12:53:20 -05:00
Sasha Koshka 471eb863f4 Created indent test 2022-08-11 12:47:50 -05:00
Sasha Koshka 71157122d6 Added support for hex, octal, and unicode escape sequences 2022-08-11 12:39:49 -05:00
Sasha Koshka f7a823687e Added new test for string and rune literals (which it passes) 2022-08-11 12:12:41 -05:00
Sasha Koshka 4f37715a8c Hexidecimal numbers are now properly read 2022-08-11 04:25:56 -05:00
Sasha Koshka 7a0ed247e2 Added number lexing unit test 2022-08-11 04:23:06 -05:00
Sasha Koshka 6acc11d046 Removed debug rune printing th 2022-08-11 04:19:39 -05:00
Sasha Koshka 92c3e41810 Merge pull request 'pass-test-tokenize-all' (#1) from pass-test-tokenize-all into main
Reviewed-on: #1
2022-08-11 09:07:36 +00:00
Sasha Koshka a0d5b3a1a2 Added basic escape sequences to string parser 2022-08-11 04:05:55 -05:00
Sasha Koshka 4d73fa4b83 Fixed equality issue with int 2022-08-11 03:58:45 -05:00
Sasha Koshka bef5b0328e Fixed PermissionFrom() 2022-08-11 03:52:16 -05:00
Sasha Koshka af6f170833 Normalized whitespace tokens 2022-08-11 03:47:42 -05:00
Sasha Koshka 0a31ea7bf8 Support for digraphs such as &&, <<, ++ 2022-08-11 02:54:20 -05:00
Sasha Koshka 758b85e735 Added naieve string and char literal parsing 2022-08-11 02:47:51 -05:00
Sasha Koshka 3768e3454f Added float support 2022-08-11 02:17:35 -05:00
Sasha Koshka 40ad569870 Collapsed all number tokenization functions into just one 2022-08-11 02:03:54 -05:00
Sasha Koshka 9e4684dbed Number tokenizing functions use one digit conversion functions 2022-08-11 01:57:04 -05:00
Sasha Koshka 8813928b68 Negative numbers are now supported 2022-08-11 01:10:34 -05:00
Sasha Koshka 0f603e3bf7 I am an idiot 2022-08-11 01:00:57 -05:00
Sasha Koshka 7a45224449 Reduced code du0plicaion with number lexing functions 2022-08-11 00:57:04 -05:00
Sasha Koshka 3d610df44e Added support for decimal and octal numbers 2022-08-11 00:21:04 -05:00
Sasha Koshka 8f38203684 Added support for binary literals 2022-08-11 00:17:22 -05:00
Sasha Koshka 77f3c590c6 Added lexing hexidecimal numbers 2022-08-11 00:14:41 -05:00
Sasha Koshka 040e14d27c Test now prints out list of tokens 2022-08-10 15:02:08 -04:00
Sasha Koshka 2220b95cd2 Name and permission tokens are now supported 2022-08-10 14:55:26 -04:00
Sasha Koshka 9c1baf8216 Lexer can now tokenize
minus
decrement
return direction
separator
2022-08-10 14:18:28 -04:00
Sasha Koshka d43a2540cf Fixed error formatting column indicator 2022-08-10 14:08:04 -04:00
Sasha Koshka 314c045e65 Lexer no longer hangs when encountering letters 2022-08-10 13:59:09 -04:00
Sasha Koshka 9f8b48161a Lexer unit test now prints out resulting error 2022-08-10 13:03:48 -04:00
Sasha Koshka cf04dfd600 Lexer unit test now works properly 2022-08-10 12:58:47 -04:00
Sasha Koshka 2e965d6f68 Added Permission type 2022-08-10 12:52:20 -04:00
Sasha Koshka 488220f3a7 Added all tokens to unit test 2022-08-10 11:43:21 -04:00
Sasha Koshka 3f16d34aa1 Added unit test for lexer 2022-08-10 11:28:29 -04:00
Sasha Koshka 245798f33d Print warning when a tab is discovered where it shouldn't be 2022-08-10 01:22:53 -04:00
Sasha Koshka 0d2d10fe04 All basic symbol tokens are now parsed 2022-08-10 01:03:59 -04:00
Sasha Koshka a0ce033c27 Added a ton more token kinds 2022-08-10 00:48:18 -04:00
Sasha Koshka 64de897de5 Added lexing various symbol tokens 2022-08-09 22:18:12 -04:00
Sasha Koshka 861400b4a1 LexingOperation now stores the list of tokens 2022-08-09 22:12:14 -04:00