Added module overview doc comment to lexer

This commit is contained in:
Sasha Koshka 2024-02-08 23:05:36 -05:00
parent e21a865c61
commit a236bb0804
1 changed files with 6 additions and 0 deletions

6
lexer/doc.go Normal file
View File

@ -0,0 +1,6 @@
// Package lexer implements the lexical analysis stage of the FSPL compiler.
// Its job is to convert text into a series of tokens (lexemes) which are then
// passed to other parts of the compiler to be interpreted into more complex
// data structures. The lexer is able to read in new tokens as needed instead of
// reading them in all at once.
package lexer