15 lines
294 B
Text
15 lines
294 B
Text
---input---
|
|
a=1
|
|
b=2 # comment
|
|
|
|
---tokens---
|
|
'a' Name.Variable
|
|
'=' Operator
|
|
'1' Literal.Number
|
|
'\n' Text.Whitespace
|
|
|
|
'b' Name.Variable
|
|
'=' Operator
|
|
'2' Literal.Number
|
|
' ' Text.Whitespace
|
|
'# comment\n' Comment.Single
|