7c358cd5e6
* Modernize Whitespace token: basic lexer * Modernize Whitespace token: bibtex lexer * Modernize Whitespace token: boa lexer * Modernize Whitespace token: capnproto lexer + new example * Modernize Whitespace token: cddl lexer * Modernize Whitespace token: chapel lexer * Modernize Whitespace token: c_like lexer * Modernize Whitespace token: configs lexer * Modernize Whitespace token: console lexer * Modernize Whitespace token: crystal lexer * Modernize Whitespace token: csound lexer * Modernize Whitespace token: css lexer * Revert a change in basic lexer
52 lines
1 KiB
Text
52 lines
1 KiB
Text
---input---
|
|
123 0123456789
|
|
0xabcdef0123456789 0XABCDEF
|
|
1e2
|
|
3e+4
|
|
5e-6
|
|
7E8
|
|
9E+0
|
|
1E-2
|
|
3.
|
|
4.56
|
|
.789
|
|
|
|
---tokens---
|
|
'123' Literal.Number.Integer
|
|
' ' Text.Whitespace
|
|
'0123456789' Literal.Number.Integer
|
|
'\n' Text.Whitespace
|
|
|
|
'0x' Keyword.Type
|
|
'abcdef0123456789' Literal.Number.Hex
|
|
' ' Text.Whitespace
|
|
'0X' Keyword.Type
|
|
'ABCDEF' Literal.Number.Hex
|
|
'\n' Text.Whitespace
|
|
|
|
'1e2' Literal.Number.Float
|
|
'\n' Text.Whitespace
|
|
|
|
'3e+4' Literal.Number.Float
|
|
'\n' Text.Whitespace
|
|
|
|
'5e-6' Literal.Number.Float
|
|
'\n' Text.Whitespace
|
|
|
|
'7E8' Literal.Number.Float
|
|
'\n' Text.Whitespace
|
|
|
|
'9E+0' Literal.Number.Float
|
|
'\n' Text.Whitespace
|
|
|
|
'1E-2' Literal.Number.Float
|
|
'\n' Text.Whitespace
|
|
|
|
'3.' Literal.Number.Float
|
|
'\n' Text.Whitespace
|
|
|
|
'4.56' Literal.Number.Float
|
|
'\n' Text.Whitespace
|
|
|
|
'.789' Literal.Number.Float
|
|
'\n' Text.Whitespace
|