7c358cd5e6
* Modernize Whitespace token: basic lexer * Modernize Whitespace token: bibtex lexer * Modernize Whitespace token: boa lexer * Modernize Whitespace token: capnproto lexer + new example * Modernize Whitespace token: cddl lexer * Modernize Whitespace token: chapel lexer * Modernize Whitespace token: c_like lexer * Modernize Whitespace token: configs lexer * Modernize Whitespace token: console lexer * Modernize Whitespace token: crystal lexer * Modernize Whitespace token: csound lexer * Modernize Whitespace token: css lexer * Revert a change in basic lexer
41 lines
1.1 KiB
Text
41 lines
1.1 KiB
Text
---input---
|
|
%(hello ("world"))
|
|
%[hello ["world"]]
|
|
%{hello "world"}
|
|
%<hello <"world">>
|
|
%|hello "world"|
|
|
|
|
---tokens---
|
|
'%(' Literal.String.Other
|
|
'hello ' Literal.String.Other
|
|
'(' Literal.String.Other
|
|
'"world"' Literal.String.Other
|
|
')' Literal.String.Other
|
|
')' Literal.String.Other
|
|
'\n' Text.Whitespace
|
|
|
|
'%[' Literal.String.Other
|
|
'hello ' Literal.String.Other
|
|
'[' Literal.String.Other
|
|
'"world"' Literal.String.Other
|
|
']' Literal.String.Other
|
|
']' Literal.String.Other
|
|
'\n' Text.Whitespace
|
|
|
|
'%{' Literal.String.Other
|
|
'hello "world"' Literal.String.Other
|
|
'}' Literal.String.Other
|
|
'\n' Text.Whitespace
|
|
|
|
'%<' Literal.String.Other
|
|
'hello ' Literal.String.Other
|
|
'<' Literal.String.Other
|
|
'"world"' Literal.String.Other
|
|
'>' Literal.String.Other
|
|
'>' Literal.String.Other
|
|
'\n' Text.Whitespace
|
|
|
|
'%|' Literal.String.Other
|
|
'hello "world"' Literal.String.Other
|
|
'|' Literal.String.Other
|
|
'\n' Text.Whitespace
|