7c358cd5e6
* Modernize Whitespace token: basic lexer * Modernize Whitespace token: bibtex lexer * Modernize Whitespace token: boa lexer * Modernize Whitespace token: capnproto lexer + new example * Modernize Whitespace token: cddl lexer * Modernize Whitespace token: chapel lexer * Modernize Whitespace token: c_like lexer * Modernize Whitespace token: configs lexer * Modernize Whitespace token: console lexer * Modernize Whitespace token: crystal lexer * Modernize Whitespace token: csound lexer * Modernize Whitespace token: css lexer * Revert a change in basic lexer
40 lines
1 KiB
Text
40 lines
1 KiB
Text
---input---
|
|
$MACRO.(((x#y\)))' "(#'x)\)x\))"# {{x\))x)\)(#'}});
|
|
|
|
---tokens---
|
|
'$MACRO.' Comment.Preproc
|
|
'(' Punctuation
|
|
'(' Comment.Preproc
|
|
'(' Comment.Preproc
|
|
'x#y\\)' Comment.Preproc
|
|
')' Comment.Preproc
|
|
')' Comment.Preproc
|
|
"'" Punctuation
|
|
' ' Comment.Preproc
|
|
'"' Literal.String
|
|
'(' Error
|
|
'#' Error
|
|
"'" Error
|
|
'x' Literal.String
|
|
')' Error
|
|
'\\)' Comment.Preproc
|
|
'x' Literal.String
|
|
'\\)' Comment.Preproc
|
|
')' Error
|
|
'"' Literal.String
|
|
'#' Punctuation
|
|
' ' Comment.Preproc
|
|
'{{' Literal.String
|
|
'x' Literal.String
|
|
'\\)' Comment.Preproc
|
|
')' Error
|
|
'x' Literal.String
|
|
')' Error
|
|
'\\)' Comment.Preproc
|
|
'(' Error
|
|
'#' Error
|
|
"'" Error
|
|
'}}' Literal.String
|
|
')' Punctuation
|
|
';' Comment.Single
|
|
'\n' Text.Whitespace
|