* Modernize Whitespace token: basic lexer * Modernize Whitespace token: bibtex lexer * Modernize Whitespace token: boa lexer * Modernize Whitespace token: capnproto lexer + new example * Modernize Whitespace token: cddl lexer * Modernize Whitespace token: chapel lexer * Modernize Whitespace token: c_like lexer * Modernize Whitespace token: configs lexer * Modernize Whitespace token: console lexer * Modernize Whitespace token: crystal lexer * Modernize Whitespace token: csound lexer * Modernize Whitespace token: css lexer * Revert a change in basic lexer
44 lines
1 KiB
Text
44 lines
1 KiB
Text
---input---
|
|
#define MACRO(ARG1#ARG2) #macro_body#
|
|
#define/**/
|
|
MACRO(ARG1'ARG2' ARG3)/**/
|
|
#\#macro
|
|
body\##
|
|
|
|
---tokens---
|
|
'#define' Comment.Preproc
|
|
' ' Text.Whitespace
|
|
'MACRO' Comment.Preproc
|
|
'(' Punctuation
|
|
'ARG1' Comment.Preproc
|
|
'#' Punctuation
|
|
'ARG2' Comment.Preproc
|
|
')' Punctuation
|
|
' ' Text.Whitespace
|
|
'#' Punctuation
|
|
'macro_body' Comment.Preproc
|
|
'#' Punctuation
|
|
'\n' Text.Whitespace
|
|
|
|
'#define' Comment.Preproc
|
|
'/**/' Comment.Multiline
|
|
'\n' Text.Whitespace
|
|
|
|
'MACRO' Comment.Preproc
|
|
'(' Punctuation
|
|
'ARG1' Comment.Preproc
|
|
"'" Punctuation
|
|
'ARG2' Comment.Preproc
|
|
"'" Punctuation
|
|
' ' Text.Whitespace
|
|
'ARG3' Comment.Preproc
|
|
')' Punctuation
|
|
'/**/' Comment.Multiline
|
|
'\n' Text.Whitespace
|
|
|
|
'#' Punctuation
|
|
'\\#' Comment.Preproc
|
|
'macro\nbody' Comment.Preproc
|
|
'\\#' Comment.Preproc
|
|
'#' Punctuation
|
|
'\n' Text.Whitespace
|