7c358cd5e6
* Modernize Whitespace token: basic lexer * Modernize Whitespace token: bibtex lexer * Modernize Whitespace token: boa lexer * Modernize Whitespace token: capnproto lexer + new example * Modernize Whitespace token: cddl lexer * Modernize Whitespace token: chapel lexer * Modernize Whitespace token: c_like lexer * Modernize Whitespace token: configs lexer * Modernize Whitespace token: console lexer * Modernize Whitespace token: crystal lexer * Modernize Whitespace token: csound lexer * Modernize Whitespace token: css lexer * Revert a change in basic lexer
50 lines
1.1 KiB
Text
50 lines
1.1 KiB
Text
---input---
|
|
def f(x : T, line = __LINE__) forall T
|
|
if x.is_a?(String)
|
|
pp! x
|
|
end
|
|
end
|
|
|
|
---tokens---
|
|
'def' Keyword
|
|
' ' Text.Whitespace
|
|
'f' Name.Function
|
|
'(' Punctuation
|
|
'x' Name
|
|
' ' Text.Whitespace
|
|
':' Punctuation
|
|
' ' Text.Whitespace
|
|
'T' Name
|
|
',' Punctuation
|
|
' ' Text.Whitespace
|
|
'line' Name
|
|
' ' Text.Whitespace
|
|
'=' Operator
|
|
' ' Text.Whitespace
|
|
'__LINE__' Keyword.Pseudo
|
|
')' Punctuation
|
|
' ' Text.Whitespace
|
|
'forall' Keyword.Pseudo
|
|
' ' Text.Whitespace
|
|
'T' Name
|
|
'\n' Text.Whitespace
|
|
|
|
'if' Keyword
|
|
' ' Text.Whitespace
|
|
'x' Name
|
|
'.is_a?' Keyword.Pseudo
|
|
'(' Punctuation
|
|
'String' Name
|
|
')' Punctuation
|
|
'\n' Text.Whitespace
|
|
|
|
'pp!' Name.Builtin.Pseudo
|
|
' ' Text.Whitespace
|
|
'x' Name
|
|
'\n' Text.Whitespace
|
|
|
|
'end' Keyword
|
|
'\n' Text.Whitespace
|
|
|
|
'end' Keyword
|
|
'\n' Text.Whitespace
|