7c358cd5e6
* Modernize Whitespace token: basic lexer * Modernize Whitespace token: bibtex lexer * Modernize Whitespace token: boa lexer * Modernize Whitespace token: capnproto lexer + new example * Modernize Whitespace token: cddl lexer * Modernize Whitespace token: chapel lexer * Modernize Whitespace token: c_like lexer * Modernize Whitespace token: configs lexer * Modernize Whitespace token: console lexer * Modernize Whitespace token: crystal lexer * Modernize Whitespace token: csound lexer * Modernize Whitespace token: css lexer * Revert a change in basic lexer
58 lines
1.4 KiB
Text
58 lines
1.4 KiB
Text
---input---
|
|
@[Link("some")]
|
|
lib LibSome
|
|
@[CallConvention("X86_StdCall")]
|
|
fun foo="some.foo"(thing : Void*) : LibC::Int
|
|
end
|
|
|
|
---tokens---
|
|
'@[' Operator
|
|
'Link' Name.Decorator
|
|
'(' Punctuation
|
|
'"' Literal.String.Double
|
|
'some' Literal.String.Double
|
|
'"' Literal.String.Double
|
|
')' Punctuation
|
|
']' Operator
|
|
'\n' Text.Whitespace
|
|
|
|
'lib' Keyword
|
|
' ' Text.Whitespace
|
|
'LibSome' Name.Namespace
|
|
'\n' Text.Whitespace
|
|
|
|
'@[' Operator
|
|
'CallConvention' Name.Decorator
|
|
'(' Punctuation
|
|
'"' Literal.String.Double
|
|
'X86_StdCall' Literal.String.Double
|
|
'"' Literal.String.Double
|
|
')' Punctuation
|
|
']' Operator
|
|
'\n' Text.Whitespace
|
|
|
|
'fun' Keyword
|
|
' ' Text.Whitespace
|
|
'foo' Name.Function
|
|
'=' Operator
|
|
'"' Literal.String.Double
|
|
'some.foo' Literal.String.Double
|
|
'"' Literal.String.Double
|
|
'(' Punctuation
|
|
'thing' Name
|
|
' ' Text.Whitespace
|
|
':' Punctuation
|
|
' ' Text.Whitespace
|
|
'Void' Name
|
|
'*' Operator
|
|
')' Punctuation
|
|
' ' Text.Whitespace
|
|
':' Punctuation
|
|
' ' Text.Whitespace
|
|
'LibC' Name
|
|
'::' Operator
|
|
'Int' Name
|
|
'\n' Text.Whitespace
|
|
|
|
'end' Keyword
|
|
'\n' Text.Whitespace
|