907df2c247
* Whitespace token modernization - ambient lexer * Whitespace token modernization - ampl lexer * Whitespace token modernization - apdlexer lexer * Whitespace token modernization - apl lexer * Whitespace token modernization - adl lexer * Whitespace token modernization - arrow lexer * Whitespace token modernization - asm lexer
29 lines
785 B
Text
29 lines
785 B
Text
---input---
|
|
lock addq $0, /* comments */ (%rsp) /*
|
|
// comments
|
|
*/ xorq %rax, %rax // comments
|
|
|
|
---tokens---
|
|
'lock' Name.Attribute
|
|
' ' Text.Whitespace
|
|
'addq' Name.Function
|
|
' ' Text.Whitespace
|
|
'$0' Name.Constant
|
|
',' Punctuation
|
|
' ' Text.Whitespace
|
|
'/* comments */' Comment.Multiline
|
|
' ' Text.Whitespace
|
|
'(' Punctuation
|
|
'%rsp' Name.Variable
|
|
')' Punctuation
|
|
' ' Text.Whitespace
|
|
'/*\n// comments\n*/' Comment.Multiline
|
|
' ' Text.Whitespace
|
|
'xorq' Name.Function
|
|
' ' Text.Whitespace
|
|
'%rax' Name.Variable
|
|
',' Punctuation
|
|
' ' Text.Whitespace
|
|
'%rax' Name.Variable
|
|
' ' Text.Whitespace
|
|
'// comments\n' Comment.Single
|