Geoffrey Booth 7cf739e2b6 Lexer, helpers and comments cleanup (#5063) ...

* Move the building of the comments hash into its own function, to make clearer that it only happens once

* Abstract token comments dictionary

* Format comments

* Allow attaching a “data” property to tokens, to allow extra info to pass through the parser into the node classes

* Add data to StringLiteral tokens such that we should be able to deindent them in the nodes class

* Update output

* Another comment fix

* Add data to every token, with common properties

* Be more defensive, even though we apparently don't need to be

* Improve comments

* Remove the token data property, leaving all unrelated improvements

* Code review improvements; update output

2018-05-13 16:58:44 -07:00

..

coffeescript

Lexer, helpers and comments cleanup (#5063)

2018-05-13 16:58:44 -07:00