mirror of
https://github.com/atom/atom.git
synced 2026-04-06 03:02:13 -04:00
3ebd7cfef1
The tokenizer emits individual tokens with arrays of scopes, rather than a more tree-like structure. It's debatable whether we want to emit scope trees rather than token streams in general, though that might complicate things like line wrapping. For now, we're reconstructing the tree during rendering based on information that's implicit in the tokens.