Kevin Sawicki
27cee3e19c
Don't terminate tokenization if stack size changes
...
Previously Python import blocks were not tokenizing correctly since
the loop was prematurely terminating when a match at the end of the line
was reached and no tokens were generated for it.
This approach was incorrect since the tokenizer may have just popped a rule
and another loop could possibly pop more rules.
Now this early termination is only performed if the stack size hasn't changed.
2013-08-20 11:38:06 -07:00
..
2013-08-14 14:05:35 -07:00
2013-08-14 08:48:12 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 21:23:00 -07:00
2013-08-19 20:13:58 -07:00
2013-07-23 17:49:14 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-06-12 15:43:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 21:23:00 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-06-11 11:17:16 -07:00
2013-08-14 14:05:35 -07:00
2013-08-16 20:52:20 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 21:23:00 -07:00
2013-08-19 20:13:58 -07:00
2013-08-20 11:38:06 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-03-12 10:38:05 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00
2013-08-19 20:13:58 -07:00