- Midrule actions and all preceding symbols are now accessible from later actions in that rule
- Explicit switching of tokenizer state with
enter_tokenizer_statemethod - Implicit end of input token now has modifiable states in which it is active
enter_tokenizer_state method