diff --git a/website/monarch.html b/website/monarch.html index 7429117681..d10e218172 100644 --- a/website/monarch.html +++ b/website/monarch.html @@ -152,7 +152,6 @@
Note: The token classes in the third column are currently only highlighted correctly if you include the monarch.css
style file (Aug 2012).
A tokenizer consists of an object that defines states. The initial state of the tokenizer is the first state defined in the tokenizer. When a tokenizer is in a certain state, only the rules in that state will be applied. All rules are matched in order and when the first one matches its action is used to determine the token class. No further rules are tried. Therefore, it can