Non-semantic highlighting

[KubaP]

The VS Code client already supports semantic highlighting information received from the server, but semantic highlighting is only available "in context", which basically means within an editor/project that the server is operating on. Everywhere else, only non-semantic highlighting using TextMate grammars is used:

• Within the hover/documentation widget.
• Within markdown code blocks.
• Within the diff viewer.
• Many more such places...

TextMate grammar rules are a bit of a clusterfuck; the "standard" tokens are very precise in some areas but very imprecise in others. Plus, there really is no standard either, though it seems most editors and themes have settled on some common tokens. Given the complexity of writing regex rules to tokenize a non-trivial programming language, I think it's probably best to steal an existing TextMate grammar definition for a language like C and then modify it to work with GLSL.

Some potentially useful references:

• Section 12.4 of https://macromates.com/manual/en/language_grammars
• VS Code overview - https://code.visualstudio.com/api/language-extensions/syntax-highlight-guide
• Mapping of semantic scopes to textmate tokens - https://code.visualstudio.com/api/language-extensions/semantic-highlight-guide

Tasks

• TextMate grammar rules.
• TextMate markdown grammar injection.