The current highligher API is based on the end-of-life sonar-channel library.
It must therefore evolve in order to remove that dependency.
In addition, it currently does not allow to work on multi-line tokens, i.e. a tokenizer is not expected to consume a line terminator. This assumption is too restrictive and should be removed, as in many languages, it is possible to have multi-line strings.