Tokenize some text using Syntax. Note that the syntax definitions are assumed to have their keyword lists already resolved into word sets (as is the case for the bundled syntax definitions and for definitions loaded with the functions in Skylighting.Loader). If you construct a syntax map yourself from syntaxes parsed with parseSyntaxDefinition, apply resolveKeywords to each syntax first.
Moduleskylighting-core-0.15Haskell2010
Skylighting.Tokenizer
- 1 type
- 1 value
- Packageskylighting-core-0.15
- Exports2
- LanguageHaskell2010
- LicenceBSD-3-Clause
- SourceTokenizer.hs
Configuration options for tokenize.
Constructors
TokenizerConfigsyntaxMap :: SyntaxMapSyntax map to use
traceOutput :: BoolGenerate trace output for debugging
Instances2Show, MonadReader
Show TokenizerConfigDefined in skylighting-core-0.15 · Skylighting.TokenizerMonadReader TokenizerConfig TokenizerMDefined in skylighting-core-0.15 · Skylighting.Tokenizer