| Safe Haskell | None |
|---|---|
| Language | Haskell2010 |
Skylighting.Tokenizer
Synopsis
- tokenize :: TokenizerConfig -> Syntax -> Text -> Either String [SourceLine]
- data TokenizerConfig = TokenizerConfig {
- syntaxMap :: SyntaxMap
- traceOutput :: Bool
Documentation
tokenize :: TokenizerConfig -> Syntax -> Text -> Either String [SourceLine] Source #
Tokenize some text using Syntax.
Note that the syntax definitions are assumed to have their
keyword lists already resolved into word sets (as is the case
for the bundled syntax definitions and for definitions loaded
with the functions in Skylighting.Loader). If you construct a
syntax map yourself from syntaxes parsed with
parseSyntaxDefinition, apply
resolveKeywords to each syntax first.
data TokenizerConfig Source #
Configuration options for tokenize.
Constructors
| TokenizerConfig | |
Fields
| |
Instances
| Show TokenizerConfig Source # | |
Defined in Skylighting.Tokenizer Methods showsPrec :: Int -> TokenizerConfig -> ShowS show :: TokenizerConfig -> String showList :: [TokenizerConfig] -> ShowS | |