Modulecommonmark-0.3.1Haskell2010

Commonmark.Tokens

Synopsis

data Tok
data TokType
data SourcePos
value tokenize
value untokenize

Packagecommonmark-0.3.1
Exports5
LanguageHaskell2010
LicenceBSD-3-Clause
SourcePos.hs

datadata Tok

Constructors

Tok
- tokType :: !TokType
- tokPos :: !SourcePos
- tokContents :: !Text

Instances3Eq, Data, Show

Eq TokDefined in commonmark-0.3.1 · Commonmark.Tokens
Data TokDefined in commonmark-0.3.1 · Commonmark.Tokens
Show TokDefined in commonmark-0.3.1 · Commonmark.Tokens

datadata TokType

Instances4Eq, Data, Ord, Show

Eq TokTypeDefined in commonmark-0.3.1 · Commonmark.Tokens
Data TokTypeDefined in commonmark-0.3.1 · Commonmark.Tokens
Ord TokTypeDefined in commonmark-0.3.1 · Commonmark.Tokens
Show TokTypeDefined in commonmark-0.3.1 · Commonmark.Tokens

datadata SourcePos

Source#

The abstract data type SourcePos represents source positions. It contains the name of the source (i.e. file name), a line number and a column number. SourcePos is an instance of the Show, Eq and Ord class.

Instances4Eq, Data, Ord, Show

Eq SourcePosDefined in parsec-3.1.18.0 · Text.Parsec.Pos
Data SourcePosDefined in parsec-3.1.18.0 · Text.Parsec.Pos
Ord SourcePosDefined in parsec-3.1.18.0 · Text.Parsec.Pos
Show SourcePosDefined in parsec-3.1.18.0 · Text.Parsec.Pos

valuetokenize :: String -> Text -> [Tok]

Source#

Convert a Text into a list of Tok. The first parameter species the source name. The text is normalized to NFC, and U+0000 is replaced with U+FFFD, as required by the spec (section 2.3, Insecure characters).

valueuntokenize :: [Tok] -> Text

Source#

Reverses tokenize. untokenize . tokenize should be the identity on text that is NFC-normalized and does not contain U+0000.