tokenify-0.1.2.0: A regex lexer
Text.Tokenify.Types
Description
Common types used by Text.Tokenify
Synopsis
type Tokenizer s a = [Token s a] Source
A series of Tokens which will match in sequencial order
type Token s a = (Regex s, Response s a) Source
Defines what is matches, and how to respond to said match
type Pos = (Int, Int) Source
The type for a token position in a file