Legend:
Library
Module
Module type
Parameter
Class
Class type
Library
Module
Module type
Parameter
Class
Class type
A very fast lexer for very basic tokens
type t =
| LexNull
| LexBool of bool
| LexInt of int
| LexReal of float
| LexString of string
| LexName of string
| LexLeftSquare
| LexRightSquare
| LexLeftDict
| LexRightDict
| LexStream of Pdf.stream
| LexEndStream
| LexObj
| LexEndObj
| LexR
| LexComment
| StopLexing
| LexNone
To avoid too much storage allocation (and hence garbage collection), we use the same data type for this very basic lexing module as for the main lexing in Pdfread
. Eventually, we may unify this with the parsing type too.
val string_of_token : t -> string
For debug only.
val string_of_tokens : t list -> string
For debug only.
val lex_single : Pdfio.input -> t
Lex a single token from a Pdfio.input
.
val lex : Pdfio.input -> t list
Lex all the token in a Pdfio.input
.
val lex_string : string -> t list
Lex all the tokens from a string.