Interface Raw

Raw token

Resulting token from processing through the tokenizer.

interface Raw {
    pos: number;
    raw: string;
    type: "TEXT" | "INTRODUCER" | "DATA" | "FINAL";
}

Hierarchy (View Summary)

BaseToken
- Raw

Index

Properties

Properties

pos

pos: number

Position in the input

raw

raw: string

Raw text

type

type: "TEXT" | "INTRODUCER" | "DATA" | "FINAL"

Token type