lex

Definition

To perform lexical analysis; to convert a character stream to a token stream as a preliminary to parsing.

Etymology

From lexical analysis, from lexical.

Example Sentences

• "Once this is done, each processor parses and lexes its own documents, using conventional programming techniques."
• "SAFL source is lexed and parsed into an abstract syntax tree."
• "Lexing and parsing do not have to be separated, and there are often convenient .NET methods for extracting information from text in particular formats..."