Lexer - CI/CD Glossary Definition

A lexer (tokenizer) reads source character by character and groups them into tokens (keywords, identifiers, numbers, operators), discarding whitespace and comments; it is the first compiler stage and hands its token stream to the parser.

Related guides

Parser - CI/CD Glossary DefinitionA parser consumes tokens from the lexer and builds an abstract syntax tree per the language grammar, reportin… Abstract Syntax Tree - CI/CD Glossary DefinitionAn abstract syntax tree is the structured tree a parser builds from source, capturing its grammar without pun… Semantic Analysis - CI/CD Glossary DefinitionSemantic analysis checks an AST for meaning-level rules a grammar can’t - scope, types, declared-before-use -…