How to Validate Orchestrator Config in CI
Parsing config in CI turns a runtime scheduler failure into a fast, obvious pull request failure.
Run dbt parse, yamllint, and orchestrator-specific validators so malformed project or definition files fail before merge.
Steps
- Run
yamllintover config directories. - Run
dbt parseto compile the project without touching the warehouse. - Run the orchestrator validator (for example
dagster definitions validate).
Workflow
.github/workflows/ci.yml
steps:
- uses: actions/checkout@v4
- run: pip install yamllint dbt-snowflake==1.8.0
- run: yamllint -d relaxed models/ dbt_project.yml
- name: Compile dbt project
run: dbt parse --target ciGotchas
dbt parsecompiles and builds the manifest without running models, so it needs no warehouse write.- Use
yamllint -d relaxedto avoid failing on cosmetic rules while still catching real syntax errors.
Related guides
How to Validate Airflow DAGs With an Import Test in CICatch broken Airflow DAGs in CI by parsing every file with DagBag and failing on import errors, so a syntax o…
How to Run Dagster CI Checks for Jobs and AssetsValidate a Dagster code location in CI by loading definitions with dagster definitions validate and running a…