Data Transformation - CI/CD Glossary Definition
Data transformation cleans, reshapes, and aggregates raw data into modeled tables ready for analysis or serving.
Data transformation is the step that cleans, reshapes, joins, and aggregates raw data into a modeled form fit for analysis or serving. In modern stacks it is written as versioned SQL or code.
Transformation logic is code: it lives in a repo, is reviewed in pull requests, and is tested in CI before it changes production tables.
Tested in CI
Transform models are validated with unit tests and data tests on every commit, so a schema change or bad join fails the build instead of corrupting a table.
Related guides
ELT - CI/CD Glossary DefinitionELT: ELT (Extract, Load, Transform) loads raw data into a warehouse first, then transforms it in place using…
Data Quality - CI/CD Glossary DefinitionData Quality: Data quality measures how accurate, complete, consistent, and timely data is relative to expect…
Data Validation - CI/CD Glossary DefinitionData Validation: Data validation is the automated checking of data against rules (types, ranges, nullability,…