Test Flakiness Rate - CI/CD Glossary Definition
The test flakiness rate measures how often tests fail intermittently on unchanged code.
The test flakiness rate is the fraction of test runs that fail intermittently on unchanged code, usually measured per test over a window of runs. It quantifies how much nondeterminism is eroding CI trust.
Tracking flakiness per test lets teams quarantine the worst offenders and prioritize fixes instead of blindly retrying failed runs.
Related guides
Flaky Test - CI/CD Glossary DefinitionFlaky Test: A **flaky test** passes and fails on the same code due to nondeterminism (races, timing, external…
Quarantine List - CI/CD Glossary DefinitionQuarantine List: A quarantine list is a set of known-flaky tests temporarily excluded from failing the build,…
Retry Storm - CI/CD Glossary DefinitionRetry Storm: A retry storm is a cascade where many clients retry a failing operation at once, multiplying loa…