Unit Test workflow (mead-ml/mead-baseline)
The Unit Test workflow from mead-ml/mead-baseline, explained and optimized by Latchkey.
CI health: C - fair
Point runs-on at Latchkey and get run de-duplication, job timeouts, self-healing for flaky steps, and up to 58% lower cost, applied automatically.
What it does
This is the Unit Test workflow from the mead-ml/mead-baseline repository, a real project running GitHub Actions. It is shown here with attribution under its Apache-2.0 license.
Below, Latchkey shows a faster, safer version produced by its optimization engine.
The workflow
name: Unit Test
on:
push:
branches:
- master
pull_request:
branches:
- master
jobs:
test-tf-2-1:
runs-on: ubuntu-latest
strategy:
max-parallel: 4
matrix:
tf-version:
- 2.1.0
container: tensorflow/tensorflow:${{matrix.tf-version}}-py3
steps:
- uses: actions/checkout@v2
- name: Install Baseline
run: |
cd layers
pip install -e .
cd ..
pip install tensorflow_addons==0.9.1
pip install -e .[test,yaml]
- name: Unit Test Tf ${{matrix.tf-version}}
run: |
pytest --forked
test-tf-2-3:
runs-on: ubuntu-latest
strategy:
max-parallel: 4
matrix:
tf-version:
- 2.3.0
container: tensorflow/tensorflow:${{matrix.tf-version}}
steps:
- uses: actions/checkout@v2
- name: Install Baseline
run: |
cd layers
pip install -e .
cd ..
pip install tensorflow_addons
pip install -e .[test,yaml]
- name: Unit Test Tf ${{matrix.tf-version}}
run: |
pytest --forked
test-pyt:
runs-on: ubuntu-latest
strategy:
max-parallel: 4
matrix:
pyt-version:
- 1.7.1-cuda11.0-cudnn8-runtime
container: pytorch/pytorch:${{matrix.pyt-version}}
steps:
- uses: actions/checkout@v2
- name: Install Baseline
run: |
cd layers
pip install --no-use-pep517 -e .
cd ..
pip install --no-use-pep517 -e .[test,yaml]
- name: Unit Test PyTorch ${{matrix.pyt-version}}
run: |
pytest --forked
The same workflow, on Latchkey
Removes redundant runs and caps runaway jobs. Added and changed lines are highlighted.
name: Unit Test on: push: branches: - master pull_request: branches: - master concurrency: group: ${{ github.workflow }}-${{ github.ref }} cancel-in-progress: true jobs: test-tf-2-1: timeout-minutes: 30 runs-on: latchkey-small strategy: max-parallel: 4 matrix: tf-version: - 2.1.0 container: tensorflow/tensorflow:${{matrix.tf-version}}-py3 steps: - uses: actions/checkout@v2 - name: Install Baseline run: | cd layers pip install -e . cd .. pip install tensorflow_addons==0.9.1 pip install -e .[test,yaml] - name: Unit Test Tf ${{matrix.tf-version}} run: | pytest --forked test-tf-2-3: timeout-minutes: 30 runs-on: latchkey-small strategy: max-parallel: 4 matrix: tf-version: - 2.3.0 container: tensorflow/tensorflow:${{matrix.tf-version}} steps: - uses: actions/checkout@v2 - name: Install Baseline run: | cd layers pip install -e . cd .. pip install tensorflow_addons pip install -e .[test,yaml] - name: Unit Test Tf ${{matrix.tf-version}} run: | pytest --forked test-pyt: timeout-minutes: 30 runs-on: latchkey-small strategy: max-parallel: 4 matrix: pyt-version: - 1.7.1-cuda11.0-cudnn8-runtime container: pytorch/pytorch:${{matrix.pyt-version}} steps: - uses: actions/checkout@v2 - name: Install Baseline run: | cd layers pip install --no-use-pep517 -e . cd .. pip install --no-use-pep517 -e .[test,yaml] - name: Unit Test PyTorch ${{matrix.pyt-version}} run: | pytest --forked
What changed
- Run on Latchkey managed runners with one line (
runs-on), which apply the fixes below automatically and self-heal transient failures. This example useslatchkey-small; pick the runner size that fits the job. - Cancel superseded runs when a branch or PR gets a newer push.
- Add a job timeout so a hung step cannot burn hours of runner time.
What Latchkey heals here
This workflow has steps that commonly fail on transient issues (network, registries, flaky browsers). On Latchkey managed runners they are detected, retried, and self-healed instead of failing your build:
- Dependency installs
This workflow runs 3 jobs per trigger. On Latchkey the same minutes cost up to 58% less than GitHub-hosted, with zero queue time.