Benchmarks workflow (mirumee/ariadne)

The Benchmarks workflow from mirumee/ariadne, explained and optimized by Latchkey.

CI health: D - needs work

Point runs-on at Latchkey and get caching, run de-duplication, job timeouts, self-healing for flaky steps, and up to 58% lower cost, applied automatically.

Grade your own workflow free or run it on Latchkey →

Source: mirumee/ariadne.github/workflows/benchmark.ymlLicense BSD-3-ClauseView source

What it does

This is the Benchmarks workflow from the mirumee/ariadne repository, a real project running GitHub Actions. It is shown here with attribution under its BSD-3-Clause license.

Below, Latchkey shows a faster, safer version produced by its optimization engine.

The workflow

workflow (.yml)

name: Benchmarks

on:
  push:
    branches:
      - main
    tags:
      - benchmark-**

jobs:
  build:

    runs-on: ubuntu-latest
    strategy:
      fail-fast: false
      max-parallel: 1
      matrix:
        python-version: ["3.10", "3.11", "3.12", "3.13", "3.14"]

    steps:
    - name: Checkout source code
      uses: actions/checkout@v4
      with:
        ref: main

    - name: Set up Python ${{ matrix.python-version }}
      uses: actions/setup-python@v5
      with:
        python-version: ${{ matrix.python-version }}

    - name: Install Hatch
      uses: pypa/hatch@257e27e51a6a5616ed08a39a408a21c35c9931bc

    - name: Benchmark
      run: |
        hatch test -py ${{ matrix.python-version }} benchmark --benchmark-storage=file://benchmark/results --benchmark-autosave
        cd benchmark && python rotate_results.py "${{ matrix.python-version }}"

    - name: Commit
      run: |
        git config user.name "pytest-benchmark"
        git config user.email "<>"
        git add benchmark/results --all
        git commit -m "Benchmark results for ${{ matrix.python-version }}"
        git push

The same workflow, on Latchkey

Estimated ~20% faster on cache hits, plus fewer wasted runs and a safer supply chain. Added and changed lines are highlighted.

name: Benchmarks
 
on:
  push:
    branches:
      - main
    tags:
      - benchmark-**
 
concurrency:
  group: ${{ github.workflow }}-${{ github.ref }}
  cancel-in-progress: true
 
jobs:
  build:
    timeout-minutes: 30
 
    runs-on: latchkey-small
    strategy:
      fail-fast: false
      max-parallel: 1
      matrix:
        python-version: ["3.10", "3.11", "3.12", "3.13", "3.14"]
 
    steps:
    - name: Checkout source code
      uses: actions/checkout@v4
      with:
        ref: main
 
    - name: Set up Python ${{ matrix.python-version }}
      uses: actions/setup-python@v5
      with:
        cache: 'pip'
        python-version: ${{ matrix.python-version }}
 
    - name: Install Hatch
      uses: pypa/hatch@257e27e51a6a5616ed08a39a408a21c35c9931bc
 
    - name: Benchmark
      run: |
        hatch test -py ${{ matrix.python-version }} benchmark --benchmark-storage=file://benchmark/results --benchmark-autosave
        cd benchmark && python rotate_results.py "${{ matrix.python-version }}"
 
    - name: Commit
      run: |
        git config user.name "pytest-benchmark"
        git config user.email "<>"
        git add benchmark/results --all
        git commit -m "Benchmark results for ${{ matrix.python-version }}"
        git push

What changed

Run on Latchkey managed runners with one line (runs-on), which apply the fixes below automatically and self-heal transient failures. This example uses latchkey-small; pick the runner size that fits the job.
Cancel superseded runs when a branch or PR gets a newer push.
Cache dependency installs on the setup step so they are served from cache.
Add a job timeout so a hung step cannot burn hours of runner time.

This workflow runs 1 job (5 with the matrix expanded) per trigger. On Latchkey the same minutes cost up to 58% less than GitHub-hosted, with zero queue time.

Actions used in this workflow

actions/checkout actions/setup-python