Packages in CI

Running tricky packages (native builds, browsers, GPUs) in CI.

How to install and run dependencies that are painful in CI - native-build npm modules, browser automation, ML libraries, and database tooling - without flaky failures.

Node native modules

sharp, node-gyp, bcrypt, canvas.

Install protobufjs in CIInstall protobufjs in CI: it is pure JS, but its postinstall and pbjs/pbts CLIs need an unblocked install - Install ws addons in CIInstall the ws WebSocket optional addons in CI: bufferutil and utf-8-validate compile via node-gyp - add a jf "401 Unauthorized"Fix JFrog "401 Unauthorized" in CI - the jf CLI reached Artifactory but sent no valid credential because

Browsers & E2E

Puppeteer, Playwright, Cypress.

Run axe-core in CIRun axe-core in CI: it injects into a real browser via Playwright/Puppeteer, so install the browser, run

Data, ML & DB

Prisma, TensorFlow, OpenCV, psycopg2.

librosa/soundfile in CIInstall librosa and soundfile in CI: soundfile needs the libsndfile system library, so add libsndfile1, plus MoviePy in CIInstall MoviePy in CI: it needs the ffmpeg binary for video and ImageMagick for text/captions - add both via mysqlclient in CIInstall mysqlclient in CI without "Cannot find mysql_config" - add default-libmysqlclient-dev + pkg-config + Installing psycopg2 in CIInstall psycopg2 in CI: use psycopg2-binary or add libpq-dev for a source build, connect to a Postgres cryptography in CIInstall the Python cryptography package in CI without a Rust/OpenSSL build - keep the prebuilt wheel, or add Using PySpark in CIRun PySpark in CI: install a matching JDK, set JAVA_HOME, run a local Spark session, cache pip, and fix

Explore other topics

GitHub ActionsWorkflow, runner, and YAML errors - diagnosed and fixed. Node.js & npmnpm, yarn, and pnpm failures in CI - solved. DockerBuild, run, compose, and registry errors - explained. Pythonpip, poetry, venv, and pytest failures - fixed. Java & JVMMaven, Gradle, and JVM failures in CI - resolved. GoGo build, module, and test failures - diagnosed.