build: add frontend-builder image and bake buf into java-builder
ci/frontend-builder (new): Node 24 + pnpm 10 + buf 1.55 + global @bufbuild/protoc-gen-es 2.4 + Playwright chromium runtime libs + ORAS. Used by KollectAI-ETL frontend CI to run TS proto codegen locally (buf.gen.yaml uses `local: protoc-gen-es`) instead of the rate-limited BSR remote-plugin path. ci/java-builder: added the standalone buf binary so `buf lint` runs in CI without an inline curl install. Backend Java codegen stays in the Maven build (protobuf-maven-plugin), so no protoc plugins are added to this image. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,91 @@
|
||||
# KollectAI CI - Frontend Builder Image
|
||||
#
|
||||
# Pre-baked build environment for SvelteKit frontend CI jobs and
|
||||
# protobuf TypeScript code generation.
|
||||
# Contains: Node.js, pnpm, buf CLI, @bufbuild/protoc-gen-es plugin
|
||||
# (global so buf 'local: protoc-gen-es' resolves via PATH), Playwright
|
||||
# system deps, ORAS CLI, common build tools.
|
||||
#
|
||||
# Build:
|
||||
# docker build -t 192.168.1.72/kollect-tools/ci/frontend-builder:latest ci/frontend-builder/
|
||||
#
|
||||
# Usage in CI:
|
||||
# container:
|
||||
# image: 192.168.1.72/kollect-tools/ci/frontend-builder:latest
|
||||
|
||||
ARG NODE_MAJOR=24
|
||||
FROM node:${NODE_MAJOR}-bookworm-slim
|
||||
|
||||
ARG PNPM_VERSION=10.15.0
|
||||
ARG BUF_VERSION=1.55.0
|
||||
# Pin protoc-gen-es to a known-good major. Bump in lockstep with the
|
||||
# frontend's @bufbuild/protobuf runtime version in package.json.
|
||||
ARG PROTOC_GEN_ES_VERSION=2.4.0
|
||||
ARG ORAS_VERSION=1.2.2
|
||||
|
||||
# ─────────────────────────────────────────────────────────────────────
|
||||
# System dependencies
|
||||
#
|
||||
# The Playwright system libs (libnss3 ... libasound2) are pre-installed
|
||||
# so test-e2e jobs can skip `playwright install --with-deps` and just
|
||||
# run `playwright install chromium` (browser binary still cached at
|
||||
# ~/.cache/ms-playwright in CI). Saves ~30s per E2E run.
|
||||
# ─────────────────────────────────────────────────────────────────────
|
||||
RUN apt-get update && apt-get install -y --no-install-recommends \
|
||||
ca-certificates \
|
||||
curl \
|
||||
git \
|
||||
jq \
|
||||
unzip \
|
||||
# Playwright chromium runtime libs
|
||||
libasound2 \
|
||||
libatk1.0-0 \
|
||||
libatk-bridge2.0-0 \
|
||||
libcups2 \
|
||||
libdbus-1-3 \
|
||||
libdrm2 \
|
||||
libgbm1 \
|
||||
libnspr4 \
|
||||
libnss3 \
|
||||
libxcomposite1 \
|
||||
libxdamage1 \
|
||||
libxfixes3 \
|
||||
libxkbcommon0 \
|
||||
libxrandr2 \
|
||||
&& rm -rf /var/lib/apt/lists/*
|
||||
|
||||
# ─────────────────────────────────────────────────────────────────────
|
||||
# pnpm via corepack (ships with Node.js)
|
||||
# ─────────────────────────────────────────────────────────────────────
|
||||
RUN corepack enable \
|
||||
&& corepack prepare "pnpm@${PNPM_VERSION}" --activate
|
||||
|
||||
# ─────────────────────────────────────────────────────────────────────
|
||||
# buf CLI - single static binary, used for `buf lint` and `buf generate`
|
||||
# ─────────────────────────────────────────────────────────────────────
|
||||
RUN curl -fsSL "https://github.com/bufbuild/buf/releases/download/v${BUF_VERSION}/buf-Linux-x86_64" \
|
||||
-o /usr/local/bin/buf \
|
||||
&& chmod +x /usr/local/bin/buf
|
||||
|
||||
# ─────────────────────────────────────────────────────────────────────
|
||||
# protoc-gen-es - TypeScript codegen plugin for buf 'local:' references.
|
||||
# Installed globally so it lands on PATH; buf v2 resolves
|
||||
# `local: protoc-gen-es` via PATH lookup.
|
||||
# ─────────────────────────────────────────────────────────────────────
|
||||
RUN npm install -g "@bufbuild/protoc-gen-es@${PROTOC_GEN_ES_VERSION}"
|
||||
|
||||
# ─────────────────────────────────────────────────────────────────────
|
||||
# ORAS CLI - for uploading artifacts (test reports, audit logs) to Harbor
|
||||
# ─────────────────────────────────────────────────────────────────────
|
||||
RUN curl -fsSL "https://github.com/oras-project/oras/releases/download/v${ORAS_VERSION}/oras_${ORAS_VERSION}_linux_amd64.tar.gz" \
|
||||
| tar -xz -C /usr/local/bin oras
|
||||
|
||||
WORKDIR /workspace
|
||||
|
||||
# Verify installation
|
||||
RUN node --version \
|
||||
&& pnpm --version \
|
||||
&& buf --version \
|
||||
&& protoc-gen-es --version \
|
||||
&& oras version \
|
||||
&& jq --version
|
||||
@@ -0,0 +1,72 @@
|
||||
# Frontend Builder — CI Image
|
||||
|
||||
Pre-baked build environment for KollectAI-ETL frontend (SvelteKit) CI jobs and protobuf TypeScript code generation.
|
||||
|
||||
## What's included
|
||||
|
||||
- Node.js 24 (`node:24-bookworm-slim`)
|
||||
- pnpm 10 (via corepack)
|
||||
- [buf](https://buf.build) CLI — for `buf lint` and `buf generate`
|
||||
- [`@bufbuild/protoc-gen-es`](https://www.npmjs.com/package/@bufbuild/protoc-gen-es) — installed globally so `buf` v2 `local: protoc-gen-es` resolves via PATH (no BSR remote-plugin calls)
|
||||
- Playwright chromium runtime libraries pre-installed (`libnss3`, `libgbm1`, `libasound2`, etc.) — so `playwright install chromium` works without `--with-deps` apt fetches
|
||||
- ORAS CLI — for uploading test reports / audit artifacts to Harbor
|
||||
- `git`, `jq`, `curl`, `unzip`
|
||||
|
||||
## Build
|
||||
|
||||
```bash
|
||||
docker build -t 192.168.1.72/kollect-tools/ci/frontend-builder:latest ci/frontend-builder/
|
||||
docker push 192.168.1.72/kollect-tools/ci/frontend-builder:latest
|
||||
```
|
||||
|
||||
### Build args
|
||||
|
||||
| Arg | Default | Description |
|
||||
|-----|---------|-------------|
|
||||
| `NODE_MAJOR` | `24` | Node.js major version (matches Node base image) |
|
||||
| `PNPM_VERSION` | `10.15.0` | pnpm version (corepack-activated) |
|
||||
| `BUF_VERSION` | `1.55.0` | buf CLI version |
|
||||
| `PROTOC_GEN_ES_VERSION` | `2.4.0` | `@bufbuild/protoc-gen-es` version (bump in lockstep with frontend's `@bufbuild/protobuf` runtime) |
|
||||
| `ORAS_VERSION` | `1.2.2` | ORAS CLI version |
|
||||
|
||||
## Usage in CI
|
||||
|
||||
```yaml
|
||||
jobs:
|
||||
test-unit:
|
||||
runs-on: ubuntu-latest
|
||||
container:
|
||||
image: 192.168.1.72/kollect-tools/ci/frontend-builder:latest
|
||||
steps:
|
||||
- uses: actions/checkout@v6
|
||||
- run: pnpm install --frozen-lockfile
|
||||
working-directory: frontend/svelte
|
||||
- run: pnpm test
|
||||
working-directory: frontend/svelte
|
||||
```
|
||||
|
||||
For protobuf TS codegen (`buf.gen.yaml` declares `local: protoc-gen-es`):
|
||||
|
||||
```yaml
|
||||
- name: Generate proto TS bindings
|
||||
working-directory: proto
|
||||
run: buf generate
|
||||
```
|
||||
|
||||
For Playwright E2E (drop `--with-deps` because system libs are pre-installed):
|
||||
|
||||
```yaml
|
||||
- name: Install Playwright browsers
|
||||
working-directory: frontend/svelte
|
||||
run: pnpm exec playwright install chromium
|
||||
```
|
||||
|
||||
## Maintenance
|
||||
|
||||
Rebuild on dependency bumps:
|
||||
|
||||
- New Node major → bump `NODE_MAJOR`, push image
|
||||
- pnpm bump → bump `PNPM_VERSION`, push image
|
||||
- buf protocol changes → bump `BUF_VERSION` and `PROTOC_GEN_ES_VERSION`, push image
|
||||
|
||||
The CI workflow's weekly schedule rebuilds the image to keep base layers patched.
|
||||
Reference in New Issue
Block a user