ci: use cheaper review model and cache pipeline installs
PR Check / Security scan (Snyk) (pull_request) Skipped
PR Check / Lint + typecheck (pull_request) Successful in 1m42s
PR Check / Secret scan (gitleaks) (pull_request) Successful in 6s
PR Check / Dependency audit (pull_request) Successful in 9s
PR Check / Dockerfile lint (droast) (pull_request) Successful in 5s
PR Check / AI code review (opencode) (pull_request) Successful in 45s
PR Check / Security scan (Snyk) (pull_request) Skipped
PR Check / Lint + typecheck (pull_request) Successful in 1m42s
PR Check / Secret scan (gitleaks) (pull_request) Successful in 6s
PR Check / Dependency audit (pull_request) Successful in 9s
PR Check / Dockerfile lint (droast) (pull_request) Successful in 5s
PR Check / AI code review (opencode) (pull_request) Successful in 45s
- review model: opencode-go/claude-haiku-5-5#medium instead of deepseek-v4.1-flash#max; flash has no medium variant - merge lint and typecheck into one job with a single pnpm install - cache the pnpm store and opencode binary via actions/cache@v4.1.0, keyed on a sha256 of the lockfile (hashFiles is empty on this runner) - update the decision records and log
This commit is contained in:
1 parent
71b73aacc8
commit
fa8fafb7ef
5 files changed
+110
-44
No files matched your search
@@ -1,7 +1,7 @@
|
||||
---
|
||||
type: Decision
|
||||
title: AI code review setup
|
||||
description: The review job runs opencode with the opencode-go plan model, env-only auth, a read-only permission set, and posts only reviews that end with a verdict line.
|
||||
description: The review job runs opencode with a cheap medium-effort opencode-go model, env-only auth, a read-only permission set, and posts only reviews that end with a verdict line.
|
||||
tags: [decision, ci, ai, opencode, security]
|
||||
status: draft
|
||||
generated: { by: opencode-go/glm-5.3-flash, at: 2026-10-18T16:05:00Z }
|
||||
@@ -19,7 +19,7 @@ sources:
|
||||
|
||||
The review job installs opencode v2 from the dedicated v2 installer,
|
||||
authenticates with `OPENCODE_API_KEY` from the environment only, runs
|
||||
`opencode-go/deepseek-v4-pro#max` (covered by the Go plan subscription,
|
||||
`opencode-go/claude-haiku-5-5#medium` (covered by the Go plan subscription,
|
||||
no per-token cost), denies `edit`/`shell`/`webfetch`/`websearch` via a
|
||||
global permission config written outside the checkout, and posts the
|
||||
review as a PR comment only if the output ends with a `VERDICT:` line.
|
||||
@@ -29,6 +29,7 @@ review as a PR comment only if the output ends with a `VERDICT:` line.
|
||||
| Piece | Why |
|
||||
|---|---|
|
||||
| Provider prefix `opencode-go`, not `opencode` | `opencode` is the pay-per-call Console gateway; the Go plan lives under its own provider id. The wrong prefix failed every run with "Insufficient account funds". |
|
||||
| Model `claude-haiku-5-5#medium` | Cheap per token and cheap in the usage window, with a real `#medium` reasoning level. `deepseek-v4.1-flash` only exposes low/high/max, so its reviews always paid for the maximum effort. |
|
||||
| The v2 installer (`/v2/install`) | The classic installer ships OpenCode 1.x (v1.19.3 on arm64), which cannot resolve model variants and failed with `ProviderModelNotFoundError` for `#max`. |
|
||||
| Env-only auth, no `opencode.json` in the checkout | A config file in the workspace holds the API key in plaintext where the review agent can read it; a malicious PR diff could prompt-inject the agent into quoting the key in the publicly visible review comment. Environment variables are invisible to file reads. |
|
||||
| Deny write tools via a global config outside the checkout | Headless runs cannot answer permission prompts; denials prevent both hangs and repo modification. The config file itself holds no secret, so its location leaks nothing. |
|
||||
@@ -54,17 +55,28 @@ derives the verdict from the findings, so the gate and the prompt agree.
|
||||
* Fresh-container replica test (node:22-bookworm, key-only auth)
|
||||
reproduced the CI failure exactly, then confirmed the v2 + `#max` fix
|
||||
before it was pushed.
|
||||
* Model history: `deepseek-v4-pro#max` was replaced by
|
||||
`deepseek-v4.1-flash#max` after two consecutive endpoint outages, then
|
||||
by `claude-haiku-5-5#medium` (2026-10-20) to stop paying maximum
|
||||
reasoning effort on every review. The flash model had no `#medium`
|
||||
variant to fall back to.
|
||||
|
||||
# Not verified
|
||||
|
||||
* Whether `#max` still resolves after a future CLI upgrade — the variant
|
||||
list comes from the model catalog, not a contract.
|
||||
* Long-run behaviour of Go plan usage windows ($3 per 5 hours for
|
||||
DeepSeek V4 Pro) under real review frequency.
|
||||
* Whether `#medium` still resolves after a future CLI upgrade — the
|
||||
variant list comes from the model catalog, not a contract.
|
||||
* Whether the smaller model still catches the same class of findings as
|
||||
the first flash review. The PR #14 findings are the baseline; re-run
|
||||
the eval on the next few PRs.
|
||||
* Long-run behaviour of Go plan usage windows under real review
|
||||
frequency, now that the model is cheaper.
|
||||
|
||||
# Revisit when
|
||||
|
||||
* A PR review fails again with a new error class — check the provider
|
||||
prefix, the CLI version, and the usage limits first; they caused every
|
||||
failure so far.
|
||||
* A flash-tier model gains a `#medium` variant and beats the current
|
||||
model on the PR #14 eval set — the present pick is a cost/quality
|
||||
compromise, not a permanent one.
|
||||
* Go Plus or pay-as-you-go balance becomes relevant.
|
||||
Reference in new issue
Block a user