mirror of
https://github.com/garrytan/gstack.git
synced 2026-05-15 16:52:14 +08:00
* fix(learnings): accept type:"investigation" in gstack-learnings-log The /investigate skill instructed agents to log learnings with type:"investigation", but bin/gstack-learnings-log:22 rejected anything not in [pattern, pitfall, preference, architecture, tool, operational]. Every investigation run exited 1 to stderr and the learning was dropped, silently to the user. Fix: add 'investigation' to ALLOWED_TYPES. Regression test: round-trips a learning with type:"investigation" and asserts exit 0 + file write; second test reads investigate/SKILL.md.tmpl and asserts it emits the literal type:"investigation" string, guarding the template/validator contract at both ends. Fixes #1423. Reported by diogolealassis. * fix(gbrain): engine detection survives gbrain ≥0.25 schema + non-zero doctor exit freshDetectEngineTier() in lib/gstack-memory-helpers.ts returned engine: "unknown" for every Supabase user on gbrain ≥0.25. Two stacking bugs: 1. execSync("gbrain doctor --json --fast 2>/dev/null") threw on non-zero exit. gbrain doctor exits 1 whenever health_score < 100, which is essentially every fresh install due to resolver_health warnings. The JSON output never reached the parser. 2. gbrain ≥0.25 shipped schema_version:2 doctor output that dropped the top-level 'engine' field entirely. Result: every /sync-gbrain on Supabase logged 'engine=unknown' and skipped all sync stages silently. Fix: - Replace execSync with execFileSync (no shell, no bash-specific 2>/dev/null redirect; portable to Windows). - Recover stdout from the thrown error object so non-zero exits still parse. - Fall back to reading gbrain's config.json (respecting GBRAIN_HOME env var, defaulting to ~/.gbrain/config.json) when doctor output doesn't surface an engine field. - Add logGbrainError() helper that appends one-line JSONL to ~/.gstack/.gbrain-errors.jsonl on parse failure, so future regressions leave a forensic trail. The "supabase" tier here means "remote postgres" in practice — gbrain config uses engine:"postgres" for both real Supabase and any other remote postgres (e.g. local-postgres-for-testing). Downstream sync code treats them identically, so the label compression is intentional and documented inline. Regression test: existing detectEngineTier suite now isolates HOME + GBRAIN_HOME + PATH to temp dirs (closes a flake source where the prior tests would read whatever was on the reviewer's machine). New test forces gbrain off PATH, writes a synthetic config.json with engine:"postgres", asserts detectEngineTier() returns engine:"supabase". Fixes #1415. Patch shape contributed by Shiv @shivasymbl (tested on gstack v1.31.0.0 + gbrain v0.31.3 + Supabase). * fix(codex): /codex review works on Codex CLI ≥0.130.0 Codex CLI 0.130.0 made [PROMPT] and --base <BRANCH> mutually exclusive at argv level. Step 2A of codex/SKILL.md.tmpl had always passed both (the filesystem boundary prefix as the prompt argument + the base branch), so every /codex review call died with: error: the argument '[PROMPT]' cannot be used with '--base <BRANCH>' Fix: split Step 2A into two paths. Default (no custom user instructions): bare 'codex review --base <base>'. Codex's review prompt is internally diff-scoped, so the model focuses on the changes against base. The filesystem boundary prefix is dropped here because Codex 0.130 has no documented system-prompt config key (probed -c 'system_prompt="..."' against 0.130 — the flag is silently accepted but the value isn't applied). Skill files under .claude/ and agents/ are public, so this is a token-efficiency concern, not a safety one. Custom instructions (/codex review <focus>): route through codex exec with the diff written to a tempfile, inlined into the prompt between explicit DIFF_START / DIFF_END markers. The boundary is preserved here because codex exec isn't auto-scoped to the diff. The DIFF_START/END delimiters tell the model where data ends and instructions resume, which materially reduces prompt-injection hijack rates when the diff contains adversarial content. Note on bash semantics: codex's earlier review flagged the exec route as "command injection via $_DIFF interpolation." That framing is wrong — bash parameter expansion does not re-evaluate $(...) or backticks inside the expanded value, so a diff containing $(rm -rf /) is plain string data to codex exec. The real risk is prompt injection (model-side, not shell-side), which the DIFF_START/END pattern mitigates. Regression tests in test/codex-hardening.test.ts assert across BOTH codex/SKILL.md.tmpl AND the generated codex/SKILL.md: 1. No 'codex review' invocation line combines a quoted-string OR variable positional argument with --base. 2. Step 2A still contains either bare 'codex review --base' OR 'codex exec' (guards against accidental deletion of both fix paths). Fixes #1428. Reported by Stashub. * test: raise timeouts for slow integration tests Two test files were timing out at the default 5s on developer machines, both pre-existing on origin/main but unrelated to this branch's bug fixes: - test/gstack-artifacts-init.test.ts: 13 tests spawning real subprocesses via fake gh/glab/git shims in PATH. bun's fork+exec overhead pushed these past 5s consistently. Added a local test-wrapper that aliases test() with a 30s timeout (matches the brain-sync.test.ts pattern already in the repo). - test/gstack-next-version.test.ts: one integration smoke test that spawns 'bun run ./bin/gstack-next-version' and parses the resulting JSON. The subprocess does a 'gh pr list' against the live GitHub API to enumerate claimed version slots. Network latency makes 5s tight; raised this single test to 30s. No production code changed. The tests already passed deterministically once given enough wall-clock time. * chore: bump version and changelog (v1.34.2.0) Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
345 lines
12 KiB
TypeScript
345 lines
12 KiB
TypeScript
/**
|
|
* Unit tests for lib/gstack-memory-helpers.ts (Lane 0 foundation).
|
|
*
|
|
* Covers the public surface used by Lanes A, B, C:
|
|
* - canonicalizeRemote: 8 cases across https/ssh/git@/.git/empty
|
|
* - secretScanFile: gitleaks-missing fallback + redactMatch behavior
|
|
* - parseSkillManifest: valid manifest + missing manifest + multi-kind
|
|
* - withErrorContext: success path + error path + log writing
|
|
* - detectEngineTier: cache TTL + fresh-detect fallback
|
|
*
|
|
* Free-tier (~50ms total). Runs in `bun test`.
|
|
*/
|
|
|
|
import { describe, it, expect, beforeEach, afterAll } from "bun:test";
|
|
import { mkdtempSync, writeFileSync, readFileSync, existsSync, rmSync, mkdirSync } from "fs";
|
|
import { tmpdir } from "os";
|
|
import { join } from "path";
|
|
|
|
import {
|
|
canonicalizeRemote,
|
|
secretScanFile,
|
|
parseSkillManifest,
|
|
withErrorContext,
|
|
detectEngineTier,
|
|
_resetGitleaksAvailabilityCache,
|
|
} from "../lib/gstack-memory-helpers";
|
|
|
|
// ── canonicalizeRemote ─────────────────────────────────────────────────────
|
|
|
|
describe("canonicalizeRemote", () => {
|
|
it("strips https scheme and .git suffix", () => {
|
|
expect(canonicalizeRemote("https://github.com/garrytan/gstack.git")).toBe("github.com/garrytan/gstack");
|
|
});
|
|
|
|
it("normalizes git@host:path scp-style remotes", () => {
|
|
expect(canonicalizeRemote("git@github.com:garrytan/gstack.git")).toBe("github.com/garrytan/gstack");
|
|
});
|
|
|
|
it("strips ssh:// scheme", () => {
|
|
expect(canonicalizeRemote("ssh://git@gitlab.com/foo/bar")).toBe("gitlab.com/foo/bar");
|
|
});
|
|
|
|
it("returns empty string for null/undefined/empty input", () => {
|
|
expect(canonicalizeRemote("")).toBe("");
|
|
expect(canonicalizeRemote(null)).toBe("");
|
|
expect(canonicalizeRemote(undefined)).toBe("");
|
|
});
|
|
|
|
it("strips surrounding quotes", () => {
|
|
expect(canonicalizeRemote(`"https://github.com/foo/bar.git"`)).toBe("github.com/foo/bar");
|
|
});
|
|
|
|
it("strips trailing slashes", () => {
|
|
expect(canonicalizeRemote("https://github.com/foo/bar/")).toBe("github.com/foo/bar");
|
|
});
|
|
|
|
it("lowercases the result", () => {
|
|
expect(canonicalizeRemote("https://GitHub.com/Foo/Bar.git")).toBe("github.com/foo/bar");
|
|
});
|
|
|
|
it("handles paths with multiple segments", () => {
|
|
expect(canonicalizeRemote("https://gitlab.example.com/group/subgroup/project.git")).toBe(
|
|
"gitlab.example.com/group/subgroup/project"
|
|
);
|
|
});
|
|
|
|
it("collapses redundant slashes", () => {
|
|
expect(canonicalizeRemote("https://github.com//foo//bar")).toBe("github.com/foo/bar");
|
|
});
|
|
});
|
|
|
|
// ── secretScanFile ─────────────────────────────────────────────────────────
|
|
|
|
describe("secretScanFile", () => {
|
|
beforeEach(() => {
|
|
_resetGitleaksAvailabilityCache();
|
|
});
|
|
|
|
it("returns scanner=error for non-existent file", () => {
|
|
const result = secretScanFile("/nonexistent/path/that/does/not/exist");
|
|
expect(result.scanned).toBe(false);
|
|
expect(result.scanner).toBe("error");
|
|
expect(result.findings).toEqual([]);
|
|
});
|
|
|
|
it("returns scanner=missing or runs gitleaks (env-dependent)", () => {
|
|
// We can't assume gitleaks is installed in CI; we just verify the shape.
|
|
const dir = mkdtempSync(join(tmpdir(), "gstack-test-"));
|
|
const file = join(dir, "clean.txt");
|
|
writeFileSync(file, "no secrets here\n");
|
|
const result = secretScanFile(file);
|
|
expect(["gitleaks", "missing", "error"]).toContain(result.scanner);
|
|
if (result.scanner === "gitleaks") {
|
|
// Clean file should produce no findings
|
|
expect(result.findings).toEqual([]);
|
|
}
|
|
rmSync(dir, { recursive: true, force: true });
|
|
});
|
|
});
|
|
|
|
// ── parseSkillManifest ─────────────────────────────────────────────────────
|
|
|
|
describe("parseSkillManifest", () => {
|
|
it("returns null for non-existent file", () => {
|
|
expect(parseSkillManifest("/nonexistent/skill.md")).toBeNull();
|
|
});
|
|
|
|
it("returns null for file without frontmatter", () => {
|
|
const dir = mkdtempSync(join(tmpdir(), "gstack-test-"));
|
|
const file = join(dir, "no-fm.md");
|
|
writeFileSync(file, "# Just a heading\n\nbody text\n");
|
|
expect(parseSkillManifest(file)).toBeNull();
|
|
rmSync(dir, { recursive: true, force: true });
|
|
});
|
|
|
|
it("returns null when frontmatter has no gbrain: key", () => {
|
|
const dir = mkdtempSync(join(tmpdir(), "gstack-test-"));
|
|
const file = join(dir, "no-gbrain.md");
|
|
writeFileSync(file, `---\nname: foo\ndescription: bar\n---\n\nbody\n`);
|
|
expect(parseSkillManifest(file)).toBeNull();
|
|
rmSync(dir, { recursive: true, force: true });
|
|
});
|
|
|
|
it("parses a multi-kind manifest correctly", () => {
|
|
const dir = mkdtempSync(join(tmpdir(), "gstack-test-"));
|
|
const file = join(dir, "multi.md");
|
|
writeFileSync(
|
|
file,
|
|
`---
|
|
name: office-hours
|
|
description: YC Office Hours
|
|
gbrain:
|
|
schema: 1
|
|
context_queries:
|
|
- id: prior-sessions
|
|
kind: vector
|
|
query: "office-hours sessions for {repo_slug}"
|
|
limit: 5
|
|
render_as: "## Prior office-hours sessions in this repo"
|
|
- id: builder-profile
|
|
kind: filesystem
|
|
glob: "~/.gstack/builder-profile.jsonl"
|
|
tail: 1
|
|
render_as: "## Your builder profile snapshot"
|
|
- id: prior-assignments
|
|
kind: list
|
|
sort: created_at_desc
|
|
limit: 5
|
|
render_as: "## Open assignments from past sessions"
|
|
triggers:
|
|
- office-hours
|
|
---
|
|
|
|
body
|
|
`
|
|
);
|
|
|
|
const m = parseSkillManifest(file);
|
|
expect(m).not.toBeNull();
|
|
expect(m!.schema).toBe(1);
|
|
expect(m!.context_queries).toHaveLength(3);
|
|
|
|
const ids = m!.context_queries.map((q) => q.id);
|
|
expect(ids).toEqual(["prior-sessions", "builder-profile", "prior-assignments"]);
|
|
|
|
const kinds = m!.context_queries.map((q) => q.kind);
|
|
expect(kinds).toEqual(["vector", "filesystem", "list"]);
|
|
|
|
expect(m!.context_queries[0].query).toBe("office-hours sessions for {repo_slug}");
|
|
expect(m!.context_queries[0].limit).toBe(5);
|
|
expect(m!.context_queries[1].glob).toBe("~/.gstack/builder-profile.jsonl");
|
|
expect(m!.context_queries[1].tail).toBe(1);
|
|
expect(m!.context_queries[2].sort).toBe("created_at_desc");
|
|
|
|
rmSync(dir, { recursive: true, force: true });
|
|
});
|
|
|
|
it("ignores incomplete query items (missing kind)", () => {
|
|
const dir = mkdtempSync(join(tmpdir(), "gstack-test-"));
|
|
const file = join(dir, "incomplete.md");
|
|
writeFileSync(
|
|
file,
|
|
`---
|
|
name: bad
|
|
gbrain:
|
|
schema: 1
|
|
context_queries:
|
|
- id: missing-kind
|
|
render_as: "## Should be skipped"
|
|
- id: complete
|
|
kind: vector
|
|
query: "x"
|
|
render_as: "## OK"
|
|
---
|
|
|
|
body
|
|
`
|
|
);
|
|
|
|
const m = parseSkillManifest(file);
|
|
expect(m).not.toBeNull();
|
|
expect(m!.context_queries).toHaveLength(1);
|
|
expect(m!.context_queries[0].id).toBe("complete");
|
|
rmSync(dir, { recursive: true, force: true });
|
|
});
|
|
});
|
|
|
|
// ── withErrorContext ───────────────────────────────────────────────────────
|
|
|
|
describe("withErrorContext", () => {
|
|
let savedHome: string | undefined;
|
|
let testHome: string;
|
|
|
|
beforeEach(() => {
|
|
savedHome = process.env.GSTACK_HOME;
|
|
testHome = mkdtempSync(join(tmpdir(), "gstack-test-home-"));
|
|
process.env.GSTACK_HOME = testHome;
|
|
});
|
|
|
|
afterAll(() => {
|
|
if (savedHome === undefined) delete process.env.GSTACK_HOME;
|
|
else process.env.GSTACK_HOME = savedHome;
|
|
});
|
|
|
|
it("returns the value on success and writes an ok entry", async () => {
|
|
const result = await withErrorContext("test-op-success", () => 42, "test-caller");
|
|
expect(result).toBe(42);
|
|
|
|
const log = readFileSync(join(testHome, ".gbrain-errors.jsonl"), "utf-8");
|
|
const entry = JSON.parse(log.trim().split("\n").pop()!);
|
|
expect(entry.op).toBe("test-op-success");
|
|
expect(entry.outcome).toBe("ok");
|
|
expect(entry.schema_version).toBe(1);
|
|
expect(entry.last_writer).toBe("test-caller");
|
|
expect(typeof entry.duration_ms).toBe("number");
|
|
expect(entry.duration_ms).toBeGreaterThanOrEqual(0);
|
|
});
|
|
|
|
it("rethrows the error on failure and writes an error entry", async () => {
|
|
let caught: unknown = null;
|
|
try {
|
|
await withErrorContext("test-op-fail", () => {
|
|
throw new Error("boom");
|
|
}, "test-caller");
|
|
} catch (e) {
|
|
caught = e;
|
|
}
|
|
expect(caught).toBeInstanceOf(Error);
|
|
expect((caught as Error).message).toBe("boom");
|
|
|
|
const log = readFileSync(join(testHome, ".gbrain-errors.jsonl"), "utf-8");
|
|
const entry = JSON.parse(log.trim().split("\n").pop()!);
|
|
expect(entry.op).toBe("test-op-fail");
|
|
expect(entry.outcome).toBe("error");
|
|
expect(entry.error).toBe("boom");
|
|
});
|
|
|
|
it("supports async functions", async () => {
|
|
const result = await withErrorContext(
|
|
"async-op",
|
|
async () => {
|
|
await new Promise((r) => setTimeout(r, 5));
|
|
return "done";
|
|
},
|
|
"test-caller"
|
|
);
|
|
expect(result).toBe("done");
|
|
});
|
|
});
|
|
|
|
// ── detectEngineTier ───────────────────────────────────────────────────────
|
|
|
|
describe("detectEngineTier", () => {
|
|
let savedHome: string | undefined;
|
|
let savedGbrainHome: string | undefined;
|
|
let savedRealHome: string | undefined;
|
|
let savedPath: string | undefined;
|
|
let testHome: string;
|
|
let testGbrainHome: string;
|
|
|
|
beforeEach(() => {
|
|
savedHome = process.env.GSTACK_HOME;
|
|
savedGbrainHome = process.env.GBRAIN_HOME;
|
|
savedRealHome = process.env.HOME;
|
|
savedPath = process.env.PATH;
|
|
testHome = mkdtempSync(join(tmpdir(), "gstack-test-engine-"));
|
|
testGbrainHome = mkdtempSync(join(tmpdir(), "gstack-test-gbrain-"));
|
|
process.env.GSTACK_HOME = testHome;
|
|
process.env.GBRAIN_HOME = testGbrainHome;
|
|
// Isolate HOME too — even though gbrainConfigPath() prefers GBRAIN_HOME
|
|
// when set, defense-in-depth against future code reading ~/.gbrain
|
|
// directly. See #1415 codex review finding #6.
|
|
process.env.HOME = testHome;
|
|
});
|
|
|
|
afterAll(() => {
|
|
if (savedHome === undefined) delete process.env.GSTACK_HOME;
|
|
else process.env.GSTACK_HOME = savedHome;
|
|
if (savedGbrainHome === undefined) delete process.env.GBRAIN_HOME;
|
|
else process.env.GBRAIN_HOME = savedGbrainHome;
|
|
if (savedRealHome === undefined) delete process.env.HOME;
|
|
else process.env.HOME = savedRealHome;
|
|
if (savedPath === undefined) delete process.env.PATH;
|
|
else process.env.PATH = savedPath;
|
|
});
|
|
|
|
it("returns a valid EngineDetect shape (engine, detected_at, schema_version)", () => {
|
|
const result = detectEngineTier();
|
|
expect(["pglite", "supabase", "unknown"]).toContain(result.engine);
|
|
expect(result.schema_version).toBe(1);
|
|
expect(typeof result.detected_at).toBe("number");
|
|
expect(result.detected_at).toBeGreaterThan(0);
|
|
});
|
|
|
|
it("writes a cache file at ~/.gstack/.gbrain-engine-cache.json", () => {
|
|
detectEngineTier();
|
|
const cachePath = join(testHome, ".gbrain-engine-cache.json");
|
|
expect(existsSync(cachePath)).toBe(true);
|
|
const cached = JSON.parse(readFileSync(cachePath, "utf-8"));
|
|
expect(cached.schema_version).toBe(1);
|
|
expect(cached.last_writer).toBe("gstack-memory-helpers.detectEngineTier");
|
|
});
|
|
|
|
it("returns the cached value on second call within TTL", () => {
|
|
const first = detectEngineTier();
|
|
const second = detectEngineTier();
|
|
expect(second.detected_at).toBe(first.detected_at);
|
|
});
|
|
|
|
it("falls back to GBRAIN_HOME/config.json when gbrain doctor omits engine (schema_version:2 case)", () => {
|
|
// Regression test for #1415: gbrain >=0.25 doctor output dropped the
|
|
// top-level `engine` field. The detect path must fall back to config.json.
|
|
// We force the doctor call to fail (PATH stripped of gbrain) and write a
|
|
// synthetic config to GBRAIN_HOME so the fallback path is deterministic.
|
|
process.env.PATH = "/nonexistent-no-gbrain-here";
|
|
writeFileSync(
|
|
join(testGbrainHome, "config.json"),
|
|
JSON.stringify({ engine: "postgres", database_url: "postgresql://test/example" }),
|
|
"utf-8"
|
|
);
|
|
const result = detectEngineTier();
|
|
expect(result.engine).toBe("supabase");
|
|
});
|
|
});
|