Files
mokosh/tests/uat/harness.test.ts
Mark cc13f319a1 feat(03-01): Task 2 — assertA29 + driveA29 + orchestrator wiring (A29 30/30 GREEN)
Page-side (tests/uat/extension-page-harness.ts):
- assertA29 dispatches probe-page DOM mutation (input value + modal
  toggle), settles 500ms for rrweb IncrementalSnapshot to enqueue,
  setupFreshRecording, 11s segment-settle, SAVE_ARCHIVE; pushes
  A29.1 SAVE ack check. Module-local constants:
  A29_SAVE_ARCHIVE_TIMEOUT_MS=15s, A29_SEGMENT_SETTLE_MS=11s,
  A29_MUTATION_SETTLE_MS=500ms.
- declare global interface + window.__mokoshHarness object literal
  extended with assertA29 (single-method-per-assertion contract).
- statusEl + console banner updated A28 → A29 + cite Plan 03-01.

Host-side (tests/uat/lib/harness-page-driver.ts):
- Add `import { EventType } from '@rrweb/types';`.
- driveA29 — 3-phase orchestration mirroring driveA26:
  Phase 1 page.evaluate harness.assertA29(); Phase 2 findLatestZip;
  Phase 3 JSZip.loadAsync rrweb/session.json + EventType grep.
  Appends A29.0a (rrweb/session.json present) + A29.2..A29.5
  (events.length>0 + Meta + FullSnapshot + IncrementalSnapshot).

Orchestrator (tests/uat/harness.test.ts):
- driveA29 imported after driveA28.
- driveA29Wrapped const captures handles.downloadsDir.
- drivers array push A29 entry with banner citing Plan 03-01 + Pitfall 1.
- Architecture banner string updated A28 → A29.

Empirical verification (HEADLESS=1 SKIP_PROD_REBUILD=0 npm run test:uat):
- UAT harness: 30/30 GREEN (29 prior + A29 NEW).
- A29 events.length=4; event types observed: 2, 3, 4 (FullSnapshot,
  IncrementalSnapshot, Meta — all three required types present).
- Pitfall 1 mitigation empirically verified — the pre-SAVE DOM
  mutation produced the IncrementalSnapshot.
- vitest 171/171 GREEN preserved (full suite).
- Tier-1 FORBIDDEN_HOOK_STRINGS unit gate 13/13 GREEN (12 strings × 0
  hits each) — A29 rides production rrweb wiring + GET_RRWEB_EVENTS
  bridge + sendMessageWithTimeout helper; NO new __MOKOSH_UAT__
  symbols.
- npx tsc --noEmit exit 0.
2026-05-20 19:17:47 +02:00

514 lines
22 KiB
TypeScript

// tests/uat/harness.test.ts — Plan 01-13 orchestrator (Wave 3A → Task 9).
//
// Top-level entry for the production UAT harness. Drives all 15
// assertions sequentially against a SINGLE launched Chrome instance with
// a SINGLE harness page; bails on the first failure with a structured
// diagnostic dump. Exits 0 only when 15/15 GREEN.
//
// Wave 3A scope — wires A0+A1+A2+A3+A4+A6 (A6 via the proven Wave-2
// driver). A5+A7..A13 threw `NOT YET IMPLEMENTED — Wave 3<X> wires this`
// from `tests/uat/lib/harness-page-driver.ts`; the bail-on-first-failure
// loop stopped at the first such throw.
//
// Wave 3B wires A5 (SAVE_ARCHIVE → zip on disk) + A7 (genuine
// RECORDING_ERROR → ERR + recovery notification). Wave 3C wires A8
// (Bug A canonical onStartup-notification regression rewind) + A9 (icon
// file sizes meet imageUtil floors) + A10 (manifest shape contract).
// Wave 3D wires A11+A12+A13 for 14/14 GREEN.
//
// Plan 01-13 Task 9 closure (debug 01-09-save-stops-recording) adds A14:
// post-SAVE auto-stop state check (badge='', popup='', no new
// mokosh-recovery-*). Chains off A13's SAVE_ARCHIVE — read-only
// observation, no new dispatch.
//
// Plan 01-14 adds A23 as the final functional assertion (post-A14 chain):
// read-only inspection of the last `getDisplayMedia` constraints from
// A2's setupFreshRecording; verifies the production call site passes
// `monitorTypeSurfaces: 'include'` (W3C Screen Capture spec §6.1; Chrome
// ≥ 119 picker-narrowing semantics — removes the Window + Chrome-Tab
// panes from the operator's picker dialog). A23 has no side effects
// (the constraints cell is populated by A2 and read by the bridge op);
// hence independent of A14's no-side-effects post-SAVE contract.
// Final target: 16/16 GREEN.
//
// The orchestrator structure is final from Wave 3A onward; future waves
// only fill in the assertion-driver stubs.
//
// Architectural commitments (per 01-11-SUMMARY.md, DO NOT REGRESS):
// - Single browser, single recording per run (state machine: idle →
// A1 reads idle → A2 transitions to REC → A3+A4 read REC →
// A5 saves archive → A6 simulates user-stop → A7 surfaces ERR → ...).
// - A0 (Tier-1 grep gate) runs PRE-FLIGHT before any Chrome launch.
// Mirrors `tests/background/no-test-hooks-in-prod-bundle.test.ts`
// FORBIDDEN_HOOK_STRINGS inventory. Belt-and-suspenders: the unit
// test gate runs in `npm test` (~15s); the UAT-level A0 runs in
// `npm run test:uat` (~60-90s). Same invariant; two independent
// verification paths.
// - Drive Chrome FROM INSIDE: each assertion is a single
// `page.evaluate(() => window.__mokoshHarness.assertXX())` call;
// no SW.evaluate, no popup-bridge (both falsified per 01-11-SUMMARY).
//
// References:
// - puppeteer.launch + extension loading:
// https://pptr.dev/api/puppeteer.launchoptions
// - Node fs.readdirSync recursive walk:
// https://nodejs.org/api/fs.html#fsreaddirsyncpath-options
// - Node child_process.execFileSync:
// https://nodejs.org/api/child_process.html#child_processexecfilesyncfile-args-options
import { execFileSync } from 'node:child_process';
import { existsSync, readFileSync, readdirSync, statSync } from 'node:fs';
import { dirname, resolve as resolvePath } from 'node:path';
import { fileURLToPath } from 'node:url';
import { launchHarnessBrowser } from './lib/launch';
import {
driveA1,
driveA2,
driveA3,
driveA4,
driveA5,
driveA6,
driveA7,
driveA8,
driveA9,
driveA10,
driveA11,
driveA12,
driveA13,
driveA14,
// Plan 01-10 Wave 3 — onboarding + design-swap-readiness
driveA15,
driveA16,
driveA17,
// Plan 01-12 Wave 6 — design integration assertions
driveA18,
driveA19,
driveA20,
driveA21,
driveA22,
// Plan 01-14 — picker-narrowing constraint
driveA23,
// Plan 02-04 Task 1 — D-P2-01 empirical Blob URL verification
driveA24,
// Plan 02-04 Task 2 — REQ-archive-export-latency (5s ceiling)
driveA25,
// Plan 02-04 Task 3 — meta.json 8-field + multi-tab strict + REQ-archive-layout
driveA26,
driveA27,
driveA28,
// Plan 03-01 — rrweb DOM verification (SPEC §10 #4 / REQ-rrweb-dom-buffer)
driveA29,
getManifestVersion,
} from './lib/harness-page-driver';
import {
printAssertionResult,
runAssertion,
type AssertionRecord,
} from './lib/assertions';
/**
* A0 forbidden-string inventory — mirrors
* `tests/background/no-test-hooks-in-prod-bundle.test.ts:FORBIDDEN_HOOK_STRINGS`.
* Keep in sync. The two lists serving the same invariant is intentional
* (belt-and-suspenders per `feedback-pre-checkpoint-bundle-gates.md`):
* unit-test gate catches at `npm test`, UAT gate catches at `npm run test:uat`.
*/
const FORBIDDEN_HOOK_STRINGS: ReadonlyArray<string> = [
'__mokoshTest',
'setCurrentStream',
'setSegmentCountGetter',
'installFakeDisplayMedia',
'uninstallFakeDisplayMedia',
'dispatchEndedOnTrack',
'getSegmentCount',
'__mokoshOffscreenQuery',
'get-display-surface',
'get-segment-count',
// Plan 01-14 A23 surface — lockstep with unit-gate inventory at
// tests/background/no-test-hooks-in-prod-bundle.test.ts:105.
'lastGetDisplayMediaConstraints',
'get-last-getDisplayMedia-constraints',
];
/** Build timeout for the pre-flight production rebuild (matches unit-gate value). */
const PROD_BUILD_TIMEOUT_MS = 60_000;
/** Resolve repo-root paths from this file's location. */
const HARNESS_FILE_DIR = dirname(fileURLToPath(import.meta.url));
const REPO_ROOT = resolvePath(HARNESS_FILE_DIR, '..', '..');
const DIST_DIR = resolvePath(REPO_ROOT, 'dist');
/** Binary extensions skipped during the grep walk (mirror of unit gate). */
const BINARY_EXTENSIONS: ReadonlySet<string> = new Set([
'.png', '.jpg', '.jpeg', '.gif', '.ico', '.webp', '.woff', '.woff2', '.ttf', '.otf',
]);
/**
* Recursively collect every regular file under `root`. Returns absolute
* paths sorted alphabetically for stable diagnostics.
*
* @param root - Absolute directory path to walk.
* @returns Sorted list of absolute file paths under `root`.
*/
function listAllFilesRecursive(root: string): ReadonlyArray<string> {
const accumulator: string[] = [];
const stack: string[] = [root];
while (stack.length > 0) {
const dir = stack.pop()!;
const entries = readdirSync(dir, { withFileTypes: true });
for (const entry of entries) {
const fullPath = resolvePath(dir, entry.name);
if (entry.isSymbolicLink()) {
continue;
}
if (entry.isDirectory()) {
stack.push(fullPath);
} else if (entry.isFile()) {
accumulator.push(fullPath);
}
}
}
return accumulator.sort();
}
/**
* Count occurrences of `needle` in the given file. Returns 0 for binary
* file extensions (text matching against UTF-8 of a PNG would be
* meaningless and could yield spurious matches).
*
* @param filePath - Absolute file path to scan.
* @param needle - Literal substring to count.
* @returns Total occurrences in the file's text.
*/
function countOccurrencesInFile(filePath: string, needle: string): number {
const dotIdx = filePath.lastIndexOf('.');
const ext = dotIdx >= 0 ? filePath.substring(dotIdx).toLowerCase() : '';
if (BINARY_EXTENSIONS.has(ext)) {
return 0;
}
const stat = statSync(filePath);
if (stat.size === 0) {
return 0;
}
const text = readFileSync(filePath, 'utf8');
let count = 0;
let from = 0;
for (;;) {
const idx = text.indexOf(needle, from);
if (idx < 0) {
break;
}
count += 1;
from = idx + needle.length;
}
return count;
}
/**
* A0 — Tier-1 grep gate (UAT-level mirror of the unit-gate). Spawns
* `npm run build` if `SKIP_PROD_REBUILD !== '1'`, then walks `dist/`
* checking every forbidden string. Reports all matches in one pass
* (full enumeration, not bail-on-first) so the operator sees the entire
* leak surface in a single failure.
*
* @returns Structured A0 result: passed flag + list of (string, file) matches.
*/
async function assertA0_GrepGate(): Promise<{
passed: boolean;
matches: Array<{ needle: string; filePath: string; count: number }>;
}> {
if (process.env.SKIP_PROD_REBUILD !== '1') {
process.stdout.write('A0: running `npm run build` (set SKIP_PROD_REBUILD=1 to skip)...\n');
execFileSync('npm', ['run', 'build'], {
stdio: 'inherit',
timeout: PROD_BUILD_TIMEOUT_MS,
});
} else {
process.stdout.write('A0: SKIP_PROD_REBUILD=1 — using existing dist/\n');
}
if (!existsSync(DIST_DIR)) {
return {
passed: false,
matches: [
{
needle: '<missing dist/>',
filePath: DIST_DIR,
count: 0,
},
],
};
}
const files = listAllFilesRecursive(DIST_DIR);
const matches: Array<{ needle: string; filePath: string; count: number }> = [];
for (const needle of FORBIDDEN_HOOK_STRINGS) {
for (const filePath of files) {
const count = countOccurrencesInFile(filePath, needle);
if (count > 0) {
matches.push({ needle, filePath, count });
}
}
}
return { passed: matches.length === 0, matches };
}
/**
* Top-to-bottom orchestrator entry. Pre-flight A0 → launch browser →
* iterate driver list → bail on first failure → close browser → return
* exit code.
*
* Plan 01-13 Task 9 closure (debug 01-09-save-stops-recording) added A14
* after A13. The orchestrator now drives 14 page-side assertions
* (A1..A14) plus the host-side A0 grep gate = 15 total.
*
* @returns Process exit code: 0 on 15/15 GREEN, 1 on any failure.
*/
async function main(): Promise<number> {
process.stdout.write('\nMokosh Plan 01-13 + 01-14 + 02-04 — UAT harness orchestrator\n');
process.stdout.write('Architecture: A0 pre-flight + extension-internal page driver (A1..A14, A15..A17, A18..A22, A23, A24, A25, A26, A27, A28, A29)\n');
process.stdout.write('='.repeat(72) + '\n');
// A0 pre-flight (no Chrome launch needed; runs against built dist/).
const a0 = await assertA0_GrepGate();
if (!a0.passed) {
process.stderr.write('\nA0 FAIL: production bundle hook-string leak detected.\n');
for (const m of a0.matches) {
process.stderr.write(` - '${m.needle}' in ${m.filePath} (${m.count} occurrence${m.count === 1 ? '' : 's'})\n`);
}
process.stderr.write(
'\nThe Vite mode gate on the test-hook imports has regressed; verify\n' +
'src/background/index.ts + src/offscreen/recorder.ts still gate via `__MOKOSH_UAT__`.\n',
);
return 1;
}
process.stdout.write('A0: GREEN (production bundle hook-free)\n\n');
// Driver registry — execution order matters:
// A1 (idle) → A2 (REC start) → A3 (displaySurface) → A4 (popup pinned)
// → A5 (SAVE_ARCHIVE) → A6 (Bug B dispatch-ended) → A7 (genuine error)
// → A8 (Bug A onStartup) → A9 (icon sizes) → A10 (manifest)
// → A11 (35s segments) → A12 (ffprobe) → A13 (zip shape).
//
// A6 currently lives mid-list because the prototype's assertA6 does
// its own ensureOffscreen + START_RECORDING (idempotent w.r.t. A2's
// recording), then dispatch-ended. After A6 the recording is torn
// down — A7+ would need to re-start or test post-stop state.
//
// Wave 3C wires A8 + A9 + A10 in addition to A1..A7 — bail-on-first-
// failure stops at A11 (Wave 3D wires that). Expected diagnostic:
// "11/14 GREEN: A0+A1+A2+A3+A4+A5+A6+A7+A8+A9+A10; A11..A13 NOT YET IMPLEMENTED".
// The standalone `npx tsx tests/uat/a6.test.ts` entry remains the
// way to verify A6 in isolation for inner-loop iteration.
process.stdout.write('Launching Chrome + opening harness page...\n');
const handles = await launchHarnessBrowser();
process.stdout.write(`Extension id: ${handles.extensionId}\n`);
process.stdout.write(`Downloads dir: ${handles.downloadsDir}\n\n`);
// Adapter: driveA5 / driveA12 / driveA13 need `handles.downloadsDir`
// (host-side fs polling). driveA13 additionally needs the manifest
// version (read once at orchestrator startup via the page-side
// `getManifestVersion` helper). All other drivers take only `page`.
// The driver list is constructed AFTER `launchHarnessBrowser` returns
// so the closures can capture handles without a TDZ trap.
const expectedManifestVersion = await getManifestVersion(handles.harnessPage);
process.stdout.write(`Manifest version (for A13): ${expectedManifestVersion}\n\n`);
const driveA5Wrapped: (page: import('puppeteer').Page) => Promise<AssertionRecord> =
(page) => driveA5(page, handles.downloadsDir);
const driveA12Wrapped: (page: import('puppeteer').Page) => Promise<AssertionRecord> =
(page) => driveA12(page, handles.downloadsDir);
const driveA13Wrapped: (page: import('puppeteer').Page) => Promise<AssertionRecord> =
(page) => driveA13(page, handles.downloadsDir, expectedManifestVersion);
// Plan 02-04 Task 2 — driveA25 needs downloadsDir for the host-side
// dispatch→file-on-disk latency check (mirrors A5/A12/A13 wrapping).
const driveA25Wrapped: (page: import('puppeteer').Page) => Promise<AssertionRecord> =
(page) => driveA25(page, handles.downloadsDir);
// Plan 02-04 Task 3 — driveA26/A27/A28 need downloadsDir for host-side
// zip inspection (JSZip-parse meta.json + zip-layout enumeration). A26
// chains off A25's zip (no new SAVE); A27 owns its SAVE (multi-tab);
// A28 chains off A27's zip (no new SAVE).
const driveA26Wrapped: (page: import('puppeteer').Page) => Promise<AssertionRecord> =
(page) => driveA26(page, handles.downloadsDir);
const driveA27Wrapped: (page: import('puppeteer').Page) => Promise<AssertionRecord> =
(page) => driveA27(page, handles.downloadsDir);
const driveA28Wrapped: (page: import('puppeteer').Page) => Promise<AssertionRecord> =
(page) => driveA28(page, handles.downloadsDir);
// Plan 03-01 — driveA29 needs downloadsDir for host-side JSZip parse
// of rrweb/session.json from the just-produced zip.
const driveA29Wrapped: (page: import('puppeteer').Page) => Promise<AssertionRecord> =
(page) => driveA29(page, handles.downloadsDir);
const drivers: ReadonlyArray<{
readonly name: string;
readonly drive: (page: import('puppeteer').Page) => Promise<AssertionRecord>;
}> = [
{ name: 'A1', drive: driveA1 },
{ name: 'A2', drive: driveA2 },
{ name: 'A3', drive: driveA3 },
{ name: 'A4', drive: driveA4 },
{ name: 'A5', drive: driveA5Wrapped },
{ name: 'A6', drive: driveA6 },
{ name: 'A7', drive: driveA7 },
{ name: 'A8', drive: driveA8 },
{ name: 'A9', drive: driveA9 },
{ name: 'A10', drive: driveA10 },
{ name: 'A11', drive: driveA11 },
{ name: 'A12', drive: driveA12Wrapped },
{ name: 'A13', drive: driveA13Wrapped },
// Plan 01-13 Task 9 closure (debug 01-09-save-stops-recording): A14
// verifies that A13's SAVE_ARCHIVE auto-stopped the recording per
// SPEC one-shot intent. Read-only assertion on chrome.action +
// notification ids state; no new SAVE dispatch — A13's already
// exercised the SAVE path. Recording stays stopped after A14.
{ name: 'A14', drive: driveA14 },
// Plan 01-10 Wave 3 — onboarding + design-swap-readiness (read-only;
// chained AFTER A14 + before A18 so A15/A16/A17 inspect the
// welcome-page artifacts that A22's skip-gate test (Plan 01-12 Wave 6)
// previously fell through. With Plan 01-10 landed, A22 no longer
// skip-gates — it's a substantive token-usage check.
// A15 — chrome.storage.local 'onboarding-completed' + 'installed-at'
// A16 — 2s settle: no new welcome tabs spontaneously reappear
// A17 — welcome.html parse + .welcome-hero + ≥7 mokosh-keyed +
// welcome.css canonical @import or inlined tokens + zero hex
// (or canonical resolved) + ≥5 var(--mks-*) + bundled JS
// has COPY[ or chrome.i18n.getMessage(welcomeHero +
// getComputedStyle --mks-rec probe resolves
{ name: 'A15', drive: driveA15 },
{ name: 'A16', drive: driveA16 },
{ name: 'A17', drive: driveA17 },
// Plan 01-12 Wave 6 — design integration assertions (read-only;
// independent of A14). Chained here so they execute regardless of
// the recording state machine; they only inspect static brand /
// i18n / token / icon surfaces.
// A18 — Lora WOFF2 reachability + size floor
// A19 — icons NOT the Bug A placeholders
// A20 — manifest:name resolves via chrome i18n
// A21 — --mks-font-display resolves to Lora
// A22 — welcome page tokens.css adoption (CONDITIONAL on 01-10
// landing; with Plan 01-10 landed it executes the
// substantive token-usage path rather than skip-gating)
{ name: 'A18', drive: driveA18 },
{ name: 'A19', drive: driveA19 },
{ name: 'A20', drive: driveA20 },
{ name: 'A21', drive: driveA21 },
{ name: 'A22', drive: driveA22 },
// Plan 01-14 A23: read-only inspection of the last getDisplayMedia
// constraints object captured by A2's setupFreshRecording. Verifies
// the production call at src/offscreen/recorder.ts:270 passes
// `monitorTypeSurfaces: 'include'` (W3C Screen Capture spec §6.1;
// Chrome ≥ 119 picker-narrowing semantics). Independent of A14 —
// no new getDisplayMedia call, no new state change.
{ name: 'A23', drive: driveA23 },
// Plan 02-04 Task 1 A24: D-P2-01 empirical Blob URL verification.
// Installs chrome.downloads.onCreated listener cross-realm, dispatches
// SAVE_ARCHIVE, captures the download URL, asserts the `blob:` prefix
// (closes audit P0-6 end-to-end through a real Chrome instance +
// the offscreen mint round-trip + chrome.downloads platform call).
// A24 does its OWN setupFreshRecording + SAVE because the listener
// must be installed pre-dispatch. After A24 the recording stays alive
// for any chained Plan 02-04 Tasks 2-3 assertions (Phase 2 closure).
{ name: 'A24', drive: driveA24 },
// Plan 02-04 Task 2 A25: REQ-archive-export-latency / SPEC §10 #6.
// Page-side measures SAVE→ack via performance.now() bookends; host-side
// adds the dispatch→file-on-disk latency check via downloadsDir
// polling + mtime delta. Hard ceiling: 5000ms end-to-end. A25 owns
// its setupFreshRecording (clean latency measurement; not compounded
// with A24's still-pending state). The 11s segment-settle is NOT
// counted toward the 5s budget — only the SAVE dispatch.
{ name: 'A25', drive: driveA25Wrapped },
// Plan 02-04 Task 3 A26: D-P2-02 + D-P2-03 meta.json 8-field shape.
// Chains off A25's zip (no new SAVE); host-side JSZip-parse meta.json
// and asserts the 8-field shape with urls[] + schemaVersion='2'.
{ name: 'A26', drive: driveA26Wrapped },
// Plan 02-04 Task 3 A27: STRICT multi-tab urls[] post DEC-011 Amendment 1.
// Opens 2 tabs sequentially + activates each + 11s settle + SAVE; host-side
// asserts meta.urls contains BOTH example.com + iana.org (length>=2
// REQUIRED; FAILS on length<2; no extension-origin sentinels; no
// chrome-internal URLs). Owns its SAVE dispatch (multi-tab tracker
// state needs both onActivated events to fire BEFORE the SAVE).
{ name: 'A27', drive: driveA27Wrapped },
// Plan 02-04 Task 3 A28: REQ-archive-layout strict 5-entry zip-layout.
// Chains off A27's zip (no new SAVE); host-side enumerates zip entries
// and asserts EXACTLY 5 paths: video/last_30sec.webm, rrweb/session.json,
// logs/events.json, screenshot.png, meta.json (set-equality; no extras).
{ name: 'A28', drive: driveA28Wrapped },
// Plan 03-01 A29: rrweb DOM verification (SPEC §10 #4).
// A29 owns its SAVE because the probe-page DOM mutation must
// happen between page load and SAVE so rrweb's IncrementalSnapshot
// fires (RESEARCH Pitfall 1). Host-side driveA29 JSZip-parses
// rrweb/session.json and asserts the EventType enum surfaces
// (Meta=4, FullSnapshot=2, IncrementalSnapshot=3) are present.
{ name: 'A29', drive: driveA29Wrapped },
];
const buffers = { swConsole: handles.swConsole, offConsole: handles.offConsole };
const results: Array<{ name: string; passed: boolean; error?: string }> = [];
let bailReason: string | null = null;
try {
for (const { name, drive } of drivers) {
process.stdout.write(`--- ${name} ---\n`);
let driverErr: string | undefined;
let result: AssertionRecord | null = null;
try {
result = await runAssertion(
name,
() => drive(handles.harnessPage),
buffers,
);
printAssertionResult(result);
} catch (err) {
driverErr = err instanceof Error ? err.message : String(err);
// A throw here is either: (a) a Wave-3 stub firing
// (NOT YET IMPLEMENTED) — expected during incremental waves; OR
// (b) a CDP/Puppeteer-level error (e.g. page closed, timeout) —
// a genuine harness regression. Both bail uniformly.
process.stderr.write(`*** ${name} THREW: ${driverErr}\n`);
}
const passed = result !== null && result.passed && driverErr === undefined;
results.push({ name, passed, error: driverErr });
if (!passed) {
bailReason = driverErr ?? `${name} failed; see structured checks above`;
break;
}
}
} finally {
try {
await handles.browser.close();
} catch (closeErr) {
process.stderr.write(`(non-fatal: browser close threw: ${String(closeErr)})\n`);
}
}
const passedCount = results.filter((r) => r.passed).length;
// Total = 1 (A0) + drivers.length (A1..A14, A23) = 16. Plan 01-14
// appended A23 after A14 — the running count adapts via `drivers.length`
// so no manual update is needed when future plans extend the chain.
const total = drivers.length + 1;
const finalPassed = passedCount + 1; // +1 for A0 (we already passed it to reach here)
process.stdout.write('\n' + '='.repeat(72) + '\n');
process.stdout.write(
`UAT harness: ${finalPassed}/${total} assertions passed${bailReason !== null ? ` (bailed: ${bailReason})` : ''}\n`,
);
for (const r of results) {
const mark = r.passed ? '[PASS]' : '[FAIL]';
const tail = r.error !== undefined ? `${r.error}` : '';
process.stdout.write(` ${mark} ${r.name}${tail}\n`);
}
if (bailReason !== null) {
const remainingStart = results.length;
for (let i = remainingStart; i < drivers.length; i += 1) {
process.stdout.write(` [SKIP] ${drivers[i].name} (not reached — bailed at ${results[results.length - 1].name})\n`);
}
}
process.stdout.write('='.repeat(72) + '\n');
return finalPassed === total ? 0 : 1;
}
const code = await main();
process.exit(code);