Skip to content

ci: drop E2E job from PR checks until the suite is CI-ready#199

Merged
DavidBabinec merged 1 commit into
mainfrom
claude/pr187-review-kut0c1
Jul 7, 2026
Merged

ci: drop E2E job from PR checks until the suite is CI-ready#199
DavidBabinec merged 1 commit into
mainfrom
claude/pr187-review-kut0c1

Conversation

@DavidBabinec

Copy link
Copy Markdown
Contributor

Summary

Removes the E2E job from the PR CI workflow (.github/workflows/ci.yml), leaving Build & Typecheck / Lint / Test as the fast, reliable PR gate.

Why

When the workflow was first exercised (on PRs #183, #182, #174), the E2E job failed on every run — but not because of those PRs. Two suite-level problems make it unfit to gate PRs today:

  • Too slow to finish. The Playwright suite runs fully serially (workers: 1, fullyParallel: false, 156 tests) and needs ~45–60 min. It only ever reached ~1/3 of the suite before tripping its own 20-min timeout, so it would be cancelled even if every test passed.
  • Pre-existing, timeout-fragile failures. The same specs (admin-navigation, ai, capabilities) failed identically across three unrelated PRs, which points at the suite/environment rather than the changes. The failures cluster on editor/canvas-dependent specs racing 20s timeouts against the un-optimized dev server (the "6.5× faster dev boot" work is not merged yet).

Rather than block every PR on a slow, pre-existing-red suite, drop it from CI for now. Build/Lint/Test give the reliable signal today.

Impact

  • PR CI = Build & Typecheck, Lint, Test only.
  • The E2E suite is unchanged and still runs locally via bun run test:e2e.
  • A comment in ci.yml records why E2E is absent and that it will return as its own sharded/parallelized workflow once stabilized.

Verification

  • ci.yml parses; jobs are now build, lint, test.
  • No product code touched — workflow config only.

🤖 Generated with Claude Code


Generated by Claude Code

The Playwright E2E suite runs fully serially (`workers: 1`, 156 tests) and takes
~45-60 min, and is timeout-fragile against the un-optimized dev server, so it
cannot reliably gate PRs today — it only tripped its own 20-min timeout on every
run. Remove the `e2e` job so PR CI is the fast, reliable Build/Lint/Test gate.

The suite is unchanged and still runs locally via `bun run test:e2e`; it will
return as its own sharded/parallelized workflow once stabilized.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BQimijBDYixvpHp2HRiSJu
@DavidBabinec DavidBabinec merged commit 72a0316 into main Jul 7, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants