Skip to content

chore: playwright#6562

Open
kyle-ssg wants to merge 256 commits intomainfrom
chore/playwright
Open

chore: playwright#6562
kyle-ssg wants to merge 256 commits intomainfrom
chore/playwright

Conversation

@kyle-ssg
Copy link
Member

@kyle-ssg kyle-ssg commented Jan 20, 2026

  • I have read the Contributing Guide.
  • I have added information to docs/ if required so people know about the feature.
  • I have filled in the "Changes" section below.
  • I have filled in the "How did you test this code" section below.

Changes

Playwright Test Improvements

Faster Tests

  • Inputs are really fast compared to TestCafe
  • Tests are passing in CI around 2m30s vs ~4m

Better Local Development

  • Tests are re-runable via ui (you'll have to run npm run test:teardown before clicking play again)
  • Tests come with videos and clickable traces (these get uploaded from GitHub on failures too)
  • Tests can be ran very quickly and can be repeated (E2E_REPEAT=x) and exit on first failed test (E2E_RETRIES=0)
image

main_large

Added Claude Commands

  • /e2e - Run all tests (OSS + Enterprise)
  • /e2e-oss - Run OSS tests, auto-fix failures, re-run until passing
  • /e2e-ee - Run Enterprise tests, auto-fix failures, re-run until passing
  • /e2e-create - Create a new test following existing patterns

Note: You can have the tests repeat to guarantee no flakiness

  • /e2e 5 → Runs all tests with E2E_REPEAT=5 (runs once, then 5 more times if passing)
  • /e2e-oss 5 → Same for OSS tests only
  • /e2e-ee 5 → Same for enterprise tests only
image

HTML Reports

  • Interactive dashboard with search/filter
  • Test timeline and duration metrics
  • Detailed error messages with stack traces

e.g. this is a downloaded report, we can access reports of failures as well as videos / interactive traces.

image image image image

CI/CD Features

GitHub Integration

  • Sticky PR comments with failure summaries
  • Direct links to ZIP artifacts containing:
  • HTML report
  • Videos of failures
  • Interactive traces
  • Screenshots
  • Automatic artifact cleanup
image image

How did you test this code?

  • No code changes, all e2e refactoring
  • Run local image and keep track of any failures
image

kyle-ssg and others added 30 commits August 26, 2025 17:50
# Conflicts:
#	frontend/web/components/pages/UserPage.tsx
…chore/componentise-feature-override-row

# Conflicts:
#	frontend/web/components/feature-override/FeatureOverrideRow.tsx
Copy link
Contributor

@Zaimwa9 Zaimwa9 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One comment that prevents the app to be run without E2E

Add comment-identifier parameter to playwright-report-summary to prevent
OSS and Private Cloud test result comments from overwriting each other.
Each test type now has its own identifier (playwright-oss, playwright-private-cloud).

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
@github-actions github-actions bot added chore and removed chore labels Feb 4, 2026
@github-actions github-actions bot added chore and removed chore labels Feb 4, 2026
@github-actions github-actions bot added chore and removed chore labels Feb 4, 2026
@kyle-ssg
Copy link
Member Author

kyle-ssg commented Feb 4, 2026

One comment that prevents the app to be run without E2E

Yep I'd spotted this earlier, all sorted. I've just adjusted the tests so that PR comment uniqueness is done correctly, since we have 2 archs it runs under. we should see 4 passed comments shortly assuming one doesnt get a 429 rate limit.

@kyle-ssg kyle-ssg requested a review from Zaimwa9 February 4, 2026 12:20
@github-actions
Copy link
Contributor

github-actions bot commented Feb 4, 2026

Playwright Test Results (oss - depot-ubuntu-latest-16)

passed  9 passed

Details

stats  9 tests across 7 suites
duration  40 seconds
commit  8a3d436
info  🔄 Run: #14745 (attempt 1)

@github-actions
Copy link
Contributor

github-actions bot commented Feb 4, 2026

Playwright Test Results (oss - depot-ubuntu-latest-arm-16)

passed  9 passed

Details

stats  9 tests across 7 suites
duration  55.7 seconds
commit  8a3d436
info  🔄 Run: #14745 (attempt 1)

@github-actions
Copy link
Contributor

github-actions bot commented Feb 4, 2026

Playwright Test Results (private-cloud - depot-ubuntu-latest-16)

passed  2 passed

Details

stats  2 tests across 2 suites
duration  48.5 seconds
commit  8a3d436
info  🔄 Run: #14745 (attempt 1)

@github-actions
Copy link
Contributor

github-actions bot commented Feb 4, 2026

Playwright Test Results (private-cloud - depot-ubuntu-latest-arm-16)

passed  2 passed

Details

stats  2 tests across 2 suites
duration  1 minute, 4 seconds
commit  8a3d436
info  🔄 Run: #14745 (attempt 1)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

chore front-end Issue related to the React Front End Dashboard

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants