Skip to content

Add screenshot capture to evaluation pipeline#646

Open
keugenek wants to merge 2 commits intoneondatabase:mainfrom
keugenek:evgenii/screenshot-capture
Open

Add screenshot capture to evaluation pipeline#646
keugenek wants to merge 2 commits intoneondatabase:mainfrom
keugenek:evgenii/screenshot-capture

Conversation

@keugenek
Copy link
Collaborator

@keugenek keugenek commented Feb 5, 2026

Summary

  • Add screenshot capture capability to evaluation pipeline
  • Works in both Dagger and non-Dagger modes
  • Captures UI screenshots for visual validation

Test plan

  • Run evaluation with Dagger to verify screenshot capture
  • Run evaluation without Dagger to verify screenshot capture

🤖 Generated with Claude Code

- Add capture_screenshot() function that runs Playwright in Dagger
- Starts app as service, takes screenshot, exports to host
- Call screenshot capture after runtime succeeds in evaluation
- Add capture_screenshot_local() using async Playwright API
- Reorder evaluation: capture screenshot right after runtime check
  (before tests which may kill the app)
- Add capture_screenshot() for Dagger pipeline
- Update start prompt to not kill app after health check
- Add playwright as dependency
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant