Skip to content

Test command with Maestro runs ~6s faster when Maestro Studio is open#348

Description

@SeanBarker182

Describe the bug
When running a test command with Maestro, the test runs around 6 seconds faster if Maestro Studio is open with the test device connected.

To Reproduce

Command:

flashlight test --bundleId com.pizzaapp --testCommand "MAESTRO_APP_ID=com.pizzaapp npx @perf-profiler/maestro@latest test .maestro/flows/Login.yaml"

Test file:

https://github.com/infinitered/ignite/blob/master/boilerplate/.maestro/flows/Login.yaml

Steps to reproduce the behavior:

  1. npx ignite-cli@latest new PizzaApp --yes
  2. yarn android
  3. Open Maestro Studio and select the device that you'll be running the test in
  4. flashlight test --bundleId com.pizzaapp --testCommand "MAESTRO_APP_ID=com.pizzaapp npx @perf-profiler/maestro@latest test .maestro/flows/Login.yaml"
  5. Observe Average Test Runtime
  6. Close Maestro Studio
  7. flashlight test --bundleId com.pizzaapp --testCommand "MAESTRO_APP_ID=com.pizzaapp npx @perf-profiler/maestro@latest test .maestro/flows/Login.yaml"
  8. Observe that Average Test Runtime is ~6s longer

Screenshots
Image

Environment (please complete the following information):

  • OS: macOS 26.0.1
  • Flashlight Version: 0.18.0
  • Android SDK platform tools version: Android Debug Bridge version 1.0.41 Version 36.0.0-13206524 Running on Darwin 25.0.0 (arm64)
  • Test Framework: Maestro v2.0.3
  • Share the bundle identifier of your app: com.pizzaapp

Additional context
This might be more of a Maestro issue. I just wanted to share it here just in case others were having similar issues with test runtime inconsistencies.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Package:CLIBug or feature concerning cli tools (measure, test, report, tools, ...)Status:UnconfirmedA potential issue that we haven't yet confirmed as a bug from the library

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions