Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ability to measure custom spans/metrics #335

Open
olerass opened this issue Dec 4, 2024 · 0 comments
Open

Ability to measure custom spans/metrics #335

olerass opened this issue Dec 4, 2024 · 0 comments

Comments

@olerass
Copy link

olerass commented Dec 4, 2024

It would be useful if one could use the flashlight api during e2e tests (or some other way) to measure custom spans like TTID (time to initial display), TTFD (time to full display) of screens or tabs or just general operations that span multiple renders like a "how long does it take for dialog x to show up when I click button y". These would fit perfectly with flashlights repeated execution model to normalize the measures.

I"m not sure if Maestro allows timing such things (unfortunately), but maybe other e2e frameworks could (like Detox). An example user flow could be:

  • Open app
  • Goto tab A, wait for content to load
  • Goto tab B, wait for content to load

In this flow we could have 4 metrics, 2 for each tab:

  • "navigation time" or TTID: starting the span when the test touches the tab bar button for the respective tab, and ends when the test sees the first rendered frame/content on the respective tab content screen
  • TTFD: same start as TTID, but ends when the test sees some final content visible in the respective tab content

Would this be possible/fit into the scope of flashlight?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant