Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

core(metrics): add lantern speed index #4695

Merged
merged 4 commits into from
Apr 16, 2018
Merged

core(metrics): add lantern speed index #4695

merged 4 commits into from
Apr 16, 2018

Conversation

patrickhulce
Copy link
Collaborator

@patrickhulce patrickhulce commented Mar 6, 2018

closes #4639
blocked from merging on #4966

predicts speed index by using the real speed index as the optimistic estimate and a layout-based speed index approximation from the pessimistic TTI graph as the pessimistic estimate

accuracy is decent. probably wouldn't recommend making it a headline metric as-is, but correlates slightly better than FCP (less than TTI/TTFCPUI)

spearman's rho ~.78, MAPE ~47%

@patrickhulce patrickhulce changed the title core(predictive-perf): add speedIndex estimate [WIP] core(predictive-perf): add speedIndex estimate Mar 15, 2018
@patrickhulce patrickhulce changed the title [WIP] core(predictive-perf): add speedIndex estimate core(metrics): add lantern speed index metric Apr 13, 2018
@patrickhulce patrickhulce changed the title core(metrics): add lantern speed index metric core(metrics): add lantern speed index Apr 13, 2018
@patrickhulce patrickhulce changed the base branch from master to lantern_ttfcpui April 13, 2018 21:05
@patrickhulce
Copy link
Collaborator Author

OK folks FYI I've updated this and it's ready for review!

@patrickhulce
Copy link
Collaborator Author

friendly reminder here that I/O-Expedite policy has this currently auto-merging at 2pm today folks ;)

* @param {number} fcpTimeInMs
* @return {number}
*/
static computeLayoutBasedSpeedIndex(nodeTiming, fcpTimeInMs) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add some documentation that explains the approach here?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 done

@patrickhulce patrickhulce changed the base branch from lantern_ttfcpui to master April 16, 2018 19:47
Copy link
Member

@brendankenny brendankenny left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM2

@patrickhulce patrickhulce merged commit e2fc6dd into master Apr 16, 2018
@patrickhulce patrickhulce deleted the lantern_psi branch April 16, 2018 23:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Investigate Lantern predicting Speed Index
4 participants