[meta] I/O Burndown

[paulirish]

Feel free to comment or edit. Check items once PRs are up for review, rather than when merged.

---

🎯 ✅ Mandatory for I/O

Report and Config refactors

• ReportinDOM: Render the Lighthouse report without innerHTML [team]
  • Refactor from Handlebars -> DOM (Add basic rendering to report generator v2 #1933) #blocksDevTools [@dgozman]
  • No more markdown links [@ebidel]
  • Remove markdown from descriptions. [?]
  • Migrate formatters to DOM [@ebidel, others]
    • cards Report v2: port over cards formatter #1992
    • table [@paulirish]
    • critical request chain [@ebidel]
    • nodes incl revealing (a11y) [@paulirish]
    • user timings [?]
    • url list [@patrickhulce]
  • show passing tests UI [@paulirish]
  • performance UI for filmstrip & metrics (crbug.com/717082) [?]
  • perf diagnostics: sparklines of estimated cost (Quantifiable perf audit renderer w/ sparklines #2112) [@patrickhulce]
  • Report UI: view system (Category renderer basics for Perf category #2111, crbug.com/717079) punt
  • Report UI: gauge scores
  • Report UI: other misc report needs
• DevTools UI: Sidebar (crbug.com/717076) [@pavelfeldman]
• DevTools UI: modal for starting new audit. (crbug.com/717072) [@pavelfeldman]
• DevTools UI: share/context menu. print? --- may be punted
• Configv2: Aggregations -> Categories (refactor(aggregations): switch usage of aggregations to categories #1935) [@patrickhulce]
• Configv2: Subitems -> Tags (topics) [@patrickhulce]
• Configv2: category/audit whitelisting via settings (feat: support category and audit whitelisting #1988) [@patrickhulce]

Features & Improvements

• Audits: PWA section alignment (placeholders, HTTPS, and retitling) [@ebidel]
• Audits: Express PWA boolean (and choose relationship to score) [@brendankenny] - Introduces isPWA boolean #2032
• Audits: PWA collapsed 3 audits (Collapse the 9 manifest PWA audits into 3  #1847) [@paulirish]
• Audits: Move perf metrics (Move perf metrics into performance section #1876) [@patrickhulce]
• Audits: Add new start_url is available via SW for webapp-install-banner (Add start_url_works_offline to "User can be prompted to Add to Homescreen" #1903) [@wardpeet]
• Audits: Implement deep's TTI for comparison (Chrome Speed Metrics - align with latest TTI definition #1800) #blocksWPT [@patrickhulce]
• Better video capture for WPT #blocksWPT [@patrickhulce]
• LighthousePlots: Run result collection & analysis [@wwwillchen + @patrickhulce]
  • Process for local bulk runs, collection, and graphing (Measure and visualize perf metrics #1936) [@wwwillchen]
• Metrics: Quantify screenshot failures #blocksWPT [@patrickhulce]
• Metrics: Measure and improve metrics reliability #blocksDevTools #blockedByLHPlots [@wwwillchen]
  • Network throttling consistency & comparison to WPT/tsproxy shaping
  • Quantify Device differences -> CPU throttling calibration
  • (Stretch) Quantify metrics variance (in good conditions)
• CI story: Ship docs & recipes for webhook & issue status. [@ebidel]
• Recipes: Revised Custom Gather & Audit recipe [@brendankenny]

🌆 ☑️ Nice to have for I/O

• Land audit: Compression gzip/br (Added audit for request compression (gzip & br) #1513) [@paulirish]
• New audit: Reduce server response time [@wardpeet]
• New audit: Avoid document redirects [@wardpeet]
• New audit: Evaluate other TTI implementations [@patrickhulce]
• Dev ergonomics: Separate gather & audit into two phases (Split Gather phase from Audit phase #1806) [@brendankenny]
• Code health: Get Closure compilation for reportv2 and various typefixes [@brendankenny]
• Configv2: Migrate --perf to Configv2 [@patrickhulce]
• Reduce bug count to 150
• Get caseq working to make screenshots reliable
• Get pavel to implement mutationeventlisteners as Violations
• File bug asking about javascript dialogs to figure it out. headless/xvfv? [@brendankenny]
• Operation Yaquina Bay items
• Reduce LHR size

🏈 🏖 Punt till after I/O

• Additional audits e.g. CSS & JS Coverage
• Report: incremental/progress updates
• Dedicated LH-on-WPT landing page. Do after incremental.
• Config v2: strong support for extends
• Config v2: remaining config arch cleanup
• Report: other visual updates - tabs, nice expando sections
• Plots: export/submit flag to upload result/trace/artifacts to the cloud [@wwwillchen]
• Plots: Docs/scripts for pulling cloud results/traces down for local analysis

[paulirish]

closing in favor of #2161