Spike: Data Loading Checklist for Engineers to document loading times under various conditions

[cottonchristopher]

Dependency

• Reopen when there is a need to analyze these results, or add more entries based on a new commit hash

Overview

We need a checklist for engineers to document loading times under various conditions so that we can improve load times, upload alerts about load times or create load time fillers to enhance user experience, minimize confusion.

Template

• copy the template below
• fill in each section

Action Items

• measure and document load times based on selection
• measure and document load times based on local machine vs github pages site
• Identify various conditions that can impact data loading performance (e.g., network latency, server load, data volume
• Document any changes made to the system or environment

### Load Time Criteria
- Platform: (local / hosted)
- Request Status: (Open / All / Closed)
- Commit Hash: (get latest commit hash)
- Operating System: (Windows / MacOs / Linux)
- Browser: (Chrome / Firefox / Safari)

### Results
- [ ] choose 3 months, 3 request types
- [ ] choose 3 months, 1 request type  
- [ ] choose 1 week, chose all requests
- [ ] choose 1 week with 2 request types

Consider splitting up work based on

• using local machine
• using https://hackforla.github.io/311-data

Resources/Instructions

• hosted site: https://hackforla.github.io/311-data

Archived Info

• offer suggestions to update/ improve loading time (Ryan says that by completing this checklist, we can arrive at the suggestions for improvement)
• provide recommendations for optimizing data loading performance based on test findings (same as above)
• Provide recommendations to optimize wait experience (same as above)

[ryanfchase]

Thanks @cottonchristopher -- now going to meet with @Skydodle and consider next steps for making this available for devs to pick up.

[ryanfchase]

• ETA: 6/23/24 @ 6pm PT
• available till evening

[ryanfchase]

Load Time Criteria

• Platform: Hosted
• Request Status: Open
• Commit Hash: cfb0808
• Operating System: Windows 11
• Browser: Chrome, Version 126.0.6478.115 (Official Build) (64-bit)

Results

• choose 3 months, 3 request types
  • Dataset registration & table creation (by year) time: 66 ms.
  • Data loading time: 1865 ms
  • Map loading time: 11402 ms
  • Pin load time: 39427 ms
• choose 3 months, 1 request type
  • Dataset registration & table creation (by year) time: 26 ms
  • Data loading time: 1673 ms
  • Map loading time: 18153 ms
  • Pin load time: 57703 ms
• choose 1 week, chose all requests
  • Dataset registration & table creation (by year) time: 8501 ms.
  • Data loading time: 177 ms
  • Map loading time: 722 ms
  • Pin load time: 10988 ms
• choose 1 week with 2 request types
  • Dataset registration & table creation (by year) time: 34 ms.
  • Pin load time: 2942 ms

[ryanfchase]

Load Time Criteria

• Platform: Hosted
• Request Status: Open (REPEAT)
• Commit Hash: cfb0808
• Operating System: Windows 11
• Browser: Chrome, Version 126.0.6478.115 (Official Build) (64-bit)

Results

• choose 3 months, 3 request types
  • Dataset registration & table creation (by year) time: 31 ms
  • Data loading time: 1855 ms
  • Map loading time: 15210 ms
  • Pin load time: 41179 ms
• choose 3 months, 1 request type
• choose 1 week, chose all requests
  • Dataset registration & table creation (by year) time: 15829 ms.
  • Data loading time: 459 ms
  • Map loading time: 2904 ms
  • Pin load time: 288308 ms
• choose 1 week with 2 request types

[ryanfchase]

Load Time Criteria

• Platform: Hosted
• Request Status: All
• Commit Hash: cfb0808
• Operating System: Windows 11
• Browser: Chrome, Version 126.0.6478.115 (Official Build) (64-bit)

Results

• choose 3 months, 3 request types
  • Dataset registration & table creation (by year) time: 32 ms.
  • Data loading time: 1576 ms
  • Map loading time: 12832 ms
  • Pin load time: 78614 ms
• choose 3 months, 1 request type
• choose 1 week, chose all requests
  • Dataset registration & table creation (by year) time: 14858 ms.
  • Data loading time: 381 ms
  • Map loading time: 3046 ms
  • Pin load time: 39322 ms
• choose 1 week with 2 request types

[ryanfchase]

Load Time Criteria

• Platform: Hosted
• Request Status: Closed
• Commit Hash: cfb0808
• Operating System: Windows 11
• Browser: Chrome, Version 126.0.6478.115 (Official Build) (64-bit)

Results

• choose 3 months, 3 request types
  • Dataset registration & table creation (by year) time: 25 ms.
  • Data loading time: 1461 ms
  • Map loading time: 9291 ms
  • Pin load time: 53692 ms
• choose 3 months, 1 request type
• choose 1 week, chose all requests
• Dataset registration & table creation (by year) time: 108 ms.
• choose 1 week with 2 request types

Notes

• since we load data by default, it is impossible to get a first-time load on Closed requests, since Closed is just a filter on the total number of requests

[ryanfchase]

Unassigning. Moving to Icebox for when we need this info / when we'd like to dig into this further

[ryanfchase]

• Add to agenda

Question for @efrenmarin45

• Wondering if this ticket will be useful for you since you are assessing performance for pins and state management

[efrenmarin45]

These load times are in correlation with issue #1865.
Notated conditions with the current build as a control and the modified version not using the pin Sagas as the variable.

Load Time Criteria
Platform	local
Request Status	Open
Commit Hash	475e994
Operating System	Windows
Browser	Firefox

Data Filters	Dataset Registration & Table Creation (by year) Time (in milliseconds)	Data Loading Time (in milliseconds)	Map Loading Time (in milliseconds)	Pin Loading Time (in milliseconds)
3 Months, 3 Request Types	With Saga: 28876 ms W/O Saga: 28945 ms	With Saga: 3999 ms W/O Saga: 3975 ms	With Saga: 8360 ms W/O Saga: 8604 ms	With Saga: 55154 ms W/O Saga: 54449 ms
3 Months, 1 Request Type	With Saga: 28485 ms W/O Saga: 28529 ms	With Saga: 4014 ms W/O Saga: 3975 ms	With Saga: 8610 ms W/O Saga: 8504 ms	With Saga: 55040 ms W/O Saga: 54971 ms
1 Week, All Requests Types	With Saga: 28242 ms W/O Saga: 28322 ms	With Saga: 308 ms W/O Saga: 309 ms	With Saga: 545 ms W/O Saga: 551 ms	With Saga: 29948 ms W/O Saga: 30070 ms
1 Week, 2 Request Types	With Saga: 28207 ms W/O Saga: 28777 ms	With Saga: 307 ms W/O Saga: 320 ms	With Saga: 556 ms W/O Saga: 548 ms	With Saga: 30251 ms W/O Saga: 30517 ms

[ryanfchase]

This ticket seems to have been made useful in the comment above, I will move this back to Icebox until we need to continue adding data points.