Research Request - Speeds chart for 20th, mean, 80th percentile by shape

[tiffanychu90]

Complete the below when receiving a research request, and continue to add to this issue as you receive additional details and produce deliverables. Be sure to also add the appropriate project-level label to this issue (eg gtfs-rt, DLA).

Research Question

Single sentence description: The original idea was to look at the speeds for each operator-route-stop combination through charts. Over this proved to be unwieldy due to sheer amount of data. Instead, each row from speeds_stop_segments and avg_speeds_stop_segments was tagged if meters_elapsed and sec_elapsed both displayed zeroes.

Detailed description:

• After tagging out rows, looked through the previous processing stages to see what could have potentially created these zeroes.

Previous:
Single sentence description: Charts for various speed columns - 20th percentile speeds, mean speeds, 80th percentile speeds by segment.

Detailed description:

• Since we want to publish 3 speed columns, let's take a look at the distribution.
• Trip-level speeds by segment are available....show a stripplot of this.
• Average speeds by segment are what we want to publish. Overlay stripplot with the 3 numbers we'll publish - 20th, mean, 80th percentile, which is a summary of trip-level speeds.
• Use the charting functions to show the distribution of speeds for an individual operator - shape_array_key - stop_id - stop_sequence combination
• A stop is a stop_id-stop_sequence pair. x-axis ordered by stop sequence.
• shape_array_key: versioned key for feed_key-shape_id...use this
• include column of loop_or_inlining value in the chart

How will this research be used?

• Use this to figure out which shapes are still problematic for us, and give us an idea of which stops to focus on
• Before, making a map of 20th percentile speeds means we're always hitting the lower range. Do we see unexpected things if we now broaden our range?

Data sources

• Cal-ITP data sources: GCS folder: rt_segment_speeds
• March and April dates available
• speeds_stop_segments_{analysis_date} partitioned parquet: by trip-segment
• avg_speeds_stop_segments_{analysis_date}.parquet: by segment

Deliverables:

Notebook