Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jan open data #626

Merged
merged 14 commits into from
Jan 28, 2023
Merged

Jan open data #626

merged 14 commits into from
Jan 28, 2023

Conversation

tiffanychu90
Copy link
Member

@tiffanychu90 tiffanychu90 commented Jan 28, 2023

Traffic Ops open data

Quarterly Performance Metrics

  • Start moving quarterly_performance_metrics workflow by moving create_parallel_corridors into v2.
  • Something is fishy here. Numbers are similar under v1, but very different with transition to v2.
    • Earlier v1 to v2 parity work showed that we dealt with intra-operator duplicates by dropping duplicate route_id or stop_id within the operator, but not across operators. We still kept too many duplicates if it's actually the same route or stop, but we stored it as different itp_ids.
    • If the above is true, then v1 should always have way more service hours than v2. But here, v2 has almost 2-3x more hours in aggregate than v1, and feeds are already narrowed down to keep only 1 feed per name.
    • Add script to download corresponding tables for dates we used in the past, but for v2 tables, and see how this stacks up.
    • Continue work in Research Request - Migrate quarterly performance metrics to v2 #625

Portfolio

  • Deal with too big file checked in for portfolio/segment_speeds, and break it up by district then.
  • Move the aggregation into a script rather than the notebook.
  • Follow-up to Fix portfolios #622

@github-actions
Copy link

@github-actions
Copy link

@github-actions
Copy link

3 similar comments
@github-actions
Copy link

@github-actions
Copy link

@github-actions
Copy link

@tiffanychu90 tiffanychu90 merged commit f18ce20 into main Jan 28, 2023
@tiffanychu90 tiffanychu90 deleted the jan-open-data branch January 28, 2023 00:39
@tiffanychu90 tiffanychu90 added the open-data Work related to publishing, ingesting open data label Jul 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
open-data Work related to publishing, ingesting open data
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant