Skip to content

Stop segments pipeline refactor #743

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
May 16, 2023
Merged

Conversation

tiffanychu90
Copy link
Member

@tiffanychu90 tiffanychu90 commented May 4, 2023

segment speeds pipeline

  • Refactor stop segments pipeline
  • Identify shapes that are more special vs normal (repurpose the monotonic increasing condition as a flag to group shapes into these 2 cases....about 5/6 normal and 1/6 special case)
    • Normal cases go through normal cutting of segments with shapely.project
    • Special cases go through super_project
    • concatenate the 2 together
  • after the spatial join of vp to segments, normal cases can go directly into keeping the first/last observation
  • after the spatial join, special cases use dot product to determine which batch of vp runs in the same direction as the segment and need to be kept
  • refactor preprocessing step (A0)- output tabular instead of geospatial
  • Research Request - "super" project to deal with inlining / looping routes #705
  • Epic - Daskify RT segment speeds #592

segment_speed_utils

  • add array_utils and more to wrangle_shapes to support subsetting with arrays and moving between shapely's interpolate / project
  • wrangle_shapes holds the normalized dot product check, which can take any two array of points, find the direction, normalize it by unit vector, and take the dot product

@github-actions
Copy link

github-actions bot commented May 4, 2023

1 similar comment
@github-actions
Copy link

github-actions bot commented May 4, 2023

@tiffanychu90 tiffanychu90 force-pushed the stop-segments-pipeline-refactor branch from 6f0da8c to f92464b Compare May 5, 2023 15:01
@tiffanychu90 tiffanychu90 force-pushed the stop-segments-pipeline-refactor branch from f92464b to 8e7b02e Compare May 9, 2023 18:57
@github-actions
Copy link

@github-actions
Copy link

@github-actions
Copy link

2 similar comments
@github-actions
Copy link

@github-actions
Copy link

@tiffanychu90 tiffanychu90 merged commit dc32028 into main May 16, 2023
@tiffanychu90 tiffanychu90 deleted the stop-segments-pipeline-refactor branch May 16, 2023 15:46
@tiffanychu90 tiffanychu90 mentioned this pull request Jul 19, 2023
21 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant