Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable Support for Multiple Update Graph Processors #3506

Merged
merged 87 commits into from
Jun 3, 2023
Merged

Enable Support for Multiple Update Graph Processors #3506

merged 87 commits into from
Jun 3, 2023

Commits on Jun 2, 2023

  1. Enable Support for Multiple Update Graph Processors

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    d535d15 View commit details
    Browse the repository at this point in the history

  2. Ryan's feedback checkpoint

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    4039012 View commit details
    Browse the repository at this point in the history

  3. It starts ^_^

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    cad49e6 View commit details
    Browse the repository at this point in the history

  4. Test Compiles

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    1b0329e View commit details
    Browse the repository at this point in the history

  5. Compiling again after rebase

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    aa4cdf8 View commit details
    Browse the repository at this point in the history

  6. 1st patch manual review fixes

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    bd509ea View commit details
    Browse the repository at this point in the history

  7. temporarily commit the extra controlled update graph for compilation

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    9832eb0 View commit details
    Browse the repository at this point in the history

  8. Fix UG.start() inline mistakes

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    141a33c View commit details
    Browse the repository at this point in the history

  9. spotless

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    db5413c View commit details
    Browse the repository at this point in the history

  10. Cleanup Round

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    dbd5e91 View commit details
    Browse the repository at this point in the history

  11. spotless + replicate

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    4df0066 View commit details
    Browse the repository at this point in the history

  12. replication fix

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    5190aee View commit details
    Browse the repository at this point in the history

  13. remove extra imports

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    590dd3d View commit details
    Browse the repository at this point in the history

  14. compiles and starts again

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    2c4b919 View commit details
    Browse the repository at this point in the history

  15. dependency update graph validation + few bug fixes

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    b4b3e14 View commit details
    Browse the repository at this point in the history

  16. Fix two type errors in benchmark code

    @rcaudy @nbauernfeind
    rcaudy authored and nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    a031adb View commit details
    Browse the repository at this point in the history

  17. Couple of bug fixes

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    4365dbe View commit details
    Browse the repository at this point in the history

  18. Fix a handful of issues around UpdateGraph access

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    a794193 View commit details
    Browse the repository at this point in the history

  19. Some more fixes

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    41b3f2d View commit details
    Browse the repository at this point in the history

  20. Refactored UpdateGraph interface somewhat

    @rcaudy @nbauernfeind
    rcaudy authored and nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    f718f90 View commit details
    Browse the repository at this point in the history

  21. More personal review items

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    386851b View commit details
    Browse the repository at this point in the history

  22. Rebase + Rebuild

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    4424eee View commit details
    Browse the repository at this point in the history

  23. Move UpdateGraphProcessor to engine-table

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    c69019e View commit details
    Browse the repository at this point in the history

  24. Fix UpdateGraph installation for unit tests

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    5ed4804 View commit details
    Browse the repository at this point in the history

  25. Fix PartitionedTableTest cases that use transform. Update poisoned co… 

    …ntext error messages to be a little bit clearer.
    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    810ef79 View commit details
    Browse the repository at this point in the history

  26. Pedantic changes to TrackingWritableRowSetImpl.

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    29ac051 View commit details
    Browse the repository at this point in the history

  27. Gratuitous re-work of poisoned exec context issues.

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    31c717f View commit details
    Browse the repository at this point in the history

  28. Fix RangeJoin and UpdateBy parallelism w.r.t. ExecutionContext

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    fd0ef50 View commit details
    Browse the repository at this point in the history

  29. Fix TestCsvTools

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    26ef04a View commit details
    Browse the repository at this point in the history

  30. ColumnSources and friends to get their clocks from an instance member… 

    … recorded at construction, or a known table
    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    52ec4c7 View commit details
    Browse the repository at this point in the history

  31. Server starts once again; can stream time table to UI

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    691bf15 View commit details
    Browse the repository at this point in the history

  32. Move clock into CrossJoinShiftState

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    db3e9f9 View commit details
    Browse the repository at this point in the history

  33. Spotless fixes

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    80f8515 View commit details
    Browse the repository at this point in the history

  34. fix fuzzer, update graph lock, and column source test leaks

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    80b643c View commit details
    Browse the repository at this point in the history

  35. Fix DeltaAware leaks except ChunkAdapter

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    e3d57bc View commit details
    Browse the repository at this point in the history

  36. A few TestChunkColumnSource fixes

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    6c80fc9 View commit details
    Browse the repository at this point in the history

  37. Finish Nate's work to make Test*DeltaAwareColumnSource stop leaking c… 

    …hunks
    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    3ee6e9b View commit details
    Browse the repository at this point in the history

  38. Out damned spot

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    f676882 View commit details
    Browse the repository at this point in the history

  39. Fix UpdateGraphLock static check

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    6d4f84d View commit details
    Browse the repository at this point in the history

  40. remove todo

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    e146c5c View commit details
    Browse the repository at this point in the history

  41. Address documentation TODOs

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    47df3db View commit details
    Browse the repository at this point in the history

  42. Merge remote-tracking branch 'upstream/main' into multi_ugp

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    0dbd6dc View commit details
    Browse the repository at this point in the history

  43. Merge related fixes

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    94fccfc View commit details
    Browse the repository at this point in the history

  44. Merge remote-tracking branch 'origin/multi_ugp' into multi_ugp

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    42b02f9 View commit details
    Browse the repository at this point in the history

  45. Generators need not statically initialize their input classes

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    2b6ab9d View commit details
    Browse the repository at this point in the history

  46. Clean up model farm enum

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    c1056aa View commit details
    Browse the repository at this point in the history

  47. Revert inadvertent ReleaseTracker change

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    b538014 View commit details
    Browse the repository at this point in the history

  48. Small fixes, and rename UpdateGraphProcessor to PeriodicUpdateGraph

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    12b6d2f View commit details
    Browse the repository at this point in the history

  49. More small fixes

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    c5d007e View commit details
    Browse the repository at this point in the history

  50. Python fixes + refactoring for multi ugp

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    0829139 View commit details
    Browse the repository at this point in the history

  51. more python fixes

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    7d79ef6 View commit details
    Browse the repository at this point in the history

  52. More small fixes again

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    5b9bbc6 View commit details
    Browse the repository at this point in the history

  53. Merge remote-tracking branch 'nate/multi_ugp' into multi_ugp

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    c1618f8 View commit details
    Browse the repository at this point in the history

  54. fixup UGP to UG references

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    46149d9 View commit details
    Browse the repository at this point in the history

  55. More cleanup

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    86574f1 View commit details
    Browse the repository at this point in the history

  56. More fixes from code review

    @rcaudy
    rcaudy committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    a92f3cb View commit details
    Browse the repository at this point in the history

  57. quick py fixup

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    36103c9 View commit details
    Browse the repository at this point in the history

  58. spotless

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    4c9fc52 View commit details
    Browse the repository at this point in the history

  59. quick test compile fix

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    68e638a View commit details
    Browse the repository at this point in the history

  60. Merge remote-tracking branch 'upstream/main' into multi_ugp

    @nbauernfeind
    nbauernfeind committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    1ea1d2d View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2023

  1. Even more fixes from code review

    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    8243b1c View commit details
    Browse the repository at this point in the history

  2. More spotless

    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    15574ed View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'nate/multi_ugp' into multi_ugp

    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    1b9c91d View commit details
    Browse the repository at this point in the history

  4. fix test formula column

    @nbauernfeind
    nbauernfeind committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    c6e7aff View commit details
    Browse the repository at this point in the history

  5. Some unit test fixes

    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    5c1e022 View commit details
    Browse the repository at this point in the history

  6. fix RowSetShiftDataExpanderTest

    @nbauernfeind
    nbauernfeind committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    481c48a View commit details
    Browse the repository at this point in the history

  7. fix TestKeyedTableListener

    @nbauernfeind
    nbauernfeind committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    4caeff7 View commit details
    Browse the repository at this point in the history

  8. Fix known Java unit test failures

    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    76441b3 View commit details
    Browse the repository at this point in the history

  9. Merge remote-tracking branch 'nate/multi_ugp' into multi_ugp

    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    98e34df View commit details
    Browse the repository at this point in the history

  10. Fix more tests

    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    54372d5 View commit details
    Browse the repository at this point in the history

  11. fix TestKeyedArrayBackedMutableTable

    @nbauernfeind
    nbauernfeind committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    961d3f6 View commit details
    Browse the repository at this point in the history

  12. Fix more tests again

    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    72c7b3b View commit details
    Browse the repository at this point in the history

  13. Merge remote-tracking branch 'nate/multi_ugp' into multi_ugp

    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    73b6e19 View commit details
    Browse the repository at this point in the history

  14. Fix even more tests

    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    8d994c3 View commit details
    Browse the repository at this point in the history

  15. For now re-use the ControlledUpdateGraph

    @nbauernfeind
    nbauernfeind committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    010cc76 View commit details
    Browse the repository at this point in the history

  16. Fix FlightMessageRoundTripTests

    @nbauernfeind
    nbauernfeind committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    b3a46fd View commit details
    Browse the repository at this point in the history

  17. cleaner fix on api server test base

    @nbauernfeind
    nbauernfeind committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    eb6dc3b View commit details
    Browse the repository at this point in the history

  18. revert removal of livenessScope in ApiServerTestBase

    @nbauernfeind
    nbauernfeind committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    8adea9d View commit details
    Browse the repository at this point in the history

  19. Some python fixes, and experimental improvements to DeephavenApiServe… 

    …rTestBase and TestExecutionContext
    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    cb33689 View commit details
    Browse the repository at this point in the history

  20. This might enable simple static use cases

    @nbauernfeind
    nbauernfeind committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    d9a193a View commit details
    Browse the repository at this point in the history

  21. Fix the remaining Python issues, I think, and fix some JavaDoc format… 

    …ting
    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    e983c06 View commit details
    Browse the repository at this point in the history

  22. Merge remote-tracking branch 'nate/multi_ugp' into multi_ugp

    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    3766515 View commit details
    Browse the repository at this point in the history

  23. 1. Make DeephavenApiServerTestBase more resilient for subsequent test… 

    …s after failure

2. Add PeriodicUpdateGraph caching by name, and re-use when providing via Dagger
3. Add proper unit test for update graph conflicts
4. Fix bug in update graph provision for merge and partitioned table construction
    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    61ae914 View commit details
    Browse the repository at this point in the history

  24. Clean up python session initialization for tests, and fix bug in sess… 

    …ion initializationf or sphinx
    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    32e6854 View commit details
    Browse the repository at this point in the history

  25. Re-fix the Python tests

    @rcaudy
    rcaudy committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    0c79352 View commit details
    Browse the repository at this point in the history

  26. Must install UpdateGraph in Session ThreadFactory Threads

    @nbauernfeind
    nbauernfeind committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    f0ee72f View commit details
    Browse the repository at this point in the history

  27. Map#put returns old value not new value

    @nbauernfeind
    nbauernfeind committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    29d7e81 View commit details
    Browse the repository at this point in the history