-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-17731][SQL][STREAMING][FOLLOWUP] Refactored StreamingQueryListener APIs for branch-2.0 #15535
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
LGTM |
|
Test build #67141 has started for PR 15535 at commit |
|
Test build #67140 has finished for PR 15535 at commit
|
|
Test build #67143 has finished for PR 15535 at commit
|
|
I cancelled previous jenkins tests, hence the failures. |
|
Test build #3361 has finished for PR 15535 at commit
|
|
Test build #67144 has finished for PR 15535 at commit
|
|
I am merging this. |
…ener APIs for branch-2.0 This is the branch-2.0 PR of #15530 to make the APIs consistent with the master. Since these APIs are experimental and not direct user facing (StreamingQueryListener is advanced Structured Streaming APIs), its okay to change them in branch-2.0. ## What changes were proposed in this pull request? As per rxin request, here are further API changes - Changed `Stream(Started/Progress/Terminated)` events to `Stream*Event` - Changed the fields in `StreamingQueryListener.on***` from `query*` to `event` ## How was this patch tested? Existing unit tests. Author: Tathagata Das <tathagata.das1565@gmail.com> Closes #15535 from tdas/SPARK-17731-1-branch-2.0.
|
@tdas could you close this PR? Thanks! |
This is the branch-2.0 PR of #15530 to make the APIs consistent with the master. Since these APIs are experimental and not direct user facing (StreamingQueryListener is advanced Structured Streaming APIs), its okay to change them in branch-2.0.
What changes were proposed in this pull request?
As per @rxin request, here are further API changes
Stream(Started/Progress/Terminated)events toStream*EventStreamingQueryListener.on***fromquery*toeventHow was this patch tested?
Existing unit tests.