Remove ListingTable and FileScanConfig Unbounded (#8540) #8573
Conversation
| @@ -2140,70 +2140,11 @@ mod tests { | |||
| Ok(()) | |||
| } | |||
|
|
|||
| #[tokio::test] | |||
| async fn test_with_lost_ordering_unbounded() -> Result<()> { | |||
There was a problem hiding this comment.
I couldn't see a reason to keep these as they effectively duplicate the above
There was a problem hiding this comment.
These tests makes sure that when sources are unbounded, we try to preserve existing ordering as much as possible. I will re-add corresponding tests that enforces this functionality. For this PR, I just ignore these tests.
| ]; | ||
| assert_optimized!(expected_input, expected_optimized, physical_plan); | ||
| assert_optimized!(expected_input, expected_optimized, physical_plan, true); |
There was a problem hiding this comment.
#8572 tracks making this the default behaviour
There was a problem hiding this comment.
I think test logic may depend on infinite sources. So, we can use an unbounded executor like StreamingTableExec to preserve the test logic.
There was a problem hiding this comment.
It needs either infinite sources or prefer_existing_sort, I switched it to the latter
| .await?; | ||
| let path = format!("{testdata}/csv/aggregate_test_100.csv"); | ||
|
|
||
| match infinite { |
Which issue does this PR close?
Closes #8540
Rationale for this change
What changes are included in this PR?
Are these changes tested?
Are there any user-facing changes?