Commit 58ba7db
[SPARK-53615][FOLLOWUP][PYTHON][TEST] Fix test case for arrow grouped agg UDF partial consumption
### What changes were proposed in this pull request?
Fix test case `test_iterator_grouped_agg_partial_consumption` to use count and sum instead of mean for testing partial consumption. Use the same value for all data points to avoid ordering issues.
### Why are the changes needed?
Fixes test flakiness by ensuring test data points have the same value and using count/sum metrics that properly validate partial consumption behavior, making the test robust against ordering variations.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Ran existing tests.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes apache#53372 from Yicong-Huang/SPARK-53615/fix/fix-test-partial-consumption-ordering.
Authored-by: Yicong-Huang <17627829+Yicong-Huang@users.noreply.github.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>1 parent 00c09db commit 58ba7db
File tree
1 file changed
+24
-11
lines changed- python/pyspark/sql/tests/arrow
1 file changed
+24
-11
lines changedLines changed: 24 additions & 11 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1153 | 1153 | | |
1154 | 1154 | | |
1155 | 1155 | | |
| 1156 | + | |
1156 | 1157 | | |
1157 | 1158 | | |
1158 | | - | |
| 1159 | + | |
1159 | 1160 | | |
1160 | 1161 | | |
1161 | | - | |
1162 | | - | |
| 1162 | + | |
| 1163 | + | |
1163 | 1164 | | |
1164 | 1165 | | |
1165 | 1166 | | |
| |||
1171 | 1172 | | |
1172 | 1173 | | |
1173 | 1174 | | |
1174 | | - | |
| 1175 | + | |
1175 | 1176 | | |
1176 | | - | |
| 1177 | + | |
| 1178 | + | |
| 1179 | + | |
1177 | 1180 | | |
1178 | 1181 | | |
1179 | 1182 | | |
1180 | 1183 | | |
1181 | | - | |
1182 | | - | |
| 1184 | + | |
| 1185 | + | |
1183 | 1186 | | |
1184 | | - | |
1185 | | - | |
| 1187 | + | |
| 1188 | + | |
1186 | 1189 | | |
1187 | 1190 | | |
1188 | 1191 | | |
1189 | 1192 | | |
1190 | 1193 | | |
1191 | 1194 | | |
| 1195 | + | |
| 1196 | + | |
| 1197 | + | |
| 1198 | + | |
| 1199 | + | |
1192 | 1200 | | |
1193 | | - | |
| 1201 | + | |
1194 | 1202 | | |
1195 | 1203 | | |
1196 | 1204 | | |
1197 | 1205 | | |
| 1206 | + | |
| 1207 | + | |
| 1208 | + | |
| 1209 | + | |
| 1210 | + | |
1198 | 1211 | | |
1199 | | - | |
| 1212 | + | |
1200 | 1213 | | |
1201 | 1214 | | |
1202 | 1215 | | |
| |||
0 commit comments