We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 7f36cd2 commit 1eab753Copy full SHA for 1eab753
core/src/main/scala/org/apache/spark/rdd/RDD.scala
@@ -430,8 +430,6 @@ abstract class RDD[T: ClassTag](
430
*
431
* If you are decreasing the number of partitions in this RDD, consider using `coalesce`,
432
* which can avoid performing a shuffle.
433
- *
434
- * TODO Fix the Shuffle+Repartition data loss issue described in SPARK-23207.
435
*/
436
def repartition(numPartitions: Int)(implicit ord: Ordering[T] = null): RDD[T] = withScope {
437
coalesce(numPartitions, shuffle = true)
0 commit comments