Search results

[SPARK-53080][CORE][CONNECT] Support <code>cleanDirectory</code> in <code>SparkFileUtils</code> and <code>JavaUtils</code>

BUILD

CONNECT

ML

SQL

Status: Open (in progress).

apache/sparknumber 51792

#51792 In apache/spark;

· dongjoon-hyun opened on Aug 2, 2025

[SPARK-53064][CORE] Rewrite MDC LogKey in Java

CONNECT

CORE

DSTREAM

GRAPHX

KUBERNETES

ML

MLLIB

PYTHON

R

SQL

STRUCTURED STREAMING

WEB UI

YARN

Status: Open (in progress).

apache/sparknumber 51775

#51775 In apache/spark;

· pan3793 opened on Aug 1, 2025

Wip naming sources

CONNECT

SQL

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51756

#51756 In apache/spark;

· ericm-db opened on Jul 31, 2025

[SPARK-53044] Change Declarative Pipelines import alias convention from "sdp" to "dp"

CONNECT

DOCS

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51752

#51752 In apache/spark;

· sryza opened on Jul 31, 2025

[SPARK-52451][CONNECT][SQL] Make WriteOperation in SparkConnectPlanner side effect free

CONNECT

SQL

Status: Open (in progress).

apache/sparknumber 51727

#51727 In apache/spark;

· heyihong opened on Jul 30, 2025

[SPARK-52980][PYTHON] Support Arrow Python UDTFs

BUILD

CONNECT

CORE

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51692

#51692 In apache/spark;

· allisonwang-db opened on Jul 28, 2025

[SPARK-52844][PYTHON][TESTS] Update black to 24.3.0

BUILD

CONNECT

CORE

DSTREAM

INFRA

ML

MLLIB

PANDAS API ON SPARK

PYTHON

SQL

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51687

#51687 In apache/spark;

· eschcam opened on Jul 28, 2025

[SPARK-52930][CONNECT] Use DataType.Array/Map for Array/Map Literals

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51653

#51653 In apache/spark;

· heyihong opened on Jul 24, 2025

[SPARK-52937][SDP] Sinks

CONNECT

SQL

Status: Draft (not ready).

apache/sparknumber 51644

#51644 In apache/spark;

· sryza opened on Jul 24, 2025

[WIP][SPARK-52764][PYTHON][ML][CONNECT][TESTS] Retry flaky tests in <code>test_parity_classification</code>

CONNECT

INFRA

ML

PYTHON

Status: Draft (not ready).

apache/sparknumber 51535

#51535 In apache/spark;

· zhengruifeng opened on Jul 17, 2025

Add client env proto to spark connect client requests

CONNECT

SQL

Status: Open (in progress).

apache/sparknumber 51529

#51529 In apache/spark;

· garlandz-db opened on Jul 17, 2025

[SPARK-52813][CONNECT] Allow DAGs in Spark Connect

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51516

#51516 In apache/spark;

· hvanhovell opened on Jul 16, 2025