Skip to content

Conversation

@jiangzho
Copy link
Contributor

@jiangzho jiangzho commented May 3, 2024

What changes were proposed in this pull request?

This PR aims to promote KubernetesDriverConf to DeveloperApi

Why are the changes needed?

Since Apache Spark Kubernetes Operator requires this, we had better maintain it as a developer API officially from Apache Spark 4.0.0.

apache/spark-kubernetes-operator#10

Does this PR introduce any user-facing change?

No

How was this patch tested?

Pass the CIs

Was this patch authored or co-authored using generative AI tooling?

No

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please file a JIRA issue, @jiangzho .

@dongjoon-hyun
Copy link
Member

One more thing. If you have some time, please review the following PR on Apache Spark K8s Operator repository.

@jiangzho jiangzho changed the title Promote KubernetesDriverConf to DeveloperApi [SPARK-48121][K8S]Promote KubernetesDriverConf to DeveloperApi May 3, 2024
@dongjoon-hyun dongjoon-hyun changed the title [SPARK-48121][K8S]Promote KubernetesDriverConf to DeveloperApi [SPARK-48121][K8S] Promote KubernetesDriverConf to DeveloperApi May 3, 2024
}

private[spark] class KubernetesDriverConf(

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please remove this redundant empty line addition.

*/
@Unstable
@DeveloperApi
@Since("4.0.0")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ya, I hope we can make it stable from 4.0.0.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM.

@dongjoon-hyun
Copy link
Member

Merged to master for Apache Spark 4.0.0-preview.
Thank you, @jiangzho .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants