Skip to content

Conversation

@HyukjinKwon
Copy link
Member

What changes were proposed in this pull request?

This PR proposes:

  1. Fix the code style in SparkConnectPlugin.scala and SparkBuild.scala to be consistent with others.
  2. Rename data_frame to dataframe to be consistent with existing PySpark codes.

This Pr is a sort of a followup of #37710

Why are the changes needed?

To follow existing codebase, and style.

Does this PR introduce any user-facing change?

No, the codes are not released yet. The only notable change would be renaming data_frame to dataframe to be consistent.

How was this patch tested?

Ci in this PR should validate the changes.

@HyukjinKwon
Copy link
Member Author

cc @dongjoon-hyun FYI

@amaliujia
Copy link
Contributor

Big +1!

LGTM

Copy link
Contributor

@LuciferYang LuciferYang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. (Pending CIs).

@dongjoon-hyun
Copy link
Member

YarnClusterSuite failure is irrelevant to this PR. Merged to master.

[info] *** 4 TESTS FAILED ***
[error] Failed tests:
[error] 	org.apache.spark.deploy.yarn.YarnClusterSuite

@zhengruifeng
Copy link
Contributor

Late LGTM

@HyukjinKwon HyukjinKwon deleted the minor-cleanup branch January 15, 2024 00:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants