Skip to content

Conversation

@rxin
Copy link
Contributor

@rxin rxin commented Jun 15, 2016

What changes were proposed in this pull request?

This patch renames various Parquet support classes from CatalystAbc to ParquetAbc. This new naming makes more sense for two reasons:

  1. These are not optimizer related (i.e. Catalyst) classes.
  2. We are in the Spark code base, and as a result it'd be more clear to call out these are Parquet support classes, rather than some Spark classes.

How was this patch tested?

Renamed test cases as well.

@rxin
Copy link
Contributor Author

rxin commented Jun 15, 2016

JIRA is down - I will create a ticket when it comes back up.

cc @liancheng

options: Map[String, String],
files: Seq[FileStatus]): Map[String, String] = {
def computeNumFeatures(): Int = {
val numFeatures = options.get("numFeatures").filter(_.toInt > 0).getOrElse {
Copy link
Contributor Author

@rxin rxin Jun 15, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cc @cloud-fan / @liancheng

I got rid of the nested function.

@rxin rxin changed the title Rename various Parquet support classes. [SQL] Rename various Parquet support classes. Jun 15, 2016
@cloud-fan
Copy link
Contributor

LGTM

@liancheng
Copy link
Contributor

LGTM pending Jenkins.

@SparkQA
Copy link

SparkQA commented Jun 16, 2016

Test build #60615 has finished for PR 13696 at commit 61a56c2.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@rxin rxin changed the title [SQL] Rename various Parquet support classes. [SPARK-15979][SQL] Rename various Parquet support classes. Jun 16, 2016
@rxin
Copy link
Contributor Author

rxin commented Jun 16, 2016

Merging in master/2.0.

@rxin
Copy link
Contributor Author

rxin commented Jun 16, 2016

I merged this into master but there is a conflict in 2.0. Going to submit a separate pr.

@asfgit asfgit closed this in 865e7cc Jun 16, 2016
@rxin
Copy link
Contributor Author

rxin commented Jun 16, 2016

See #13700 for branch-2.0.

asfgit pushed a commit that referenced this pull request Jul 6, 2016
## What changes were proposed in this pull request?

PR #13696 renamed various Parquet support classes but left `CatalystWriteSupport` behind. This PR is renames it as a follow-up.

## How was this patch tested?

N/A.

Author: Cheng Lian <lian@databricks.com>

Closes #14070 from liancheng/spark-15979-follow-up.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants