Skip to content

Conversation

@amaliujia
Copy link
Contributor

What changes were proposed in this pull request?

Add .agg in Dataset in Scala client.

Why are the changes needed?

API coverage.

Does this PR introduce any user-facing change?

NO

How was this patch tested?

Existing UT

@amaliujia
Copy link
Contributor Author

@hvanhovell

@amaliujia amaliujia changed the title [SPARK-42468][CONNECT][FOLLOW-UP] Add agg in Dataset [SPARK-42468][CONNECT][FOLLOW-UP] Add .agg variants in Dataset Feb 22, 2023
Copy link
Contributor

@hvanhovell hvanhovell left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hvanhovell
Copy link
Contributor

@amaliujia what existing PR cover this?

@amaliujia
Copy link
Contributor Author

amaliujia commented Feb 22, 2023

@hvanhovell this one #40057. A few agg API that are built on top of that are not in Dataset.

@hvanhovell
Copy link
Contributor

@amaliujia those tests are not exercising the new code paths. Since the change is small I am fine with merging it though.

@hvanhovell
Copy link
Contributor

Merging this.

hvanhovell pushed a commit that referenced this pull request Feb 22, 2023
### What changes were proposed in this pull request?

Add `.agg` in Dataset in Scala client.

### Why are the changes needed?

API coverage.

### Does this PR introduce _any_ user-facing change?

NO
### How was this patch tested?

Existing UT

Closes #40125 from amaliujia/rw_add_agg_dataset.

Authored-by: Rui Wang <rui.wang@databricks.com>
Signed-off-by: Herman van Hovell <herman@databricks.com>
(cherry picked from commit 1232309)
Signed-off-by: Herman van Hovell <herman@databricks.com>
snmvaughan pushed a commit to snmvaughan/spark that referenced this pull request Jun 20, 2023
### What changes were proposed in this pull request?

Add `.agg` in Dataset in Scala client.

### Why are the changes needed?

API coverage.

### Does this PR introduce _any_ user-facing change?

NO
### How was this patch tested?

Existing UT

Closes apache#40125 from amaliujia/rw_add_agg_dataset.

Authored-by: Rui Wang <rui.wang@databricks.com>
Signed-off-by: Herman van Hovell <herman@databricks.com>
(cherry picked from commit 1232309)
Signed-off-by: Herman van Hovell <herman@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants