Skip to content

Conversation

@jkbradley
Copy link
Member

This backports #20964 to branch-2.3.

What changes were proposed in this pull request?

Adds structured streaming tests using testTransformer for these suites:

  • IDF
  • Imputer
  • Interaction
  • MaxAbsScaler
  • MinHashLSH
  • MinMaxScaler
  • NGram

How was this patch tested?

It is a bunch of tests!

Author: Joseph K. Bradley joseph@databricks.com

## What changes were proposed in this pull request?

Adds structured streaming tests using testTransformer for these suites:
* IDF
* Imputer
* Interaction
* MaxAbsScaler
* MinHashLSH
* MinMaxScaler
* NGram

## How was this patch tested?

It is a bunch of tests!

Author: Joseph K. Bradley <joseph@databricks.com>

Closes apache#20964 from jkbradley/SPARK-22883-part2.
@jkbradley jkbradley changed the title [SPARK-22883] ML test for StructuredStreaming: spark.ml.feature, I-M [SPARK-22883][ML] ML test for StructuredStreaming: spark.ml.feature, I-M Apr 11, 2018
@jkbradley
Copy link
Member Author

I haven't made any changes from the PR which was merged into master in #20964

@SparkQA
Copy link

SparkQA commented Apr 11, 2018

Test build #89210 has finished for PR 21042 at commit a420943.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
  • class IDFSuite extends MLTest with DefaultReadWriteTest
  • class ImputerSuite extends MLTest with DefaultReadWriteTest
  • class InteractionSuite extends MLTest with DefaultReadWriteTest
  • class MaxAbsScalerSuite extends MLTest with DefaultReadWriteTest
  • class MinHashLSHSuite extends MLTest with DefaultReadWriteTest
  • class MinMaxScalerSuite extends MLTest with DefaultReadWriteTest

@jkbradley
Copy link
Member Author

Since this had a LGTM for the original PR and has no changes and tests pass, I'll merge this with branch-2.3

asfgit pushed a commit that referenced this pull request Apr 11, 2018
This backports #20964 to branch-2.3.

## What changes were proposed in this pull request?

Adds structured streaming tests using testTransformer for these suites:
* IDF
* Imputer
* Interaction
* MaxAbsScaler
* MinHashLSH
* MinMaxScaler
* NGram

## How was this patch tested?

It is a bunch of tests!

Author: Joseph K. Bradley <josephdatabricks.com>

Author: Joseph K. Bradley <joseph@databricks.com>

Closes #21042 from jkbradley/SPARK-22883-part2-2.3backport.
@jkbradley jkbradley closed this Apr 11, 2018
@jkbradley jkbradley deleted the SPARK-22883-part2-2.3backport branch April 11, 2018 18:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants