Skip to content

Latest commit

 

History

History
35 lines (25 loc) · 804 Bytes

spark-mllib-Transformer.adoc

File metadata and controls

35 lines (25 loc) · 804 Bytes

Transformer

Transformer is the contract in Spark MLlib for transformers that transform one dataset into another.

Transformer is a PipelineStage and so…​FIXME

Transforming Dataset with Extra Parameters — transform Method

Caution
FIXME

Transformer Contract

package org.apache.spark.ml

abstract class Evaluator {
  // only required methods that have no implementation
  def transform(dataset: Dataset[_]): DataFrame
  def copy(extra: ParamMap): Transformer
}
Table 1. Transformer Contract
Method Description

copy

Used when…​

transform

Used when…​