NGramsFeaturizer

Instance Constructors

new NGramsFeaturizer(orders: Seq[Int])(implicit arg0: ClassTag[T])

orders
valid ngram orders, must be consecutive positive integers

Value Members

final def !=(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def !=(arg0: Any): Boolean

Definition Classes
Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def ==(arg0: Any): Boolean

Definition Classes
Any
final def andThen[C, L](est: LabelEstimator[Seq[Seq[T]], C, L], data: PipelineDataset[Seq[T]], labels: PipelineDataset[L]): Pipeline[Seq[T], C]

Chains a label estimator onto the end of this pipeline, producing a new pipeline.
Chains a label estimator onto the end of this pipeline, producing a new pipeline. If this pipeline has already been executed, it will not need to be fit again.
est
The estimator to chain onto the end of this pipeline
data
The training data to use (the estimator will be fit on the result of passing this data through the current pipeline)
labels
The labels to use when fitting the LabelEstimator. Must be zippable with the training data.

Definition Classes
Chainable
final def andThen[C, L](est: LabelEstimator[Seq[Seq[T]], C, L], data: RDD[Seq[T]], labels: PipelineDataset[L]): Pipeline[Seq[T], C]

Chains a label estimator onto the end of this pipeline, producing a new pipeline.
Chains a label estimator onto the end of this pipeline, producing a new pipeline. If this pipeline has already been executed, it will not need to be fit again.
est
The estimator to chain onto the end of this pipeline
data
The training data to use (the estimator will be fit on the result of passing this data through the current pipeline)
labels
The labels to use when fitting the LabelEstimator. Must be zippable with the training data.

Definition Classes
Chainable
final def andThen[C, L](est: LabelEstimator[Seq[Seq[T]], C, L], data: PipelineDataset[Seq[T]], labels: RDD[L]): Pipeline[Seq[T], C]

Chains a label estimator onto the end of this pipeline, producing a new pipeline.
Chains a label estimator onto the end of this pipeline, producing a new pipeline. If this pipeline has already been executed, it will not need to be fit again.
est
The estimator to chain onto the end of this pipeline
data
The training data to use (the estimator will be fit on the result of passing this data through the current pipeline)
labels
The labels to use when fitting the LabelEstimator. Must be zippable with the training data.

Definition Classes
Chainable
final def andThen[C, L](est: LabelEstimator[Seq[Seq[T]], C, L], data: RDD[Seq[T]], labels: RDD[L]): Pipeline[Seq[T], C]

Chains a label estimator onto the end of this pipeline, producing a new pipeline.
Chains a label estimator onto the end of this pipeline, producing a new pipeline. If this pipeline has already been executed, it will not need to be fit again.
est
The estimator to chain onto the end of this pipeline
data
The training data to use (the estimator will be fit on the result of passing this data through the current pipeline)
labels
The labels to use when fitting the LabelEstimator. Must be zippable with the training data.

Definition Classes
Chainable
final def andThen[C](est: Estimator[Seq[Seq[T]], C], data: PipelineDataset[Seq[T]]): Pipeline[Seq[T], C]

Chains an estimator onto the end of this pipeline, producing a new pipeline.
Chains an estimator onto the end of this pipeline, producing a new pipeline. If this pipeline has already been executed, it will not need to be fit again.
est
The estimator to chain onto the end of this pipeline
data
The training data to use (the estimator will be fit on the result of passing this data through the current pipeline)

Definition Classes
Chainable
final def andThen[C](est: Estimator[Seq[Seq[T]], C], data: RDD[Seq[T]]): Pipeline[Seq[T], C]

Chains an estimator onto the end of this pipeline, producing a new pipeline.
Chains an estimator onto the end of this pipeline, producing a new pipeline. If this pipeline has already been executed, it will not need to be fit again.
est
The estimator to chain onto the end of this pipeline
data
The training data to use (the estimator will be fit on the result of passing this data through the current pipeline)

Definition Classes
Chainable
final def andThen[C](next: Chainable[Seq[Seq[T]], C]): Pipeline[Seq[T], C]

Chains a pipeline onto the end of this one, producing a new pipeline.
Chains a pipeline onto the end of this one, producing a new pipeline. If either this pipeline or the following has already been executed, it will not need to be fit again.
next
the pipeline to chain

Definition Classes
Chainable
def apply(line: Seq[T]): Seq[Seq[T]]

The application of this Transformer to a single input item.
The application of this Transformer to a single input item. This method MUST be overridden by ML developers.
returns
The output value

Definition Classes
NGramsFeaturizer → Transformer
def apply(in: RDD[Seq[T]]): RDD[Seq[Seq[T]]]

The application of this Transformer to an RDD of input items.
The application of this Transformer to an RDD of input items. This method may optionally be overridden by ML developers.
in
The bulk RDD input to pass into this transformer
returns
The bulk RDD output for the given input

Definition Classes
NGramsFeaturizer → Transformer
final def asInstanceOf[T0]: T0

Definition Classes
Any
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def execute(deps: Seq[Expression]): Expression

Definition Classes
TransformerOperator → Operator
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
def label: String

Definition Classes
Operator
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
val orders: Seq[Int]

valid ngram orders, must be consecutive positive integers
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def toPipeline: Pipeline[Seq[T], Seq[Seq[T]]]

A method that converts this object into a Pipeline.
A method that converts this object into a Pipeline. Must be implemented by anything that extends Chainable.

Definition Classes
Transformer → Chainable
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

case class NGramsFeaturizer[T](orders: Seq[Int])(implicit evidence$1: ClassTag[T]) extends Transformer[Seq[T], Seq[Seq[T]]] with Product with Serializable

Instance Constructors

new NGramsFeaturizer(orders: Seq[Int])(implicit arg0: ClassTag[T])

Value Members

final def !=(arg0: AnyRef): Boolean

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: AnyRef): Boolean

final def ==(arg0: Any): Boolean

final def andThen[C, L](est: LabelEstimator[Seq[Seq[T]], C, L], data: PipelineDataset[Seq[T]], labels: PipelineDataset[L]): Pipeline[Seq[T], C]

final def andThen[C, L](est: LabelEstimator[Seq[Seq[T]], C, L], data: RDD[Seq[T]], labels: PipelineDataset[L]): Pipeline[Seq[T], C]

final def andThen[C, L](est: LabelEstimator[Seq[Seq[T]], C, L], data: PipelineDataset[Seq[T]], labels: RDD[L]): Pipeline[Seq[T], C]

final def andThen[C, L](est: LabelEstimator[Seq[Seq[T]], C, L], data: RDD[Seq[T]], labels: RDD[L]): Pipeline[Seq[T], C]

final def andThen[C](est: Estimator[Seq[Seq[T]], C], data: PipelineDataset[Seq[T]]): Pipeline[Seq[T], C]

final def andThen[C](est: Estimator[Seq[Seq[T]], C], data: RDD[Seq[T]]): Pipeline[Seq[T], C]

final def andThen[C](next: Chainable[Seq[Seq[T]], C]): Pipeline[Seq[T], C]

def apply(line: Seq[T]): Seq[Seq[T]]

def apply(in: RDD[Seq[T]]): RDD[Seq[Seq[T]]]

final def asInstanceOf[T0]: T0

def clone(): AnyRef

final def eq(arg0: AnyRef): Boolean

def execute(deps: Seq[Expression]): Expression

def finalize(): Unit

final def getClass(): Class[_]

final def isInstanceOf[T0]: Boolean

def label: String

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

val orders: Seq[Int]

final def synchronized[T0](arg0: ⇒ T0): T0

def toPipeline: Pipeline[Seq[T], Seq[Seq[T]]]

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from Product

Inherited from Equals

Inherited from Transformer[Seq[T], Seq[Seq[T]]]

Inherited from Chainable[Seq[T], Seq[Seq[T]]]

Inherited from TransformerOperator

Inherited from Serializable

Inherited from Serializable

Inherited from Operator

Inherited from AnyRef

Inherited from Any

Ungrouped