Package org.apache.spark.ml.util

Class DatasetUtils

Object

org.apache.spark.ml.util.DatasetUtils

public class DatasetUtils
extends Object

Constructor Summary

Constructors

Constructor	Description
DatasetUtils()

Method Summary

Modifier and Type	Method	Description
static RDD<Vector>	columnToOldVector(Dataset<?> dataset, String colName)
static Column	columnToVector(Dataset<?> dataset, String colName)	Cast a column in a Dataset to Vector type.
static org.apache.spark.internal.Logging.LogStringContext	LogStringContext(scala.StringContext sc)
static org.slf4j.Logger	org$apache$spark$internal$Logging$$log_()
static void	org$apache$spark$internal$Logging$$log__$eq(org.slf4j.Logger x$1)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

DatasetUtils

public DatasetUtils()

Method Details

columnToVector

public static Column columnToVector(Dataset<?> dataset,
 String colName)

Cast a column in a Dataset to Vector type.

The supported data types of the input column are - Vector - float/double type Array.

Note: The returned column does not have Metadata.

Parameters:

dataset - input DataFrame

colName - column name.

Returns:

Vector column

columnToOldVector

public static RDD<Vector> columnToOldVector(Dataset<?> dataset,
 String colName)

org$apache$spark$internal$Logging$$log_

public static org.slf4j.Logger org$apache$spark$internal$Logging$$log_()

org$apache$spark$internal$Logging$$log__$eq

public static void org$apache$spark$internal$Logging$$log__$eq(org.slf4j.Logger x$1)

LogStringContext

public static org.apache.spark.internal.Logging.LogStringContext LogStringContext(scala.StringContext sc)