Uses of Class
com.logicalclocks.hsfs.spark.TrainingDataset

Packages that use TrainingDataset

Package	Description
com.logicalclocks.hsfs.spark
com.logicalclocks.hsfs.spark.engine

Uses of TrainingDataset in com.logicalclocks.hsfs.spark

Methods in com.logicalclocks.hsfs.spark that return TrainingDataset

Modifier and Type	Method and Description
TrainingDataset	FeatureStore.getTrainingDataset(String name) Deprecated.
TrainingDataset	FeatureStore.getTrainingDataset(@NonNull String name, @NonNull Integer version) Deprecated.

Methods in com.logicalclocks.hsfs.spark that return types with arguments of type TrainingDataset

Modifier and Type	Method and Description
scala.collection.Seq<TrainingDataset>	FeatureStore.getTrainingDatasets(@NonNull String name) Deprecated.

Uses of TrainingDataset in com.logicalclocks.hsfs.spark.engine

Methods in com.logicalclocks.hsfs.spark.engine that return TrainingDataset

Modifier and Type	Method and Description
TrainingDataset	TrainingDatasetEngine.save(TrainingDataset trainingDataset, Query query, Map<String,String> userWriteOptions, List<String> labels) Make a REST call to Hopsworks to create the metadata and write the data on the File System.

Methods in com.logicalclocks.hsfs.spark.engine with parameters of type TrainingDataset

Modifier and Type	Method and Description
void	TrainingDatasetEngine.addTag(TrainingDataset trainingDataset, String name, Object value)
Statistics	StatisticsEngine.computeStatistics(FeatureView featureView, TrainingDataset trainingDataset, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame)
Statistics	FeatureViewEngine.computeStatistics(FeatureView featureView, TrainingDataset trainingDataset, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>[] datasets)
Statistics	StatisticsEngine.computeStatistics(TrainingDataset trainingDataset, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame)
TrainingDatasetBundle	FeatureViewEngine.createTrainingDataset(FeatureView featureView, TrainingDataset trainingDataset, Map<String,String> userWriteOptions)
void	TrainingDatasetEngine.delete(TrainingDataset trainingDataset)
void	TrainingDatasetEngine.deleteTag(TrainingDataset trainingDataset, String name)
Statistics	StatisticsEngine.get(TrainingDataset trainingDataset, String commitTime)
Statistics	StatisticsEngine.getLast(TrainingDataset trainingDataset)
String	TrainingDatasetEngine.getQuery(TrainingDataset trainingDataset, Storage storage, boolean withLabel, boolean isHiveQuery)
Statistics	StatisticsEngine.getSplitStatistics(TrainingDataset trainingDataset)
Statistics	StatisticsEngine.getSplitStatistics(TrainingDataset trainingDataset, Map<String,org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>> splitDatasets)
Object	TrainingDatasetEngine.getTag(TrainingDataset trainingDataset, String name)
Map<String,Object>	TrainingDatasetEngine.getTags(TrainingDataset trainingDataset)
TrainingDatasetBundle	FeatureViewEngine.getTrainingDataset(FeatureView featureView, TrainingDataset trainingDataset, List<String> requestedSplits, Map<String,String> userReadOptions)
TrainingDatasetBundle	FeatureViewEngine.getTrainingDataset(FeatureView featureView, TrainingDataset trainingDataset, Map<String,String> userReadOptions)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	TrainingDatasetEngine.read(TrainingDataset trainingDataset, String split, Map<String,String> providedOptions)
Statistics	StatisticsEngine.registerSplitStatistics(FeatureView featureView, TrainingDataset trainingDataset, Map<String,org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>> splitDatasets)
Statistics	StatisticsEngine.registerSplitStatistics(TrainingDataset trainingDataset)
TrainingDataset	TrainingDatasetEngine.save(TrainingDataset trainingDataset, Query query, Map<String,String> userWriteOptions, List<String> labels) Make a REST call to Hopsworks to create the metadata and write the data on the File System.
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>[]	SparkEngine.splitDataset(TrainingDataset trainingDataset, Query query, Map<String,String> readOptions)
void	TrainingDatasetEngine.updateStatisticsConfig(TrainingDataset trainingDataset)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>[]	SparkEngine.write(TrainingDataset trainingDataset, Query query, Map<String,String> queryReadOptions, Map<String,String> writeOptions, org.apache.spark.sql.SaveMode saveMode) Setup Spark to write the data on the File System.
void	FeatureViewEngine.writeTrainingDataset(FeatureView featureView, TrainingDataset trainingDataset, Map<String,String> userWriteOptions)