Package | Description |
---|---|
com.logicalclocks.hsfs.spark | |
com.logicalclocks.hsfs.spark.engine |
Modifier and Type | Method and Description |
---|---|
Query |
StreamFeatureGroup.asOf(String wallclockTime)
Get Query object to retrieve all features of the group at a point in the past.
|
Query |
FeatureGroup.asOf(String wallclockTime)
Get Query object to retrieve all features of the group at a point in the past.
|
Query |
StreamFeatureGroup.asOf(String wallclockTime,
String excludeUntil)
Get Query object to retrieve all features of the group at a point in the past.
|
Query |
FeatureGroup.asOf(String wallclockTime,
String excludeUntil)
Get Query object to retrieve all features of the group at a point in the past.
|
Query |
ExternalFeatureGroup.select(List<String> features) |
Query |
StreamFeatureGroup.select(List<String> features)
Select a subset of features of the feature group and return a query object.
|
Query |
FeatureGroup.select(List<String> features)
Select a subset of features of the feature group and return a query object.
|
Query |
ExternalFeatureGroup.selectAll() |
Query |
StreamFeatureGroup.selectAll()
Select all features of the feature group and return a query object.
|
Query |
FeatureGroup.selectAll()
Select all features of the feature group and return a query object.
|
Query |
ExternalFeatureGroup.selectExcept(List<String> features) |
Query |
StreamFeatureGroup.selectExcept(List<String> features)
Select all features including primary key and event time feature of the feature group except provided `features`
and return a query object.
|
Query |
FeatureGroup.selectExcept(List<String> features)
Select all features including primary key and event time feature of the feature group except provided `features`
and return a query object.
|
Query |
ExternalFeatureGroup.selectExceptFeatures(List<Feature> features) |
Query |
StreamFeatureGroup.selectExceptFeatures(List<Feature> features)
Select all features including primary key and event time feature of the feature group except provided `features`
and return a query object.
|
Query |
FeatureGroup.selectExceptFeatures(List<Feature> features)
Select all features including primary key and event time feature of the feature group except provided `features`
and return a query object.
|
Query |
ExternalFeatureGroup.selectFeatures(List<Feature> features) |
Query |
StreamFeatureGroup.selectFeatures(List<Feature> features)
Select a subset of features of the feature group and return a query object.
|
Query |
FeatureGroup.selectFeatures(List<Feature> features)
Select a subset of features of the feature group and return a query object.
|
Modifier and Type | Method and Description |
---|---|
FeatureView |
FeatureStore.getOrCreateFeatureView(String name,
Query query,
Integer version)
Get feature view metadata object or create a new one if it doesn't exist.
|
FeatureView |
FeatureStore.getOrCreateFeatureView(String name,
Query query,
Integer version,
String description,
List<String> labels)
Get feature view metadata object or create a new one if it doesn't exist.
|
FeatureView.FeatureViewBuilder |
FeatureView.FeatureViewBuilder.query(Query query)
Query of a feature view.
|
void |
TrainingDataset.save(Query query) |
void |
TrainingDataset.save(Query query,
Map<String,String> writeOptions)
Create the training dataset based on the content of the feature store query.
|
Constructor and Description |
---|
FeatureView(@NonNull String name,
Integer version,
@NonNull Query query,
String description,
@NonNull FeatureStore featureStore,
List<String> labels) |
Modifier and Type | Method and Description |
---|---|
Query |
FeatureViewEngine.getBatchQuery(FeatureView featureView,
Date startTime,
Date endTime,
Boolean withLabels,
Integer trainingDataVersion) |
Modifier and Type | Method and Description |
---|---|
FeatureView |
FeatureViewEngine.getOrCreateFeatureView(FeatureStore featureStore,
String name,
Integer version,
Query query,
String description,
List<String> labels) |
TrainingDataset |
TrainingDatasetEngine.save(TrainingDataset trainingDataset,
Query query,
Map<String,String> userWriteOptions,
List<String> labels)
Make a REST call to Hopsworks to create the metadata and write the data on the File System.
|
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>[] |
SparkEngine.splitDataset(TrainingDataset trainingDataset,
Query query,
Map<String,String> readOptions) |
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>[] |
SparkEngine.write(TrainingDataset trainingDataset,
Query query,
Map<String,String> queryReadOptions,
Map<String,String> writeOptions,
org.apache.spark.sql.SaveMode saveMode)
Setup Spark to write the data on the File System.
|
Copyright © 2025. All rights reserved.