| Modifier and Type | Field and Description |
|---|---|
protected DataSource |
FeatureGroupBase.dataSource |
protected DataSource |
TrainingDatasetBase.dataSource |
| Modifier and Type | Method and Description |
|---|---|
DataSource |
FeatureStoreBase.getDataSource(String name)
Get a previously created data source from the feature store.
|
| Modifier and Type | Method and Description |
|---|---|
abstract FeatureGroupBase |
FeatureStoreBase.createStreamFeatureGroup(@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKeys,
List<String> partitionKeys,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource)
Create a stream feature group object.
|
StreamFeatureGroup |
FeatureStore.createStreamFeatureGroup(@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKeys,
List<String> partitionKeys,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource) |
Integer |
FeatureViewBase.createTrainingData(String startTime,
String endTime,
String description,
DataFormat dataFormat,
Boolean coalesce,
DataSource dataSource,
Long seed,
StatisticsConfig statisticsConfig,
Map<String,String> writeOptions,
FilterLogic extraFilterLogic,
Filter extraFilter)
Create the metadata for a training dataset and save the corresponding training data into `location`.
|
Integer |
FeatureViewBase.createTrainTestSplit(Float testSize,
String trainStart,
String trainEnd,
String testStart,
String testEnd,
String description,
DataFormat dataFormat,
Boolean coalesce,
DataSource dataSource,
Long seed,
StatisticsConfig statisticsConfig,
Map<String,String> writeOptions,
FilterLogic extraFilterLogic,
Filter extraFilter)
Create the metadata for a training dataset and save the corresponding training data into `location`.
|
Integer |
FeatureViewBase.createTrainValidationTestSplit(Float validationSize,
Float testSize,
String trainStart,
String trainEnd,
String validationStart,
String validationEnd,
String testStart,
String testEnd,
String description,
DataFormat dataFormat,
Boolean coalesce,
DataSource dataSource,
Long seed,
StatisticsConfig statisticsConfig,
Map<String,String> writeOptions,
FilterLogic extraFilterLogic,
Filter extraFilter)
Create the metadata for a training dataset and save the corresponding training data into `location`.
|
abstract FeatureGroupBase |
FeatureStoreBase.getOrCreateStreamFeatureGroup(@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKeys,
List<String> partitionKeys,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource,
OnlineConfig onlineConfig)
Get a stream feature group metadata object or create a new one if it doesn't exist.
|
StreamFeatureGroup |
FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKeys,
List<String> partitionKeys,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource,
OnlineConfig onlineConfig) |
TrainingDatasetType |
TrainingDatasetBase.getTrainingDatasetType(DataSource dataSource) |
void |
FeatureGroupBase.setDataSource(DataSource dataSource) |
abstract Map<String,String> |
StorageConnector.sparkOptions(DataSource dataSource) |
Map<String,String> |
StorageConnector.HopsFsConnector.sparkOptions(DataSource dataSource) |
Map<String,String> |
StorageConnector.S3Connector.sparkOptions(DataSource dataSource) |
Map<String,String> |
StorageConnector.RedshiftConnector.sparkOptions(DataSource dataSource) |
Map<String,String> |
StorageConnector.AdlsConnector.sparkOptions(DataSource dataSource) |
Map<String,String> |
StorageConnector.SnowflakeConnector.sparkOptions(DataSource dataSource) |
Map<String,String> |
StorageConnector.JdbcConnector.sparkOptions(DataSource dataSource) |
Map<String,String> |
StorageConnector.KafkaConnector.sparkOptions(DataSource dataSource) |
Map<String,String> |
StorageConnector.GcsConnector.sparkOptions(DataSource dataSource) |
Map<String,String> |
StorageConnector.BigqueryConnector.sparkOptions(DataSource dataSource)
Set spark options specific to BigQuery.
|
Map<String,String> |
StorageConnector.SqlConnector.sparkOptions(DataSource dataSource) |
| Constructor and Description |
|---|
TrainingDatasetBase(Integer version,
String description,
DataFormat dataFormat,
Boolean coalesce,
StorageConnector storageConnector,
String location,
List<Split> splits,
String trainSplit,
Long seed,
FeatureStoreBase featureStore,
StatisticsConfig statisticsConfig,
List<String> label,
String eventStartTime,
String eventEndTime,
TrainingDatasetType trainingDatasetType,
Float validationSize,
Float testSize,
String trainStart,
String trainEnd,
String validationStart,
String validationEnd,
String testStart,
String testEnd,
Integer timeSplitSize,
FilterLogic extraFilterLogic,
Filter extraFilter,
DataSource dataSource) |
| Modifier and Type | Method and Description |
|---|---|
StreamFeatureGroup |
FeatureStore.createStreamFeatureGroup(@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKeys,
List<String> partitionKeys,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource) |
StreamFeatureGroup |
FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKeys,
List<String> partitionKeys,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource,
OnlineConfig onlineConfig) |
| Modifier and Type | Method and Description |
|---|---|
StreamFeatureGroup |
FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore,
@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKeys,
List<String> partitionKeys,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource,
OnlineConfig onlineConfig) |
| Modifier and Type | Method and Description |
|---|---|
StreamFeatureGroup |
FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore,
@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKeys,
List<String> partitionKeys,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource,
OnlineConfig onlineConfig) |
| Modifier and Type | Method and Description |
|---|---|
StreamFeatureGroup |
FeatureStore.createStreamFeatureGroup(@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKeys,
List<String> partitionKeys,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource) |
StreamFeatureGroup |
FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKeys,
List<String> partitionKeys,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource,
OnlineConfig onlineConfig) |
| Modifier and Type | Method and Description |
|---|---|
StreamFeatureGroup |
FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore,
@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKeys,
List<String> partitionKeys,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource,
OnlineConfig onlineConfig) |
| Modifier and Type | Method and Description |
|---|---|
StreamFeatureGroup |
FeatureStore.createStreamFeatureGroup(@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKey,
List<String> partitionKey,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource) |
Integer |
FeatureView.createTrainingData(String startTime,
String endTime,
String description,
DataFormat dataFormat,
Boolean coalesce,
DataSource dataSource,
Long seed,
StatisticsConfig statisticsConfig,
Map<String,String> writeOptions,
FilterLogic extraFilterLogic,
Filter extraFilter)
Create the metadata for a training dataset and save the corresponding training data into `location`.
|
Integer |
FeatureView.createTrainTestSplit(Float testSize,
String trainStart,
String trainEnd,
String testStart,
String testEnd,
String description,
DataFormat dataFormat,
Boolean coalesce,
DataSource dataSource,
Long seed,
StatisticsConfig statisticsConfig,
Map<String,String> writeOptions,
FilterLogic extraFilterLogic,
Filter extraFilter)
Create the metadata for a training dataset and save the corresponding training data into `location`.
|
Integer |
FeatureView.createTrainValidationTestSplit(Float validationSize,
Float testSize,
String trainStart,
String trainEnd,
String validationStart,
String validationEnd,
String testStart,
String testEnd,
String description,
DataFormat dataFormat,
Boolean coalesce,
DataSource dataSource,
Long seed,
StatisticsConfig statisticsConfig,
Map<String,String> writeOptions,
FilterLogic extraFilterLogic,
Filter extraFilter)
Create the metadata for a training dataset and save the corresponding training data into `location`.
|
StreamFeatureGroup |
FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name,
Integer version,
String description,
Boolean onlineEnabled,
TimeTravelFormat timeTravelFormat,
List<String> primaryKeys,
List<String> partitionKeys,
String eventTime,
String hudiPrecombineKey,
List<Feature> features,
StatisticsConfig statisticsConfig,
DataSource dataSource,
OnlineConfig onlineConfig) |
| Constructor and Description |
|---|
TrainingDataset(Integer version,
String description,
DataFormat dataFormat,
Boolean coalesce,
StorageConnector storageConnector,
String location,
List<Split> splits,
String trainSplit,
Long seed,
FeatureStoreBase featureStore,
StatisticsConfig statisticsConfig,
List<String> label,
String eventStartTime,
String eventEndTime,
TrainingDatasetType trainingDatasetType,
Float validationSize,
Float testSize,
String trainStart,
String trainEnd,
String validationStart,
String validationEnd,
String testStart,
String testEnd,
Integer timeSplitSize,
FilterLogic extraFilterLogic,
Filter extraFilter,
DataSource dataSource) |
| Modifier and Type | Method and Description |
|---|---|
StreamFeatureGroup |
FeatureGroupEngine.getOrCreateStreamFeatureGroup(FeatureStore featureStore,
String name,
Integer version,
String description,
List<String> primaryKeys,
List<String> partitionKeys,
String hudiPrecombineKey,
boolean onlineEnabled,
StatisticsConfig statisticsConfig,
String eventTime,
TimeTravelFormat timeTravelFormat,
List<Feature> features,
DataSource dataSource,
OnlineConfig onlineConfig) |
| Modifier and Type | Method and Description |
|---|---|
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
StorageConnectorUtils.read(StorageConnector.AdlsConnector connector,
DataSource dataSource,
String dataFormat,
Map<String,String> options)
Reads path into a spark dataframe using the AdlsConnector.
|
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
StorageConnectorUtils.read(StorageConnector.BigqueryConnector connector,
DataSource dataSource,
Map<String,String> options)
Reads a query or a path into a spark dataframe using the sBigqueryConnector.
|
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
StorageConnectorUtils.read(StorageConnector.GcsConnector connector,
DataSource dataSource,
String dataFormat,
Map<String,String> options)
Reads a path into a spark dataframe using the GcsConnector.
|
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
StorageConnectorUtils.read(StorageConnector.HopsFsConnector connector,
DataSource dataSource,
String dataFormat,
Map<String,String> options)
Reads path into a spark dataframe using the HopsFsConnector.
|
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
StorageConnectorUtils.read(StorageConnector.JdbcConnector connector,
DataSource dataSource,
Map<String,String> options)
Reads query into a spark dataframe using the JdbcConnector.
|
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
StorageConnectorUtils.read(StorageConnector.RedshiftConnector connector,
DataSource dataSource,
Map<String,String> options)
Reads query into a spark dataframe using the RedshiftConnector.
|
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
StorageConnectorUtils.read(StorageConnector.S3Connector connector,
DataSource dataSource,
String dataFormat,
Map<String,String> options)
Reads path into a spark dataframe using the S3Connector.
|
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
StorageConnectorUtils.read(StorageConnector.SnowflakeConnector connector,
DataSource dataSource,
Map<String,String> options)
Reads query into a spark dataframe using the SnowflakeConnector.
|
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
StorageConnectorUtils.read(StorageConnector.SqlConnector connector,
DataSource dataSource,
Map<String,String> options)
Reads a query into a spark dataframe using the SqlConnector.
|
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
StorageConnectorUtils.read(StorageConnector connector,
DataSource dataSource,
String dataFormat,
Map<String,String> options)
Reads a query or a path into a spark dataframe using the storage connector.
|
Copyright © 2026. All rights reserved.