Uses of Class
com.logicalclocks.hsfs.spark.StreamFeatureGroup

Packages that use StreamFeatureGroup

Package	Description
com.logicalclocks.hsfs.spark
com.logicalclocks.hsfs.spark.engine
com.logicalclocks.hsfs.spark.engine.hudi

Uses of StreamFeatureGroup in com.logicalclocks.hsfs.spark

Methods in com.logicalclocks.hsfs.spark that return StreamFeatureGroup

Modifier and Type	Method	Description
StreamFeatureGroup	FeatureStore.createStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKey, List<String> partitionKey, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, DataSource dataSource)
StreamFeatureGroup	FeatureStore.createStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKey, List<String> partitionKey, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path)
StreamFeatureGroup	FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, DataSource dataSource, OnlineConfig onlineConfig)
StreamFeatureGroup	FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig)	Get stream feature group metadata object or create a new one if it doesn't exist.
StreamFeatureGroup	FeatureStore.getOrCreateStreamFeatureGroup(String name, Integer version)	Get stream feature group metadata object or create a new one if it doesn't exist.
StreamFeatureGroup	FeatureStore.getOrCreateStreamFeatureGroup(String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, StatisticsConfig statisticsConfig, String eventTime, TimeTravelFormat timeTravelFormat)	Get stream feature group metadata object or create a new one if it doesn't exist.
StreamFeatureGroup	FeatureStore.getOrCreateStreamFeatureGroup(String name, Integer version, List<String> primaryKeys, boolean onlineEnabled, String eventTime)	Get stream feature group metadata object or create a new one if it doesn't exist.
StreamFeatureGroup	FeatureStore.getOrCreateStreamFeatureGroup(String name, Integer version, List<String> primaryKeys, List<String> partitionKeys, boolean onlineEnabled, String eventTime)	Get stream feature group metadata object or create a new one if it doesn't exist.
StreamFeatureGroup	FeatureStore.getStreamFeatureGroup(@NonNull String name, @NonNull Integer version)	Get a stream feature group object from the feature store.
StreamFeatureGroup	FeatureStore.getStreamFeatureGroup(String name)	Get a stream feature group object with default version `1` from the feature store.

Uses of StreamFeatureGroup in com.logicalclocks.hsfs.spark.engine

Methods in com.logicalclocks.hsfs.spark.engine that return StreamFeatureGroup

Modifier and Type	Method	Description
StreamFeatureGroup	FeatureGroupEngine.getOrCreateStreamFeatureGroup(FeatureStore featureStore, String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, StatisticsConfig statisticsConfig, String eventTime, TimeTravelFormat timeTravelFormat, List<Feature> features, DataSource dataSource, OnlineConfig onlineConfig)
StreamFeatureGroup	FeatureGroupEngine.getOrCreateStreamFeatureGroup(FeatureStore featureStore, String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, StatisticsConfig statisticsConfig, String eventTime, TimeTravelFormat timeTravelFormat, List<Feature> features, StorageConnector storageConnector, String path, OnlineConfig onlineConfig)
StreamFeatureGroup	FeatureGroupEngine.getStreamFeatureGroup(FeatureStore featureStore, String fgName, Integer fgVersion)
StreamFeatureGroup	FeatureGroupEngine.save(StreamFeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, List<String> partitionKeys, String hudiPrecombineKey, Map<String,String> writeOptions, JobConfiguration sparkJobConfiguration)	Create the metadata and write the data to the online/offline feature store.
StreamFeatureGroup	FeatureGroupEngine.saveFeatureGroupMetaData(StreamFeatureGroup featureGroup, List<String> partitionKeys, String hudiPrecombineKey, Map<String,String> writeOptions, JobConfiguration sparkJobConfiguration, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData)

Methods in com.logicalclocks.hsfs.spark.engine that return types with arguments of type StreamFeatureGroup

Modifier and Type	Method	Description
List<StreamFeatureGroup>	FeatureGroupEngine.getStreamFeatureGroups(FeatureStore featureStore, String fgName)

Methods in com.logicalclocks.hsfs.spark.engine with parameters of type StreamFeatureGroup

Modifier and Type	Method	Description
void	FeatureGroupEngine.insert(StreamFeatureGroup streamFeatureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, org.apache.spark.sql.SaveMode saveMode, List<String> partitionKeys, String hudiPrecombineKey, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
org.apache.spark.sql.streaming.StreamingQuery	FeatureGroupEngine.insertStream(StreamFeatureGroup streamFeatureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, List<String> partitionKeys, String hudiPrecombineKey, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
StreamFeatureGroup	FeatureGroupEngine.save(StreamFeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, List<String> partitionKeys, String hudiPrecombineKey, Map<String,String> writeOptions, JobConfiguration sparkJobConfiguration)	Create the metadata and write the data to the online/offline feature store.
StreamFeatureGroup	FeatureGroupEngine.saveFeatureGroupMetaData(StreamFeatureGroup featureGroup, List<String> partitionKeys, String hudiPrecombineKey, Map<String,String> writeOptions, JobConfiguration sparkJobConfiguration, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData)
void	SparkEngine.streamToHudiTable(StreamFeatureGroup streamFeatureGroup, Map<String,String> writeOptions)

Uses of StreamFeatureGroup in com.logicalclocks.hsfs.spark.engine.hudi

Methods in com.logicalclocks.hsfs.spark.engine.hudi with parameters of type StreamFeatureGroup

Modifier and Type	Method	Description
void	HudiEngine.streamToHoodieTable(org.apache.spark.sql.SparkSession sparkSession, StreamFeatureGroup streamFeatureGroup, Map<String,String> writeOptions)