Uses of Class
com.logicalclocks.hsfs.spark.FeatureGroup
Packages that use FeatureGroup
-
Uses of FeatureGroup in com.logicalclocks.hsfs.spark
Methods in com.logicalclocks.hsfs.spark that return FeatureGroupModifier and TypeMethodDescriptionFeatureStore.getFeatureGroup(@NonNull String name, @NonNull Integer version) Get a feature group object from the feature store.FeatureStore.getFeatureGroup(String name) Get a feature group object with default version `1` from the feature store.FeatureStore.getOrCreateFeatureGroup(String name, Integer version) Get feature group metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateFeatureGroup(String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, TimeTravelFormat timeTravelFormat, StatisticsConfig statisticsConfig, String topicName, String notificationTopicName, String eventTime, OnlineConfig onlineConfig) Get feature group metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateFeatureGroup(String name, Integer version, List<String> primaryKeys, boolean onlineEnabled, String eventTime) Get feature group metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateFeatureGroup(String name, Integer version, List<String> primaryKeys, List<String> partitionKeys, boolean onlineEnabled, String eventTime) Get feature group metadata object or create a new one if it doesn't exist.Methods in com.logicalclocks.hsfs.spark that return types with arguments of type FeatureGroupModifier and TypeMethodDescriptionscala.collection.Seq<FeatureGroup>FeatureStore.getFeatureGroups(@NonNull String name) Get a list of all versions of a feature group from the feature store. -
Uses of FeatureGroup in com.logicalclocks.hsfs.spark.engine
Methods in com.logicalclocks.hsfs.spark.engine that return FeatureGroupModifier and TypeMethodDescriptionFeatureGroupEngine.getFeatureGroup(FeatureStore featureStore, String fgName, Integer fgVersion) FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore, String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, TimeTravelFormat timeTravelFormat, StatisticsConfig statisticsConfig, String topicName, String notificationTopicName, String eventTime, OnlineConfig onlineConfig) FeatureGroupEngine.save(FeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions) Create the metadata and write the data to the online/offline feature store.FeatureGroupEngine.saveFeatureGroupMetaData(FeatureGroup featureGroup, List<String> partitionKeys, String hudiPrecombineKey, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean saveEmpty) Methods in com.logicalclocks.hsfs.spark.engine that return types with arguments of type FeatureGroupModifier and TypeMethodDescriptionFeatureGroupEngine.getFeatureGroups(FeatureStore featureStore, String fgName) Methods in com.logicalclocks.hsfs.spark.engine with parameters of type FeatureGroupModifier and TypeMethodDescriptionvoidFeatureGroupEngine.insert(FeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, HudiOperationType operation, org.apache.spark.sql.SaveMode saveMode, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions) org.apache.spark.sql.streaming.StreamingQueryFeatureGroupEngine.insertStream(FeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions) Deprecated.FeatureGroupEngine.save(FeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions) Create the metadata and write the data to the online/offline feature store.voidFeatureGroupEngine.saveDataframe(FeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Storage storage, HudiOperationType operation, Map<String, String> offlineWriteOptions, Integer validationId) FeatureGroupEngine.saveFeatureGroupMetaData(FeatureGroup featureGroup, List<String> partitionKeys, String hudiPrecombineKey, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean saveEmpty)