Uses of Enum Class
com.logicalclocks.hsfs.Storage
Packages that use Storage
Package
Description
-
Uses of Storage in com.logicalclocks.hsfs
Methods in com.logicalclocks.hsfs that return Storage -
Uses of Storage in com.logicalclocks.hsfs.constructor
Methods in com.logicalclocks.hsfs.constructor with parameters of type Storage -
Uses of Storage in com.logicalclocks.hsfs.engine
Methods in com.logicalclocks.hsfs.engine with parameters of type StorageModifier and TypeMethodDescriptionFeatureGroupUtils.getHeaders(FeatureGroupBase featureGroup, Long numEntries, Map<String, String> options, String operation, Storage storage) Kafka headers for the records of one write to the online topic. -
Uses of Storage in com.logicalclocks.hsfs.spark
Methods in com.logicalclocks.hsfs.spark with parameters of type StorageModifier and TypeMethodDescriptionvoidExternalFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage) voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage) Incrementally insert data to a feature group or overwrite all data contained in the feature group.voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, boolean overwrite) Incrementally insert data to a feature group or overwrite all data contained in the feature group.voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, boolean overwrite, HudiOperationType operation, Map<String, String> writeOptions) Incrementally insert data to a feature group or overwrite all data contained in the feature group.voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage) voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, boolean overwrite) voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, boolean overwrite, HudiOperationType operation, Map<String, String> writeOptions) voidFeatureGroup.removeRows(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage) Drops records present in the provided DataFrame from the offline table, and optionally from the online store of an online-enabled feature group.voidFeatureGroup.removeRows(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions, Storage storage) Drops records present in the provided DataFrame from the offline table, and optionally from the online store of an online-enabled feature group.voidStreamFeatureGroup.removeRows(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage) Drops records present in the provided DataFrame from the offline table, and optionally from the online store of an online-enabled feature group.voidStreamFeatureGroup.removeRows(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions, Storage storage) Drops records present in the provided DataFrame from the offline table, and optionally from the online store of an online-enabled feature group. -
Uses of Storage in com.logicalclocks.hsfs.spark.constructor
Methods in com.logicalclocks.hsfs.spark.constructor with parameters of type Storage -
Uses of Storage in com.logicalclocks.hsfs.spark.engine
Methods in com.logicalclocks.hsfs.spark.engine with parameters of type StorageModifier and TypeMethodDescriptionFeatureGroupEngine.commitDelete(FeatureGroupBase featureGroupBase, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> genericDataset, Map<String, String> writeOptions, Storage storage) Deletes the records ingenericDatasetfrom the storage named bystorage.voidFeatureGroupEngine.insert(FeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, HudiOperationType operation, org.apache.spark.sql.SaveMode saveMode, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions) voidFeatureGroupEngine.saveDataframe(FeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Storage storage, HudiOperationType operation, Map<String, String> offlineWriteOptions, Integer validationId) voidSparkEngine.writeOnlineDataframe(FeatureGroupBase featureGroupBase, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String, String> writeOptions, Storage storage) Writes feature group dataframe to kafka for online-fs ingestion.