Uses of Class
com.logicalclocks.hsfs.StorageConnector

Packages that use StorageConnector

Package	Description
com.logicalclocks.hsfs
com.logicalclocks.hsfs.beam
com.logicalclocks.hsfs.beam.engine
com.logicalclocks.hsfs.engine
com.logicalclocks.hsfs.flink
com.logicalclocks.hsfs.flink.engine
com.logicalclocks.hsfs.spark
com.logicalclocks.hsfs.spark.engine
com.logicalclocks.hsfs.spark.util

Uses of StorageConnector in com.logicalclocks.hsfs

Subclasses of StorageConnector in com.logicalclocks.hsfs

Modifier and Type	Class	Description
static class	StorageConnector.AdlsConnector
static class	StorageConnector.BigqueryConnector
static class	StorageConnector.GcsConnector
static class	StorageConnector.GlueConnector
static class	StorageConnector.HopsFsConnector
static class	StorageConnector.JdbcConnector
static class	StorageConnector.KafkaConnector
static class	StorageConnector.MongoDbConnector
static class	StorageConnector.RedshiftConnector
static class	StorageConnector.S3Connector
static class	StorageConnector.SapHanaConnector
static class	StorageConnector.SnowflakeConnector
static class	StorageConnector.SqlConnector

Methods in com.logicalclocks.hsfs that return StorageConnector

Modifier and Type	Method	Description
StorageConnector	FeatureStoreBase.getStorageConnector(String name)	Get a previously created storage connector from the feature store.
StorageConnector	StorageConnector.refetch()

Methods in com.logicalclocks.hsfs with parameters of type StorageConnector

Modifier and Type	Method	Description
StreamFeatureGroup	FeatureStore.createStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path)
abstract FeatureGroupBase	FeatureStoreBase.createStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path)	Deprecated. Use FeatureStoreBase.createStreamFeatureGroup(String, Integer, String, Boolean, TimeTravelFormat, List, List, String, String, List, StatisticsConfig, DataSource) instead.
Integer	FeatureViewBase.createTrainingData(String startTime, String endTime, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, Long seed, StatisticsConfig statisticsConfig, Map<String,String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter)	Deprecated.
Integer	FeatureViewBase.createTrainTestSplit(Float testSize, String trainStart, String trainEnd, String testStart, String testEnd, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, Long seed, StatisticsConfig statisticsConfig, Map<String,String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter)	Deprecated.
Integer	FeatureViewBase.createTrainValidationTestSplit(Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, Long seed, StatisticsConfig statisticsConfig, Map<String,String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter)	Deprecated.
StreamFeatureGroup	FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig)
abstract FeatureGroupBase	FeatureStoreBase.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig)	Deprecated. Use FeatureStoreBase.getOrCreateStreamFeatureGroup(String, Integer, String, Boolean, TimeTravelFormat, List, List, String, String, List, StatisticsConfig, DataSource, OnlineConfig) instead.
void	DataSource.updateStorageConnector(StorageConnector storageConnector)

Constructors in com.logicalclocks.hsfs with parameters of type StorageConnector

Modifier	Constructor	Description
	StreamFeatureGroup(FeatureStoreBase featureStore, @NonNull String name, Integer version, String description, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, List<Feature> features, StatisticsConfig statisticsConfig, String onlineTopicName, String eventTime, StorageConnector storageConnector, String path, OnlineConfig onlineConfig)
	TrainingDatasetBase(Integer version, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, List<Split> splits, String trainSplit, Long seed, FeatureStoreBase featureStore, StatisticsConfig statisticsConfig, List<String> label, String eventStartTime, String eventEndTime, TrainingDatasetType trainingDatasetType, Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, Integer timeSplitSize, FilterLogic extraFilterLogic, Filter extraFilter, DataSource dataSource)

Uses of StorageConnector in com.logicalclocks.hsfs.beam

Methods in com.logicalclocks.hsfs.beam with parameters of type StorageConnector

Modifier and Type	Method	Description
StreamFeatureGroup	FeatureStore.createStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path)
StreamFeatureGroup	FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig)

Constructors in com.logicalclocks.hsfs.beam with parameters of type StorageConnector

Modifier	Constructor	Description
	StreamFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<Feature> features, StatisticsConfig statisticsConfig, String onlineTopicName, String eventTime, OnlineConfig onlineConfig, StorageConnector storageConnector, String path)

Uses of StorageConnector in com.logicalclocks.hsfs.beam.engine

Methods in com.logicalclocks.hsfs.beam.engine with parameters of type StorageConnector

Modifier and Type	Method	Description
StreamFeatureGroup	FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig)

Uses of StorageConnector in com.logicalclocks.hsfs.engine

Methods in com.logicalclocks.hsfs.engine with parameters of type StorageConnector

Modifier and Type	Method	Description
StreamFeatureGroup	FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig)

Uses of StorageConnector in com.logicalclocks.hsfs.flink

Methods in com.logicalclocks.hsfs.flink with parameters of type StorageConnector

Modifier and Type	Method	Description
StreamFeatureGroup	FeatureStore.createStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path)
StreamFeatureGroup	FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig)

Constructors in com.logicalclocks.hsfs.flink with parameters of type StorageConnector

Modifier	Constructor	Description
	StreamFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<Feature> features, StatisticsConfig statisticsConfig, String onlineTopicName, String topicName, String notificationTopicName, String eventTime, OnlineConfig onlineConfig, StorageConnector storageConnector, String path)

Uses of StorageConnector in com.logicalclocks.hsfs.flink.engine

Methods in com.logicalclocks.hsfs.flink.engine with parameters of type StorageConnector

Modifier and Type	Method	Description
StreamFeatureGroup	FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig)

Uses of StorageConnector in com.logicalclocks.hsfs.spark

Methods in com.logicalclocks.hsfs.spark that return StorageConnector

Modifier and Type	Method	Description
StorageConnector	FeatureStore.getStorageConnector(String name)	Get a previously created storage connector from the feature store.

Methods in com.logicalclocks.hsfs.spark with parameters of type StorageConnector

Modifier and Type	Method	Description
StreamFeatureGroup	FeatureStore.createStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKey, List<String> partitionKey, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path)
Integer	FeatureView.createTrainingData(String startTime, String endTime, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, Long seed, StatisticsConfig statisticsConfig, Map<String,String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter)	Deprecated.
Integer	FeatureView.createTrainTestSplit(Float testSize, String trainStart, String trainEnd, String testStart, String testEnd, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, Long seed, StatisticsConfig statisticsConfig, Map<String,String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter)	Deprecated.
Integer	FeatureView.createTrainValidationTestSplit(Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, Long seed, StatisticsConfig statisticsConfig, Map<String,String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter)	Deprecated.
StreamFeatureGroup	FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig)	Get stream feature group metadata object or create a new one if it doesn't exist.

Constructors in com.logicalclocks.hsfs.spark with parameters of type StorageConnector

Modifier	Constructor	Description
	ExternalFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String query, ExternalDataFormat dataFormat, String path, Map<String,String> options, @NonNull StorageConnector storageConnector, String description, List<String> primaryKeys, List<Feature> features, StatisticsConfig statisticsConfig, String eventTime, boolean onlineEnabled, String onlineTopicName, String topicName, String notificationTopicName, OnlineConfig onlineConfig)
	FeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<Feature> features, StatisticsConfig statisticsConfig, String onlineTopicName, String topicName, String notificationTopicName, String eventTime, OnlineConfig onlineConfig, StorageConnector storageConnector, String path)
	StreamFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<Feature> features, StatisticsConfig statisticsConfig, String onlineTopicName, String topicName, String notificationTopicName, String eventTime, OnlineConfig onlineConfig, StorageConnector storageConnector, String path)
	TrainingDataset(Integer version, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, List<Split> splits, String trainSplit, Long seed, FeatureStoreBase featureStore, StatisticsConfig statisticsConfig, List<String> label, String eventStartTime, String eventEndTime, TrainingDatasetType trainingDatasetType, Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, Integer timeSplitSize, FilterLogic extraFilterLogic, Filter extraFilter, DataSource dataSource)

Uses of StorageConnector in com.logicalclocks.hsfs.spark.engine

Methods in com.logicalclocks.hsfs.spark.engine with parameters of type StorageConnector

Modifier and Type	Method	Description
StreamFeatureGroup	FeatureGroupEngine.getOrCreateStreamFeatureGroup(FeatureStore featureStore, String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, StatisticsConfig statisticsConfig, String eventTime, TimeTravelFormat timeTravelFormat, List<Feature> features, StorageConnector storageConnector, String path, OnlineConfig onlineConfig)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	SparkEngine.read(StorageConnector storageConnector, String dataFormat, Map<String,String> readOptions, String location)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	SparkEngine.readStream(StorageConnector storageConnector, String dataFormat, String messageFormat, String schema, Map<String,String> options, boolean includeMetadata)
void	SparkEngine.setupConnectorHadoopConf(StorageConnector storageConnector)

Uses of StorageConnector in com.logicalclocks.hsfs.spark.util

Methods in com.logicalclocks.hsfs.spark.util with parameters of type StorageConnector

Modifier and Type	Method	Description
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	StorageConnectorUtils.read(StorageConnector connector, DataSource dataSource, String dataFormat, Map<String,String> options)	Reads a query or a path into a spark dataframe using the storage connector.