Uses of Class
com.logicalclocks.hsfs.FeatureStoreException
Packages that use FeatureStoreException
Package
Description
-
Uses of FeatureStoreException in com.logicalclocks.hsfs
Methods in com.logicalclocks.hsfs that throw FeatureStoreExceptionModifier and TypeMethodDescriptionvoidAdd name/value tag to the feature group.voidAdd name/value tag to the feature view.voidAdd name/value tag to the training dataset.voidFeatureViewBase.addTrainingDatasetTag(Integer version, String name, Object value) Add name/value tag to the training dataset.FeatureView.FeatureViewBuilder.build()FeatureViewBase.createTrainingData(String startTime, String endTime, String description, DataFormat dataFormat) Create the metadata for a training dataset and save the corresponding training data into `location`.FeatureViewBase.createTrainingData(String startTime, String endTime, String description, DataFormat dataFormat, Boolean coalesce, DataSource dataSource, Long seed, StatisticsConfig statisticsConfig, Map<String, String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter) Create the metadata for a training dataset and save the corresponding training data into `location`.FeatureViewBase.createTrainingData(String startTime, String endTime, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, Long seed, StatisticsConfig statisticsConfig, Map<String, String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter) Deprecated.FeatureViewBase.createTrainTestSplit(Float testSize, String trainStart, String trainEnd, String testStart, String testEnd, String description, DataFormat dataFormat) Create the metadata for a training dataset and save the corresponding training data into `location`.FeatureViewBase.createTrainTestSplit(Float testSize, String trainStart, String trainEnd, String testStart, String testEnd, String description, DataFormat dataFormat, Boolean coalesce, DataSource dataSource, Long seed, StatisticsConfig statisticsConfig, Map<String, String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter) Create the metadata for a training dataset and save the corresponding training data into `location`.FeatureViewBase.createTrainTestSplit(Float testSize, String trainStart, String trainEnd, String testStart, String testEnd, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, Long seed, StatisticsConfig statisticsConfig, Map<String, String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter) Deprecated.FeatureViewBase.createTrainValidationTestSplit(Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, String description, DataFormat dataFormat) Create the metadata for a training dataset and save the corresponding training data into `location`.FeatureViewBase.createTrainValidationTestSplit(Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, String description, DataFormat dataFormat, Boolean coalesce, DataSource dataSource, Long seed, StatisticsConfig statisticsConfig, Map<String, String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter) Create the metadata for a training dataset and save the corresponding training data into `location`.FeatureViewBase.createTrainValidationTestSplit(Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, Long seed, StatisticsConfig statisticsConfig, Map<String, String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter) Deprecated.voidFeatureGroupBase.delete()voidFeatureViewBase.delete()Delete current feature view, all associated metadata and training data.voidDelete current feature view, all associated metadata and training data.voidTrainingDatasetBase.delete()Delete training dataset and all associated metadata.voidDelete a tag of the feature group.voidDelete a tag of the feature view.voidDelete a tag of the training dataset.voidFeatureViewBase.deleteTrainingDatasetTag(Integer version, String name) Delete a tag of the training dataset.FeatureStoreBase.getAdlsConnector(String name) Get a previously created Adls compliant storage connector from the feature store.FeatureGroupBase.getAvroSchema()FeatureStoreBase.getBigqueryConnector(String name) Get a previously created BigQuery compliant storage connector from the feature store.FeatureStoreBase.getDataSource(String name) Get a previously created data source from the feature store.org.apache.avro.SchemaFeatureGroupBase.getDeserializedAvroSchema()org.apache.avro.SchemaFeatureGroupBase.getDeserializedEncodedAvroSchema()FeatureGroupBase.getEncodedAvroSchema()FeatureGroupBase.getFeature(String name) Retrieve a feature of the feature group by name.FeatureGroupBase.getFeatureAvroSchema(String featureName) HopsworksConnection.getFeatureStore()Retrieve the project feature store.HopsworksConnection.getFeatureStore(String name) Retrieve a feature store based on name.abstract ObjectHopsworksConnectionBase.getFeatureStore()abstract ObjectHopsworksConnectionBase.getFeatureStore(String name) FeatureViewBase.getFeatureVector(Map<String, Object> entry) Returns assembled feature vector from online feature store.FeatureViewBase.getFeatureVector(Map<String, Object> entry, boolean external) Returns assembled feature vector from online feature store.<T> TFeatureViewBase.getFeatureVectorObject(Map<String, Object> entry, boolean external, Class<T> returnType) Returns assembled feature vector from online feature store (as Object).<T> TFeatureViewBase.getFeatureVectorObject(Map<String, Object> entry, Class<T> returnType) Returns assembled feature vector from online feature store (as Object).FeatureViewBase.getFeatureVectors(Map<String, List<Object>> entry) Returns assembled feature vectors in batches from online feature store.FeatureViewBase.getFeatureVectors(Map<String, List<Object>> entry, boolean external) Returns assembled feature vectors in batches from online feature store.FeatureStore.getFeatureView(@NonNull String name, @NonNull Integer version) Get a feature view object from the selected feature store.FeatureStore.getFeatureView(String name) Get a feature view object from the selected feature store.abstract ObjectFeatureStoreBase.getFeatureView(@NonNull String name, @NonNull Integer version) abstract ObjectFeatureStoreBase.getFeatureView(String name) FeatureStoreBase.getGcsConnector(String name) Get a previously created Gcs compliant storage connector from the feature store.FeatureStoreBase.getHopsFsConnector(String name) Get a previously created HopsFs compliant storage connector from the feature store.FeatureStoreBase.getJdbcConnector(String name) Get a previously created JDBC compliant storage connector from the feature store.FeatureStoreBase.getKafkaConnector(String name) Get a previously created Kafka compliant storage connector from the feature store.FeatureGroupBase.getLatestOnlineIngestion()FeatureGroupBase.getOnlineIngestion(Integer id) FeatureStoreBase.getOnlineStorageConnector()Get a previously created JDBC compliant storage connector from the feature store to connect to the online feature store.FeatureStore.getOrCreateFeatureView(String name, Query query, Integer version) Get feature view metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, DataSource dataSource, OnlineConfig onlineConfig) FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig) abstract FeatureGroupBaseFeatureStoreBase.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, DataSource dataSource, OnlineConfig onlineConfig) Get a stream feature group metadata object or create a new one if it doesn't exist.abstract FeatureGroupBaseFeatureStoreBase.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig) Deprecated.abstract StringFeatureViewBase.getPrimaryKeys()Set of primary key names that is used as keys in input dict object for `get_serving_vector` method.HopsworksConnectionBase.getProject()FeatureStoreBase.getRedshiftConnector(String name) Get a previously created Redshift compliant storage connector from the feature store.FeatureStoreBase.getS3Connector(String name) Get a previously created S3 compliant storage connector from the feature store.FeatureStoreBase.getSnowflakeConnector(String name) Get a previously created Snowflake compliant storage connector from the feature store.FeatureStore.getSqlConnector(String name) abstract ObjectFeatureStoreBase.getSqlConnector(String name) TrainingDatasetBase.getStatistics()Get the last statistics commit for the training dataset.TrainingDatasetBase.getStatistics(String commitTime) Get the statistics of a specific commit time for the training dataset.FeatureStoreBase.getStorageConnector(String name) Get a previously created storage connector from the feature store.FeatureStore.getStreamFeatureGroup(@NonNull String name, @NonNull Integer version) Get a stream feature group object from the feature store.FeatureStore.getStreamFeatureGroup(String name) Get a stream feature group object from the feature store.abstract ObjectFeatureStoreBase.getStreamFeatureGroup(@NonNull String name, @NonNull Integer version) Get a feature group object from the feature store.abstract ObjectFeatureStoreBase.getStreamFeatureGroup(String name) Get a feature group object with default version `1` from the feature store.FeatureGroupBase.getSubject()Get a single tag value of the feature group.Get a single tag value of the feature view.Get a single tag value of the training dataset.FeatureGroupBase.getTags()Get all tags of the feature group.FeatureViewBase.getTags()Get all tags of the feature view.TrainingDatasetBase.getTags()Get all tags of the training dataset.FeatureViewBase.getTrainingDatasetTag(Integer version, String name) Get a single tag value of the training dataset.FeatureViewBase.getTrainingDatasetTags(Integer version) Get all tags of the training dataset.voidFeatureViewBase.initServing()Initialise feature view to retrieve feature vector from online feature store.voidFeatureViewBase.initServing(Boolean batch) Initialise feature view to retrieve feature vector from online feature store.voidFeatureViewBase.initServing(Boolean batch, Boolean external) Initialise feature view to retrieve feature vector from online feature store.StorageConnector.KafkaConnector.kafkaOptions()StorageConnector.refetch()voidOnlineIngestion.refresh()voidStreamFeatureGroup.save()Save the feature group metadata on Hopsworks.voidStreamFeatureGroup.save(Map<String, String> writeOptions, JobConfiguration materializationJobConfiguration) Save the feature group metadata on Hopsworks.voidTrainingDatasetBase.setTimeSeriesSplits(Integer timeSplitSize, String trainStart, String trainEnd, String valStart, String valEnd, String testStart, String testEnd) StorageConnector.KafkaConnector.sparkOptions(DataSource dataSource) StorageConnector.MongoDbConnector.sparkOptions(DataSource dataSource) StorageConnector.SapHanaConnector.sparkOptions(DataSource dataSource) StorageConnector.sparkOptions()StorageConnector.sparkOptions(DataSource dataSource) StorageConnector.SqlConnector.sparkOptions(DataSource dataSource) voidStorageConnector.GlueConnector.update()voidStorageConnector.JdbcConnector.update()voidStorageConnector.MongoDbConnector.update()voidStorageConnector.RedshiftConnector.update()voidStorageConnector.S3Connector.update()voidStorageConnector.SapHanaConnector.update()voidStorageConnector.SqlConnector.update()voidFeatureGroupBase.updateDeprecated()Deprecate the feature group.voidFeatureGroupBase.updateDeprecated(Boolean deprecate) Deprecate the feature group.voidFeatureGroupBase.updateDescription(String description) Update the description of the feature group.voidFeatureGroupBase.updateFeatureDescription(String featureName, String description) Update the description of a single feature.voidFeatureGroupBase.updateNotificationTopicName(String notificationTopicName) Update the notification topic name of the feature group.voidFeatureGroupBase.updateStatisticsConfig()Update the statistics configuration of the feature group.protected voidFeatureViewBase.validateTrainTestSplit(Float testSize, String trainEnd, String testStart) protected voidFeatureViewBase.validateTrainValidationTestSplit(Float validationSize, Float testSize, String trainEnd, String validationStart, String validationEnd, String testStart) voidOnlineIngestion.waitForCompletion(int timeout, int period) Constructors in com.logicalclocks.hsfs that throw FeatureStoreExceptionModifierConstructorDescriptionFeature(String name, String type, String onlineType, Boolean primary, Boolean partition, String defaultValue, String description) HopsworksConnection(String host, int port, String project, software.amazon.awssdk.regions.Region region, SecretStore secretStore, boolean hostnameVerification, String trustStorePath, String certPath, String apiKeyFilePath, String apiKeyValue) TrainingDatasetBase(Integer version, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, List<Split> splits, String trainSplit, Long seed, FeatureStoreBase featureStore, StatisticsConfig statisticsConfig, List<String> label, String eventStartTime, String eventEndTime, TrainingDatasetType trainingDatasetType, Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, Integer timeSplitSize, FilterLogic extraFilterLogic, Filter extraFilter, DataSource dataSource) -
Uses of FeatureStoreException in com.logicalclocks.hsfs.beam
Methods in com.logicalclocks.hsfs.beam that throw FeatureStoreExceptionModifier and TypeMethodDescriptionFeatureView.FeatureViewBuilder.build()HopsworksConnection.getFeatureStore()Retrieve the project feature store.HopsworksConnection.getFeatureStore(String name) Retrieve a feature store based on name.FeatureStore.getFeatureView(@NonNull String name, @NonNull Integer version) Get a feature view object from the selected feature store.FeatureStore.getFeatureView(String name) Get a feature view object from the selected feature store.FeatureStore.getOrCreateFeatureView(String name, com.logicalclocks.hsfs.beam.constructor.Query query, Integer version) Get feature view metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, DataSource dataSource, OnlineConfig onlineConfig) FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig) FeatureStore.getSqlConnector(String name) FeatureStore.getStreamFeatureGroup(@NonNull String name, @NonNull Integer version) Get a stream feature group object from the feature store.FeatureStore.getStreamFeatureGroup(String name) Get a stream feature group object from the feature store.voidStreamFeatureGroup.save()Save the feature group metadata on Hopsworks.voidStreamFeatureGroup.save(Map<String, String> writeOptions, JobConfiguration materializationJobConfiguration) Save the feature group metadata on Hopsworks.Constructors in com.logicalclocks.hsfs.beam that throw FeatureStoreExceptionModifierConstructorDescriptionHopsworksConnection(String host, int port, String project, software.amazon.awssdk.regions.Region region, SecretStore secretStore, boolean hostnameVerification, String trustStorePath, String certPath, String apiKeyFilePath, String apiKeyValue) -
Uses of FeatureStoreException in com.logicalclocks.hsfs.beam.engine
Methods in com.logicalclocks.hsfs.beam.engine that throw FeatureStoreExceptionModifier and TypeMethodDescriptionFeatureViewEngine.get(FeatureStore featureStore, String name, Integer version) static BeamEngineBeamEngine.getInstance()BeamEngine.getKafkaConfig(FeatureGroupBase featureGroup, Map<String, String> writeOptions) FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, DataSource dataSource, OnlineConfig onlineConfig) FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig) FeatureViewEngine.getOrCreateFeatureView(FeatureStore featureStore, String name, Integer version, com.logicalclocks.hsfs.beam.constructor.Query query, String description, List<String> labels) FeatureGroupEngine.getStreamFeatureGroup(FeatureStore featureStore, String fgName, Integer fgVersion) FeatureGroupEngine.getStreamFeatureGroups(FeatureStore featureStore, String fgName) BeamEngine.insertStream(StreamFeatureGroup streamFeatureGroup, Map<String, String> writeOptions) voidFeatureGroupEngine.save(StreamFeatureGroup featureGroup, List<String> partitionKeys, String precombineKeyName, Map<String, String> writeOptions, JobConfiguration materializationJobConfiguration) FeatureViewEngine.update(FeatureView featureView) Constructors in com.logicalclocks.hsfs.beam.engine that throw FeatureStoreExceptionModifierConstructorDescriptionBeamProducer(String topic, Map<String, String> properties, org.apache.avro.Schema schema, org.apache.avro.Schema encodedSchema, Map<String, org.apache.avro.Schema> deserializedComplexFeatureSchemas, List<String> primaryKeys, StreamFeatureGroup streamFeatureGroup) -
Uses of FeatureStoreException in com.logicalclocks.hsfs.constructor
Methods in com.logicalclocks.hsfs.constructor that throw FeatureStoreExceptionModifier and TypeMethodDescriptionPerform time travel on the given Query.Perform time travel on the given Query.FsQueryBase.getStorageQuery(Storage storage) QueryBase.pullChanges(String wallclockStartTime, String wallclockEndTime) Deprecated.use asOf(wallclockEndTime, wallclockStartTime) insteadabstract voidFsQueryBase.registerHudiFeatureGroups(Map<String, String> readOptions) abstract voidFsQueryBase.registerOnDemandFeatureGroups() -
Uses of FeatureStoreException in com.logicalclocks.hsfs.engine
Methods in com.logicalclocks.hsfs.engine that throw FeatureStoreExceptionModifier and TypeMethodDescriptionabstract StringvoidFeatureGroupEngineBase.addTag(FeatureGroupBase featureGroupBase, String name, Object value) voidFeatureViewEngineBase.addTag(FeatureViewBase featureViewBase, String name, Object value) voidFeatureViewEngineBase.addTag(FeatureViewBase featureViewBase, String name, Object value, Integer trainingDataVersion) static org.apache.avro.generic.GenericRecordPojoToAvroUtils.convertPojoToGenericRecord(Object input, org.apache.avro.Schema featureGroupSchema, org.apache.avro.Schema encodedFeatureGroupSchema, Map<String, org.apache.avro.Schema> complexFeatureSchemas) voidFeatureGroupEngineBase.delete(FeatureGroupBase featureGroupBase) voidvoidvoidvoidvoidFeatureGroupEngineBase.deleteTag(FeatureGroupBase featureGroupBase, String name) voidFeatureViewEngineBase.deleteTag(FeatureViewBase featureViewBase, String name) voidFeatureViewEngineBase.deleteTag(FeatureViewBase featureViewBase, String name, Integer trainingDataVersion) voidFeatureViewEngineBase.deleteTrainingData(T2 featureView) voidFeatureViewEngineBase.deleteTrainingData(T2 featureView, Integer trainingDataVersion) voidFeatureViewEngineBase.deleteTrainingDatasetOnly(T2 featureView) voidFeatureViewEngineBase.deleteTrainingDatasetOnly(T2 featureView, Integer trainingDataVersion) FeatureViewEngine.get(FeatureStore featureStore, String name, Integer version) abstract T2FeatureViewEngineBase.getBatchQuery(T2 featureView, Date startTime, Date endTime, Boolean withLabels, Integer trainingDataVersion, Class<T1> queryType) FeatureGroupUtils.getCommitDetails(FeatureGroupBase featureGroup, String wallclockTime, Integer limit) VectorServer.getComplexFeatureSchemas(List<TrainingDatasetFeature> features, Map<Integer, String> prefixMap) static DateFeatureGroupUtils.getDateFromDateString(String inputDate) org.apache.avro.SchemaFeatureGroupUtils.getDeserializedAvroSchema(String avroSchema) org.apache.avro.SchemaFeatureGroupUtils.getDeserializedEncodedAvroSchema(org.apache.avro.Schema schema, List<String> complexFeatures) FeatureGroupUtils.getEncodedAvroSchema(org.apache.avro.Schema schema, List<String> complexFeatures) FeatureGroupUtils.getFeatureAvroSchema(String featureName, org.apache.avro.Schema schema) VectorServer.getFeatureVector(FeatureViewBase featureViewBase, Map<String, Object> entry) VectorServer.getFeatureVector(FeatureViewBase featureViewBase, Map<String, Object> entry, boolean external) VectorServer.getFeatureVector(Map<String, Object> entry) <T> TVectorServer.getFeatureVectorObject(FeatureViewBase featureViewBase, Map<String, Object> entry, boolean external, Class<T> returnType) <T> TVectorServer.getFeatureVectorObject(Map<String, Object> entry, Class<T> returnType) VectorServer.getFeatureVectors(FeatureViewBase featureViewBase, Map<String, List<Object>> entry, boolean external) VectorServer.getFeatureVectors(Map<String, List<Object>> entry) FeatureGroupUtils.getHeaders(FeatureGroupBase featureGroup, Long numEntries) FeatureGroupUtils.getHeaders(FeatureGroupBase featureGroup, Long numEntries, Map<String, String> options) FeatureGroupUtils.getHeaders(FeatureGroupBase featureGroup, Long numEntries, Map<String, String> options, String operation) FeatureGroupUtils.getHeaders(FeatureGroupBase featureGroup, Long numEntries, Map<String, String> options, String operation, Storage storage) Kafka headers for the records of one write to the online topic.FeatureGroupUtils.getHiveServerConnection(FeatureGroupBase featureGroup, String connectionString) static EngineEngine.getInstance()Engine.getKafkaConfig(FeatureGroupBase featureGroup, Map<String, String> writeOptions) EngineBase.getKafkaConfig(FeatureGroupBase featureGroup, Map<String, String> writeOptions) FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, DataSource dataSource, OnlineConfig onlineConfig) FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig) FeatureViewEngine.getOrCreateFeatureView(FeatureStore featureStore, String name, Integer version, Query query, String description, List<String> labels) FeatureGroupEngine.getStreamFeatureGroup(FeatureStore featureStore, String fgName, Integer fgVersion) FeatureGroupEngine.getStreamFeatureGroups(FeatureStore featureStore, String fgName) FeatureGroupUtils.getSubject(FeatureGroupBase featureGroup) FeatureGroupEngineBase.getTag(FeatureGroupBase featureGroupBase, String name) FeatureViewEngineBase.getTag(FeatureViewBase featureViewBase, String name) FeatureViewEngineBase.getTag(FeatureViewBase featureViewBase, String name, Integer trainingDataVersion) FeatureGroupEngineBase.getTags(FeatureGroupBase featureGroupBase) FeatureViewEngineBase.getTags(FeatureViewBase featureViewBase) FeatureViewEngineBase.getTags(FeatureViewBase featureViewBase, Integer trainingDataVersion) static LongFeatureGroupUtils.getTimeStampFromDateString(String inputDate) voidVectorServer.initPreparedStatement(FeatureStoreBase featureStoreBase, List<TrainingDatasetFeature> features, List<ServingPreparedStatement> servingPreparedStatements, boolean batch, boolean external) voidVectorServer.initPreparedStatement(FeatureViewBase featureViewBase, boolean batch) voidVectorServer.initPreparedStatement(FeatureViewBase featureViewBase, boolean batch, boolean external) voidVectorServer.initServing(FeatureViewBase featureViewBase, boolean batch) voidVectorServer.initServing(FeatureViewBase featureViewBase, boolean batch, boolean external) static List<TrainingDatasetFeature>FeatureViewEngineBase.makeLabelFeatures(QueryBase query, List<String> labels) <T> voidVectorServer.processQuery(Map<String, Object> entry, int preparedStatementIndex, T returnObject) voidFeatureGroupEngine.save(StreamFeatureGroup featureGroup, List<String> partitionKeys, String precombineKeyName, Map<String, String> writeOptions, JobConfiguration materializationJobConfiguration) protected <T extends FeatureGroupBase>
TFeatureGroupEngineBase.saveExtennalFeatureGroupMetaData(T externalFeatureGroup, Class<T> fgClass) voidVectorServer.setupHikariPool(FeatureStoreBase featureStoreBase, Boolean external) FeatureViewEngine.update(FeatureView featureView) abstract T2<T extends FeatureGroupBase>
voidFeatureGroupEngineBase.updateDeprecated(FeatureGroupBase featureGroup, Boolean deprecate, Class<T> fgClass) <T extends FeatureGroupBase>
voidFeatureGroupEngineBase.updateDescription(FeatureGroupBase featureGroup, String description, Class<T> fgClass) <T extends FeatureGroupBase>
voidFeatureGroupEngineBase.updateFeatures(FeatureGroupBase featureGroup, List<Feature> features, Class<T> fgClass) <T extends FeatureGroupBase>
voidFeatureGroupEngineBase.updateNotificationTopicName(FeatureGroupBase featureGroup, String notificationTopicName, Class<T> fgClass) <T extends FeatureGroupBase>
voidFeatureGroupEngineBase.updateStatisticsConfig(FeatureGroupBase featureGroup, Class<T> fgClass) voidFeatureGroupUtils.verifyAttributeKeyNames(FeatureGroupBase featureGroup, List<String> partitionKeyNames, String precombineKeyName) Engine.writeStream(StreamFeatureGroup streamFeatureGroup, List<T> featureData, Map<String, String> writeOptions) -
Uses of FeatureStoreException in com.logicalclocks.hsfs.flink
Methods in com.logicalclocks.hsfs.flink that throw FeatureStoreExceptionModifier and TypeMethodDescriptionFeatureView.FeatureViewBuilder.build()HopsworksConnection.getFeatureStore()Retrieve the project feature store.HopsworksConnection.getFeatureStore(String name) Retrieve a feature store based on name.FeatureStore.getFeatureView(@NonNull String name, @NonNull Integer version) Get a feature view object from the selected feature store.FeatureStore.getFeatureView(String name) Get a feature view object from the selected feature store.FeatureStore.getOrCreateFeatureView(String name, com.logicalclocks.hsfs.flink.constructor.Query query, Integer version) Get feature view metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, DataSource dataSource, OnlineConfig onlineConfig) FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig) FeatureStore.getSqlConnector(String name) FeatureStore.getStreamFeatureGroup(@NonNull String name, @NonNull Integer version) Get a stream feature group object from the feature store.FeatureStore.getStreamFeatureGroup(String name) Get a stream feature group object from the feature store.voidStreamFeatureGroup.save()Save the feature group metadata on Hopsworks.voidStreamFeatureGroup.save(Map<String, String> writeOptions, JobConfiguration materializationJobConfiguration) Save the feature group metadata on Hopsworks.Constructors in com.logicalclocks.hsfs.flink that throw FeatureStoreExceptionModifierConstructorDescriptionHopsworksConnection(String host, int port, String project, software.amazon.awssdk.regions.Region region, SecretStore secretStore, boolean hostnameVerification, String trustStorePath, String certPath, String apiKeyFilePath, String apiKeyValue) -
Uses of FeatureStoreException in com.logicalclocks.hsfs.flink.engine
Methods in com.logicalclocks.hsfs.flink.engine that throw FeatureStoreExceptionModifier and TypeMethodDescriptionFeatureViewEngine.get(FeatureStore featureStore, String name, Integer version) FlinkEngine.getKafkaConfig(FeatureGroupBase featureGroup, Map<String, String> writeOptions) FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, DataSource dataSource, OnlineConfig onlineConfig) FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig) FeatureViewEngine.getOrCreateFeatureView(FeatureStore featureStore, String name, Integer version, com.logicalclocks.hsfs.flink.constructor.Query query, String description, List<String> labels) FeatureGroupEngine.getStreamFeatureGroup(FeatureStore featureStore, String fgName, Integer fgVersion) FeatureGroupEngine.getStreamFeatureGroups(FeatureStore featureStore, String fgName) voidFeatureGroupEngine.save(StreamFeatureGroup featureGroup, List<String> partitionKeys, String precombineKeyName, Map<String, String> writeOptions, JobConfiguration materializationJobConfiguration) FeatureViewEngine.update(FeatureView featureView) org.apache.flink.streaming.api.datastream.DataStreamSink<?>FlinkEngine.writeDataStream(StreamFeatureGroup streamFeatureGroup, org.apache.flink.streaming.api.datastream.DataStream<?> dataStream, Map<String, String> writeOptions) Constructors in com.logicalclocks.hsfs.flink.engine that throw FeatureStoreException -
Uses of FeatureStoreException in com.logicalclocks.hsfs.metadata
Methods in com.logicalclocks.hsfs.metadata that throw FeatureStoreExceptionModifier and TypeMethodDescriptionvoidTagsApi.add(FeatureGroupBase featureGroupBase, String name, Object value) voidTagsApi.add(FeatureViewBase featureViewBase, Integer trainingDatasetVersion, String name, Object value) voidTagsApi.add(FeatureViewBase featureViewBase, String name, Object value) voidTagsApi.add(TrainingDatasetBase trainingDatasetBase, String name, Object value) voidFeatureViewApi.computeTrainingData(FeatureStoreBase featureStore, FeatureViewBase featureViewBase, TrainingDatasetBase trainingData) <T> FsQueryBaseQueryConstructorApi.constructQuery(FeatureStoreBase featureStoreBase, QueryBase queryBase, Class<T> fsQueryType) OnlineIngestionApi.createOnlineIngestion(FeatureGroupBase featureGroup, OnlineIngestion onlineIngestion) <T extends TrainingDatasetBase>
TrainingDatasetBaseFeatureViewApi.createTrainingData(String featureViewName, Integer featureViewVersion, TrainingDatasetBase trainingData, Class<T> tdType) TrainingDatasetApi.createTrainingDataset(TrainingDatasetBase trainingDatasetBase) voidFeatureGroupApi.delete(FeatureGroupBase featureGroupBase) voidFeatureViewApi.delete(FeatureStoreBase featureStoreBase, String name, Boolean force) voidFeatureViewApi.delete(FeatureStoreBase featureStoreBase, String name, Integer version, Boolean force) voidTrainingDatasetApi.delete(TrainingDatasetBase trainingDatasetBase) voidFeatureGroupApi.deleteContent(FeatureGroupBase featureGroup) voidTagsApi.deleteTag(FeatureGroupBase featureGroup, String name) voidTagsApi.deleteTag(FeatureViewBase featureViewBase, Integer trainingDatasetVersion, String name) voidTagsApi.deleteTag(FeatureViewBase featureViewBase, String name) voidTagsApi.deleteTag(TrainingDatasetBase trainingDatasetBase, String name) voidFeatureViewApi.deleteTrainingData(FeatureStoreBase featureStoreBase, String name, Integer version) voidFeatureViewApi.deleteTrainingData(FeatureStoreBase featureStoreBase, String featureViewName, Integer featureViewVersion, Integer trainingDataVersion) voidFeatureViewApi.deleteTrainingDatasetOnly(FeatureStoreBase featureStoreBase, String name, Integer version) voidFeatureViewApi.deleteTrainingDatasetOnly(FeatureStoreBase featureStoreBase, String name, Integer version, Integer trainingDataVersion) FeatureGroupApi.featureGroupCommit(FeatureGroupBase featureGroup, FeatureGroupCommit featureGroupCommit) <T> TFeatureViewApi.get(FeatureStoreBase featureStoreBase, String name) <T extends FeatureViewBase>
FeatureViewBaseFeatureViewApi.get(FeatureStoreBase featureStoreBase, String name, Integer version, Class<T> fvType) StatisticsApi.get(FeatureGroupBase featureGroup, String commitTime) StatisticsApi.get(TrainingDatasetBase trainingDatasetBase, String commitTime) <U> UTagsApi.get(FeatureGroupBase featureGroupBase) TagsApi.get(FeatureGroupBase featureGroupBase, String name) TagsApi.get(FeatureViewBase featureViewBase) TagsApi.get(FeatureViewBase featureViewBase, Integer trainingDatasetVersion) TagsApi.get(FeatureViewBase featureViewBase, Integer trainingDatasetVersion, String name) TagsApi.get(FeatureViewBase featureViewBase, String name) TagsApi.get(TrainingDatasetBase trainingDatasetBase) TagsApi.get(TrainingDatasetBase trainingDatasetBase, String name) TrainingDatasetApi.get(FeatureStoreBase featureStoreBase, String tdName, Integer tdVersion) protected StringHopsworksExternalClient.getAssumedRole()<T extends QueryBase>
TFeatureViewApi.getBatchQuery(FeatureStoreBase featureStoreBase, String name, Integer version, Long startTime, Long endTime, Boolean withLabels, Integer trainingDataVersion, Class<T> queryType) <T> TStorageConnectorApi.getByName(FeatureStoreBase featureStoreBase, String name, Class<T> storageConnectorType) FeatureGroupApi.getCommitDetails(FeatureGroupBase featureGroupBase, Long wallclockTimestamp, Integer limit) HopsworksClient.getCredentials()static HopsworksClientHopsworksClient.getInstance()<T extends FeatureGroupBase>
T[]FeatureGroupApi.getInternal(FeatureStoreBase featureStoreBase, String fgName, Integer fgVersion, Class<T[]> fgType) StorageConnectorApi.getKafkaStorageConnector(FeatureStoreBase featureStoreBase, boolean external) StatisticsApi.getLast(FeatureGroupBase featureGroup) StatisticsApi.getLast(TrainingDatasetBase trainingDatasetBase) OnlineIngestionApi.getOnlineIngestion(FeatureGroupBase featureGroup, String queryParameters) <T> TStorageConnectorApi.getOnlineStorageConnector(FeatureStoreBase featureStoreBase, Class<T> storageConnectorType) TrainingDatasetApi.getQuery(TrainingDatasetBase trainingDatasetBase, boolean withLabel, boolean isHiveQuery) FeatureViewApi.getServingPreparedStatement(FeatureViewBase featureViewBase, boolean batch) TrainingDatasetApi.getServingPreparedStatement(TrainingDatasetBase trainingDatasetBase, boolean batch) KafkaApi.getSubject(FeatureStoreBase featureStoreBase, String subjectName) KafkaApi.getSubject(Integer featureStoreId, String subjectName) KafkaApi.getSubject(Integer featureStoreId, String subjectName, String subjectVersion) <T extends TrainingDatasetBase>
TrainingDatasetBaseFeatureViewApi.getTrainingData(FeatureStoreBase featureStoreBase, String featureViewName, Integer featureViewVersion, Integer trainingDataVersion, Class<T> tdType) TrainingDatasetApi.getTrainingDataset(FeatureStoreBase featureStoreBase, String tdName, Integer tdVersion) FeatureViewApi.getTransformationFunctions(FeatureViewBase featureViewBase) TrainingDatasetApi.getTransformationFunctions(TrainingDatasetBase trainingDatasetBase) <T> THopsworksClient.handleRequest(org.apache.http.HttpRequest request) <T> THopsworksClient.handleRequest(org.apache.http.HttpRequest request, Class<T> cls) <T> THopsworksClient.handleRequest(org.apache.http.HttpRequest request, org.apache.http.client.ResponseHandler<T> responseHandler) <T> THopsworksHttpClient.handleRequest(org.apache.http.HttpRequest request, org.apache.http.client.ResponseHandler<T> responseHandler) <T> THopsworksInternalClient.handleRequest(org.apache.http.HttpRequest request, org.apache.http.client.ResponseHandler<T> responseHandler) StatisticsApi.post(FeatureGroupBase featureGroup, Statistics statistics) StatisticsApi.post(FeatureViewBase featureViewBase, Integer trainingDataVersion, Statistics statistics) StatisticsApi.post(TrainingDatasetBase trainingDatasetBase, Statistics statistics) HopsworksExternalClient.readApiKey(SecretStore secretStore, software.amazon.awssdk.regions.Region region, String apiKeyFilepath) Read API key.protected StringHopsworksExternalClient.readApiKeyParamStore(software.amazon.awssdk.regions.Region region, String secretKey) protected StringHopsworksExternalClient.readApiKeySecretManager(software.amazon.awssdk.regions.Region region, String secretKey) static byte[]DatasetApi.readContent(String path) static byte[]DatasetApi.readContent(String path, String datasetType) voidHopsworksInternalClient.refreshJwt()<U extends FeatureGroupBase>
FeatureGroupBaseFeatureGroupApi.save(FeatureGroupBase featureGroup, Class<U> fgType) <T extends FeatureViewBase>
TFeatureViewApi.save(FeatureViewBase featureViewBase, Class<T> fvType) <U extends FeatureGroupBase>
FeatureGroupBaseFeatureGroupApi.saveFeatureGroupMetaData(FeatureGroupBase featureGroup, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions, JobConfiguration jobConfiguration, Class<U> fgType) <U extends FeatureGroupBase>
FeatureGroupBaseFeatureGroupApi.saveInternal(FeatureGroupBase featureGroupBase, org.apache.http.entity.StringEntity entity, Class<U> fgType) static HopsworksClientHopsworksClient.setupHopsworksClient(String host, int port, software.amazon.awssdk.regions.Region region, SecretStore secretStore, boolean hostnameVerification, String trustStorePath, String apiKeyFilePath, String apiKeyValue) <T> TFeatureViewApi.update(FeatureViewBase featureViewBase, Class<T> fvType) <T extends FeatureGroupBase>
TFeatureGroupApi.updateMetadata(FeatureGroupBase featureGroup, String queryParameter, Class<T> fgType) <T extends FeatureGroupBase>
TFeatureGroupApi.updateMetadata(FeatureGroupBase featureGroup, String queryParameter, Object value, Class<T> fgType) TrainingDatasetApi.updateMetadata(TrainingDatasetBase trainingDatasetBase, String queryParameter) Constructors in com.logicalclocks.hsfs.metadata that throw FeatureStoreException -
Uses of FeatureStoreException in com.logicalclocks.hsfs.spark
Methods in com.logicalclocks.hsfs.spark that throw FeatureStoreExceptionModifier and TypeMethodDescriptionvoidExternalFeatureGroup.appendFeatures(Feature features) voidExternalFeatureGroup.appendFeatures(List<Feature> features) voidFeatureGroup.appendFeatures(Feature features) Append a single feature to the schema of the feature group.voidFeatureGroup.appendFeatures(List<Feature> features) Append features to the schema of the feature group.voidStreamFeatureGroup.appendFeatures(Feature features) Append a single feature to the schema of the stream feature group.voidStreamFeatureGroup.appendFeatures(List<Feature> features) Append features to the schema of the stream feature group.Get Query object to retrieve all features of the group at a point in the past.Get Query object to retrieve all features of the group at a point in the past.Get Query object to retrieve all features of the group at a point in the past.Get Query object to retrieve all features of the group at a point in the past.FeatureView.FeatureViewBuilder.build()voidFeatureView.clean(FeatureStore featureStore, String featureViewName, Integer featureViewVersion) Delete the feature view and all associated metadata and training data.voidFeatureGroup.commitDeleteRecord(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData) Deprecated.useFeatureGroup.removeRows(Dataset)instead.voidFeatureGroup.commitDeleteRecord(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions) Deprecated.useFeatureGroup.removeRows(Dataset, Map)instead.voidStreamFeatureGroup.commitDeleteRecord(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData) Deprecated.useStreamFeatureGroup.removeRows(Dataset)instead.voidStreamFeatureGroup.commitDeleteRecord(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions) Deprecated.useStreamFeatureGroup.removeRows(Dataset, Map)instead.FeatureGroup.commitDetails()Retrieves commit timeline for this feature group.FeatureGroup.commitDetails(Integer limit) Retrieves commit timeline for this feature group.FeatureGroup.commitDetails(String wallclockTime) Return commit details as of specific point in time.FeatureGroup.commitDetails(String wallclockTime, Integer limit) Return commit details as of specific point in time.StreamFeatureGroup.commitDetails()Retrieves commit timeline for this stream feature group.StreamFeatureGroup.commitDetails(Integer limit) /** Retrieves commit timeline for this stream feature group.StreamFeatureGroup.commitDetails(String wallclockTime) Return commit details as of specific point in time.StreamFeatureGroup.commitDetails(String wallclockTime, Integer limit) Return commit details as of specific point in time.ExternalFeatureGroup.computeStatistics()FeatureGroup.computeStatistics()Recompute the statistics for the feature group and save them to the feature store.FeatureGroup.computeStatistics(String wallclockTime) Recompute the statistics for the feature group and save them to the feature store.StreamFeatureGroup.computeStatistics()Recompute the statistics for the stream feature group and save them to the feature store.StreamFeatureGroup.computeStatistics(String wallclockTime) Recompute the statistics for the feature group and save them to the feature store.TrainingDataset.computeStatistics()Recompute the statistics for the entire training dataset and save them to the feature store.FeatureView.createTrainingData(String startTime, String endTime, String description, DataFormat dataFormat) Create the metadata for a training dataset and save the corresponding training data into `location`.FeatureView.createTrainingData(String startTime, String endTime, String description, DataFormat dataFormat, Boolean coalesce, DataSource dataSource, Long seed, StatisticsConfig statisticsConfig, Map<String, String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter) Create the metadata for a training dataset and save the corresponding training data into `location`.FeatureView.createTrainingData(String startTime, String endTime, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, Long seed, StatisticsConfig statisticsConfig, Map<String, String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter) Deprecated.FeatureView.createTrainTestSplit(Float testSize, String trainStart, String trainEnd, String testStart, String testEnd, String description, DataFormat dataFormat) Create the metadata for a training dataset and save the corresponding training data into `location`.FeatureView.createTrainTestSplit(Float testSize, String trainStart, String trainEnd, String testStart, String testEnd, String description, DataFormat dataFormat, Boolean coalesce, DataSource dataSource, Long seed, StatisticsConfig statisticsConfig, Map<String, String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter) Create the metadata for a training dataset and save the corresponding training data into `location`.FeatureView.createTrainTestSplit(Float testSize, String trainStart, String trainEnd, String testStart, String testEnd, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, Long seed, StatisticsConfig statisticsConfig, Map<String, String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter) Deprecated.FeatureView.createTrainValidationTestSplit(Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, String description, DataFormat dataFormat) Create the metadata for a training dataset and save the corresponding training data into `location`.FeatureView.createTrainValidationTestSplit(Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, String description, DataFormat dataFormat, Boolean coalesce, DataSource dataSource, Long seed, StatisticsConfig statisticsConfig, Map<String, String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter) Create the metadata for a training dataset and save the corresponding training data into `location`.FeatureView.createTrainValidationTestSplit(Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, Long seed, StatisticsConfig statisticsConfig, Map<String, String> writeOptions, FilterLogic extraFilterLogic, Filter extraFilter) Deprecated.voidFeatureView.deleteAllTrainingDatasets()Delete all training datasets.voidFeatureView.deleteTrainingDataset(Integer version) Delete a training dataset.FeatureStore.getAdlsConnector(String name) Get a previously created Adls compliant storage connector from the feature store.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>FeatureView.getBatchData()Get all data from the feature view as a batch from the offline feature store.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>FeatureView.getBatchData(String startTime, String endTime) Get a batch of data from an event time interval from the offline feature store.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Get a batch of data from an event time interval from the offline feature store.FeatureView.getBatchQuery()Get a query string of the batch query.FeatureView.getBatchQuery(String startTime, String endTime) Get a query string of the batch query.FeatureStore.getBigqueryConnector(String name) Get a previously created BigQuery compliant storage connector from the feature store.FeatureStore.getExternalFeatureGroup(@NonNull String name, @NonNull Integer version) Get an external feature group object from the feature store.FeatureStore.getExternalFeatureGroup(String name) Get an external feature group object with default version `1` from the feature store.scala.collection.Seq<ExternalFeatureGroup>FeatureStore.getExternalFeatureGroups(@NonNull String name) Get a list of all versions of an external feature group from the feature store.FeatureStore.getFeatureGroup(@NonNull String name, @NonNull Integer version) Get a feature group object from the feature store.FeatureStore.getFeatureGroup(String name) Get a feature group object with default version `1` from the feature store.scala.collection.Seq<FeatureGroup>FeatureStore.getFeatureGroups(@NonNull String name) Get a list of all versions of a feature group from the feature store.HopsworksConnection.getFeatureStore()Retrieve the project feature store.HopsworksConnection.getFeatureStore(String name) Retrieve a feature store based on name.FeatureStore.getFeatureView(@NonNull String name, @NonNull Integer version) Get a feature view object from the selected feature store.FeatureStore.getFeatureView(String name) Get a feature view object with the default version `1` from the selected feature store.FeatureStore.getGcsConnector(String name) Get a previously created Gcs compliant storage connector from the feature store.FeatureStore.getHopsFsConnector(String name) Get a previously created HopsFs compliant storage connector from the feature store.FeatureStore.getJdbcConnector(String name) Get a previously created JDBC compliant storage connector from the feature store.FeatureStore.getKafkaConnector(String name) Get a previously created Kafka compliant storage connector from the feature store.FeatureStore.getOnDemandFeatureGroup(@NonNull String name, @NonNull Integer version) Deprecated.FeatureStore.getOnDemandFeatureGroup(String name) Deprecated.scala.collection.Seq<ExternalFeatureGroup>FeatureStore.getOnDemandFeatureGroups(@NonNull String name) Deprecated.FeatureStore.getOnlineStorageConnector()Get a previously created JDBC compliant storage connector from the feature store to connect to the online feature store.FeatureStore.getOrCreateFeatureGroup(String name, Integer version) Get feature group metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateFeatureGroup(String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, TimeTravelFormat timeTravelFormat, StatisticsConfig statisticsConfig, String topicName, String notificationTopicName, String eventTime, OnlineConfig onlineConfig) Get feature group metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateFeatureGroup(String name, Integer version, List<String> primaryKeys, boolean onlineEnabled, String eventTime) Get feature group metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateFeatureGroup(String name, Integer version, List<String> primaryKeys, List<String> partitionKeys, boolean onlineEnabled, String eventTime) Get feature group metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateFeatureView(String name, Query query, Integer version) Get feature view metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateFeatureView(String name, Query query, Integer version, String description, List<String> labels) Get feature view metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, DataSource dataSource, OnlineConfig onlineConfig) FeatureStore.getOrCreateStreamFeatureGroup(@NonNull String name, Integer version, String description, Boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<String> primaryKeys, List<String> partitionKeys, String eventTime, String hudiPrecombineKey, List<Feature> features, StatisticsConfig statisticsConfig, StorageConnector storageConnector, String path, OnlineConfig onlineConfig) Get stream feature group metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateStreamFeatureGroup(String name, Integer version) Get stream feature group metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateStreamFeatureGroup(String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, StatisticsConfig statisticsConfig, String eventTime, TimeTravelFormat timeTravelFormat) Get stream feature group metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateStreamFeatureGroup(String name, Integer version, List<String> primaryKeys, boolean onlineEnabled, String eventTime) Get stream feature group metadata object or create a new one if it doesn't exist.FeatureStore.getOrCreateStreamFeatureGroup(String name, Integer version, List<String> primaryKeys, List<String> partitionKeys, boolean onlineEnabled, String eventTime) Get stream feature group metadata object or create a new one if it doesn't exist.FeatureStore.getRedshiftConnector(String name) Get a previously created Redshift compliant storage connector from the feature store.FeatureStore.getS3Connector(String name) Get a previously created S3 compliant storage connector from the feature store.FeatureStore.getSnowflakeConnector(String name) Get a previously created Snowflake compliant storage connector from the feature store.FeatureStore.getSqlConnector(String name) Get a previously created SQL storage connector from the feature store.ExternalFeatureGroup.getStatistics()FeatureGroup.getStatistics()Get the last statistics commit for the feature group.StreamFeatureGroup.getStatistics()FeatureStore.getStorageConnector(String name) Get a previously created storage connector from the feature store.FeatureStore.getStreamFeatureGroup(@NonNull String name, @NonNull Integer version) Get a stream feature group object from the feature store.FeatureStore.getStreamFeatureGroup(String name) Get a stream feature group object with default version `1` from the feature store.List<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>FeatureView.getTrainingData(Integer version) Get training data created by `featureView.createTrainingData` or `featureView.trainingData`.List<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>FeatureView.getTrainingData(Integer version, Map<String, String> readOptions) Get training data created by `featureView.createTrainingData` or `featureView.trainingData`.FeatureStore.getTrainingDataset(@NonNull String name, @NonNull Integer version) Deprecated.FeatureStore.getTrainingDataset(String name) Deprecated.scala.collection.Seq<TrainingDataset>FeatureStore.getTrainingDatasets(@NonNull String name) Deprecated.List<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>FeatureView.getTrainTestSplit(Integer version) Get training data created by `featureView.createTrainTestSplit` or `featureView.trainTestSplit`.List<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>FeatureView.getTrainTestSplit(Integer version, Map<String, String> readOptions) Get training data created by `featureView.createTrainTestSplit` or `featureView.trainTestSplit`.List<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>FeatureView.getTrainValidationTestSplit(Integer version) Get training data created by `featureView.createTrainValidationTestSplit` or featureView.trainValidationTestSplit`.List<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>FeatureView.getTrainValidationTestSplit(Integer version, Map<String, String> readOptions) Get training data created by `featureView.createTrainValidationTestSplit` or featureView.trainValidationTestSplit`.voidExternalFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData) Incrementally insert data to the online storage of an external feature group.voidExternalFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage) voidExternalFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions) Incrementally insert data to the online storage of an external feature group.voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData) Incrementally insert data to a feature group or overwrite all data contained in the feature group.voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite) Incrementally insert data to a feature group or overwrite all data contained in the feature group.voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite, Map<String, String> writeOptions) Incrementally insert data to a feature group or overwrite all data contained in the feature group.voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite, Map<String, String> writeOptions, JobConfiguration jobConfiguration) voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, HudiOperationType operation) Incrementally insert data to a feature group or overwrite all data contained in the feature group.voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, JobConfiguration jobConfiguration) voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage) Incrementally insert data to a feature group or overwrite all data contained in the feature group.voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, boolean overwrite) Incrementally insert data to a feature group or overwrite all data contained in the feature group.voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, boolean overwrite, HudiOperationType operation, Map<String, String> writeOptions) Incrementally insert data to a feature group or overwrite all data contained in the feature group.voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions) Incrementally insert data to a feature group or overwrite all data contained in the feature group.voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData) Incrementally insert data to a stream feature group or overwrite all data contained in the feature group.voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite) Incrementally insert data to a stream feature group or overwrite all data contained in the feature group.voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite, Map<String, String> writeOptions) Incrementally insert data to a stream feature group or overwrite all data contained in the feature group.voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite, Map<String, String> writeOptions, JobConfiguration jobConfiguration) Incrementally insert data to a stream feature group or overwrite all data contained in the feature group.voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, HudiOperationType operation) voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, JobConfiguration jobConfiguration) Incrementally insert data to a stream feature group or overwrite all data contained in the feature group.voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage) voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, boolean overwrite) voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, boolean overwrite, HudiOperationType operation, Map<String, String> writeOptions) voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions) Incrementally insert data to a stream feature group or overwrite all data contained in the feature group.org.apache.spark.sql.streaming.StreamingQueryFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData) Deprecated.insertStream method is deprecated FeatureGroups.org.apache.spark.sql.streaming.StreamingQueryFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName) Deprecated.org.apache.spark.sql.streaming.StreamingQueryFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode) Deprecated.org.apache.spark.sql.streaming.StreamingQueryFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout) Deprecated.insertStream method is deprecated FeatureGroups.org.apache.spark.sql.streaming.StreamingQueryFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation) Deprecated.org.apache.spark.sql.streaming.StreamingQueryFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String, String> writeOptions) Deprecated.FeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String, String> writeOptions, JobConfiguration jobConfiguration) org.apache.spark.sql.streaming.StreamingQueryFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, String checkpointLocation) Deprecated.insertStream method is deprecated FeatureGroups.org.apache.spark.sql.streaming.StreamingQueryFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, String checkpointLocation) Deprecated.org.apache.spark.sql.streaming.StreamingQueryFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, Map<String, String> writeOptions) org.apache.spark.sql.streaming.StreamingQueryFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions) Deprecated.voidFeatureView.purgeAllTrainingData()Delete all training datasets in this feature view (data only).voidFeatureView.purgeTrainingData(Integer version) Delete a training dataset (data only).org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>ExternalFeatureGroup.read()org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>ExternalFeatureGroup.read(boolean online) org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>FeatureGroup.read()Reads the feature group from the offline storage as Spark DataFrame.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>FeatureGroup.read(boolean online) Reads the feature group from the offline or online storage as Spark DataFrame.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Reads the feature group from the offline or online storage as Spark DataFrame.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Reads Feature group into a dataframe at a specific point in time.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Reads Feature group into a dataframe at a specific point in time.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Reads the feature group from the offline storage as Spark DataFrame.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StreamFeatureGroup.read()Reads the feature group from the offline storage as Spark DataFrame.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StreamFeatureGroup.read(boolean online) Reads the stream feature group from the offline or online storage as Spark DataFrame.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Reads the stream feature group from the offline or online storage as Spark DataFrame.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Reads stream Feature group into a dataframe at a specific point in time.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Reads stream Feature group into a dataframe at a specific point in time.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Reads the stream feature group from the offline storage as Spark DataFrame.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>TrainingDataset.read()Read the content of the training dataset.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Read all a single split from the training dataset.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Read a single split from the training dataset.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Read the content of the training dataset.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>FeatureGroup.readChanges(String wallclockStartTime, String wallclockEndTime) Deprecated.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>FeatureGroup.readChanges(String wallclockStartTime, String wallclockEndTime, Map<String, String> readOptions) Deprecated.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StreamFeatureGroup.readChanges(String wallclockStartTime, String wallclockEndTime) Deprecated.`readChanges` method is deprecated.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StreamFeatureGroup.readChanges(String wallclockStartTime, String wallclockEndTime, Map<String, String> readOptions) Deprecated.voidFeatureView.recreateTrainingDataset(Integer version, Map<String, String> writeOptions) Recreate a training dataset.voidFeatureGroup.removeRows(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData) Drops records present in the provided DataFrame and commits it as update to this Feature group.voidFeatureGroup.removeRows(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage) Drops records present in the provided DataFrame from the offline table, and optionally from the online store of an online-enabled feature group.voidFeatureGroup.removeRows(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions) Drops records present in the provided DataFrame and commits it as update to this Feature group.voidFeatureGroup.removeRows(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions, Storage storage) Drops records present in the provided DataFrame from the offline table, and optionally from the online store of an online-enabled feature group.voidStreamFeatureGroup.removeRows(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData) Drops records present in the provided DataFrame and commits it as update to this Stream Feature group.voidStreamFeatureGroup.removeRows(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage) Drops records present in the provided DataFrame from the offline table, and optionally from the online store of an online-enabled feature group.voidStreamFeatureGroup.removeRows(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions) Drops records present in the provided DataFrame and commits it as update to this Stream Feature group.voidStreamFeatureGroup.removeRows(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions, Storage storage) Drops records present in the provided DataFrame from the offline table, and optionally from the online store of an online-enabled feature group.voidExternalFeatureGroup.save()voidFeatureGroup.save(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData) Deprecated.voidFeatureGroup.save(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions) Deprecated.voidStreamFeatureGroup.save(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions) Deprecated.voidStreamFeatureGroup.save(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions, JobConfiguration jobConfiguration) Deprecated.voidExternalFeatureGroup.show(int numRows) voidExternalFeatureGroup.show(int numRows, boolean online) voidFeatureGroup.show(int numRows) Show the first `n` rows of the feature group.voidFeatureGroup.show(int numRows, boolean online) Show the first `n` rows of the feature group.voidStreamFeatureGroup.show(int numRows) Show the first `n` rows of the feature group.voidStreamFeatureGroup.show(int numRows, boolean online) Show the first `n` rows of the feature group.voidTrainingDataset.show(int numRows) Show numRows from the training dataset (across all splits).List<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>FeatureView.trainingData(String startTime, String endTime, String description) Create the metadata for a training dataset and get the corresponding training data from the offline feature store.List<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>FeatureView.trainingData(String startTime, String endTime, String description, Long seed, StatisticsConfig statisticsConfig, Map<String, String> readOptions, FilterLogic extraFilterLogic, Filter extraFilter) Create the metadata for a training dataset and get the corresponding training data from the offline feature store.List<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>FeatureView.trainTestSplit(Float testSize, String trainStart, String trainEnd, String testStart, String testEnd, String description) Create the metadata for a training dataset and get the corresponding training data from the offline feature store.List<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>FeatureView.trainTestSplit(Float testSize, String trainStart, String trainEnd, String testStart, String testEnd, String description, Long seed, StatisticsConfig statisticsConfig, Map<String, String> readOptions, FilterLogic extraFilterLogic, Filter extraFilter) Create the metadata for a training dataset and get the corresponding training data from the offline feature store.List<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>FeatureView.trainValidationTestSplit(Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, String description) Create the metadata for a training dataset and get the corresponding training data from the offline feature store.List<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>FeatureView.trainValidationTestSplit(Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, String description, Long seed, StatisticsConfig statisticsConfig, Map<String, String> readOptions, FilterLogic extraFilterLogic, Filter extraFilter) Create the metadata for a training dataset and get the corresponding training data from the offline feature store.FeatureView.update(FeatureView other) Update the description of the feature view.voidExternalFeatureGroup.updateFeatures(Feature feature) voidExternalFeatureGroup.updateFeatures(List<Feature> features) voidFeatureGroup.updateFeatures(Feature feature) Update the metadata of feature.voidFeatureGroup.updateFeatures(List<Feature> features) Update the metadata of multiple features.voidStreamFeatureGroup.updateFeatures(Feature feature) Update the metadata of feature.voidStreamFeatureGroup.updateFeatures(List<Feature> features) Update the metadata of multiple features.Constructors in com.logicalclocks.hsfs.spark that throw FeatureStoreExceptionModifierConstructorDescriptionHopsworksConnection(String host, int port, String project, software.amazon.awssdk.regions.Region region, SecretStore secretStore, boolean hostnameVerification, String trustStorePath, String certPath, String apiKeyFilePath, String apiKeyValue) TrainingDataset(Integer version, String description, DataFormat dataFormat, Boolean coalesce, StorageConnector storageConnector, String location, List<Split> splits, String trainSplit, Long seed, FeatureStoreBase featureStore, StatisticsConfig statisticsConfig, List<String> label, String eventStartTime, String eventEndTime, TrainingDatasetType trainingDatasetType, Float validationSize, Float testSize, String trainStart, String trainEnd, String validationStart, String validationEnd, String testStart, String testEnd, Integer timeSplitSize, FilterLogic extraFilterLogic, Filter extraFilter, DataSource dataSource) -
Uses of FeatureStoreException in com.logicalclocks.hsfs.spark.constructor
Methods in com.logicalclocks.hsfs.spark.constructor that throw FeatureStoreExceptionModifier and TypeMethodDescriptionorg.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Query.read()org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>Query.read(boolean online) org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>voidFsQuery.registerHudiFeatureGroups(Map<String, String> readOptions) voidFsQuery.registerOnDemandFeatureGroups()voidQuery.show(boolean online, int numRows) voidQuery.show(int numRows) -
Uses of FeatureStoreException in com.logicalclocks.hsfs.spark.engine
Methods in com.logicalclocks.hsfs.spark.engine that throw FeatureStoreExceptionModifier and TypeMethodDescription<T extends FeatureGroupBase>
voidFeatureGroupEngine.appendFeatures(FeatureGroupBase featureGroup, List<Feature> features, Class<T> fgClass) org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>SparkEngine.castColumnType(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, List<TrainingDatasetFeature> features) FeatureGroupEngine.commitDelete(FeatureGroupBase featureGroupBase, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> genericDataset, Map<String, String> writeOptions) FeatureGroupEngine.commitDelete(FeatureGroupBase featureGroupBase, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> genericDataset, Map<String, String> writeOptions, Storage storage) Deletes the records ingenericDatasetfrom the storage named bystorage.FeatureGroupEngine.commitDetails(FeatureGroupBase featureGroupBase, Integer limit) FeatureGroupEngine.commitDetailsByWallclockTime(FeatureGroupBase featureGroup, String wallclockTime, Integer limit) StatisticsEngine.computeAndSaveSplitStatistics(FeatureView featureView, TrainingDataset trainingDataset, Map<String, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>> splitDatasets) StatisticsEngine.computeAndSaveSplitStatistics(TrainingDataset trainingDataset) StatisticsEngine.computeSplitStatistics(TrainingDataset trainingDataset) FeatureViewEngine.computeStatistics(FeatureView featureView, TrainingDataset trainingDataset, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>[] datasets) StatisticsEngine.computeStatistics(FeatureGroupBase featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame, Long commitId) StatisticsEngine.computeStatistics(FeatureView featureView, TrainingDataset trainingDataset, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame) StatisticsEngine.computeStatistics(TrainingDataset trainingDataset, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame) SparkEngine.constructCheckpointPath(FeatureGroupBase featureGroup, String queryName, String queryPrefix) FeatureViewEngine.createTrainingDataset(FeatureView featureView, TrainingDataset trainingDataset, Map<String, String> userWriteOptions) voidSparkEngine.deleteOnlineDataframe(FeatureGroupBase featureGroupBase, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String, String> writeOptions) Produces an online delete tombstone for every row in the dataset.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>SparkEngine.encodeComplexFeatures(FeatureGroupBase featureGroupBase, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset) Encodes all complex type features to binary using their avro type as schema.FeatureViewEngine.get(FeatureStore featureStore, String name, Integer version) StatisticsEngine.get(FeatureGroupBase featureGroup, String commitTime) StatisticsEngine.get(TrainingDataset trainingDataset, String commitTime) org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>FeatureViewEngine.getBatchData(FeatureView featureView, Date startTime, Date endTime, Map<String, String> readOptions, Integer trainingDataVersion) FeatureViewEngine.getBatchQuery(FeatureView featureView, Date startTime, Date endTime, Boolean withLabels, Integer trainingDataVersion) FeatureViewEngine.getBatchQueryString(FeatureView featureView, Date startTime, Date endTime, Integer trainingDataVersion) FeatureGroupEngine.getExternalFeatureGroup(FeatureStore featureStore, String fgName, Integer fgVersion) FeatureGroupEngine.getExternalFeatureGroups(FeatureStore featureStore, String fgName) FeatureGroupEngine.getFeatureGroup(FeatureStore featureStore, String fgName, Integer fgVersion) FeatureGroupEngine.getFeatureGroups(FeatureStore featureStore, String fgName) SparkEngine.getKafkaConfig(FeatureGroupBase featureGroup, Map<String, String> writeOptions) StatisticsEngine.getLast(FeatureGroupBase featureGroup) StatisticsEngine.getLast(TrainingDataset trainingDataset) FeatureGroupEngine.getOrCreateFeatureGroup(FeatureStore featureStore, String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, TimeTravelFormat timeTravelFormat, StatisticsConfig statisticsConfig, String topicName, String notificationTopicName, String eventTime, OnlineConfig onlineConfig) FeatureViewEngine.getOrCreateFeatureView(FeatureStore featureStore, String name, Integer version, Query query, String description, List<String> labels) FeatureGroupEngine.getOrCreateStreamFeatureGroup(FeatureStore featureStore, String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, StatisticsConfig statisticsConfig, String eventTime, TimeTravelFormat timeTravelFormat, List<Feature> features, DataSource dataSource, OnlineConfig onlineConfig) FeatureGroupEngine.getOrCreateStreamFeatureGroup(FeatureStore featureStore, String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, StatisticsConfig statisticsConfig, String eventTime, TimeTravelFormat timeTravelFormat, List<Feature> features, StorageConnector storageConnector, String path, OnlineConfig onlineConfig) FeatureGroupEngine.getStreamFeatureGroup(FeatureStore featureStore, String fgName, Integer fgVersion) FeatureGroupEngine.getStreamFeatureGroups(FeatureStore featureStore, String fgName) FeatureViewEngine.getTrainingDataset(FeatureView featureView, TrainingDataset trainingDataset, List<String> requestedSplits, Map<String, String> userReadOptions) FeatureViewEngine.getTrainingDataset(FeatureView featureView, TrainingDataset trainingDataset, Map<String, String> userReadOptions) FeatureViewEngine.getTrainingDataset(FeatureView featureView, Integer trainingDatasetVersion, List<String> requestedSplits, Map<String, String> userReadOptions) voidFeatureGroupEngine.insert(ExternalFeatureGroup externalFeatureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions) voidFeatureGroupEngine.insert(FeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, HudiOperationType operation, org.apache.spark.sql.SaveMode saveMode, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions) voidFeatureGroupEngine.insert(StreamFeatureGroup streamFeatureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, org.apache.spark.sql.SaveMode saveMode, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions, JobConfiguration jobConfiguration) org.apache.spark.sql.streaming.StreamingQueryFeatureGroupEngine.insertStream(FeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions) Deprecated.SparkEngine.parseFeatureGroupSchema(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, TimeTravelFormat timeTravelFormat) TrainingDatasetUtils.parseTrainingDatasetSchema(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset) org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>SparkEngine.read(StorageConnector storageConnector, String dataFormat, Map<String, String> readOptions, String location) org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>TrainingDatasetEngine.read(TrainingDataset trainingDataset, String split, Map<String, String> providedOptions) org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>SparkEngine.readStream(StorageConnector storageConnector, String dataFormat, String messageFormat, String schema, Map<String, String> options, boolean includeMetadata) voidFeatureViewEngine.recreateTrainingDataset(FeatureView featureView, Integer version, Map<String, String> userWriteOptions) voidSparkEngine.registerHudiTemporaryTable(FeatureGroupAlias featureGroupAlias, Map<String, String> readOptions) org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>SparkEngine.registerOnDemandTemporaryTable(ExternalFeatureGroup onDemandFeatureGroup, String alias) FeatureGroupEngine.save(FeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions) Create the metadata and write the data to the online/offline feature store.FeatureGroupEngine.save(StreamFeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions, JobConfiguration sparkJobConfiguration) Create the metadata and write the data to the online/offline feature store.TrainingDatasetEngine.save(TrainingDataset trainingDataset, Query query, Map<String, String> userWriteOptions, List<String> labels) Make a REST call to Hopsworks to create the metadata and write the data on the File System.voidFeatureGroupEngine.saveDataframe(FeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Storage storage, HudiOperationType operation, Map<String, String> offlineWriteOptions, Integer validationId) FeatureGroupEngine.saveExternalFeatureGroup(ExternalFeatureGroup externalFeatureGroup) FeatureGroupEngine.saveFeatureGroupMetaData(FeatureGroup featureGroup, List<String> partitionKeys, String hudiPrecombineKey, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean saveEmpty) FeatureGroupEngine.saveFeatureGroupMetaData(StreamFeatureGroup featureGroup, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions, JobConfiguration sparkJobConfiguration, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData) static voidTrainingDatasetUtils.setLabelFeature(List<TrainingDatasetFeature> features, List<String> labels) voidSparkEngine.setupConnectorHadoopConf(StorageConnector storageConnector) org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>[]SparkEngine.splitDataset(TrainingDataset trainingDataset, Query query, Map<String, String> readOptions) voidTrainingDatasetUtils.trainingDatasetSchemaMatch(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, List<TrainingDatasetFeature> features) FeatureViewEngine.update(FeatureView featureView) voidSparkEngine.validateSparkConfiguration()org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>[]SparkEngine.write(TrainingDataset trainingDataset, Query query, Map<String, String> queryReadOptions, Map<String, String> writeOptions, org.apache.spark.sql.SaveMode saveMode) Setup Spark to write the data on the File System.voidSparkEngine.writeEmptyDataframe(FeatureGroupBase featureGroup) voidSparkEngine.writeOfflineDataframe(FeatureGroupBase featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, HudiOperationType operation, Map<String, String> writeOptions, Integer validationId) voidSparkEngine.writeOnlineDataframe(FeatureGroupBase featureGroupBase, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String, String> writeOptions) Writes feature group dataframe to kafka for online-fs ingestion.voidSparkEngine.writeOnlineDataframe(FeatureGroupBase featureGroupBase, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String, String> writeOptions, Storage storage) Writes feature group dataframe to kafka for online-fs ingestion.<S> org.apache.spark.sql.streaming.StreamingQuerySparkEngine.writeStreamDataframe(FeatureGroupBase featureGroupBase, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String, String> writeOptions) voidFeatureViewEngine.writeTrainingDataset(FeatureView featureView, TrainingDataset trainingDataset, Map<String, String> userWriteOptions) -
Uses of FeatureStoreException in com.logicalclocks.hsfs.spark.engine.hudi
Methods in com.logicalclocks.hsfs.spark.engine.hudi that throw FeatureStoreExceptionModifier and TypeMethodDescriptionHudiEngine.deleteRecord(org.apache.spark.sql.SparkSession sparkSession, FeatureGroupBase featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> deleteDF, Map<String, String> writeOptions) voidHudiEngine.reconcileHudiSchema(org.apache.spark.sql.SparkSession sparkSession, FeatureGroupAlias featureGroupAlias, Map<String, String> hudiArgs) voidHudiEngine.saveHudiFeatureGroup(org.apache.spark.sql.SparkSession sparkSession, FeatureGroupBase featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, HudiOperationType operation, Map<String, String> writeOptions, Integer validationId) -
Uses of FeatureStoreException in com.logicalclocks.hsfs.spark.util
Methods in com.logicalclocks.hsfs.spark.util that throw FeatureStoreExceptionModifier and TypeMethodDescriptionorg.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StorageConnectorUtils.read(StorageConnector.AdlsConnector connector, DataSource dataSource, String dataFormat, Map<String, String> options) Reads path into a spark dataframe using the AdlsConnector.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StorageConnectorUtils.read(StorageConnector.BigqueryConnector connector, DataSource dataSource, Map<String, String> options) Reads a query or a path into a spark dataframe using the sBigqueryConnector.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StorageConnectorUtils.read(StorageConnector.GcsConnector connector, DataSource dataSource, String dataFormat, Map<String, String> options) Reads a path into a spark dataframe using the GcsConnector.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StorageConnectorUtils.read(StorageConnector.GlueConnector connector, DataSource dataSource, String dataFormat, Map<String, String> options) Reads a Glue catalog table into a spark dataframe using the GlueConnector.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StorageConnectorUtils.read(StorageConnector.HopsFsConnector connector, DataSource dataSource, String dataFormat, Map<String, String> options) Reads path into a spark dataframe using the HopsFsConnector.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StorageConnectorUtils.read(StorageConnector.JdbcConnector connector, DataSource dataSource, Map<String, String> options) Reads query into a spark dataframe using the JdbcConnector.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StorageConnectorUtils.read(StorageConnector.RedshiftConnector connector, DataSource dataSource, Map<String, String> options) Reads query into a spark dataframe using the RedshiftConnector.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StorageConnectorUtils.read(StorageConnector.S3Connector connector, DataSource dataSource, String dataFormat, Map<String, String> options) Reads path into a spark dataframe using the S3Connector.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StorageConnectorUtils.read(StorageConnector.SnowflakeConnector connector, DataSource dataSource, Map<String, String> options) Reads query into a spark dataframe using the SnowflakeConnector.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StorageConnectorUtils.read(StorageConnector.SqlConnector connector, DataSource dataSource, Map<String, String> options) Reads a query into a spark dataframe using the SqlConnector.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StorageConnectorUtils.read(StorageConnector connector, DataSource dataSource, String dataFormat, Map<String, String> options) Reads a query or a path into a spark dataframe using the storage connector.org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>StorageConnectorUtils.readStream(StorageConnector.KafkaConnector connector, String topic, boolean topicPattern, String messageFormat, String schema, Map<String, String> options, boolean includeMetadata) Reads stream into a spark dataframe using the kafka storage connector.
FeatureStoreBase.getOrCreateStreamFeatureGroup(String, Integer, String, Boolean, TimeTravelFormat, List, List, String, String, List, StatisticsConfig, DataSource, OnlineConfig)instead.