Uses of Class
com.logicalclocks.hsfs.JobConfiguration

Packages that use JobConfiguration

Package	Description
com.logicalclocks.hsfs
com.logicalclocks.hsfs.flink
com.logicalclocks.hsfs.metadata
com.logicalclocks.hsfs.spark
com.logicalclocks.hsfs.spark.engine

Uses of JobConfiguration in com.logicalclocks.hsfs

Methods in com.logicalclocks.hsfs with parameters of type JobConfiguration

Modifier and Type	Method and Description
void	FeatureGroupBaseForApi.insert(FeatureGroupBaseForApi featureData, boolean overwrite, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
void	FeatureGroupBaseForApi.insert(FeatureGroupBaseForApi featureData, JobConfiguration jobConfiguration)
abstract void	FeatureGroupBase.insert(T featureData, boolean overwrite, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
abstract void	FeatureGroupBase.insert(T featureData, JobConfiguration jobConfiguration)
Object	FeatureGroupBaseForApi.insertStream(FeatureGroupBaseForApi featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
abstract Object	FeatureGroupBase.insertStream(T featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String,String> writeOptions, JobConfiguration jobConfiguration)

Uses of JobConfiguration in com.logicalclocks.hsfs.flink

Methods in com.logicalclocks.hsfs.flink with parameters of type JobConfiguration

Modifier and Type	Method and Description
void	StreamFeatureGroup.insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, boolean online, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
void	StreamFeatureGroup.insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, JobConfiguration jobConfiguration)
Object	StreamFeatureGroup.insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String,String> writeOptions, JobConfiguration jobConfiguration)

Uses of JobConfiguration in com.logicalclocks.hsfs.metadata

Methods in com.logicalclocks.hsfs.metadata with parameters of type JobConfiguration

Modifier and Type	Method and Description
<U extends FeatureGroupBase> FeatureGroupBase	FeatureGroupApi.saveFeatureGroupMetaData(FeatureGroupBase featureGroup, List<String> partitionKeys, String hudiPrecombineKey, Map<String,String> writeOptions, JobConfiguration jobConfiguration, Class<U> fgType)

Uses of JobConfiguration in com.logicalclocks.hsfs.spark

Methods in com.logicalclocks.hsfs.spark with parameters of type JobConfiguration

Modifier and Type	Method and Description
void	ExternalFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
void	StreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite, Map<String,String> writeOptions, JobConfiguration jobConfiguration) Incrementally insert data to a stream feature group or overwrite all data contained in the feature group.
void	FeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
void	ExternalFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, JobConfiguration jobConfiguration)
void	StreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, JobConfiguration jobConfiguration) Incrementally insert data to a stream feature group or overwrite all data contained in the feature group.
void	FeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, JobConfiguration jobConfiguration)
Object	ExternalFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
org.apache.spark.sql.streaming.StreamingQuery	StreamFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String,String> writeOptions, JobConfiguration jobConfiguration) Ingest a Spark Structured Streaming Dataframe to the online feature store.
Object	FeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
void	StreamFeatureGroup.save(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String,String> writeOptions, JobConfiguration jobConfiguration) Deprecated.

Uses of JobConfiguration in com.logicalclocks.hsfs.spark.engine

Methods in com.logicalclocks.hsfs.spark.engine with parameters of type JobConfiguration

Modifier and Type	Method and Description
void	FeatureGroupEngine.insert(StreamFeatureGroup streamFeatureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, org.apache.spark.sql.SaveMode saveMode, List<String> partitionKeys, String hudiPrecombineKey, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
org.apache.spark.sql.streaming.StreamingQuery	FeatureGroupEngine.insertStream(StreamFeatureGroup streamFeatureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, List<String> partitionKeys, String hudiPrecombineKey, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
StreamFeatureGroup	FeatureGroupEngine.save(StreamFeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, List<String> partitionKeys, String hudiPrecombineKey, Map<String,String> writeOptions, JobConfiguration sparkJobConfiguration) Create the metadata and write the data to the online/offline feature store.
StreamFeatureGroup	FeatureGroupEngine.saveFeatureGroupMetaData(StreamFeatureGroup featureGroup, List<String> partitionKeys, String hudiPrecombineKey, Map<String,String> writeOptions, JobConfiguration sparkJobConfiguration, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData)