Uses of Class
com.logicalclocks.hsfs.JobConfiguration
Packages that use JobConfiguration
Package
Description
-
Uses of JobConfiguration in com.logicalclocks.hsfs
Methods in com.logicalclocks.hsfs with parameters of type JobConfigurationModifier and TypeMethodDescriptionvoidStreamFeatureGroup.save(Map<String, String> writeOptions, JobConfiguration materializationJobConfiguration) Save the feature group metadata on Hopsworks. -
Uses of JobConfiguration in com.logicalclocks.hsfs.beam
Methods in com.logicalclocks.hsfs.beam with parameters of type JobConfigurationModifier and TypeMethodDescriptionvoidStreamFeatureGroup.save(Map<String, String> writeOptions, JobConfiguration materializationJobConfiguration) Save the feature group metadata on Hopsworks. -
Uses of JobConfiguration in com.logicalclocks.hsfs.beam.engine
Methods in com.logicalclocks.hsfs.beam.engine with parameters of type JobConfigurationModifier and TypeMethodDescriptionvoidFeatureGroupEngine.save(StreamFeatureGroup featureGroup, List<String> partitionKeys, String precombineKeyName, Map<String, String> writeOptions, JobConfiguration materializationJobConfiguration) -
Uses of JobConfiguration in com.logicalclocks.hsfs.engine
Methods in com.logicalclocks.hsfs.engine with parameters of type JobConfigurationModifier and TypeMethodDescriptionvoidFeatureGroupEngine.save(StreamFeatureGroup featureGroup, List<String> partitionKeys, String precombineKeyName, Map<String, String> writeOptions, JobConfiguration materializationJobConfiguration) -
Uses of JobConfiguration in com.logicalclocks.hsfs.flink
Methods in com.logicalclocks.hsfs.flink with parameters of type JobConfigurationModifier and TypeMethodDescriptionvoidStreamFeatureGroup.save(Map<String, String> writeOptions, JobConfiguration materializationJobConfiguration) Save the feature group metadata on Hopsworks. -
Uses of JobConfiguration in com.logicalclocks.hsfs.flink.engine
Methods in com.logicalclocks.hsfs.flink.engine with parameters of type JobConfigurationModifier and TypeMethodDescriptionvoidFeatureGroupEngine.save(StreamFeatureGroup featureGroup, List<String> partitionKeys, String precombineKeyName, Map<String, String> writeOptions, JobConfiguration materializationJobConfiguration) -
Uses of JobConfiguration in com.logicalclocks.hsfs.metadata
Methods in com.logicalclocks.hsfs.metadata with parameters of type JobConfigurationModifier and TypeMethodDescription<U extends FeatureGroupBase>
FeatureGroupBaseFeatureGroupApi.saveFeatureGroupMetaData(FeatureGroupBase featureGroup, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions, JobConfiguration jobConfiguration, Class<U> fgType) -
Uses of JobConfiguration in com.logicalclocks.hsfs.spark
Methods in com.logicalclocks.hsfs.spark with parameters of type JobConfigurationModifier and TypeMethodDescriptionvoidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite, Map<String, String> writeOptions, JobConfiguration jobConfiguration) voidFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, JobConfiguration jobConfiguration) voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite, Map<String, String> writeOptions, JobConfiguration jobConfiguration) Incrementally insert data to a stream feature group or overwrite all data contained in the feature group.voidStreamFeatureGroup.insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, JobConfiguration jobConfiguration) Incrementally insert data to a stream feature group or overwrite all data contained in the feature group.FeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String, String> writeOptions, JobConfiguration jobConfiguration) org.apache.spark.sql.streaming.StreamingQueryStreamFeatureGroup.insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String, String> writeOptions, JobConfiguration jobConfiguration) Ingest a Spark Structured Streaming Dataframe to the online feature store.voidStreamFeatureGroup.save(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String, String> writeOptions, JobConfiguration jobConfiguration) Deprecated. -
Uses of JobConfiguration in com.logicalclocks.hsfs.spark.engine
Methods in com.logicalclocks.hsfs.spark.engine with parameters of type JobConfigurationModifier and TypeMethodDescriptionvoidFeatureGroupEngine.insert(StreamFeatureGroup streamFeatureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, org.apache.spark.sql.SaveMode saveMode, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions, JobConfiguration jobConfiguration) org.apache.spark.sql.streaming.StreamingQueryFeatureGroupEngine.insertStream(StreamFeatureGroup streamFeatureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions, JobConfiguration jobConfiguration) FeatureGroupEngine.save(StreamFeatureGroup featureGroup, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions, JobConfiguration sparkJobConfiguration) Create the metadata and write the data to the online/offline feature store.FeatureGroupEngine.saveFeatureGroupMetaData(StreamFeatureGroup featureGroup, List<String> partitionKeys, String hudiPrecombineKey, Map<String, String> writeOptions, JobConfiguration sparkJobConfiguration, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData)