com.logicalclocks.hsfs.flink

Class StreamFeatureGroup

java.lang.Object

com.logicalclocks.hsfs.FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

com.logicalclocks.hsfs.flink.StreamFeatureGroup

public class StreamFeatureGroup
extends FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Field Summary

Fields

Modifier and Type	Field and Description
protected FeatureGroupEngine	featureGroupEngine

Fields inherited from class com.logicalclocks.hsfs.FeatureGroupBase

created, creator, deltaStreamerJobConf, description, eventTime, expectationsNames, featureGroupEngineBase, features, featureStore, hudiPrecombineKey, id, location, LOGGER, name, onlineEnabled, onlineTopicName, partitionKeys, primaryKeys, statisticColumns, statisticsConfig, subject, timeTravelFormat, type, utils, version

Constructor Summary

Constructors

Constructor and Description
StreamFeatureGroup()
StreamFeatureGroup(FeatureStore featureStore, int id)
StreamFeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, List<Feature> features, StatisticsConfig statisticsConfig, String onlineTopicName, String eventTime)
StreamFeatureGroup(Integer id, String description, List<Feature> features)

Method Summary

Modifier and Type	Method and Description
void	appendFeatures(Feature feature) Append a single feature to the schema of the feature group.
void	appendFeatures(List<Feature> feature) Append features to the schema of the feature group.
QueryBase	asOf(String wallclockTime)
QueryBase	asOf(String wallclockTime, String excludeUntil)
void	commitDeleteRecord(org.apache.flink.streaming.api.datastream.DataStream<?> featureData)
void	commitDeleteRecord(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, Map<String,String> writeOptions)
Map<Long,Map<String,String>>	commitDetails()
Map<Long,Map<String,String>>	commitDetails(Integer integer)
Map<Long,Map<String,String>>	commitDetails(String limit)
Map<Long,Map<String,String>>	commitDetails(String wallclockTime, Integer limit)
Statistics	computeStatistics() Recompute the statistics for the feature group and save them to the feature store.
Statistics	computeStatistics(String wallclockTime)
Statistics	getStatistics() Get the last statistics commit for the feature group.
void	insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData)
void	insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, boolean overwrite)
void	insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, boolean online, Map<String,String> writeOptions)
void	insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, boolean online, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
void	insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, HudiOperationType hudiOperationType)
void	insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, JobConfiguration jobConfiguration)
void	insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, Map<String,String> writeOptions)
void	insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, Storage storage)
void	insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, Storage storage, boolean overwrite)
void	insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, Storage storage, boolean online, HudiOperationType hudiOperationType, Map<String,String> writeOptions)
org.apache.flink.streaming.api.datastream.DataStreamSink<?>	insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData) Ingest a feature data to the online feature store using Flink DataStream API.
org.apache.flink.streaming.api.datastream.DataStreamSink<?>	insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, Map<String,String> writeOptions)
Object	insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, String queryName)
Object	insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, String queryName, Map<String,String> writeOptions)
Object	insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, String queryName, String outputMode)
Object	insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout)
Object	insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation)
Object	insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String,String> writeOptions)
Object	insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String,String> writeOptions, JobConfiguration jobConfiguration)
Object	insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, String queryName, String outputMode, boolean awaitTermination, String checkpointLocation)
Object	insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData, String queryName, String outputMode, String checkpointLocation)
org.apache.flink.streaming.api.datastream.DataStream<?>	read()
org.apache.flink.streaming.api.datastream.DataStream<?>	read(boolean online)
org.apache.flink.streaming.api.datastream.DataStream<?>	read(boolean online, Map<String,String> readOptions)
org.apache.flink.streaming.api.datastream.DataStream<?>	read(Map<String,String> readOptions)
org.apache.flink.streaming.api.datastream.DataStream<?>	read(String wallclockTime)
org.apache.flink.streaming.api.datastream.DataStream<?>	read(String wallclockTime, Map<String,String> readOptions)
QueryBase	select(List<String> features)
QueryBase	selectAll()
QueryBase	selectExcept(List<String> features)
QueryBase	selectExceptFeatures(List<Feature> features)
QueryBase	selectFeatures(List<Feature> features)
void	show(int numRows)
void	show(int numRows, boolean online)
void	updateFeatures(Feature feature) Update the metadata of multiple features.
void	updateFeatures(List<Feature> feature) Update the metadata of multiple features.

Methods inherited from class com.logicalclocks.hsfs.FeatureGroupBase

addTag, delete, deleteTag, getAvroSchema, getComplexFeatures, getDeserializedAvroSchema, getDeserializedEncodedAvroSchema, getEncodedAvroSchema, getFeature, getFeatureAvroSchema, getPrimaryKeys, getSubject, getTag, getTags, unloadSubject, updateDescription, updateFeatureDescription, updateStatisticsConfig

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

featureGroupEngine

protected FeatureGroupEngine featureGroupEngine

Constructor Detail

StreamFeatureGroup

public StreamFeatureGroup(FeatureStore featureStore,
                          @NonNull
                          @NonNull String name,
                          Integer version,
                          String description,
                          List<String> primaryKeys,
                          List<String> partitionKeys,
                          String hudiPrecombineKey,
                          boolean onlineEnabled,
                          List<Feature> features,
                          StatisticsConfig statisticsConfig,
                          String onlineTopicName,
                          String eventTime)

StreamFeatureGroup

public StreamFeatureGroup()

StreamFeatureGroup

public StreamFeatureGroup(Integer id,
                          String description,
                          List<Feature> features)

StreamFeatureGroup

public StreamFeatureGroup(FeatureStore featureStore,
                          int id)

Method Detail

read

public org.apache.flink.streaming.api.datastream.DataStream<?> read()
                                                             throws FeatureStoreException,
                                                                    IOException

Specified by:

read in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

read

public org.apache.flink.streaming.api.datastream.DataStream<?> read(boolean online)
                                                             throws FeatureStoreException,
                                                                    IOException

Specified by:

read in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

read

public org.apache.flink.streaming.api.datastream.DataStream<?> read(Map<String,String> readOptions)
                                                             throws FeatureStoreException,
                                                                    IOException

Specified by:

read in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

read

public org.apache.flink.streaming.api.datastream.DataStream<?> read(boolean online,
                                                                    Map<String,String> readOptions)
                                                             throws FeatureStoreException,
                                                                    IOException

Specified by:

read in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

read

public org.apache.flink.streaming.api.datastream.DataStream<?> read(String wallclockTime)
                                                             throws FeatureStoreException,
                                                                    IOException,
                                                                    ParseException

Specified by:

read in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

ParseException

read

public org.apache.flink.streaming.api.datastream.DataStream<?> read(String wallclockTime,
                                                                    Map<String,String> readOptions)
                                                             throws FeatureStoreException,
                                                                    IOException,
                                                                    ParseException

Specified by:

read in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

ParseException

asOf

public QueryBase asOf(String wallclockTime)
               throws FeatureStoreException,
                      ParseException

Specified by:

asOf in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

ParseException

asOf

public QueryBase asOf(String wallclockTime,
                      String excludeUntil)
               throws FeatureStoreException,
                      ParseException

Specified by:

asOf in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

ParseException

show

public void show(int numRows)
          throws FeatureStoreException,
                 IOException

Specified by:

show in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

show

public void show(int numRows,
                 boolean online)
          throws FeatureStoreException,
                 IOException

Specified by:

show in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

insert

public void insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData)
            throws IOException,
                   FeatureStoreException,
                   ParseException

Specified by:

insert in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

IOException

FeatureStoreException

ParseException

insert

public void insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                   Map<String,String> writeOptions)
            throws FeatureStoreException,
                   IOException,
                   ParseException

Specified by:

insert in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

ParseException

insert

public void insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                   Storage storage)
            throws IOException,
                   FeatureStoreException,
                   ParseException

Specified by:

insert in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

IOException

FeatureStoreException

ParseException

insert

public void insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                   boolean overwrite)
            throws IOException,
                   FeatureStoreException,
                   ParseException

Specified by:

insert in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

IOException

FeatureStoreException

ParseException

insert

public void insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                   Storage storage,
                   boolean overwrite)
            throws IOException,
                   FeatureStoreException,
                   ParseException

Specified by:

insert in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

IOException

FeatureStoreException

ParseException

insert

public void insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                   boolean online,
                   Map<String,String> writeOptions)
            throws FeatureStoreException,
                   IOException,
                   ParseException

Specified by:

insert in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

ParseException

insert

public void insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                   HudiOperationType hudiOperationType)
            throws FeatureStoreException,
                   IOException,
                   ParseException

Specified by:

insert in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

ParseException

insert

public void insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                   Storage storage,
                   boolean online,
                   HudiOperationType hudiOperationType,
                   Map<String,String> writeOptions)
            throws FeatureStoreException,
                   IOException,
                   ParseException

Specified by:

insert in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

ParseException

insert

public void insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                   JobConfiguration jobConfiguration)
            throws FeatureStoreException,
                   IOException,
                   ParseException

Specified by:

insert in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

ParseException

insert

public void insert(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                   boolean online,
                   Map<String,String> writeOptions,
                   JobConfiguration jobConfiguration)
            throws FeatureStoreException,
                   IOException,
                   ParseException

Specified by:

insert in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

ParseException

commitDeleteRecord

public void commitDeleteRecord(org.apache.flink.streaming.api.datastream.DataStream<?> featureData)
                        throws FeatureStoreException,
                               IOException,
                               ParseException

Specified by:

commitDeleteRecord in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

ParseException

commitDeleteRecord

public void commitDeleteRecord(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                               Map<String,String> writeOptions)
                        throws FeatureStoreException,
                               IOException,
                               ParseException

Specified by:

commitDeleteRecord in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

ParseException

commitDetails

public Map<Long,Map<String,String>> commitDetails()
                                           throws IOException,
                                                  FeatureStoreException,
                                                  ParseException

Specified by:

commitDetails in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

IOException

FeatureStoreException

ParseException

commitDetails

public Map<Long,Map<String,String>> commitDetails(Integer integer)
                                           throws IOException,
                                                  FeatureStoreException,
                                                  ParseException

Specified by:

commitDetails in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

IOException

FeatureStoreException

ParseException

commitDetails

public Map<Long,Map<String,String>> commitDetails(String limit)
                                           throws IOException,
                                                  FeatureStoreException,
                                                  ParseException

Specified by:

commitDetails in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

IOException

FeatureStoreException

ParseException

commitDetails

public Map<Long,Map<String,String>> commitDetails(String wallclockTime,
                                                  Integer limit)
                                           throws IOException,
                                                  FeatureStoreException,
                                                  ParseException

Specified by:

commitDetails in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

IOException

FeatureStoreException

ParseException

selectFeatures

public QueryBase selectFeatures(List<Feature> features)

Specified by:

selectFeatures in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

select

public QueryBase select(List<String> features)

Specified by:

select in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

selectAll

public QueryBase selectAll()

Specified by:

selectAll in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

selectExceptFeatures

public QueryBase selectExceptFeatures(List<Feature> features)

Specified by:

selectExceptFeatures in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

selectExcept

public QueryBase selectExcept(List<String> features)

Specified by:

selectExcept in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

insertStream

public org.apache.flink.streaming.api.datastream.DataStreamSink<?> insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData)
                                                                         throws Exception

Ingest a feature data to the online feature store using Flink DataStream API. Currently, only POJO types as feature data type are supported.

 
        // get feature store handle
        FeatureStore fs = HopsworksConnection.builder().build().getFeatureStore();

        // get feature group handle
        StreamFeatureGroup fg = fs.getStreamFeatureGroup("card_transactions", 1);

        // read stream from the source and aggregate stream
        DataStream<TransactionAgg> aggregationStream =
          env.fromSource(transactionSource, customWatermark, "Transaction Kafka Source")
          .keyBy(r -> r.getCcNum())
          .window(SlidingEventTimeWindows.of(Time.minutes(windowLength), Time.minutes(1)))
          .aggregate(new TransactionCountAggregate());

        // insert streaming feature data
        fg.insertStream(featureData);
 
 

Specified by:

insertStream in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Parameters:

featureData - Features in Streaming Dataframe to be saved.

Returns:

DataStreamSink object.

Throws:

Exception

insertStream

public org.apache.flink.streaming.api.datastream.DataStreamSink<?> insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                                                                                Map<String,String> writeOptions)
                                                                         throws Exception

Specified by:

insertStream in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

Exception

insertStream

public Object insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                           String queryName)
                    throws Exception

Specified by:

insertStream in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

Exception

insertStream

public Object insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                           String queryName,
                           Map<String,String> writeOptions)
                    throws Exception

Specified by:

insertStream in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

Exception

insertStream

public Object insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                           String queryName,
                           String outputMode)
                    throws Exception

Specified by:

insertStream in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

Exception

insertStream

public Object insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                           String queryName,
                           String outputMode,
                           String checkpointLocation)
                    throws Exception

Specified by:

insertStream in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

Exception

insertStream

public Object insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                           String queryName,
                           String outputMode,
                           boolean awaitTermination,
                           Long timeout)
                    throws Exception

Specified by:

insertStream in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

Exception

insertStream

public Object insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                           String queryName,
                           String outputMode,
                           boolean awaitTermination,
                           Long timeout,
                           String checkpointLocation)
                    throws Exception

Specified by:

insertStream in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

Exception

insertStream

public Object insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                           String queryName,
                           String outputMode,
                           boolean awaitTermination,
                           Long timeout,
                           String checkpointLocation,
                           Map<String,String> writeOptions)
                    throws Exception

Specified by:

insertStream in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

Exception

insertStream

public Object insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                           String queryName,
                           String outputMode,
                           boolean awaitTermination,
                           String checkpointLocation)
                    throws Exception

Specified by:

insertStream in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

Exception

insertStream

public Object insertStream(org.apache.flink.streaming.api.datastream.DataStream<?> featureData,
                           String queryName,
                           String outputMode,
                           boolean awaitTermination,
                           Long timeout,
                           String checkpointLocation,
                           Map<String,String> writeOptions,
                           JobConfiguration jobConfiguration)
                    throws Exception

Specified by:

insertStream in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

Exception

updateFeatures

public void updateFeatures(Feature feature)
                    throws FeatureStoreException,
                           IOException,
                           ParseException

Description copied from class: FeatureGroupBase

Update the metadata of multiple features. Currently only feature description updates are supported.

Specified by:

updateFeatures in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Parameters:

feature - Feature metadata object

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

updateFeatures

public void updateFeatures(List<Feature> feature)
                    throws FeatureStoreException,
                           IOException,
                           ParseException

Description copied from class: FeatureGroupBase

Update the metadata of multiple features. Currently only feature description updates are supported.

Specified by:

updateFeatures in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Parameters:

feature - List of Feature metadata objects

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

appendFeatures

public void appendFeatures(List<Feature> feature)
                    throws FeatureStoreException,
                           IOException,
                           ParseException

Description copied from class: FeatureGroupBase

Append features to the schema of the feature group. It is only possible to append features to a feature group. Removing features is considered a breaking change.

Specified by:

appendFeatures in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Parameters:

feature - list of Feature metadata objects

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

appendFeatures

public void appendFeatures(Feature feature)
                    throws FeatureStoreException,
                           IOException,
                           ParseException

Description copied from class: FeatureGroupBase

Append a single feature to the schema of the feature group. It is only possible to append features to a feature group. Removing features is considered a breaking change.

Specified by:

appendFeatures in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Parameters:

feature - List of Feature metadata objects

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

computeStatistics

public Statistics computeStatistics()
                             throws FeatureStoreException,
                                    IOException,
                                    ParseException

Description copied from class: FeatureGroupBase

Recompute the statistics for the feature group and save them to the feature store.

Specified by:

computeStatistics in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Returns:

statistics object of computed statistics

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException

computeStatistics

public Statistics computeStatistics(String wallclockTime)
                             throws FeatureStoreException,
                                    IOException,
                                    ParseException

Specified by:

computeStatistics in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Throws:

FeatureStoreException

IOException

ParseException

getStatistics

public Statistics getStatistics()
                         throws FeatureStoreException,
                                IOException

Description copied from class: FeatureGroupBase

Get the last statistics commit for the feature group.

Specified by:

getStatistics in class FeatureGroupBase<org.apache.flink.streaming.api.datastream.DataStream<?>>

Returns:

statistics object of latest commit

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException