Package com.logicalclocks.hsfs.beam.engine

Class BeamProducer

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<@NonNull org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,@NonNull org.apache.beam.sdk.values.PDone>

com.logicalclocks.hsfs.beam.engine.BeamProducer

All Implemented Interfaces:

Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

public class BeamProducer
extends org.apache.beam.sdk.transforms.PTransform<@NonNull org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,@NonNull org.apache.beam.sdk.values.PDone>

See Also:

• Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name, resourceHints

Constructor Summary

Constructors

Constructor	Description
BeamProducer(String topic, Map<String,String> properties, org.apache.avro.Schema schema, org.apache.avro.Schema encodedSchema, Map<String,org.apache.avro.Schema> deserializedComplexFeatureSchemas, List<String> primaryKeys, StreamFeatureGroup streamFeatureGroup)

Method Summary

Modifier and Type	Method	Description
org.apache.beam.sdk.values.PDone	expand(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> input)

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Details

BeamProducer

public BeamProducer(String topic,
 Map<String,String> properties,
 org.apache.avro.Schema schema,
 org.apache.avro.Schema encodedSchema,
 Map<String,org.apache.avro.Schema> deserializedComplexFeatureSchemas,
 List<String> primaryKeys,
 StreamFeatureGroup streamFeatureGroup)
             throws FeatureStoreException,
IOException

Throws:

FeatureStoreException

IOException

Method Details

expand

public org.apache.beam.sdk.values.PDone expand(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<@NonNull org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,@NonNull org.apache.beam.sdk.values.PDone>