Skip to content

hsfs.core.online_ingestion_failure #

OnlineIngestionFailure #

A single record that never made it into the online feature store.

Online ingestion reports how many rows failed, but a count alone cannot tell you which rows were lost or what was wrong with them. This object identifies the Kafka record that was dropped and the reason it was rejected, so the offending rows can be corrected and inserted again.

The record itself is not retained

Only the record's coordinates and the reason are kept, not its contents. The record stays readable from its Kafka topic until the topic's retention period expires, after which it is gone for good.

failure_reason property #

failure_reason: str | None

Get the error reported for this record.

failure_type property #

failure_type: str | None

Get the category of the failure.

One of "ROW_CREATION", "METADATA", "FEATURE_GROUP_DELETED", "DESERIALIZATION", "USER_DATA" or "COMMIT". "USER_DATA" means the database refused the row's values, most often because a string or binary value is longer than the online column allows.

feature_group_id property #

feature_group_id: int | None

Get the id of the feature group the record was destined for.

offset property #

offset: int | None

Get the record's offset within its partition.

Together with topic and partition this locates the record in Kafka for as long as the topic retains it.

online_ingestion_id property #

online_ingestion_id: int | None

Get the id of the ingestion the record belonged to.

partition property #

partition: int | None

Get the Kafka partition the record was read from.

record_key property #

record_key: str | None

Get the record's Kafka key, which is the concatenated primary key of the row.

topic property #

topic: str | None

Get the Kafka topic the record was read from.