Validation

[source]

ValidationResult

hsfs.validation_result.ValidationResult(
    status,
    message,
    value,
    features,
    rule,
    href=None,
    expand=None,
    items=None,
    count=None,
    type=None,
)

Metadata object representing the validation result of a single rule of an expectation result of a Feature Group.

---

Properties

[source]

features

Feature of the validation result on which the rule was applied.

---

[source]

message

Message describing the outcome of applying the rule against the feature.

---

[source]

rule

Feature of the validation result on which the rule was applied.

---

[source]

status

---

[source]

value

The computed value of the feature according to the rule.

---

Methods

{{expectation_methods}}

Validate a dataframe

[source]

validate

FeatureGroup.validate(dataframe=None, log_activity=False)

Run validation based on the attached expectations

Arguments

• dataframe Optional[pyspark.sql.DataFrame]: The PySpark dataframe to run the data validation expectations against.
• log_activity: Whether to log the validation as a feature group activity. If a dataframe is not provided (None), the validation will be logged as a feature store activity.

Returns

FeatureGroupValidation. The feature group validation metadata object.

---

Retrieval

[source]

get_validations

FeatureGroup.get_validations(validation_time=None, commit_time=None)

Get feature group data validation results based on the attached expectations.

Arguments

• validation_time: The data validation time, when the data validation started. commit_time: The commit time of a time travel enabled feature group.

Returns

FeatureGroupValidation. The feature group validation metadata object.

---