Skip to content

Validation#

[source]

ValidationResult#

hsfs.validation_result.ValidationResult(
    status,
    message,
    value,
    features,
    rule,
    href=None,
    expand=None,
    items=None,
    count=None,
    type=None,
)

Metadata object representing the validation result of a single rule of an expectation result of a Feature Group.

Properties#

[source]

features#

Feature of the validation result on which the rule was applied.

[source]

message#

Message describing the outcome of applying the rule against the feature.

[source]

rule#

Feature of the validation result on which the rule was applied.

[source]

status#

[source]

value#

The computed value of the feature according to the rule.

Methods#

{{expectation_methods}}

Validate a dataframe#

[source]

validate#

FeatureGroup.validate(dataframe)

Run validation based on the attached expectations

Arguments

  • dataframe pyspark.sql.DataFrame: The PySpark dataframe to run the data validation expecations against.

Returns

FeatureGroupValidation. The feature group validation metadata object.

Retrieval#

[source]

get_validations#

FeatureGroup.get_validations(validation_time=None, commit_time=None)

Get feature group data validation results based on the attached expectations

Arguments

  • validation_time: The data validation time, when the data validation started. commit_time: The commit time of a time travel enabled feature group.

Returns

FeatureGroupValidation. The feature group validation metadata object.