Feature Descriptive Statistics#

FeatureDescriptiveStatistics#

hsfs.core.feature_descriptive_statistics.FeatureDescriptiveStatistics(
    feature_name,
    feature_type=None,
    count=None,
    completeness=None,
    num_non_null_values=None,
    num_null_values=None,
    approx_num_distinct_values=None,
    min=None,
    max=None,
    sum=None,
    mean=None,
    stddev=None,
    percentiles=None,
    distinctness=None,
    entropy=None,
    uniqueness=None,
    exact_num_distinct_values=None,
    extended_statistics=None,
    id=None,
    **kwargs
)

Properties#

[source]

approx_num_distinct_values#

Approximate number of distinct values.

[source]

completeness#

Fraction of non-null values in a column.

[source]

count#

Number of values.

[source]

distinctness#

Fraction of distinct values of a feature over the number of all its values. Distinct values occur at least once.

Example

$[a, a, b]$ contains two distinct values $a$ and $b$ , so distinctness is $2/3$ .

[source]

entropy#

Entropy is a measure of the level of information contained in an event (feature value) when considering all possible events (all feature values). Entropy is estimated using observed value counts as the negative sum of (value_count/total_count) * log(value_count/total_count).

Example

$[a, b, b, c, c]$ has three distinct values with counts $[1, 2, 2]$ .

Entropy is then $(-1/5*log(1/5)-2/5*log(2/5)-2/5*log(2/5)) = 1.055$ .

[source]