Skip to content

hsfs.statistics_config #

StatisticsConfig #

columns property writable #

Specify a subset of columns to compute statistics for.

correlations property writable #

Enable correlations as an additional statistic to be computed for each feature pair.

enabled property writable #

Enable statistics, by default this computes only descriptive statistics.

exact_uniqueness property writable #

Enable exact uniqueness as an additional statistic to be computed for each feature.

histogram_bins property writable #

histogram_bins: int | None

Number of histogram bins to compute. If None, Deequ's default (20) is used.

histograms property writable #

Enable histograms as an additional statistic to be computed for each feature.

kll property writable #

kll: bool

Enable KLL sketch computation for approximate quantile estimation.