Package com.logicalclocks.hsfs.spark.engine.profile
package com.logicalclocks.hsfs.spark.engine.profile
-
ClassesClassDescriptionReplacement for Deequ's
ColumnProfilerRunnerproducing JSON wire-compatible with Deequ 2.0.7-spark-3.5 for all keys exceptkll.Builds a KllDoublesSketch over a numeric column using a distributed mapPartitions approach.Merges per-batch native-format KLL sketches into a single aggregate sketch, then derives a 100-element percentiles vector and a histogram-from-CDF.