== Physical Plan ==
* Project (3)
+- * Filter (2)
+- * Scan ExistingRDD Delta Table State with Stats #556 - hdlfs://ced12e6d-bca7-47af-9525-449cba9023d7.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log (1)
(1) Scan ExistingRDD Delta Table State with Stats #556 - hdlfs://ced12e6d-bca7-47af-9525-449cba9023d7.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log [codegen id : 1]
Output [11]: [path#1201575, partitionValues#1201576, size#1201577L, modificationTime#1201578L, dataChange#1201579, stats#1201586, tags#1201581, deletionVector#1201582, baseRowId#1201583L, defaultRowCommitVersion#1201584L, clusteringProvider#1201585]
Arguments: [path#1201575, partitionValues#1201576, size#1201577L, modificationTime#1201578L, dataChange#1201579, stats#1201586, tags#1201581, deletionVector#1201582, baseRowId#1201583L, defaultRowCommitVersion#1201584L, clusteringProvider#1201585], Delta Table State with Stats #556 - hdlfs://ced12e6d-bca7-47af-9525-449cba9023d7.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log MapPartitionsRDD[69050] at $anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128, ExistingRDD, UnknownPartitioning(0)
(2) Filter [codegen id : 1]
Input [11]: [path#1201575, partitionValues#1201576, size#1201577L, modificationTime#1201578L, dataChange#1201579, stats#1201586, tags#1201581, deletionVector#1201582, baseRowId#1201583L, defaultRowCommitVersion#1201584L, clusteringProvider#1201585]
Condition : ((UDF(true, size#1201577L, (stats#1201586.numRecords - coalesce(deletionVector#1201582.cardinality, 0)), stats#1201586.numRecords) AND UDF(true, size#1201577L, (stats#1201586.numRecords - coalesce(deletionVector#1201582.cardinality, 0)), stats#1201586.numRecords)) AND if (isnull((((stats#1201586.nullCount.marketUnit < stats#1201586.numRecords) AND ((stats#1201586.minValues.marketUnit <= Grocery_SS) AND (Grocery_SS <= stats#1201586.maxValues.marketUnit))) OR (((isnull(stats#1201586.nullCount.marketUnit) OR isnull(stats#1201586.numRecords)) OR (isnull(stats#1201586.minValues.marketUnit) AND NOT (stats#1201586.nullCount.marketUnit = stats#1201586.numRecords))) OR (isnull(stats#1201586.maxValues.marketUnit) AND NOT (stats#1201586.nullCount.marketUnit = stats#1201586.numRecords)))))) false else UDF(knownnotnull((((stats#1201586.nullCount.marketUnit < stats#1201586.numRecords) AND ((stats#1201586.minValues.marketUnit <= Grocery_SS) AND (Grocery_SS <= stats#1201586.maxValues.marketUnit))) OR (((isnull(stats#1201586.nullCount.marketUnit) OR isnull(stats#1201586.numRecords)) OR (isnull(stats#1201586.minValues.marketUnit) AND NOT (stats#1201586.nullCount.marketUnit = stats#1201586.numRecords))) OR (isnull(stats#1201586.maxValues.marketUnit) AND NOT (stats#1201586.nullCount.marketUnit = stats#1201586.numRecords))))), size#1201577L, (stats#1201586.numRecords - coalesce(deletionVector#1201582.cardinality, 0)), stats#1201586.numRecords))
(3) Project [codegen id : 1]
Output [11]: [path#1201575, partitionValues#1201576, size#1201577L, modificationTime#1201578L, dataChange#1201579, null AS stats#1201629, tags#1201581, deletionVector#1201582, baseRowId#1201583L, defaultRowCommitVersion#1201584L, clusteringProvider#1201585]
Input [11]: [path#1201575, partitionValues#1201576, size#1201577L, modificationTime#1201578L, dataChange#1201579, stats#1201586, tags#1201581, deletionVector#1201582, baseRowId#1201583L, defaultRowCommitVersion#1201584L, clusteringProvider#1201585]