crp-order-quantity-kpi-service - Details for Query 132

Submitted Time: 2026/07/19 14:47:22
Duration: 1 s
Succeeded Jobs: 161

Plan Visualization

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [id="node0" labelType="html" label=" DeserializeToObject " tooltip="DeserializeToObject newInstance(class org.apache.spark.sql.delta.actions.AddFile), obj#10254: org.apache.spark.sql.delta.actions.AddFile"]; subgraph cluster1 { isCluster="true"; id="cluster1"; label="WholeStageCodegen (2)"; tooltip="WholeStageCodegen (2)"; 2 [id="node2" labelType="html" label=" Sort " tooltip="Sort [modificationTime#10178L ASC NULLS FIRST, path#10175 ASC NULLS FIRST], true, 0"]; } 3 [id="node3" labelType="html" label="Exchange number of partitions: 1" tooltip="Exchange rangepartitioning(modificationTime#10178L ASC NULLS FIRST, path#10175 ASC NULLS FIRST, 50), REPARTITION_BY_NUM, [plan_id=7448]"]; subgraph cluster4 { isCluster="true"; id="cluster4"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n341 ms (0 ms, 0 ms, 28 ms (stage 319.0: task 1395))"; tooltip="WholeStageCodegen (1)"; 5 [id="node5" labelType="html" label=" Project " tooltip="Project [add#10102.path AS path#10175, add#10102.partitionValues AS partitionValues#10176, add#10102.size AS size#10177L, add#10102.modificationTime AS modificationTime#10178L, add#10102.dataChange AS dataChange#10179, add#10102.stats AS stats#10180, add#10102.tags AS tags#10181, add#10102.deletionVector AS deletionVector#10182, add#10102.baseRowId AS baseRowId#10183L, add#10102.defaultRowCommitVersion AS defaultRowCommitVersion#10184L, add#10102.clusteringProvider AS clusteringProvider#10185]"]; 6 [id="node6" labelType="html" label="Filter number of output rows: 0" tooltip="Filter isnotnull(add#10102)"]; 7 [id="node7" labelType="html" label="Scan ExistingRDD Delta Table State #0 - hdlfs://ced12e6d-bca7-47af-9525-449cba9023d7.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-update/10000001330/stream-10000001330-1/_delta_log number of output rows: 2" tooltip="Scan ExistingRDD Delta Table State #0 - hdlfs://ced12e6d-bca7-47af-9525-449cba9023d7.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-update/10000001330/stream-10000001330-1/_delta_log[txn#10101,add#10102,remove#10103,metaData#10104,protocol#10105,cdc#10106,checkpointMetadata#10107,sidecar#10108,domainMetadata#10109,commitInfo#10110]"]; } 2->0; 3->2; 5->3; 6->5; 7->6; }

Details

== Physical Plan ==
DeserializeToObject (6)
+- * Sort (5)
   +- Exchange (4)
      +- * Project (3)
         +- * Filter (2)
            +- * Scan ExistingRDD Delta Table State #0 - hdlfs://ced12e6d-bca7-47af-9525-449cba9023d7.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-update/10000001330/stream-10000001330-1/_delta_log (1)


(1) Scan ExistingRDD Delta Table State #0 - hdlfs://ced12e6d-bca7-47af-9525-449cba9023d7.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-update/10000001330/stream-10000001330-1/_delta_log [codegen id : 1]
Output [10]: [txn#10101, add#10102, remove#10103, metaData#10104, protocol#10105, cdc#10106, checkpointMetadata#10107, sidecar#10108, domainMetadata#10109, commitInfo#10110]
Arguments: [txn#10101, add#10102, remove#10103, metaData#10104, protocol#10105, cdc#10106, checkpointMetadata#10107, sidecar#10108, domainMetadata#10109, commitInfo#10110], Delta Table State #0 - hdlfs://ced12e6d-bca7-47af-9525-449cba9023d7.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-update/10000001330/stream-10000001330-1/_delta_log MapPartitionsRDD[998] at start at FileStorageAdapterImpl.java:179, ExistingRDD, UnknownPartitioning(0)

(2) Filter [codegen id : 1]
Input [10]: [txn#10101, add#10102, remove#10103, metaData#10104, protocol#10105, cdc#10106, checkpointMetadata#10107, sidecar#10108, domainMetadata#10109, commitInfo#10110]
Condition : isnotnull(add#10102)

(3) Project [codegen id : 1]
Output [11]: [add#10102.path AS path#10175, add#10102.partitionValues AS partitionValues#10176, add#10102.size AS size#10177L, add#10102.modificationTime AS modificationTime#10178L, add#10102.dataChange AS dataChange#10179, add#10102.stats AS stats#10180, add#10102.tags AS tags#10181, add#10102.deletionVector AS deletionVector#10182, add#10102.baseRowId AS baseRowId#10183L, add#10102.defaultRowCommitVersion AS defaultRowCommitVersion#10184L, add#10102.clusteringProvider AS clusteringProvider#10185]
Input [10]: [txn#10101, add#10102, remove#10103, metaData#10104, protocol#10105, cdc#10106, checkpointMetadata#10107, sidecar#10108, domainMetadata#10109, commitInfo#10110]

(4) Exchange
Input [11]: [path#10175, partitionValues#10176, size#10177L, modificationTime#10178L, dataChange#10179, stats#10180, tags#10181, deletionVector#10182, baseRowId#10183L, defaultRowCommitVersion#10184L, clusteringProvider#10185]
Arguments: rangepartitioning(modificationTime#10178L ASC NULLS FIRST, path#10175 ASC NULLS FIRST, 50), REPARTITION_BY_NUM, [plan_id=7448]

(5) Sort [codegen id : 2]
Input [11]: [path#10175, partitionValues#10176, size#10177L, modificationTime#10178L, dataChange#10179, stats#10180, tags#10181, deletionVector#10182, baseRowId#10183L, defaultRowCommitVersion#10184L, clusteringProvider#10185]
Arguments: [modificationTime#10178L ASC NULLS FIRST, path#10175 ASC NULLS FIRST], true, 0

(6) DeserializeToObject
Input [11]: [path#10175, partitionValues#10176, size#10177L, modificationTime#10178L, dataChange#10179, stats#10180, tags#10181, deletionVector#10182, baseRowId#10183L, defaultRowCommitVersion#10184L, clusteringProvider#10185]
Arguments: newInstance(class org.apache.spark.sql.delta.actions.AddFile), obj#10254: org.apache.spark.sql.delta.actions.AddFile

SQL / DataFrame Properties

Name	Value
spark.activity.hdlfsEnabled	true
spark.activity.isolateSession	true
spark.sql.adaptive.enabled	false
spark.sql.cbo.enabled	false
spark.sql.parquet.fieldId.read.enabled	true
spark.sql.parquet.fieldId.write.enabled	true
spark.sql.requireAllClusterKeysForDistribution	false
spark.sql.shuffle.partitions	30
temporal.activity.id	39a35640-8ec8-31d1-b7ca-fda65c8f02d1
temporal.activity.type	RunStreamWithId