4.0.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-quantity-kpi-service
application UI
Details for Stage 101170 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 33
Input Size / Records:
0.0 B / 434
Shuffle Write Size / Records:
2.7 MiB / 434
Associated Job Ids:
5520
DAG Visualization
digraph G { id="graph_101170"; subgraph graph_stage_101170 { id="graph_stage_101170"; isCluster="true"; label="Stage 101170"; subgraph cluster_124684 { id="cluster_124684"; isCluster="true"; label="Scan parquet "; 47751 [id="node_47751" labelType="html" label="FileScanRDD [47751]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 47756 [id="node_47756" labelType="html" label="MapPartitionsRDD [47756]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_124658 { id="cluster_124658"; isCluster="true"; label="WholeStageCodegen (23)"; 47760 [id="node_47760" labelType="html" label="MapPartitionsRDD [47760]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_124657 { id="cluster_124657"; isCluster="true"; label="Exchange"; 47765 [id="node_47765" labelType="html" label="MapPartitionsRDD [47765]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } } 47751->47756; 47756->47760; 47760->47765; }
Event Timeline
Enable zooming
Tasks: 33. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time