3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 37355 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
1360.0 B / 1
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
26907
DAG Visualization
digraph G { subgraph clusterstage_37355 { label="Stage 37355"; 161223 [labelType="html" label="JDBCRDD [161223]<br>cache at <unknown>:0"]; subgraph cluster388520 { label="WholeStageCodegen (1)"; 161224 [labelType="html" label="MapPartitionsRDD [161224]<br>count at <unknown>:0"]; } subgraph cluster388526 { label="mapPartitionsInternal"; 161225 [labelType="html" label="MapPartitionsRDD [161225]<br>count at <unknown>:0"]; } subgraph cluster388527 { label="mapPartitionsInternal"; 161227 [labelType="html" label="*(1) Scan JDBCRelation((SELECT * FROM dbo.dim_compute_pdc_divisions_config WHERE bigid BETWEEN 1 AND 2) AS page) [numPartitions=1] [launch_details_config_name#15146942,division#15146943,brandid#15146944,unique_division_key#15146945,bigid#15146946L] PushedFilters: [], ReadSchema: struct<launch_details_config_name:string,division:string,brandid:string,unique_division_key:strin...\n [161227] [Cached]<br>count at <unknown>:0"]; } subgraph cluster388559 { label="InMemoryTableScan"; 161245 [labelType="html" label="MapPartitionsRDD [161245]<br>count at <unknown>:0"]; 161246 [labelType="html" label="MapPartitionsRDD [161246]<br>count at <unknown>:0"]; 161247 [labelType="html" label="MapPartitionsRDD [161247]<br>count at <unknown>:0"]; } subgraph cluster388555 { label="WholeStageCodegen (1)"; 161248 [labelType="html" label="MapPartitionsRDD [161248]<br>count at <unknown>:0"]; } subgraph cluster388554 { label="Exchange"; 161249 [labelType="html" label="MapPartitionsRDD [161249]<br>count at <unknown>:0"]; } } 161223->161224; 161224->161225; 161225->161227; 161227->161245; 161245->161246; 161246->161247; 161247->161248; 161248->161249; }
161227
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time