3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 37368 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Process local: 1
Input Size / Records:
1360.0 B / 1
Output Size / Records:
0.0 B / 2
Associated Job Ids:
26916
DAG Visualization
digraph G { subgraph clusterstage_37368 { label="Stage 37368"; 161223 [labelType="html" label="JDBCRDD [161223]<br>cache at <unknown>:0"]; 161284 [labelType="html" label="SQLExecutionRDD [161284]<br>jdbc at <unknown>:0"]; subgraph cluster388520 { label="WholeStageCodegen (1)"; 161224 [labelType="html" label="MapPartitionsRDD [161224]<br>count at <unknown>:0"]; } subgraph cluster388526 { label="mapPartitionsInternal"; 161225 [labelType="html" label="MapPartitionsRDD [161225]<br>count at <unknown>:0"]; } subgraph cluster388527 { label="mapPartitionsInternal"; 161227 [labelType="html" label="*(1) Scan JDBCRelation((SELECT * FROM dbo.dim_compute_pdc_divisions_config WHERE bigid BETWEEN 1 AND 2) AS page) [numPartitions=1] [launch_details_config_name#15146942,division#15146943,brandid#15146944,unique_division_key#15146945,bigid#15146946L] PushedFilters: [], ReadSchema: struct<launch_details_config_name:string,division:string,brandid:string,unique_division_key:strin...\n [161227] [Cached]<br>count at <unknown>:0"]; } subgraph cluster388670 { label="InMemoryTableScan"; 161280 [labelType="html" label="MapPartitionsRDD [161280]<br>jdbc at <unknown>:0"]; 161281 [labelType="html" label="MapPartitionsRDD [161281]<br>jdbc at <unknown>:0"]; 161282 [labelType="html" label="MapPartitionsRDD [161282]<br>jdbc at <unknown>:0"]; } subgraph cluster388668 { label="DeserializeToObject"; 161283 [labelType="html" label="MapPartitionsRDD [161283]<br>jdbc at <unknown>:0"]; } subgraph cluster388671 { label="mapPartitions"; 161285 [labelType="html" label="MapPartitionsRDD [161285]<br>jdbc at <unknown>:0"]; } } 161223->161224; 161224->161225; 161225->161227; 161227->161280; 161280->161281; 161281->161282; 161282->161283; 161283->161284; 161284->161285; }
161227
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time