3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 38290 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
50 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
1360.0 B / 1
Output Size / Records:
0.0 B / 2
Associated Job Ids:
27656
DAG Visualization
digraph G { subgraph clusterstage_38290 { label="Stage 38290"; 164525 [labelType="html" label="JDBCRDD [164525]<br>cache at <unknown>:0"]; 164583 [labelType="html" label="SQLExecutionRDD [164583]<br>jdbc at <unknown>:0"]; subgraph cluster395959 { label="WholeStageCodegen (1)"; 164526 [labelType="html" label="MapPartitionsRDD [164526]<br>count at <unknown>:0"]; } subgraph cluster395961 { label="mapPartitionsInternal"; 164527 [labelType="html" label="MapPartitionsRDD [164527]<br>count at <unknown>:0"]; } subgraph cluster395962 { label="mapPartitionsInternal"; 164528 [labelType="html" label="*(1) Scan JDBCRelation((SELECT * FROM dbo.dim_compute_pdc_divisions_config WHERE bigid BETWEEN 1 AND 2) AS page) [numPartitions=1] [launch_details_config_name#15469901,division#15469902,brandid#15469903,unique_division_key#15469904,bigid#15469905L] PushedFilters: [], ReadSchema: struct<launch_details_config_name:string,division:string,brandid:string,unique_division_key:strin...\n [164528] [Cached]<br>count at <unknown>:0"]; } subgraph cluster396084 { label="InMemoryTableScan"; 164579 [labelType="html" label="MapPartitionsRDD [164579]<br>jdbc at <unknown>:0"]; 164580 [labelType="html" label="MapPartitionsRDD [164580]<br>jdbc at <unknown>:0"]; 164581 [labelType="html" label="MapPartitionsRDD [164581]<br>jdbc at <unknown>:0"]; } subgraph cluster396082 { label="DeserializeToObject"; 164582 [labelType="html" label="MapPartitionsRDD [164582]<br>jdbc at <unknown>:0"]; } subgraph cluster396085 { label="mapPartitions"; 164584 [labelType="html" label="MapPartitionsRDD [164584]<br>jdbc at <unknown>:0"]; } } 164525->164526; 164526->164527; 164527->164528; 164528->164579; 164579->164580; 164580->164581; 164581->164582; 164582->164583; 164583->164584; }
164528
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time