3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 37324 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
19.2 MiB / 6
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
26880
DAG Visualization
digraph G { subgraph clusterstage_37324 { label="Stage 37324"; 161113 [labelType="html" label="JDBCRDD [161113]<br>cache at <unknown>:0"]; subgraph cluster388246 { label="WholeStageCodegen (1)"; 161114 [labelType="html" label="MapPartitionsRDD [161114]<br>count at <unknown>:0"]; } subgraph cluster388248 { label="mapPartitionsInternal"; 161115 [labelType="html" label="MapPartitionsRDD [161115]<br>count at <unknown>:0"]; } subgraph cluster388249 { label="mapPartitionsInternal"; 161116 [labelType="html" label="*(1) Scan JDBCRelation(dbo.ForcedLabor_Kharon) [numPartitions=1] [Kharon_ID#15134145,Name#15134146,Entity_Type#15134147,Risk_Labels#15134148,Notes#15134149,Primary_City#15134150,Primary_Country#15134151,URL#15134152] PushedFilters: [], ReadSchema: struct<Kharon_ID:string,Name:string,Entity_Type:string,Risk_Labels:string,Notes:string,Primary_Ci...\n [161116] [Cached]<br>count at <unknown>:0"]; } subgraph cluster388293 { label="InMemoryTableScan"; 161134 [labelType="html" label="MapPartitionsRDD [161134]<br>count at <unknown>:0"]; 161135 [labelType="html" label="MapPartitionsRDD [161135]<br>count at <unknown>:0"]; 161136 [labelType="html" label="MapPartitionsRDD [161136]<br>count at <unknown>:0"]; } subgraph cluster388289 { label="WholeStageCodegen (1)"; 161137 [labelType="html" label="MapPartitionsRDD [161137]<br>count at <unknown>:0"]; } subgraph cluster388288 { label="Exchange"; 161138 [labelType="html" label="MapPartitionsRDD [161138]<br>count at <unknown>:0"]; } } 161113->161114; 161114->161115; 161115->161116; 161116->161134; 161134->161135; 161135->161136; 161136->161137; 161137->161138; }
161116
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time