3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 37334 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
19.2 MiB / 6
Output Size / Records:
0.0 B / 51785
Associated Job Ids:
26888
DAG Visualization
digraph G { subgraph clusterstage_37334 { label="Stage 37334"; 161113 [labelType="html" label="JDBCRDD [161113]<br>cache at <unknown>:0"]; 161174 [labelType="html" label="SQLExecutionRDD [161174]<br>jdbc at <unknown>:0"]; subgraph cluster388246 { label="WholeStageCodegen (1)"; 161114 [labelType="html" label="MapPartitionsRDD [161114]<br>count at <unknown>:0"]; } subgraph cluster388248 { label="mapPartitionsInternal"; 161115 [labelType="html" label="MapPartitionsRDD [161115]<br>count at <unknown>:0"]; } subgraph cluster388249 { label="mapPartitionsInternal"; 161116 [labelType="html" label="*(1) Scan JDBCRelation(dbo.ForcedLabor_Kharon) [numPartitions=1] [Kharon_ID#15134145,Name#15134146,Entity_Type#15134147,Risk_Labels#15134148,Notes#15134149,Primary_City#15134150,Primary_Country#15134151,URL#15134152] PushedFilters: [], ReadSchema: struct<Kharon_ID:string,Name:string,Entity_Type:string,Risk_Labels:string,Notes:string,Primary_Ci...\n [161116] [Cached]<br>count at <unknown>:0"]; } subgraph cluster388404 { label="InMemoryTableScan"; 161170 [labelType="html" label="MapPartitionsRDD [161170]<br>jdbc at <unknown>:0"]; 161171 [labelType="html" label="MapPartitionsRDD [161171]<br>jdbc at <unknown>:0"]; 161172 [labelType="html" label="MapPartitionsRDD [161172]<br>jdbc at <unknown>:0"]; } subgraph cluster388402 { label="DeserializeToObject"; 161173 [labelType="html" label="MapPartitionsRDD [161173]<br>jdbc at <unknown>:0"]; } subgraph cluster388405 { label="mapPartitions"; 161175 [labelType="html" label="MapPartitionsRDD [161175]<br>jdbc at <unknown>:0"]; } } 161113->161114; 161114->161115; 161115->161116; 161116->161170; 161170->161171; 161171->161172; 161172->161173; 161173->161174; 161174->161175; }
161116
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time