3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 40619 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
19.2 MiB / 6
Output Size / Records:
0.0 B / 51785
Associated Job Ids:
25841
DAG Visualization
digraph G { subgraph clusterstage_40619 { label="Stage 40619"; 173167 [labelType="html" label="JDBCRDD [173167]<br>cache at <unknown>:0"]; 173298 [labelType="html" label="SQLExecutionRDD [173298]<br>jdbc at <unknown>:0"]; subgraph cluster412472 { label="WholeStageCodegen (1)"; 173168 [labelType="html" label="MapPartitionsRDD [173168]<br>count at <unknown>:0"]; } subgraph cluster412474 { label="mapPartitionsInternal"; 173169 [labelType="html" label="MapPartitionsRDD [173169]<br>count at <unknown>:0"]; } subgraph cluster412475 { label="mapPartitionsInternal"; 173170 [labelType="html" label="*(1) Scan JDBCRelation(dbo.ForcedLabor_Kharon) [numPartitions=1] [Kharon_ID#20599023,Name#20599024,Entity_Type#20599025,Risk_Labels#20599026,Notes#20599027,Primary_City#20599028,Primary_Country#20599029,URL#20599030] PushedFilters: [], ReadSchema: struct<Kharon_ID:string,Name:string,Entity_Type:string,Risk_Labels:string,Notes:string,Primary_Ci...\n [173170] [Cached]<br>count at <unknown>:0"]; } subgraph cluster412760 { label="InMemoryTableScan"; 173294 [labelType="html" label="MapPartitionsRDD [173294]<br>jdbc at <unknown>:0"]; 173295 [labelType="html" label="MapPartitionsRDD [173295]<br>jdbc at <unknown>:0"]; 173296 [labelType="html" label="MapPartitionsRDD [173296]<br>jdbc at <unknown>:0"]; } subgraph cluster412758 { label="DeserializeToObject"; 173297 [labelType="html" label="MapPartitionsRDD [173297]<br>jdbc at <unknown>:0"]; } subgraph cluster412761 { label="mapPartitions"; 173299 [labelType="html" label="MapPartitionsRDD [173299]<br>jdbc at <unknown>:0"]; } } 173167->173168; 173168->173169; 173169->173170; 173170->173294; 173294->173295; 173295->173296; 173296->173297; 173297->173298; 173298->173299; }
173170
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time