3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 40598 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
4.1 KiB / 1
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
25824
DAG Visualization
digraph G { subgraph clusterstage_40598 { label="Stage 40598"; 173216 [labelType="html" label="JDBCRDD [173216]<br>cache at <unknown>:0"]; subgraph cluster412584 { label="WholeStageCodegen (1)"; 173217 [labelType="html" label="MapPartitionsRDD [173217]<br>count at <unknown>:0"]; } subgraph cluster412586 { label="mapPartitionsInternal"; 173218 [labelType="html" label="MapPartitionsRDD [173218]<br>count at <unknown>:0"]; } subgraph cluster412587 { label="mapPartitionsInternal"; 173219 [labelType="html" label="*(1) Scan JDBCRelation((SELECT * FROM dbo.fact_cm_country_analysis WHERE bigid BETWEEN 1 AND 162) AS page) [numPartitions=1] [company_id#20601305,reporting_year#20601306,country_code#20601307,country_name#20601308,total_smelters#20601309,conflict_free_count#20601310,audit_committed_count#20601311,undeterminable_count#20601312,active_smelters#20601313,minerals_list#20601314,is_drc_covered#20601315,etl_runtime#20601316,bigid#20601317L] PushedFilters: [], ReadSchema: struct<company_id:string,reporting_year:int,country_code:string,country_name:string,total_smelter...\n [173219] [Cached]<br>count at <unknown>:0"]; } subgraph cluster412599 { label="InMemoryTableScan"; 173226 [labelType="html" label="MapPartitionsRDD [173226]<br>count at <unknown>:0"]; 173227 [labelType="html" label="MapPartitionsRDD [173227]<br>count at <unknown>:0"]; 173228 [labelType="html" label="MapPartitionsRDD [173228]<br>count at <unknown>:0"]; } subgraph cluster412595 { label="WholeStageCodegen (1)"; 173229 [labelType="html" label="MapPartitionsRDD [173229]<br>count at <unknown>:0"]; } subgraph cluster412594 { label="Exchange"; 173230 [labelType="html" label="MapPartitionsRDD [173230]<br>count at <unknown>:0"]; } } 173216->173217; 173217->173218; 173218->173219; 173219->173226; 173226->173227; 173227->173228; 173228->173229; 173229->173230; }
173219
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time