3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 43642 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
4.1 KiB / 1
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
32398
DAG Visualization
digraph G { subgraph clusterstage_43642 { label="Stage 43642"; 189823 [labelType="html" label="JDBCRDD [189823]<br>cache at <unknown>:0"]; subgraph cluster447534 { label="WholeStageCodegen (1)"; 189824 [labelType="html" label="MapPartitionsRDD [189824]<br>count at <unknown>:0"]; } subgraph cluster447536 { label="mapPartitionsInternal"; 189825 [labelType="html" label="MapPartitionsRDD [189825]<br>count at <unknown>:0"]; } subgraph cluster447537 { label="mapPartitionsInternal"; 189826 [labelType="html" label="*(1) Scan JDBCRelation((SELECT * FROM dbo.fact_cm_country_analysis WHERE bigid BETWEEN 1 AND 162) AS page) [numPartitions=1] [company_id#17201568,reporting_year#17201569,country_code#17201570,country_name#17201571,total_smelters#17201572,conflict_free_count#17201573,audit_committed_count#17201574,undeterminable_count#17201575,active_smelters#17201576,minerals_list#17201577,is_drc_covered#17201578,etl_runtime#17201579,bigid#17201580L] PushedFilters: [], ReadSchema: struct<company_id:string,reporting_year:int,country_code:string,country_name:string,total_smelter...\n [189826] [Cached]<br>count at <unknown>:0"]; } subgraph cluster447586 { label="InMemoryTableScan"; 189842 [labelType="html" label="MapPartitionsRDD [189842]<br>count at <unknown>:0"]; 189843 [labelType="html" label="MapPartitionsRDD [189843]<br>count at <unknown>:0"]; 189844 [labelType="html" label="MapPartitionsRDD [189844]<br>count at <unknown>:0"]; } subgraph cluster447582 { label="WholeStageCodegen (1)"; 189845 [labelType="html" label="MapPartitionsRDD [189845]<br>count at <unknown>:0"]; } subgraph cluster447581 { label="Exchange"; 189846 [labelType="html" label="MapPartitionsRDD [189846]<br>count at <unknown>:0"]; } } 189823->189824; 189824->189825; 189825->189826; 189826->189842; 189842->189843; 189843->189844; 189844->189845; 189845->189846; }
189826
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time