3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 40605 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
8.2 KiB / 1
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
25830
DAG Visualization
digraph G { subgraph clusterstage_40605 { label="Stage 40605"; 173246 [labelType="html" label="JDBCRDD [173246]<br>cache at <unknown>:0"]; subgraph cluster412644 { label="WholeStageCodegen (1)"; 173247 [labelType="html" label="MapPartitionsRDD [173247]<br>count at <unknown>:0"]; } subgraph cluster412646 { label="mapPartitionsInternal"; 173248 [labelType="html" label="MapPartitionsRDD [173248]<br>count at <unknown>:0"]; } subgraph cluster412647 { label="mapPartitionsInternal"; 173249 [labelType="html" label="*(1) Scan JDBCRelation((SELECT * FROM dbo.fact_cm_supplier_response WHERE bigid BETWEEN 1 AND 37) AS page) [numPartitions=1] [company_id#20602148,request_id#20602149,launch_id#20602150,reporting_year#20602151,template_type#20602152,supplier_id#20602153,supplier_name#20602154,request_status#20602155,due_ts#20602156,approved_ts#20602157,submitted_ts#20602158,is_submitted#20602159,is_overdue#20602160,total_smelters#20602161,conflict_free_count#20602162,audit_committed_count#20602163,undeterminable_count#20602164,undeterminable_not_in_rmi_count#20602165,undeterminable_not_identified_count#20602166,recycled_count#20602167,supplier_country#20602168,supplier_country_code#20602169,minerals#20602170,etl_runtime#20602171,bigid#20602172L] PushedFilters: [], ReadSchema: struct<company_id:string,request_id:string,launch_id:string,reporting_year:int,template_type:stri...\n [173249] [Cached]<br>count at <unknown>:0"]; } subgraph cluster412660 { label="InMemoryTableScan"; 173250 [labelType="html" label="MapPartitionsRDD [173250]<br>count at <unknown>:0"]; 173251 [labelType="html" label="MapPartitionsRDD [173251]<br>count at <unknown>:0"]; 173252 [labelType="html" label="MapPartitionsRDD [173252]<br>count at <unknown>:0"]; } subgraph cluster412656 { label="WholeStageCodegen (1)"; 173253 [labelType="html" label="MapPartitionsRDD [173253]<br>count at <unknown>:0"]; } subgraph cluster412655 { label="Exchange"; 173254 [labelType="html" label="MapPartitionsRDD [173254]<br>count at <unknown>:0"]; } } 173246->173247; 173247->173248; 173248->173249; 173249->173250; 173250->173251; 173251->173252; 173252->173253; 173253->173254; }
173249
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time