3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 43656 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
58 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
8.2 KiB / 1
Output Size / Records:
0.0 B / 37
Associated Job Ids:
32409
DAG Visualization
digraph G { subgraph clusterstage_43656 { label="Stage 43656"; 189832 [labelType="html" label="JDBCRDD [189832]<br>cache at <unknown>:0"]; 189893 [labelType="html" label="SQLExecutionRDD [189893]<br>jdbc at <unknown>:0"]; subgraph cluster447571 { label="WholeStageCodegen (1)"; 189833 [labelType="html" label="MapPartitionsRDD [189833]<br>count at <unknown>:0"]; } subgraph cluster447574 { label="mapPartitionsInternal"; 189834 [labelType="html" label="MapPartitionsRDD [189834]<br>count at <unknown>:0"]; } subgraph cluster447575 { label="mapPartitionsInternal"; 189835 [labelType="html" label="*(1) Scan JDBCRelation((SELECT * FROM dbo.fact_cm_supplier_response WHERE bigid BETWEEN 1 AND 37) AS page) [numPartitions=1] [company_id#17202003,request_id#17202004,launch_id#17202005,reporting_year#17202006,template_type#17202007,supplier_id#17202008,supplier_name#17202009,request_status#17202010,due_ts#17202011,approved_ts#17202012,submitted_ts#17202013,is_submitted#17202014,is_overdue#17202015,total_smelters#17202016,conflict_free_count#17202017,audit_committed_count#17202018,undeterminable_count#17202019,undeterminable_not_in_rmi_count#17202020,undeterminable_not_identified_count#17202021,recycled_count#17202022,supplier_country#17202023,supplier_country_code#17202024,minerals#17202025,etl_runtime#17202026,bigid#17202027L] PushedFilters: [], ReadSchema: struct<company_id:string,request_id:string,launch_id:string,reporting_year:int,template_type:stri...\n [189835] [Cached]<br>count at <unknown>:0"]; } subgraph cluster447703 { label="InMemoryTableScan"; 189887 [labelType="html" label="MapPartitionsRDD [189887]<br>jdbc at <unknown>:0"]; 189888 [labelType="html" label="MapPartitionsRDD [189888]<br>jdbc at <unknown>:0"]; 189890 [labelType="html" label="MapPartitionsRDD [189890]<br>jdbc at <unknown>:0"]; } subgraph cluster447701 { label="DeserializeToObject"; 189892 [labelType="html" label="MapPartitionsRDD [189892]<br>jdbc at <unknown>:0"]; } subgraph cluster447705 { label="mapPartitions"; 189894 [labelType="html" label="MapPartitionsRDD [189894]<br>jdbc at <unknown>:0"]; } } 189832->189833; 189833->189834; 189834->189835; 189835->189887; 189887->189888; 189888->189890; 189890->189892; 189892->189893; 189893->189894; }
189835
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time