3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 34932 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
8.2 KiB / 1
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
25006
DAG Visualization
digraph G { subgraph clusterstage_34932 { label="Stage 34932"; 152865 [labelType="html" label="JDBCRDD [152865]<br>cache at <unknown>:0"]; subgraph cluster369004 { label="WholeStageCodegen (1)"; 152871 [labelType="html" label="MapPartitionsRDD [152871]<br>count at <unknown>:0"]; } subgraph cluster369012 { label="mapPartitionsInternal"; 152872 [labelType="html" label="MapPartitionsRDD [152872]<br>count at <unknown>:0"]; } subgraph cluster369013 { label="mapPartitionsInternal"; 152873 [labelType="html" label="*(1) Scan JDBCRelation((SELECT * FROM dbo.fact_cm_supplier_response WHERE bigid BETWEEN 1 AND 37) AS page) [numPartitions=1] [company_id#14547837,request_id#14547838,launch_id#14547839,reporting_year#14547840,template_type#14547841,supplier_id#14547842,supplier_name#14547843,request_status#14547844,due_ts#14547845,approved_ts#14547846,submitted_ts#14547847,is_submitted#14547848,is_overdue#14547849,total_smelters#14547850,conflict_free_count#14547851,audit_committed_count#14547852,undeterminable_count#14547853,undeterminable_not_in_rmi_count#14547854,undeterminable_not_identified_count#14547855,recycled_count#14547856,supplier_country#14547857,supplier_country_code#14547858,minerals#14547859,etl_runtime#14547860,bigid#14547861L] PushedFilters: [], ReadSchema: struct<company_id:string,request_id:string,launch_id:string,reporting_year:int,template_type:stri...\n [152873] [Cached]<br>count at <unknown>:0"]; } subgraph cluster369041 { label="InMemoryTableScan"; 152890 [labelType="html" label="MapPartitionsRDD [152890]<br>count at <unknown>:0"]; 152891 [labelType="html" label="MapPartitionsRDD [152891]<br>count at <unknown>:0"]; 152892 [labelType="html" label="MapPartitionsRDD [152892]<br>count at <unknown>:0"]; } subgraph cluster369037 { label="WholeStageCodegen (1)"; 152893 [labelType="html" label="MapPartitionsRDD [152893]<br>count at <unknown>:0"]; } subgraph cluster369036 { label="Exchange"; 152894 [labelType="html" label="MapPartitionsRDD [152894]<br>count at <unknown>:0"]; } } 152865->152871; 152871->152872; 152872->152873; 152873->152890; 152890->152891; 152891->152892; 152892->152893; 152893->152894; }
152873
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time