3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 3261 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
8.2 KiB / 1
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
2575
DAG Visualization
digraph G { subgraph clusterstage_3261 { label="Stage 3261"; 11595 [labelType="html" label="JDBCRDD [11595]<br>cache at <unknown>:0"]; subgraph cluster26392 { label="WholeStageCodegen (1)"; 11596 [labelType="html" label="MapPartitionsRDD [11596]<br>count at <unknown>:0"]; } subgraph cluster26394 { label="mapPartitionsInternal"; 11597 [labelType="html" label="MapPartitionsRDD [11597]<br>count at <unknown>:0"]; } subgraph cluster26395 { label="mapPartitionsInternal"; 11598 [labelType="html" label="*(1) Scan JDBCRelation((SELECT * FROM dbo.fact_cm_supplier_response WHERE bigid BETWEEN 1 AND 37) AS page) [numPartitions=1] [company_id#1018095,request_id#1018096,launch_id#1018097,reporting_year#1018098,template_type#1018099,supplier_id#1018100,supplier_name#1018101,request_status#1018102,due_ts#1018103,approved_ts#1018104,submitted_ts#1018105,is_submitted#1018106,is_overdue#1018107,total_smelters#1018108,conflict_free_count#1018109,audit_committed_count#1018110,undeterminable_count#1018111,undeterminable_not_in_rmi_count#1018112,undeterminable_not_identified_count#1018113,recycled_count#1018114,supplier_country#1018115,supplier_country_code#1018116,minerals#1018117,etl_runtime#1018118,bigid#1018119L] PushedFilters: [], ReadSchema: struct<company_id:string,request_id:string,launch_id:string,reporting_year:int,template_type:stri...\n [11598] [Cached]<br>count at <unknown>:0"]; } subgraph cluster26431 { label="InMemoryTableScan"; 11611 [labelType="html" label="MapPartitionsRDD [11611]<br>count at <unknown>:0"]; 11612 [labelType="html" label="MapPartitionsRDD [11612]<br>count at <unknown>:0"]; 11613 [labelType="html" label="MapPartitionsRDD [11613]<br>count at <unknown>:0"]; } subgraph cluster26427 { label="WholeStageCodegen (1)"; 11614 [labelType="html" label="MapPartitionsRDD [11614]<br>count at <unknown>:0"]; } subgraph cluster26426 { label="Exchange"; 11615 [labelType="html" label="MapPartitionsRDD [11615]<br>count at <unknown>:0"]; } } 11595->11596; 11596->11597; 11597->11598; 11598->11611; 11611->11612; 11612->11613; 11613->11614; 11614->11615; }
11598
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time