3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 27558 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
8.2 KiB / 1
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
18606
DAG Visualization
digraph G { subgraph clusterstage_27558 { label="Stage 27558"; 120637 [labelType="html" label="JDBCRDD [120637]<br>cache at <unknown>:0"]; subgraph cluster301761 { label="WholeStageCodegen (1)"; 120638 [labelType="html" label="MapPartitionsRDD [120638]<br>count at <unknown>:0"]; } subgraph cluster301763 { label="mapPartitionsInternal"; 120639 [labelType="html" label="MapPartitionsRDD [120639]<br>count at <unknown>:0"]; } subgraph cluster301764 { label="mapPartitionsInternal"; 120640 [labelType="html" label="*(1) Scan JDBCRelation((SELECT * FROM dbo.fact_cm_supplier_response WHERE bigid BETWEEN 1 AND 37) AS page) [numPartitions=1] [company_id#12238899,request_id#12238900,launch_id#12238901,reporting_year#12238902,template_type#12238903,supplier_id#12238904,supplier_name#12238905,request_status#12238906,due_ts#12238907,approved_ts#12238908,submitted_ts#12238909,is_submitted#12238910,is_overdue#12238911,total_smelters#12238912,conflict_free_count#12238913,audit_committed_count#12238914,undeterminable_count#12238915,undeterminable_not_in_rmi_count#12238916,undeterminable_not_identified_count#12238917,recycled_count#12238918,supplier_country#12238919,supplier_country_code#12238920,minerals#12238921,etl_runtime#12238922,bigid#12238923L] PushedFilters: [], ReadSchema: struct<company_id:string,request_id:string,launch_id:string,reporting_year:int,template_type:stri...\n [120640] [Cached]<br>count at <unknown>:0"]; } subgraph cluster301783 { label="InMemoryTableScan"; 120648 [labelType="html" label="MapPartitionsRDD [120648]<br>count at <unknown>:0"]; 120649 [labelType="html" label="MapPartitionsRDD [120649]<br>count at <unknown>:0"]; 120650 [labelType="html" label="MapPartitionsRDD [120650]<br>count at <unknown>:0"]; } subgraph cluster301779 { label="WholeStageCodegen (1)"; 120651 [labelType="html" label="MapPartitionsRDD [120651]<br>count at <unknown>:0"]; } subgraph cluster301778 { label="Exchange"; 120652 [labelType="html" label="MapPartitionsRDD [120652]<br>count at <unknown>:0"]; } } 120637->120638; 120638->120639; 120639->120640; 120640->120648; 120648->120649; 120649->120650; 120650->120651; 120651->120652; }
120640
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time