3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 27568 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
105.4 KiB / 1
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
18614
DAG Visualization
digraph G { subgraph clusterstage_27568 { label="Stage 27568"; 120667 [labelType="html" label="JDBCRDD [120667]<br>cache at <unknown>:0"]; subgraph cluster301837 { label="WholeStageCodegen (1)"; 120668 [labelType="html" label="MapPartitionsRDD [120668]<br>count at <unknown>:0"]; } subgraph cluster301840 { label="mapPartitionsInternal"; 120669 [labelType="html" label="MapPartitionsRDD [120669]<br>count at <unknown>:0"]; } subgraph cluster301841 { label="mapPartitionsInternal"; 120670 [labelType="html" label="*(1) Scan JDBCRelation((SELECT * FROM dbo.fact_cm_smelter_overview WHERE bigid BETWEEN 1 AND 1587) AS page) [numPartitions=1] [company_id#12244547,facility_id#12244548,request_id#12244549,response_id#12244550,launch_id#12244551,reporting_year#12244552,template_type#12244553,request_status#12244554,supplier_id#12244555,supplier_name#12244556,material#12244557,facility_name#12244558,standard_name#12244559,rmap_id#12244560,facility_type#12244561,is_known_facility#12244562,conformance_status#12244563,rmap_status#12244564,country_code#12244565,country_name#12244566,smelter_city#12244567,is_recycled_or_scrap#12244568,smelter_key#12244569,is_drc_covered#12244570,... 2 more fields] PushedFilters: [], ReadSchema: struct<company_id:string,facility_id:string,request_id:string,response_id:string,launch_id:string...\n [120670] [Cached]<br>count at <unknown>:0"]; } subgraph cluster301858 { label="InMemoryTableScan"; 120683 [labelType="html" label="MapPartitionsRDD [120683]<br>count at <unknown>:0"]; 120684 [labelType="html" label="MapPartitionsRDD [120684]<br>count at <unknown>:0"]; 120685 [labelType="html" label="MapPartitionsRDD [120685]<br>count at <unknown>:0"]; } subgraph cluster301854 { label="WholeStageCodegen (1)"; 120686 [labelType="html" label="MapPartitionsRDD [120686]<br>count at <unknown>:0"]; } subgraph cluster301853 { label="Exchange"; 120687 [labelType="html" label="MapPartitionsRDD [120687]<br>count at <unknown>:0"]; } } 120667->120668; 120668->120669; 120669->120670; 120670->120683; 120683->120684; 120684->120685; 120685->120686; 120686->120687; }
120670
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time