3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 30133 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
84 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
11.9 KiB / 1
Output Size / Records:
0.0 B / 3
Associated Job Ids:
20630
DAG Visualization
digraph G { subgraph clusterstage_30133 { label="Stage 30133"; 129633 [labelType="html" label="SQLExecutionRDD [129633] [Unordered]<br>jdbc at <unknown>:0"]; subgraph cluster322238 { label="Exchange"; 129470 [labelType="html" label="ShuffledRowRDD [129470] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster322229 { label="WholeStageCodegen (3)"; 129471 [labelType="html" label="MapPartitionsRDD [129471] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster321838 { label="AdaptiveSparkPlan"; 129472 [labelType="html" label="MapPartitionsRDD [129472] [Unordered]<br>javaToPython at <unknown>:0"]; 129473 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Project [brand_context_id#12896487, company_id#12896488, launch_config_ref#12896489, revision_version#12896490, summary__config_name#12905426, summary__config_version#12905427, summary__entity_id#12905429, summary__submission_status#12905431, summary__is_latest#12905432, summary__is_editable#12905572, summary__launch_date#12905573, summary__expiry_date#12905574, summary__submitted_date#12905575, summary__create_ts#12905577, summary__update_ts#12905579, summary__create_date#12905583, summary__update_date#12905585, summary__source#12905587, summary__recurrence_count#12905589, summary__priority#12905591, summary__remarks#12905593, summary__latest_source#12905595, summary__launch_request_name#12905667, summary__NetworkID#12905669, ... 49 more fields]\n +- BroadcastHashJoin [brand_context_id#12896487, company_id#12896488, launch_config_ref#12896489, revision_version#12896490], [brand_context_id#12899515, company_id#12899516, launch_config_ref#12899517, revision_version#12... [129473] [Cached] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster322554 { label="InMemoryTableScan"; 129626 [labelType="html" label="MapPartitionsRDD [129626] [Unordered]<br>jdbc at <unknown>:0"]; 129627 [labelType="html" label="MapPartitionsRDD [129627] [Unordered]<br>jdbc at <unknown>:0"]; 129628 [labelType="html" label="MapPartitionsRDD [129628] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322552 { label="Filter"; 129629 [labelType="html" label="MapPartitionsRDD [129629] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322551 { label="Project"; 129630 [labelType="html" label="MapPartitionsRDD [129630] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322546 { label="WholeStageCodegen (1)"; 129631 [labelType="html" label="MapPartitionsRDD [129631] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322545 { label="DeserializeToObject"; 129632 [labelType="html" label="MapPartitionsRDD [129632] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322555 { label="mapPartitions"; 129634 [labelType="html" label="MapPartitionsRDD [129634] [Unordered]<br>jdbc at <unknown>:0"]; } } 129470->129471; 129471->129472; 129472->129473; 129473->129626; 129626->129627; 129627->129628; 129628->129629; 129629->129630; 129630->129631; 129631->129632; 129632->129633; 129633->129634; }
129294,129470
129473
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time