3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 30094 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
12.5 KiB / 1
Output Size / Records:
0.0 B / 6
Associated Job Ids:
20607
DAG Visualization
digraph G { subgraph clusterstage_30094 { label="Stage 30094"; 129442 [labelType="html" label="SQLExecutionRDD [129442] [Unordered]<br>jdbc at <unknown>:0"]; subgraph cluster321905 { label="Exchange"; 129316 [labelType="html" label="ShuffledRowRDD [129316] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster321896 { label="WholeStageCodegen (3)"; 129317 [labelType="html" label="MapPartitionsRDD [129317] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster321846 { label="AdaptiveSparkPlan"; 129318 [labelType="html" label="MapPartitionsRDD [129318] [Unordered]<br>javaToPython at <unknown>:0"]; 129319 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Project [brand_context_id#12896487, company_id#12896488, launch_config_ref#12896489, revision_version#12896490, summary__config_name#12905677, summary__config_version#12905679, summary__entity_id#12905681, summary__submission_status#12905683, summary__is_latest#12905685, summary__is_editable#12905687, summary__launch_date#12905689, summary__expiry_date#12905717, summary__submitted_date#12905719, summary__create_ts#12905721, summary__update_ts#12905723, summary__create_date#12905826, summary__update_date#12905828, summary__source#12905829, summary__recurrence_count#12905830, summary__priority#12905831, summary__remarks#12905832, summary__latest_source#12905833, summary__launch_request_name#12905834, summary__NetworkID#12905836, ... 49 more fields]\n +- BroadcastHashJoin [brand_context_id#12896487, company_id#12896488, launch_config_ref#12896489, revision_version#12896490], [brand_context_id#12899599, company_id#12899600, launch_config_ref#12899601, revision_version#12... [129319] [Cached] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster322151 { label="InMemoryTableScan"; 129435 [labelType="html" label="MapPartitionsRDD [129435] [Unordered]<br>jdbc at <unknown>:0"]; 129436 [labelType="html" label="MapPartitionsRDD [129436] [Unordered]<br>jdbc at <unknown>:0"]; 129437 [labelType="html" label="MapPartitionsRDD [129437] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322149 { label="Filter"; 129438 [labelType="html" label="MapPartitionsRDD [129438] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322148 { label="Project"; 129439 [labelType="html" label="MapPartitionsRDD [129439] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322143 { label="WholeStageCodegen (1)"; 129440 [labelType="html" label="MapPartitionsRDD [129440] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322142 { label="DeserializeToObject"; 129441 [labelType="html" label="MapPartitionsRDD [129441] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322152 { label="mapPartitions"; 129443 [labelType="html" label="MapPartitionsRDD [129443] [Unordered]<br>jdbc at <unknown>:0"]; } } 129316->129317; 129317->129318; 129318->129319; 129319->129435; 129435->129436; 129436->129437; 129437->129438; 129438->129439; 129439->129440; 129440->129441; 129441->129442; 129442->129443; }
129301,129316
129319
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time