3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 30131 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 2
Input Size / Records:
26.1 KiB / 2
Output Size / Records:
0.0 B / 19
Associated Job Ids:
20629
DAG Visualization
digraph G { subgraph clusterstage_30131 { label="Stage 30131"; 129615 [labelType="html" label="SQLExecutionRDD [129615] [Unordered]<br>jdbc at <unknown>:0"]; subgraph cluster321954 { label="Exchange"; 129337 [labelType="html" label="ShuffledRowRDD [129337] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster321945 { label="WholeStageCodegen (3)"; 129338 [labelType="html" label="MapPartitionsRDD [129338] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster321816 { label="AdaptiveSparkPlan"; 129339 [labelType="html" label="MapPartitionsRDD [129339] [Unordered]<br>javaToPython at <unknown>:0"]; 129340 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Project [brand_context_id#12896487, company_id#12896488, launch_config_ref#12896489, revision_version#12896490, summary__config_name#12905688, summary__config_version#12905716, summary__entity_id#12905718, summary__submission_status#12905720, summary__is_latest#12905722, summary__is_editable#12905724, summary__launch_date#12905725, summary__expiry_date#12905726, summary__submitted_date#12905827, summary__create_ts#12905835, summary__update_ts#12905837, summary__create_date#12905839, summary__update_date#12905841, summary__source#12905842, summary__recurrence_count#12905843, summary__priority#12905984, summary__remarks#12906125, summary__latest_source#12906126, summary__launch_request_name#12906127, summary__NetworkID#12906128, ... 49 more fields]\n +- BroadcastHashJoin [brand_context_id#12896487, company_id#12896488, launch_config_ref#12896489, revision_version#12896490], [brand_context_id#12899899, company_id#12899900, launch_config_ref#12899901, revision_version#12... [129340] [Cached] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster322516 { label="InMemoryTableScan"; 129608 [labelType="html" label="MapPartitionsRDD [129608] [Unordered]<br>jdbc at <unknown>:0"]; 129609 [labelType="html" label="MapPartitionsRDD [129609] [Unordered]<br>jdbc at <unknown>:0"]; 129610 [labelType="html" label="MapPartitionsRDD [129610] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322514 { label="Filter"; 129611 [labelType="html" label="MapPartitionsRDD [129611] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322513 { label="Project"; 129612 [labelType="html" label="MapPartitionsRDD [129612] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322508 { label="WholeStageCodegen (1)"; 129613 [labelType="html" label="MapPartitionsRDD [129613] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322507 { label="DeserializeToObject"; 129614 [labelType="html" label="MapPartitionsRDD [129614] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322517 { label="mapPartitions"; 129616 [labelType="html" label="MapPartitionsRDD [129616] [Unordered]<br>jdbc at <unknown>:0"]; } } 129337->129338; 129338->129339; 129339->129340; 129340->129608; 129608->129609; 129609->129610; 129610->129611; 129611->129612; 129612->129613; 129613->129614; 129614->129615; 129615->129616; }
129281,129337
129340
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time