3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 2582 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
75 ms
Locality Level Summary:
Process local: 5
Input Size / Records:
40.9 KiB / 2
Output Size / Records:
0.0 B / 4
Associated Job Ids:
2004
DAG Visualization
digraph G { subgraph clusterstage_2582 { label="Stage 2582"; 9255 [labelType="html" label="SQLExecutionRDD [9255] [Unordered]<br>jdbc at <unknown>:0"]; subgraph cluster20454 { label="Exchange"; 8933 [labelType="html" label="ShuffledRowRDD [8933] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster20445 { label="WholeStageCodegen (3)"; 8935 [labelType="html" label="MapPartitionsRDD [8935] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster20244 { label="AdaptiveSparkPlan"; 8936 [labelType="html" label="MapPartitionsRDD [8936] [Unordered]<br>javaToPython at <unknown>:0"]; 8937 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Project [brand_context_id#584899, company_id#584900, launch_config_ref#584901, revision_version#584902, summary__config_name#759145, summary__config_version#759146, summary__entity_id#759147, summary__submission_status#759148, summary__is_latest#759149, summary__is_editable#759150, summary__launch_date#759151, summary__expiry_date#759152, summary__submitted_date#759153, summary__create_ts#759154, summary__update_ts#759155, summary__create_date#759156, summary__update_date#759157, summary__source#759158, summary__recurrence_count#759159, summary__priority#759160, summary__remarks#759161, summary__latest_source#759162, summary__launch_request_name#759163, summary__NetworkID#759164, ... 49 more fields]\n +- BroadcastHashJoin [brand_context_id#584899, company_id#584900, launch_config_ref#584901, revision_version#584902], [brand_context_id#753747, company_id#753748, launch_config_ref#753749, revision_version#753750], Inner, BuildLeft, false\n :- BroadcastExchange Hash... [8937] [Cached] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster21106 { label="InMemoryTableScan"; 9248 [labelType="html" label="MapPartitionsRDD [9248] [Unordered]<br>jdbc at <unknown>:0"]; 9249 [labelType="html" label="MapPartitionsRDD [9249] [Unordered]<br>jdbc at <unknown>:0"]; 9250 [labelType="html" label="MapPartitionsRDD [9250] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster21104 { label="Filter"; 9251 [labelType="html" label="MapPartitionsRDD [9251] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster21103 { label="Project"; 9252 [labelType="html" label="MapPartitionsRDD [9252] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster21098 { label="WholeStageCodegen (1)"; 9253 [labelType="html" label="MapPartitionsRDD [9253] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster21097 { label="DeserializeToObject"; 9254 [labelType="html" label="MapPartitionsRDD [9254] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster21107 { label="mapPartitions"; 9256 [labelType="html" label="MapPartitionsRDD [9256] [Unordered]<br>jdbc at <unknown>:0"]; } } 8933->8935; 8935->8936; 8936->8937; 8937->9248; 9248->9249; 9249->9250; 9250->9251; 9251->9252; 9252->9253; 9253->9254; 9254->9255; 9255->9256; }
8841,8933
8937
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time