3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 37556 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
12.5 KiB / 1
Associated Job Ids:
27053
DAG Visualization
digraph G { subgraph clusterstage_37556 { label="Stage 37556"; subgraph cluster390096 { label="Exchange"; 161893 [labelType="html" label="ShuffledRowRDD [161893] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster390087 { label="WholeStageCodegen (3)"; 161894 [labelType="html" label="MapPartitionsRDD [161894] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster389935 { label="AdaptiveSparkPlan"; 161895 [labelType="html" label="MapPartitionsRDD [161895] [Unordered]<br>javaToPython at <unknown>:0"]; 161896 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Project [brand_context_id#15205022, company_id#15205023, launch_config_ref#15205024, revision_version#15205025, summary__config_name#15214199, summary__config_version#15214203, summary__entity_id#15214205, summary__submission_status#15214208, summary__is_latest#15214211, summary__is_editable#15214214, summary__launch_date#15214215, summary__expiry_date#15214217, summary__submitted_date#15214219, summary__create_ts#15214220, summary__update_ts#15214222, summary__create_date#15214224, summary__update_date#15214226, summary__source#15214228, summary__recurrence_count#15214230, summary__priority#15214234, summary__remarks#15214262, summary__latest_source#15214264, summary__launch_request_name#15214266, summary__NetworkID#15214268, ... 49 more fields]\n +- BroadcastHashJoin [brand_context_id#15205022, company_id#15205023, launch_config_ref#15205024, revision_version#15205025], [brand_context_id#15208347, company_id#15208348, launch_config_ref#15208349, revision_version#15... [161896] [Cached] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster390176 { label="InMemoryTableScan"; 161939 [labelType="html" label="MapPartitionsRDD [161939] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; 161940 [labelType="html" label="MapPartitionsRDD [161940] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; 161941 [labelType="html" label="MapPartitionsRDD [161941] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } subgraph cluster390171 { label="WholeStageCodegen (1)"; 161942 [labelType="html" label="MapPartitionsRDD [161942] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } subgraph cluster390170 { label="BroadcastExchange"; 161943 [labelType="html" label="MapPartitionsRDD [161943] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } } 161893->161894; 161894->161895; 161895->161896; 161896->161939; 161939->161940; 161940->161941; 161941->161942; 161942->161943; }
161837,161893
161896
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time