3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 37539 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
13.7 KiB / 1
Associated Job Ids:
27043
DAG Visualization
digraph G { subgraph clusterstage_37539 { label="Stage 37539"; subgraph cluster390024 { label="Exchange"; 161866 [labelType="html" label="ShuffledRowRDD [161866] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster390015 { label="WholeStageCodegen (3)"; 161867 [labelType="html" label="MapPartitionsRDD [161867] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster389957 { label="AdaptiveSparkPlan"; 161868 [labelType="html" label="MapPartitionsRDD [161868] [Unordered]<br>javaToPython at <unknown>:0"]; 161869 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Project [brand_context_id#15205022, company_id#15205023, launch_config_ref#15205024, revision_version#15205025, summary__config_name#15214231, summary__config_version#15214233, summary__entity_id#15214261, summary__submission_status#15214263, summary__is_latest#15214265, summary__is_editable#15214267, summary__launch_date#15214269, summary__expiry_date#15214271, summary__submitted_date#15214272, summary__create_ts#15214373, summary__update_ts#15214374, summary__create_date#15214375, summary__update_date#15214376, summary__source#15214377, summary__recurrence_count#15214378, summary__priority#15214379, summary__remarks#15214660, summary__latest_source#15214687, summary__launch_request_name#15214688, summary__NetworkID#15214689, ... 49 more fields]\n +- BroadcastHashJoin [brand_context_id#15205022, company_id#15205023, launch_config_ref#15205024, revision_version#15205025], [brand_context_id#15208178, company_id#15208179, launch_config_ref#15208180, revision_version#15... [161869] [Cached] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster390057 { label="InMemoryTableScan"; 161882 [labelType="html" label="MapPartitionsRDD [161882] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; 161883 [labelType="html" label="MapPartitionsRDD [161883] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; 161884 [labelType="html" label="MapPartitionsRDD [161884] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } subgraph cluster390052 { label="WholeStageCodegen (1)"; 161885 [labelType="html" label="MapPartitionsRDD [161885] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } subgraph cluster390051 { label="BroadcastExchange"; 161886 [labelType="html" label="MapPartitionsRDD [161886] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } } 161866->161867; 161867->161868; 161868->161869; 161869->161882; 161882->161883; 161883->161884; 161884->161885; 161885->161886; }
161844,161866
161869
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time