3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 39763 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
52 ms
Locality Level Summary:
Node local: 1; Process local: 9
Shuffle Read Size / Records:
199.0 B / 1
Associated Job Ids:
25169
DAG Visualization
digraph G { subgraph clusterstage_39763 { label="Stage 39763"; subgraph cluster405847 { label="Exchange"; 170338 [labelType="html" label="ShuffledRowRDD [170338] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster405838 { label="WholeStageCodegen (4)"; 170339 [labelType="html" label="MapPartitionsRDD [170339] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster405788 { label="AdaptiveSparkPlan"; 170340 [labelType="html" label="MapPartitionsRDD [170340] [Unordered]<br>javaToPython at <unknown>:0"]; 170341 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Project [supplier_id#20380397, preferrd_supplier_id#20380398, supplier_uid#20380399, name#20380400, brand_context_id#20380401, country#20380402, state#20380403, city#20380404, region#20380405, status#20380406, is_unknown#20380407, source_evidence#20380408, first_created_date#20380566]\n +- SortMergeJoin [supplier_id#20380397], [supplier_id#20377343], LeftOuter\n :- Sort [supplier_id#20380397 ASC NULLS FIRST], false, 0\n : +- Exchange hashpartitioning(supplier_id#20380397, 10), ENSURE_REQUIREMENTS, [plan_id=3326116]\n : +- MapInPandas <lambda>(supplier_id#20380372, preferrd_supplier_id#20380373, supplier_uid#20380374, name#20380375, brand_context_id#20380376, country#20380377, state#20380378, city#20380379, region#20380380, status#20380381, is_unknown#20380382, source_evidence#20380383)#20380396, [supplier_id#20380397, preferrd_supplier_id#20380398, supplier_uid#20380399, name#20380400, brand_context_id#20380401, country#20380402, state#20380403, city... [170341] [Cached] [Unordered]<br>javaToPython at <unknown>:0"]; } } 170338->170339; 170339->170340; 170340->170341; }
170332,170338
170341
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time