3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 26704 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
28 ms
Locality Level Summary:
Node local: 1; Process local: 9
Shuffle Read Size / Records:
199.0 B / 1
Associated Job Ids:
17926
DAG Visualization
digraph G { subgraph clusterstage_26704 { label="Stage 26704"; subgraph cluster294903 { label="Exchange"; 117683 [labelType="html" label="ShuffledRowRDD [117683] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster294894 { label="WholeStageCodegen (4)"; 117684 [labelType="html" label="MapPartitionsRDD [117684] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster294844 { label="AdaptiveSparkPlan"; 117685 [labelType="html" label="MapPartitionsRDD [117685] [Unordered]<br>javaToPython at <unknown>:0"]; 117686 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Project [supplier_id#12013538, preferrd_supplier_id#12013539, supplier_uid#12013540, name#12013541, brand_context_id#12013542, country#12013543, state#12013544, city#12013545, region#12013546, status#12013547, is_unknown#12013548, source_evidence#12013549, first_created_date#12013707]\n +- SortMergeJoin [supplier_id#12013538], [supplier_id#12010484], LeftOuter\n :- Sort [supplier_id#12013538 ASC NULLS FIRST], false, 0\n : +- Exchange hashpartitioning(supplier_id#12013538, 10), ENSURE_REQUIREMENTS, [plan_id=3993823]\n : +- MapInPandas <lambda>(supplier_id#12013513, preferrd_supplier_id#12013514, supplier_uid#12013515, name#12013516, brand_context_id#12013517, country#12013518, state#12013519, city#12013520, region#12013521, status#12013522, is_unknown#12013523, source_evidence#12013524)#12013537, [supplier_id#12013538, preferrd_supplier_id#12013539, supplier_uid#12013540, name#12013541, brand_context_id#12013542, country#12013543, state#12013544, city... [117686] [Cached] [Unordered]<br>javaToPython at <unknown>:0"]; } } 117683->117684; 117684->117685; 117685->117686; }
117677,117683
117686
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time