3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 33992 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
8.9 KiB / 1
Associated Job Ids:
24260
DAG Visualization
digraph G { subgraph clusterstage_33992 { label="Stage 33992"; subgraph cluster360508 { label="Exchange"; 149257 [labelType="html" label="ShuffledRowRDD [149257] [Unordered]<br>count at <unknown>:0"]; } subgraph cluster360509 { label="mapPartitionsInternal"; 149258 [labelType="html" label="MapPartitionsRDD [149258] [Unordered]<br>count at <unknown>:0"]; } subgraph cluster360510 { label="mapPartitionsInternal"; 149259 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Exchange SinglePartition, REPARTITION_BY_NUM, [plan_id=4242893]\n +- Project [brand_context_id#14271364, staticinvoke(class org.apache.spark.sql.catalyst.util.CharVarcharCodegenUtils, StringType, readSidePadding, NetworkID#14271365, 64, true, false, true) AS NetworkID#14271408, Child_Node#14271366, Parent_id#14271367, supplier_id#14271368, preferrd_supplier_id#14271369, supplier_ref_id#14271370, supplier_uid#14271371, supplier_name#14271372, supplier_country#14271373, direct_indirect#14271374, source_type#14271375, product_name#14271376, tier#14271377, is_latest#14271378, is_latest_submitted#14271379, is_unknown_supplier#14271380, company_id#14271381, config_name#14271382, direct_supplier_name#14271383, launch_request_name#14271384, launch_config_ref#14271385, revision_version#14271386, submission_status#14271387, ... 23 more fields]\n +- Scan JDBCRelation((\nSELECT\n c.brand_context_id,\n c.NetworkID,\n c.Child_Node,\n c.Parent_id,\n ISNULL(c.supplier_i... [149259] [Cached] [Unordered]<br>count at <unknown>:0"]; } subgraph cluster361276 { label="InMemoryTableScan"; 149571 [labelType="html" label="MapPartitionsRDD [149571] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; 149572 [labelType="html" label="MapPartitionsRDD [149572] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; 149573 [labelType="html" label="MapPartitionsRDD [149573] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } subgraph cluster361270 { label="WholeStageCodegen (8)"; 149574 [labelType="html" label="MapPartitionsRDD [149574] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } subgraph cluster361269 { label="SortAggregate"; 149575 [labelType="html" label="MapPartitionsRDD [149575] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } subgraph cluster361268 { label="SortAggregate"; 149576 [labelType="html" label="MapPartitionsRDD [149576] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } subgraph cluster361263 { label="WholeStageCodegen (9)"; 149577 [labelType="html" label="MapPartitionsRDD [149577] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } subgraph cluster361225 { label="BroadcastExchange"; 149578 [labelType="html" label="MapPartitionsRDD [149578] [Unordered]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } } 149257->149258; 149258->149259; 149259->149571; 149571->149572; 149572->149573; 149573->149574; 149574->149575; 149575->149576; 149576->149577; 149577->149578; }
149256,149257
149259
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time