3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 30090 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Process local: 1
Input Size / Records:
12.7 KiB / 1
Output Size / Records:
0.0 B / 7
Associated Job Ids:
20605
DAG Visualization
digraph G { subgraph clusterstage_30090 { label="Stage 30090"; 129415 [labelType="html" label="SQLExecutionRDD [129415] [Unordered]<br>jdbc at <unknown>:0"]; subgraph cluster322052 { label="Exchange"; 129386 [labelType="html" label="ShuffledRowRDD [129386] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster322035 { label="AdaptiveSparkPlan"; 129387 [labelType="html" label="MapPartitionsRDD [129387] [Unordered]<br>javaToPython at <unknown>:0"]; 129388 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Exchange SinglePartition, REPARTITION_BY_NUM, [plan_id=4044610]\n +- Project [_id#12901804, product_node_response_ref#12901805, NetworkID#12901806, is_latest#12901807, brand_context_id#12901808, company_id#12901809, launch_config_ref#12901810, revision_version#12901811, facility_declaration_ref#12901812, data_facility_dec_ref#12901813, derived_facility_dec_ref#12901814, facility_name#12901815, data_facility_name#12901816, fac_city#12901817, data_city#12901818, fac_state#12901819, data_state#12901820, fac_country#12901821, data_country#12901822, fac_address_line1#12901823, data_address_line1#12901824, enabled#12901825, facility_default_ref#12901826, Subcontractor_supplier_default_ref#12901827, ... 46 more fields]\n +- Scan JDBCRelation((\n SELECT\n pfd._id, pfd.product_node_response_ref,\n pfd.networkId AS NetworkID, pfd.is_latest,\n pfd.brand_context_id, pfd.company_id, pfd.launch_config_ref, pfd.revision_versio... [129388] [Cached] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster322100 { label="InMemoryTableScan"; 129410 [labelType="html" label="MapPartitionsRDD [129410] [Unordered]<br>jdbc at <unknown>:0"]; 129411 [labelType="html" label="MapPartitionsRDD [129411] [Unordered]<br>jdbc at <unknown>:0"]; 129412 [labelType="html" label="MapPartitionsRDD [129412] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322095 { label="WholeStageCodegen (1)"; 129413 [labelType="html" label="MapPartitionsRDD [129413] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322094 { label="DeserializeToObject"; 129414 [labelType="html" label="MapPartitionsRDD [129414] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster322101 { label="mapPartitions"; 129416 [labelType="html" label="MapPartitionsRDD [129416] [Unordered]<br>jdbc at <unknown>:0"]; } } 129386->129387; 129387->129388; 129388->129410; 129410->129411; 129411->129412; 129412->129413; 129413->129414; 129414->129415; 129415->129416; }
129378,129386
129388
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time