3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 37590 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
47 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
12.7 KiB / 1
Output Size / Records:
0.0 B / 7
Associated Job Ids:
27073
DAG Visualization
digraph G { subgraph clusterstage_37590 { label="Stage 37590"; 162111 [labelType="html" label="SQLExecutionRDD [162111] [Unordered]<br>jdbc at <unknown>:0"]; subgraph cluster390395 { label="Exchange"; 162043 [labelType="html" label="ShuffledRowRDD [162043] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster390328 { label="AdaptiveSparkPlan"; 162044 [labelType="html" label="MapPartitionsRDD [162044] [Unordered]<br>javaToPython at <unknown>:0"]; 162045 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Exchange SinglePartition, REPARTITION_BY_NUM, [plan_id=4309298]\n +- Project [_id#15210625, product_node_response_ref#15210626, NetworkID#15210627, is_latest#15210628, brand_context_id#15210629, company_id#15210630, launch_config_ref#15210631, revision_version#15210632, facility_declaration_ref#15210633, data_facility_dec_ref#15210634, derived_facility_dec_ref#15210635, facility_name#15210636, data_facility_name#15210637, fac_city#15210638, data_city#15210639, fac_state#15210640, data_state#15210641, fac_country#15210642, data_country#15210643, fac_address_line1#15210644, data_address_line1#15210645, enabled#15210646, facility_default_ref#15210647, Subcontractor_supplier_default_ref#15210648, ... 46 more fields]\n +- Scan JDBCRelation((\n SELECT\n pfd._id, pfd.product_node_response_ref,\n pfd.networkId AS NetworkID, pfd.is_latest,\n pfd.brand_context_id, pfd.company_id, pfd.launch_config_ref, pfd.revision_versio... [162045] [Cached] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster390524 { label="InMemoryTableScan"; 162106 [labelType="html" label="MapPartitionsRDD [162106] [Unordered]<br>jdbc at <unknown>:0"]; 162107 [labelType="html" label="MapPartitionsRDD [162107] [Unordered]<br>jdbc at <unknown>:0"]; 162108 [labelType="html" label="MapPartitionsRDD [162108] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster390519 { label="WholeStageCodegen (1)"; 162109 [labelType="html" label="MapPartitionsRDD [162109] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster390518 { label="DeserializeToObject"; 162110 [labelType="html" label="MapPartitionsRDD [162110] [Unordered]<br>jdbc at <unknown>:0"]; } subgraph cluster390525 { label="mapPartitions"; 162112 [labelType="html" label="MapPartitionsRDD [162112] [Unordered]<br>jdbc at <unknown>:0"]; } } 162043->162044; 162044->162045; 162045->162106; 162106->162107; 162107->162108; 162108->162109; 162109->162110; 162110->162111; 162111->162112; }
162013,162043
162045
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time