3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 37578 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
7 ms
Locality Level Summary:
Node local: 1
Shuffle Read Size / Records:
2.2 KiB / 8
Associated Job Ids:
27065
DAG Visualization
digraph G { subgraph clusterstage_37578 { label="Stage 37578"; subgraph cluster390395 { label="Exchange"; 162043 [labelType="html" label="ShuffledRowRDD [162043] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster390328 { label="AdaptiveSparkPlan"; 162044 [labelType="html" label="MapPartitionsRDD [162044] [Unordered]<br>javaToPython at <unknown>:0"]; 162045 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Exchange SinglePartition, REPARTITION_BY_NUM, [plan_id=4309298]\n +- Project [_id#15210625, product_node_response_ref#15210626, NetworkID#15210627, is_latest#15210628, brand_context_id#15210629, company_id#15210630, launch_config_ref#15210631, revision_version#15210632, facility_declaration_ref#15210633, data_facility_dec_ref#15210634, derived_facility_dec_ref#15210635, facility_name#15210636, data_facility_name#15210637, fac_city#15210638, data_city#15210639, fac_state#15210640, data_state#15210641, fac_country#15210642, data_country#15210643, fac_address_line1#15210644, data_address_line1#15210645, enabled#15210646, facility_default_ref#15210647, Subcontractor_supplier_default_ref#15210648, ... 46 more fields]\n +- Scan JDBCRelation((\n SELECT\n pfd._id, pfd.product_node_response_ref,\n pfd.networkId AS NetworkID, pfd.is_latest,\n pfd.brand_context_id, pfd.company_id, pfd.launch_config_ref, pfd.revision_versio... [162045] [Cached] [Unordered]<br>javaToPython at <unknown>:0"]; } } 162043->162044; 162044->162045; }
162013,162043
162045
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time