3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 30120 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
14 ms
Locality Level Summary:
Node local: 2
Shuffle Read Size / Records:
3.2 KiB / 26
Associated Job Ids:
20623
DAG Visualization
digraph G { subgraph clusterstage_30120 { label="Stage 30120"; subgraph cluster322417 { label="Exchange"; 129557 [labelType="html" label="ShuffledRowRDD [129557] [Unordered]<br>javaToPython at <unknown>:0"]; } subgraph cluster322406 { label="AdaptiveSparkPlan"; 129558 [labelType="html" label="MapPartitionsRDD [129558] [Unordered]<br>javaToPython at <unknown>:0"]; 129559 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Exchange hashpartitioning(brand_context_id#12902510, company_id#12902511, launch_config_ref#12902512, revision_version#12902513, 2), REPARTITION_BY_NUM, [plan_id=4044593]\n +- Project [_id#12902506, product_node_response_ref#12902507, NetworkID#12902508, is_latest#12902509, brand_context_id#12902510, company_id#12902511, launch_config_ref#12902512, revision_version#12902513, facility_declaration_ref#12902514, data_facility_dec_ref#12902515, derived_facility_dec_ref#12902516, facility_name#12902517, data_facility_name#12902518, fac_city#12902519, data_city#12902520, fac_state#12902521, data_state#12902522, fac_country#12902523, data_country#12902525, fac_address_line1#12902526, data_address_line1#12902527, enabled#12902528, facility_default_ref#12902529, Subcontractor_supplier_default_ref#12902530, ... 46 more fields]\n +- Scan JDBCRelation((\n SELECT\n pfd._id, pfd.product_node_response_ref,\n pfd.networkId AS NetworkID, pfd.... [129559] [Cached] [Unordered]<br>javaToPython at <unknown>:0"]; } } 129557->129558; 129558->129559; }
129550,129557
129559
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time