3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 40566 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
5.0 MiB / 2
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
25797
DAG Visualization
digraph G { subgraph clusterstage_40566 { label="Stage 40566"; 173077 [labelType="html" label="JDBCRDD [173077]<br>cache at <unknown>:0"]; subgraph cluster412269 { label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 1 AND 10000) AS page) [numPartitions=1] "; 173078 [labelType="html" label="MapPartitionsRDD [173078]<br>count at <unknown>:0"]; } subgraph cluster412270 { label="mapPartitionsInternal"; 173079 [labelType="html" label="MapPartitionsRDD [173079]<br>count at <unknown>:0"]; } subgraph cluster412271 { label="mapPartitionsInternal"; 173080 [labelType="html" label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 1 AND 10000) AS page) [numPartitions=1] [po_item_product_code#20590554,po_item_product_name#20590555,transaction_id#20590556,buyer_gln#20590557,seller_gln#20590558,pod_division#20590559,pod_delivery_date#20590560,pod_product_item_id#20590561,pod_product_entity#20590562,po_number#20590563,product_item_id#20590564,product_entity#20590565,brand_context_id#20590566,po_division#20590567,po_delivery_date#20590568,row_id#20590569L,parent_row_id#20590570,chain_seq#20590571,tier#20590572,production_input_type#20590573,trans_create_ts#20590574,trans_update_ts#20590575,outbound_create_ts#20590576,outbound_supplier_code#20590577,... 111 more fields] PushedFilters: [], ReadSchema: struct<po_item_product_code:string,po_item_product_name:string,transaction_id:string,buyer_gln:st...\n [173080] [Cached]<br>count at <unknown>:0"]; } subgraph cluster412340 { label="InMemoryTableScan"; 173117 [labelType="html" label="MapPartitionsRDD [173117]<br>count at <unknown>:0"]; 173118 [labelType="html" label="MapPartitionsRDD [173118]<br>count at <unknown>:0"]; 173119 [labelType="html" label="MapPartitionsRDD [173119]<br>count at <unknown>:0"]; } subgraph cluster412336 { label="WholeStageCodegen (1)"; 173120 [labelType="html" label="MapPartitionsRDD [173120]<br>count at <unknown>:0"]; } subgraph cluster412335 { label="Exchange"; 173121 [labelType="html" label="MapPartitionsRDD [173121]<br>count at <unknown>:0"]; } } 173077->173078; 173078->173079; 173079->173080; 173080->173117; 173117->173118; 173118->173119; 173119->173120; 173120->173121; }
173080
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time