3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 42673 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
5.0 MiB / 2
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
31615
DAG Visualization
digraph G { subgraph clusterstage_42673 { label="Stage 42673"; 186479 [labelType="html" label="JDBCRDD [186479]<br>cache at <unknown>:0"]; subgraph cluster439834 { label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 20001 AND 30000) AS page) [numPartitions=1] "; 186480 [labelType="html" label="MapPartitionsRDD [186480]<br>count at <unknown>:0"]; } subgraph cluster439835 { label="mapPartitionsInternal"; 186481 [labelType="html" label="MapPartitionsRDD [186481]<br>count at <unknown>:0"]; } subgraph cluster439836 { label="mapPartitionsInternal"; 186482 [labelType="html" label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 20001 AND 30000) AS page) [numPartitions=1] [po_item_product_code#16934811,po_item_product_name#16934812,transaction_id#16934813,buyer_gln#16934814,seller_gln#16934815,pod_division#16934816,pod_delivery_date#16934817,pod_product_item_id#16934818,pod_product_entity#16934819,po_number#16934820,product_item_id#16934821,product_entity#16934822,brand_context_id#16934823,po_division#16934824,po_delivery_date#16934825,row_id#16934826L,parent_row_id#16934827,chain_seq#16934828,tier#16934829,production_input_type#16934830,trans_create_ts#16934831,trans_update_ts#16934832,outbound_create_ts#16934833,outbound_supplier_code#16934834,... 111 more fields] PushedFilters: [], ReadSchema: struct<po_item_product_code:string,po_item_product_name:string,transaction_id:string,buyer_gln:st...\n [186482] [Cached]<br>count at <unknown>:0"]; } subgraph cluster439873 { label="InMemoryTableScan"; 186492 [labelType="html" label="MapPartitionsRDD [186492]<br>count at <unknown>:0"]; 186493 [labelType="html" label="MapPartitionsRDD [186493]<br>count at <unknown>:0"]; 186494 [labelType="html" label="MapPartitionsRDD [186494]<br>count at <unknown>:0"]; } subgraph cluster439869 { label="WholeStageCodegen (1)"; 186495 [labelType="html" label="MapPartitionsRDD [186495]<br>count at <unknown>:0"]; } subgraph cluster439868 { label="Exchange"; 186496 [labelType="html" label="MapPartitionsRDD [186496]<br>count at <unknown>:0"]; } } 186479->186480; 186480->186481; 186481->186482; 186482->186492; 186492->186493; 186493->186494; 186494->186495; 186495->186496; }
186482
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time