3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 27593 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
3.4 MiB / 2
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
18634
DAG Visualization
digraph G { subgraph clusterstage_27593 { label="Stage 27593"; 120769 [labelType="html" label="JDBCRDD [120769]<br>cache at <unknown>:0"]; subgraph cluster302076 { label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 60001 AND 66563) AS page) [numPartitions=1] "; 120770 [labelType="html" label="MapPartitionsRDD [120770]<br>count at <unknown>:0"]; } subgraph cluster302077 { label="mapPartitionsInternal"; 120771 [labelType="html" label="MapPartitionsRDD [120771]<br>count at <unknown>:0"]; } subgraph cluster302078 { label="mapPartitionsInternal"; 120772 [labelType="html" label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 60001 AND 66563) AS page) [numPartitions=1] [po_item_product_code#12280194,po_item_product_name#12280195,transaction_id#12280196,buyer_gln#12280197,seller_gln#12280198,pod_division#12280199,pod_delivery_date#12280200,pod_product_item_id#12280201,pod_product_entity#12280202,po_number#12280203,product_item_id#12280204,product_entity#12280205,brand_context_id#12280206,po_division#12280207,po_delivery_date#12280208,row_id#12280209L,parent_row_id#12280210,chain_seq#12280211,tier#12280212,production_input_type#12280213,trans_create_ts#12280214,trans_update_ts#12280215,outbound_create_ts#12280216,outbound_supplier_code#12280217,... 111 more fields] PushedFilters: [], ReadSchema: struct<po_item_product_code:string,po_item_product_name:string,transaction_id:string,buyer_gln:st...\n [120772] [Cached]<br>count at <unknown>:0"]; } subgraph cluster302084 { label="InMemoryTableScan"; 120773 [labelType="html" label="MapPartitionsRDD [120773]<br>count at <unknown>:0"]; 120774 [labelType="html" label="MapPartitionsRDD [120774]<br>count at <unknown>:0"]; 120775 [labelType="html" label="MapPartitionsRDD [120775]<br>count at <unknown>:0"]; } subgraph cluster302080 { label="WholeStageCodegen (1)"; 120776 [labelType="html" label="MapPartitionsRDD [120776]<br>count at <unknown>:0"]; } subgraph cluster302079 { label="Exchange"; 120777 [labelType="html" label="MapPartitionsRDD [120777]<br>count at <unknown>:0"]; } } 120769->120770; 120770->120771; 120771->120772; 120772->120773; 120773->120774; 120774->120775; 120775->120776; 120776->120777; }
120772
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time