3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 3284 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 1
Input Size / Records:
5.0 MiB / 2
Output Size / Records:
0.0 B / 10000
Associated Job Ids:
2593
DAG Visualization
digraph G { subgraph clusterstage_3284 { label="Stage 3284"; 11664 [labelType="html" label="JDBCRDD [11664]<br>cache at <unknown>:0"]; 11694 [labelType="html" label="SQLExecutionRDD [11694]<br>jdbc at <unknown>:0"]; subgraph cluster26575 { label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 30001 AND 40000) AS page) [numPartitions=1] "; 11665 [labelType="html" label="MapPartitionsRDD [11665]<br>count at <unknown>:0"]; } subgraph cluster26576 { label="mapPartitionsInternal"; 11666 [labelType="html" label="MapPartitionsRDD [11666]<br>count at <unknown>:0"]; } subgraph cluster26577 { label="mapPartitionsInternal"; 11667 [labelType="html" label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 30001 AND 40000) AS page) [numPartitions=1] [po_item_product_code#1028621,po_item_product_name#1028622,transaction_id#1028623,buyer_gln#1028624,seller_gln#1028625,pod_division#1028626,pod_delivery_date#1028627,pod_product_item_id#1028628,pod_product_entity#1028629,po_number#1028630,product_item_id#1028631,product_entity#1028632,brand_context_id#1028633,po_division#1028634,po_delivery_date#1028635,row_id#1028636L,parent_row_id#1028637,chain_seq#1028638,tier#1028639,production_input_type#1028640,trans_create_ts#1028641,trans_update_ts#1028642,outbound_create_ts#1028643,outbound_supplier_code#1028644,... 111 more fields] PushedFilters: [], ReadSchema: struct<po_item_product_code:string,po_item_product_name:string,transaction_id:string,buyer_gln:st...\n [11667] [Cached]<br>count at <unknown>:0"]; } subgraph cluster26637 { label="InMemoryTableScan"; 11690 [labelType="html" label="MapPartitionsRDD [11690]<br>jdbc at <unknown>:0"]; 11691 [labelType="html" label="MapPartitionsRDD [11691]<br>jdbc at <unknown>:0"]; 11692 [labelType="html" label="MapPartitionsRDD [11692]<br>jdbc at <unknown>:0"]; } subgraph cluster26635 { label="DeserializeToObject"; 11693 [labelType="html" label="MapPartitionsRDD [11693]<br>jdbc at <unknown>:0"]; } subgraph cluster26638 { label="mapPartitions"; 11695 [labelType="html" label="MapPartitionsRDD [11695]<br>jdbc at <unknown>:0"]; } } 11664->11665; 11665->11666; 11666->11667; 11667->11690; 11690->11691; 11691->11692; 11692->11693; 11693->11694; 11694->11695; }
11667
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time