3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 799 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
4.8 MiB / 2
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
660
DAG Visualization
digraph G { subgraph clusterstage_799 { label="Stage 799"; 2759 [labelType="html" label="JDBCRDD [2759]<br>cache at <unknown>:0"]; subgraph cluster6308 { label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 50001 AND 60000) AS page) [numPartitions=1] "; 2760 [labelType="html" label="MapPartitionsRDD [2760]<br>count at <unknown>:0"]; } subgraph cluster6309 { label="mapPartitionsInternal"; 2761 [labelType="html" label="MapPartitionsRDD [2761]<br>count at <unknown>:0"]; } subgraph cluster6310 { label="mapPartitionsInternal"; 2762 [labelType="html" label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 50001 AND 60000) AS page) [numPartitions=1] [po_item_product_code#233364,po_item_product_name#233365,transaction_id#233366,buyer_gln#233367,seller_gln#233368,pod_division#233369,pod_delivery_date#233370,pod_product_item_id#233371,pod_product_entity#233372,po_number#233373,product_item_id#233374,product_entity#233375,brand_context_id#233376,po_division#233377,po_delivery_date#233378,row_id#233379L,parent_row_id#233380,chain_seq#233381,tier#233382,production_input_type#233383,trans_create_ts#233384,trans_update_ts#233385,outbound_create_ts#233386,outbound_supplier_code#233387,... 111 more fields] PushedFilters: [], ReadSchema: struct<po_item_product_code:string,po_item_product_name:string,transaction_id:string,buyer_gln:st...\n [2762] [Cached]<br>count at <unknown>:0"]; } subgraph cluster6316 { label="InMemoryTableScan"; 2763 [labelType="html" label="MapPartitionsRDD [2763]<br>count at <unknown>:0"]; 2764 [labelType="html" label="MapPartitionsRDD [2764]<br>count at <unknown>:0"]; 2765 [labelType="html" label="MapPartitionsRDD [2765]<br>count at <unknown>:0"]; } subgraph cluster6312 { label="WholeStageCodegen (1)"; 2766 [labelType="html" label="MapPartitionsRDD [2766]<br>count at <unknown>:0"]; } subgraph cluster6311 { label="Exchange"; 2767 [labelType="html" label="MapPartitionsRDD [2767]<br>count at <unknown>:0"]; } } 2759->2760; 2760->2761; 2761->2762; 2762->2763; 2763->2764; 2764->2765; 2765->2766; 2766->2767; }
2762
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time