3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 3263 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
5.0 MiB / 2
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
2577
DAG Visualization
digraph G { subgraph clusterstage_3263 { label="Stage 3263"; 11599 [labelType="html" label="JDBCRDD [11599]<br>cache at <unknown>:0"]; subgraph cluster26410 { label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 20001 AND 30000) AS page) [numPartitions=1] "; 11600 [labelType="html" label="MapPartitionsRDD [11600]<br>count at <unknown>:0"]; } subgraph cluster26411 { label="mapPartitionsInternal"; 11601 [labelType="html" label="MapPartitionsRDD [11601]<br>count at <unknown>:0"]; } subgraph cluster26412 { label="mapPartitionsInternal"; 11602 [labelType="html" label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 20001 AND 30000) AS page) [numPartitions=1] [po_item_product_code#1018935,po_item_product_name#1018936,transaction_id#1018937,buyer_gln#1018938,seller_gln#1018939,pod_division#1018940,pod_delivery_date#1018941,pod_product_item_id#1018942,pod_product_entity#1018943,po_number#1018944,product_item_id#1018945,product_entity#1018946,brand_context_id#1018947,po_division#1018948,po_delivery_date#1018949,row_id#1018950L,parent_row_id#1018951,chain_seq#1018952,tier#1018953,production_input_type#1018954,trans_create_ts#1018955,trans_update_ts#1018956,outbound_create_ts#1018957,outbound_supplier_code#1018958,... 111 more fields] PushedFilters: [], ReadSchema: struct<po_item_product_code:string,po_item_product_name:string,transaction_id:string,buyer_gln:st...\n [11602] [Cached]<br>count at <unknown>:0"]; } subgraph cluster26440 { label="InMemoryTableScan"; 11619 [labelType="html" label="MapPartitionsRDD [11619]<br>count at <unknown>:0"]; 11620 [labelType="html" label="MapPartitionsRDD [11620]<br>count at <unknown>:0"]; 11621 [labelType="html" label="MapPartitionsRDD [11621]<br>count at <unknown>:0"]; } subgraph cluster26436 { label="WholeStageCodegen (1)"; 11622 [labelType="html" label="MapPartitionsRDD [11622]<br>count at <unknown>:0"]; } subgraph cluster26435 { label="Exchange"; 11623 [labelType="html" label="MapPartitionsRDD [11623]<br>count at <unknown>:0"]; } } 11599->11600; 11600->11601; 11601->11602; 11602->11619; 11619->11620; 11620->11621; 11621->11622; 11622->11623; }
11602
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time