3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 43676 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 1
Input Size / Records:
0.0 B / 10000
Associated Job Ids:
32425
DAG Visualization
digraph G { subgraph clusterstage_43676 { label="Stage 43676"; 189963 [labelType="html" label="JDBCRDD [189963]<br>first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169"]; subgraph cluster447886 { label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 50001 AND 60000) AS page) [numPartitions=1] "; 189964 [labelType="html" label="MapPartitionsRDD [189964]<br>first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169"]; } subgraph cluster447887 { label="mapPartitionsInternal"; 189965 [labelType="html" label="MapPartitionsRDD [189965]<br>first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169"]; } subgraph cluster447888 { label="mapPartitionsInternal"; 189966 [labelType="html" label="Scan JDBCRelation((SELECT * FROM dbo.fact_trans_chain_po_detail WHERE bigid BETWEEN 50001 AND 60000) AS page) [numPartitions=1] [po_item_product_code#17232466,po_item_product_name#17232467,transaction_id#17232468,buyer_gln#17232469,seller_gln#17232470,pod_division#17232471,pod_delivery_date#17232472,pod_product_item_id#17232473,pod_product_entity#17232474,po_number#17232475,product_item_id#17232476,product_entity#17232477,brand_context_id#17232478,po_division#17232479,po_delivery_date#17232480,row_id#17232481L,parent_row_id#17232482,chain_seq#17232483,tier#17232484,production_input_type#17232485,trans_create_ts#17232486,trans_update_ts#17232487,outbound_create_ts#17232488,outbound_supplier_code#17232489,... 111 more fields] PushedFilters: [], ReadSchema: struct<po_item_product_code:string,po_item_product_name:string,transaction_id:string,buyer_gln:st...\n [189966] [Cached]<br>first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169"]; } } 189963->189964; 189964->189965; 189965->189966; }
189966
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time