3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 42642 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
40 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
0.0 B / 13
Associated Job Ids:
31589
DAG Visualization
digraph G { subgraph clusterstage_42642 { label="Stage 42642"; 186381 [labelType="html" label="JDBCRDD [186381]<br>first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169"]; subgraph cluster439624 { label="WholeStageCodegen (1)"; 186385 [labelType="html" label="MapPartitionsRDD [186385]<br>first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169"]; } subgraph cluster439629 { label="mapPartitionsInternal"; 186386 [labelType="html" label="MapPartitionsRDD [186386]<br>first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169"]; } subgraph cluster439630 { label="mapPartitionsInternal"; 186387 [labelType="html" label="*(1) Scan JDBCRelation(dbo.fact_PDC_AGEC_Report) [numPartitions=1] [brand_id#16924344,Style ID#16924345,Supplier_id#16924346,season#16924347,Model#16924348,Part#16924349,Color#16924350,Tipo origine#16924351,Product ID#16924352,Country-Style Printing#16924353,Country-Finishing#16924354,Country-Stitching#16924355,material_supplier_id#16924356,Mseason#16924357,Country Manufacturing / Assembling#16924358,Country-Style Dyeing#16924359,ProductType#16924360,productClassification#16924361,productGroup#16924362,% Material Recycled#16924363,% Microplastic#16924364,Last Date for confirmed OC#16924365,Cancelled Flag#16924366,Supplier Name#16924367,... 9 more fields] PushedFilters: [], ReadSchema: struct<brand_id:string,Style ID:string,Supplier_id:string,season:string,Model:string,Part:string,...\n [186387] [Cached]<br>first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169"]; } } 186381->186385; 186385->186386; 186386->186387; }
186387
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time