DataHubScheduler - Details for Query 6082

Submitted Time: 2026/10/16 08:21:17
Duration: 0.3 s
Succeeded Jobs: 9291

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; 1 [labelType="html" label=" DeserializeToObject "]; 2 [labelType="html" label="InMemoryTableScan number of output rows: 5"]; subgraph cluster3 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 0 ms"; 4 [labelType="html" label="Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] number of output rows: 0"]; } 1->0; 2->1; 4->2; }

AdaptiveSparkPlan isFinalPlan=true

DeserializeToObject createexternalrow(brand_context_id#10608057.toString, Supplier Name#10608058.toString, Supplier UID#10608059.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#10608060, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#10608061, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#10608062, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#10608063, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#10608064, true, false, true), delivery_quarter#10608065.toString, Fulfillment Status#10608066.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#10608067, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#10608068, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#10608069, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#10609476: org.apache.spark.sql.Row

InMemoryTableScan [brand_context_id#10608057, Supplier Name#10608058, Supplier UID#10608059, PO Line Item TT#10608060, PO Line Items Due for Traceability#10608061, Traced PO Line Items#10608062, Quantity Traced#10608063, PO Line Items Traced on Time#10608064, delivery_quarter#10608065, Fulfillment Status#10608066, isCurrentQuarter#10608067, nike_po_line_items#10608068, mtz_po_line_items#10608069]

Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] [brand_context_id#10608057,Supplier Name#10608058,Supplier UID#10608059,PO Line Item TT#10608060,PO Line Items Due for Traceability#10608061,Traced PO Line Items#10608062,Quantity Traced#10608063,PO Line Items Traced on Time#10608064,delivery_quarter#10608065,Fulfillment Status#10608066,isCurrentQuarter#10608067,nike_po_line_items#10608068,mtz_po_line_items#10608069] PushedFilters: [], ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Li...

WholeStageCodegen (1)

Details

== Physical Plan ==
AdaptiveSparkPlan (7)
+- == Final Plan ==
   DeserializeToObject (5)
   +- TableCacheQueryStage (4), Statistics(sizeInBytes=655.0 B, rowCount=5)
      +- InMemoryTableScan (1)
            +- InMemoryRelation (2)
                  +- * Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  (3)
+- == Initial Plan ==
   DeserializeToObject (6)
   +- InMemoryTableScan (1)
         +- InMemoryRelation (2)
               +- * Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  (3)


(1) InMemoryTableScan
Output [13]: [brand_context_id#10608057, Supplier Name#10608058, Supplier UID#10608059, PO Line Item TT#10608060, PO Line Items Due for Traceability#10608061, Traced PO Line Items#10608062, Quantity Traced#10608063, PO Line Items Traced on Time#10608064, delivery_quarter#10608065, Fulfillment Status#10608066, isCurrentQuarter#10608067, nike_po_line_items#10608068, mtz_po_line_items#10608069]
Arguments: [brand_context_id#10608057, Supplier Name#10608058, Supplier UID#10608059, PO Line Item TT#10608060, PO Line Items Due for Traceability#10608061, Traced PO Line Items#10608062, Quantity Traced#10608063, PO Line Items Traced on Time#10608064, delivery_quarter#10608065, Fulfillment Status#10608066, isCurrentQuarter#10608067, nike_po_line_items#10608068, mtz_po_line_items#10608069]

(2) InMemoryRelation
Arguments: [brand_context_id#10608057, Supplier Name#10608058, Supplier UID#10608059, PO Line Item TT#10608060, PO Line Items Due for Traceability#10608061, Traced PO Line Items#10608062, Quantity Traced#10608063, PO Line Items Traced on Time#10608064, delivery_quarter#10608065, Fulfillment Status#10608066, isCurrentQuarter#10608067, nike_po_line_items#10608068, mtz_po_line_items#10608069], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@7795a5ad,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] [brand_context_id#10608057,Supplier Name#10608058,Supplier UID#10608059,PO Line Item TT#10608060,PO Line Items Due for Traceability#10608061,Traced PO Line Items#10608062,Quantity Traced#10608063,PO Line Items Traced on Time#10608064,delivery_quarter#10608065,Fulfillment Status#10608066,isCurrentQuarter#10608067,nike_po_line_items#10608068,mtz_po_line_items#10608069] PushedFilters: [], ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Li...
,None)

(3) Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  [codegen id : 1]
Output [13]: [brand_context_id#10608057, Supplier Name#10608058, Supplier UID#10608059, PO Line Item TT#10608060, PO Line Items Due for Traceability#10608061, Traced PO Line Items#10608062, Quantity Traced#10608063, PO Line Items Traced on Time#10608064, delivery_quarter#10608065, Fulfillment Status#10608066, isCurrentQuarter#10608067, nike_po_line_items#10608068, mtz_po_line_items#10608069]
ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Line Items Due for Traceability:int,Traced PO Line Items:int,Quantity Traced:double,PO Line Items Traced on Time:int,delivery_quarter:string,Fulfillment Status:string,isCurrentQuarter:int,nike_po_line_items:int,mtz_po_line_items:int>

(4) TableCacheQueryStage
Output [13]: [brand_context_id#10608057, Supplier Name#10608058, Supplier UID#10608059, PO Line Item TT#10608060, PO Line Items Due for Traceability#10608061, Traced PO Line Items#10608062, Quantity Traced#10608063, PO Line Items Traced on Time#10608064, delivery_quarter#10608065, Fulfillment Status#10608066, isCurrentQuarter#10608067, nike_po_line_items#10608068, mtz_po_line_items#10608069]
Arguments: 0

(5) DeserializeToObject
Input [13]: [brand_context_id#10608057, Supplier Name#10608058, Supplier UID#10608059, PO Line Item TT#10608060, PO Line Items Due for Traceability#10608061, Traced PO Line Items#10608062, Quantity Traced#10608063, PO Line Items Traced on Time#10608064, delivery_quarter#10608065, Fulfillment Status#10608066, isCurrentQuarter#10608067, nike_po_line_items#10608068, mtz_po_line_items#10608069]
Arguments: createexternalrow(brand_context_id#10608057.toString, Supplier Name#10608058.toString, Supplier UID#10608059.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#10608060, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#10608061, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#10608062, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#10608063, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#10608064, true, false, true), delivery_quarter#10608065.toString, Fulfillment Status#10608066.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#10608067, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#10608068, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#10608069, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#10609476: org.apache.spark.sql.Row

(6) DeserializeToObject
Input [13]: [brand_context_id#10608057, Supplier Name#10608058, Supplier UID#10608059, PO Line Item TT#10608060, PO Line Items Due for Traceability#10608061, Traced PO Line Items#10608062, Quantity Traced#10608063, PO Line Items Traced on Time#10608064, delivery_quarter#10608065, Fulfillment Status#10608066, isCurrentQuarter#10608067, nike_po_line_items#10608068, mtz_po_line_items#10608069]
Arguments: createexternalrow(brand_context_id#10608057.toString, Supplier Name#10608058.toString, Supplier UID#10608059.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#10608060, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#10608061, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#10608062, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#10608063, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#10608064, true, false, true), delivery_quarter#10608065.toString, Fulfillment Status#10608066.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#10608067, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#10608068, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#10608069, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#10609476: org.apache.spark.sql.Row

(7) AdaptiveSparkPlan
Output [1]: [obj#10609476]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.shuffle.partitions	10