DataHubScheduler - Details for Query 8265

Submitted Time: 2026/10/16 14:07:55
Duration: 1 s
Succeeded Jobs: 25785

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; 1 [labelType="html" label=" DeserializeToObject "]; 2 [labelType="html" label="InMemoryTableScan number of output rows: 5"]; subgraph cluster3 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 0 ms"; 4 [labelType="html" label="Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] number of output rows: 0"]; } 1->0; 2->1; 4->2; }

AdaptiveSparkPlan isFinalPlan=true

DeserializeToObject createexternalrow(brand_context_id#20586360.toString, Supplier Name#20586361.toString, Supplier UID#20586362.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#20586363, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#20586364, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#20586365, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#20586366, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#20586367, true, false, true), delivery_quarter#20586368.toString, Fulfillment Status#20586369.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#20586370, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#20586371, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#20586372, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#20590287: org.apache.spark.sql.Row

InMemoryTableScan [brand_context_id#20586360, Supplier Name#20586361, Supplier UID#20586362, PO Line Item TT#20586363, PO Line Items Due for Traceability#20586364, Traced PO Line Items#20586365, Quantity Traced#20586366, PO Line Items Traced on Time#20586367, delivery_quarter#20586368, Fulfillment Status#20586369, isCurrentQuarter#20586370, nike_po_line_items#20586371, mtz_po_line_items#20586372]

Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] [brand_context_id#20586360,Supplier Name#20586361,Supplier UID#20586362,PO Line Item TT#20586363,PO Line Items Due for Traceability#20586364,Traced PO Line Items#20586365,Quantity Traced#20586366,PO Line Items Traced on Time#20586367,delivery_quarter#20586368,Fulfillment Status#20586369,isCurrentQuarter#20586370,nike_po_line_items#20586371,mtz_po_line_items#20586372] PushedFilters: [], ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Li...

WholeStageCodegen (1)

Details

== Physical Plan ==
AdaptiveSparkPlan (7)
+- == Final Plan ==
   DeserializeToObject (5)
   +- TableCacheQueryStage (4), Statistics(sizeInBytes=655.0 B, rowCount=5)
      +- InMemoryTableScan (1)
            +- InMemoryRelation (2)
                  +- * Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  (3)
+- == Initial Plan ==
   DeserializeToObject (6)
   +- InMemoryTableScan (1)
         +- InMemoryRelation (2)
               +- * Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  (3)


(1) InMemoryTableScan
Output [13]: [brand_context_id#20586360, Supplier Name#20586361, Supplier UID#20586362, PO Line Item TT#20586363, PO Line Items Due for Traceability#20586364, Traced PO Line Items#20586365, Quantity Traced#20586366, PO Line Items Traced on Time#20586367, delivery_quarter#20586368, Fulfillment Status#20586369, isCurrentQuarter#20586370, nike_po_line_items#20586371, mtz_po_line_items#20586372]
Arguments: [brand_context_id#20586360, Supplier Name#20586361, Supplier UID#20586362, PO Line Item TT#20586363, PO Line Items Due for Traceability#20586364, Traced PO Line Items#20586365, Quantity Traced#20586366, PO Line Items Traced on Time#20586367, delivery_quarter#20586368, Fulfillment Status#20586369, isCurrentQuarter#20586370, nike_po_line_items#20586371, mtz_po_line_items#20586372]

(2) InMemoryRelation
Arguments: [brand_context_id#20586360, Supplier Name#20586361, Supplier UID#20586362, PO Line Item TT#20586363, PO Line Items Due for Traceability#20586364, Traced PO Line Items#20586365, Quantity Traced#20586366, PO Line Items Traced on Time#20586367, delivery_quarter#20586368, Fulfillment Status#20586369, isCurrentQuarter#20586370, nike_po_line_items#20586371, mtz_po_line_items#20586372], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@14de14ab,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] [brand_context_id#20586360,Supplier Name#20586361,Supplier UID#20586362,PO Line Item TT#20586363,PO Line Items Due for Traceability#20586364,Traced PO Line Items#20586365,Quantity Traced#20586366,PO Line Items Traced on Time#20586367,delivery_quarter#20586368,Fulfillment Status#20586369,isCurrentQuarter#20586370,nike_po_line_items#20586371,mtz_po_line_items#20586372] PushedFilters: [], ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Li...
,None)

(3) Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  [codegen id : 1]
Output [13]: [brand_context_id#20586360, Supplier Name#20586361, Supplier UID#20586362, PO Line Item TT#20586363, PO Line Items Due for Traceability#20586364, Traced PO Line Items#20586365, Quantity Traced#20586366, PO Line Items Traced on Time#20586367, delivery_quarter#20586368, Fulfillment Status#20586369, isCurrentQuarter#20586370, nike_po_line_items#20586371, mtz_po_line_items#20586372]
ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Line Items Due for Traceability:int,Traced PO Line Items:int,Quantity Traced:double,PO Line Items Traced on Time:int,delivery_quarter:string,Fulfillment Status:string,isCurrentQuarter:int,nike_po_line_items:int,mtz_po_line_items:int>

(4) TableCacheQueryStage
Output [13]: [brand_context_id#20586360, Supplier Name#20586361, Supplier UID#20586362, PO Line Item TT#20586363, PO Line Items Due for Traceability#20586364, Traced PO Line Items#20586365, Quantity Traced#20586366, PO Line Items Traced on Time#20586367, delivery_quarter#20586368, Fulfillment Status#20586369, isCurrentQuarter#20586370, nike_po_line_items#20586371, mtz_po_line_items#20586372]
Arguments: 0

(5) DeserializeToObject
Input [13]: [brand_context_id#20586360, Supplier Name#20586361, Supplier UID#20586362, PO Line Item TT#20586363, PO Line Items Due for Traceability#20586364, Traced PO Line Items#20586365, Quantity Traced#20586366, PO Line Items Traced on Time#20586367, delivery_quarter#20586368, Fulfillment Status#20586369, isCurrentQuarter#20586370, nike_po_line_items#20586371, mtz_po_line_items#20586372]
Arguments: createexternalrow(brand_context_id#20586360.toString, Supplier Name#20586361.toString, Supplier UID#20586362.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#20586363, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#20586364, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#20586365, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#20586366, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#20586367, true, false, true), delivery_quarter#20586368.toString, Fulfillment Status#20586369.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#20586370, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#20586371, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#20586372, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#20590287: org.apache.spark.sql.Row

(6) DeserializeToObject
Input [13]: [brand_context_id#20586360, Supplier Name#20586361, Supplier UID#20586362, PO Line Item TT#20586363, PO Line Items Due for Traceability#20586364, Traced PO Line Items#20586365, Quantity Traced#20586366, PO Line Items Traced on Time#20586367, delivery_quarter#20586368, Fulfillment Status#20586369, isCurrentQuarter#20586370, nike_po_line_items#20586371, mtz_po_line_items#20586372]
Arguments: createexternalrow(brand_context_id#20586360.toString, Supplier Name#20586361.toString, Supplier UID#20586362.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#20586363, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#20586364, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#20586365, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#20586366, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#20586367, true, false, true), delivery_quarter#20586368.toString, Fulfillment Status#20586369.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#20586370, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#20586371, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#20586372, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#20590287: org.apache.spark.sql.Row

(7) AdaptiveSparkPlan
Output [1]: [obj#20590287]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.shuffle.partitions	10