DataHubScheduler - Details for Query 7165

Submitted Time: 2026/10/19 05:40:33
Duration: 0.2 s
Succeeded Jobs: 26858

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; 1 [labelType="html" label=" DeserializeToObject "]; 2 [labelType="html" label="InMemoryTableScan number of output rows: 5"]; subgraph cluster3 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 0 ms"; 4 [labelType="html" label="Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] number of output rows: 0"]; } 1->0; 2->1; 4->2; }

AdaptiveSparkPlan isFinalPlan=true

DeserializeToObject createexternalrow(brand_context_id#15125187.toString, Supplier Name#15125188.toString, Supplier UID#15125189.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#15125190, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#15125191, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#15125192, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#15125193, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#15125194, true, false, true), delivery_quarter#15125195.toString, Fulfillment Status#15125196.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#15125197, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#15125198, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#15125199, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#15128466: org.apache.spark.sql.Row

InMemoryTableScan [brand_context_id#15125187, Supplier Name#15125188, Supplier UID#15125189, PO Line Item TT#15125190, PO Line Items Due for Traceability#15125191, Traced PO Line Items#15125192, Quantity Traced#15125193, PO Line Items Traced on Time#15125194, delivery_quarter#15125195, Fulfillment Status#15125196, isCurrentQuarter#15125197, nike_po_line_items#15125198, mtz_po_line_items#15125199]

Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] [brand_context_id#15125187,Supplier Name#15125188,Supplier UID#15125189,PO Line Item TT#15125190,PO Line Items Due for Traceability#15125191,Traced PO Line Items#15125192,Quantity Traced#15125193,PO Line Items Traced on Time#15125194,delivery_quarter#15125195,Fulfillment Status#15125196,isCurrentQuarter#15125197,nike_po_line_items#15125198,mtz_po_line_items#15125199] PushedFilters: [], ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Li...

WholeStageCodegen (1)

Details

== Physical Plan ==
AdaptiveSparkPlan (7)
+- == Final Plan ==
   DeserializeToObject (5)
   +- TableCacheQueryStage (4), Statistics(sizeInBytes=655.0 B, rowCount=5)
      +- InMemoryTableScan (1)
            +- InMemoryRelation (2)
                  +- * Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  (3)
+- == Initial Plan ==
   DeserializeToObject (6)
   +- InMemoryTableScan (1)
         +- InMemoryRelation (2)
               +- * Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  (3)


(1) InMemoryTableScan
Output [13]: [brand_context_id#15125187, Supplier Name#15125188, Supplier UID#15125189, PO Line Item TT#15125190, PO Line Items Due for Traceability#15125191, Traced PO Line Items#15125192, Quantity Traced#15125193, PO Line Items Traced on Time#15125194, delivery_quarter#15125195, Fulfillment Status#15125196, isCurrentQuarter#15125197, nike_po_line_items#15125198, mtz_po_line_items#15125199]
Arguments: [brand_context_id#15125187, Supplier Name#15125188, Supplier UID#15125189, PO Line Item TT#15125190, PO Line Items Due for Traceability#15125191, Traced PO Line Items#15125192, Quantity Traced#15125193, PO Line Items Traced on Time#15125194, delivery_quarter#15125195, Fulfillment Status#15125196, isCurrentQuarter#15125197, nike_po_line_items#15125198, mtz_po_line_items#15125199]

(2) InMemoryRelation
Arguments: [brand_context_id#15125187, Supplier Name#15125188, Supplier UID#15125189, PO Line Item TT#15125190, PO Line Items Due for Traceability#15125191, Traced PO Line Items#15125192, Quantity Traced#15125193, PO Line Items Traced on Time#15125194, delivery_quarter#15125195, Fulfillment Status#15125196, isCurrentQuarter#15125197, nike_po_line_items#15125198, mtz_po_line_items#15125199], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@730ae8bf,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] [brand_context_id#15125187,Supplier Name#15125188,Supplier UID#15125189,PO Line Item TT#15125190,PO Line Items Due for Traceability#15125191,Traced PO Line Items#15125192,Quantity Traced#15125193,PO Line Items Traced on Time#15125194,delivery_quarter#15125195,Fulfillment Status#15125196,isCurrentQuarter#15125197,nike_po_line_items#15125198,mtz_po_line_items#15125199] PushedFilters: [], ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Li...
,None)

(3) Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  [codegen id : 1]
Output [13]: [brand_context_id#15125187, Supplier Name#15125188, Supplier UID#15125189, PO Line Item TT#15125190, PO Line Items Due for Traceability#15125191, Traced PO Line Items#15125192, Quantity Traced#15125193, PO Line Items Traced on Time#15125194, delivery_quarter#15125195, Fulfillment Status#15125196, isCurrentQuarter#15125197, nike_po_line_items#15125198, mtz_po_line_items#15125199]
ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Line Items Due for Traceability:int,Traced PO Line Items:int,Quantity Traced:double,PO Line Items Traced on Time:int,delivery_quarter:string,Fulfillment Status:string,isCurrentQuarter:int,nike_po_line_items:int,mtz_po_line_items:int>

(4) TableCacheQueryStage
Output [13]: [brand_context_id#15125187, Supplier Name#15125188, Supplier UID#15125189, PO Line Item TT#15125190, PO Line Items Due for Traceability#15125191, Traced PO Line Items#15125192, Quantity Traced#15125193, PO Line Items Traced on Time#15125194, delivery_quarter#15125195, Fulfillment Status#15125196, isCurrentQuarter#15125197, nike_po_line_items#15125198, mtz_po_line_items#15125199]
Arguments: 0

(5) DeserializeToObject
Input [13]: [brand_context_id#15125187, Supplier Name#15125188, Supplier UID#15125189, PO Line Item TT#15125190, PO Line Items Due for Traceability#15125191, Traced PO Line Items#15125192, Quantity Traced#15125193, PO Line Items Traced on Time#15125194, delivery_quarter#15125195, Fulfillment Status#15125196, isCurrentQuarter#15125197, nike_po_line_items#15125198, mtz_po_line_items#15125199]
Arguments: createexternalrow(brand_context_id#15125187.toString, Supplier Name#15125188.toString, Supplier UID#15125189.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#15125190, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#15125191, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#15125192, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#15125193, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#15125194, true, false, true), delivery_quarter#15125195.toString, Fulfillment Status#15125196.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#15125197, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#15125198, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#15125199, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#15128466: org.apache.spark.sql.Row

(6) DeserializeToObject
Input [13]: [brand_context_id#15125187, Supplier Name#15125188, Supplier UID#15125189, PO Line Item TT#15125190, PO Line Items Due for Traceability#15125191, Traced PO Line Items#15125192, Quantity Traced#15125193, PO Line Items Traced on Time#15125194, delivery_quarter#15125195, Fulfillment Status#15125196, isCurrentQuarter#15125197, nike_po_line_items#15125198, mtz_po_line_items#15125199]
Arguments: createexternalrow(brand_context_id#15125187.toString, Supplier Name#15125188.toString, Supplier UID#15125189.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#15125190, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#15125191, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#15125192, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#15125193, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#15125194, true, false, true), delivery_quarter#15125195.toString, Fulfillment Status#15125196.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#15125197, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#15125198, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#15125199, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#15128466: org.apache.spark.sql.Row

(7) AdaptiveSparkPlan
Output [1]: [obj#15128466]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.shuffle.partitions	10