DataHubScheduler - Details for Query 5960

Submitted Time: 2026/10/18 14:08:02
Duration: 0.2 s
Succeeded Jobs: 24954

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; 1 [labelType="html" label=" DeserializeToObject "]; 2 [labelType="html" label="InMemoryTableScan number of output rows: 5"]; subgraph cluster3 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 0 ms"; 4 [labelType="html" label="Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] number of output rows: 0"]; } 1->0; 2->1; 4->2; }

AdaptiveSparkPlan isFinalPlan=true

DeserializeToObject createexternalrow(brand_context_id#14520954.toString, Supplier Name#14520955.toString, Supplier UID#14520956.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#14520957, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#14520958, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#14520959, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#14520960, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#14520961, true, false, true), delivery_quarter#14520962.toString, Fulfillment Status#14520963.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#14520964, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#14520965, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#14520966, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#14524239: org.apache.spark.sql.Row

InMemoryTableScan [brand_context_id#14520954, Supplier Name#14520955, Supplier UID#14520956, PO Line Item TT#14520957, PO Line Items Due for Traceability#14520958, Traced PO Line Items#14520959, Quantity Traced#14520960, PO Line Items Traced on Time#14520961, delivery_quarter#14520962, Fulfillment Status#14520963, isCurrentQuarter#14520964, nike_po_line_items#14520965, mtz_po_line_items#14520966]

Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] [brand_context_id#14520954,Supplier Name#14520955,Supplier UID#14520956,PO Line Item TT#14520957,PO Line Items Due for Traceability#14520958,Traced PO Line Items#14520959,Quantity Traced#14520960,PO Line Items Traced on Time#14520961,delivery_quarter#14520962,Fulfillment Status#14520963,isCurrentQuarter#14520964,nike_po_line_items#14520965,mtz_po_line_items#14520966] PushedFilters: [], ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Li...

WholeStageCodegen (1)

Details

== Physical Plan ==
AdaptiveSparkPlan (7)
+- == Final Plan ==
   DeserializeToObject (5)
   +- TableCacheQueryStage (4), Statistics(sizeInBytes=655.0 B, rowCount=5)
      +- InMemoryTableScan (1)
            +- InMemoryRelation (2)
                  +- * Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  (3)
+- == Initial Plan ==
   DeserializeToObject (6)
   +- InMemoryTableScan (1)
         +- InMemoryRelation (2)
               +- * Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  (3)


(1) InMemoryTableScan
Output [13]: [brand_context_id#14520954, Supplier Name#14520955, Supplier UID#14520956, PO Line Item TT#14520957, PO Line Items Due for Traceability#14520958, Traced PO Line Items#14520959, Quantity Traced#14520960, PO Line Items Traced on Time#14520961, delivery_quarter#14520962, Fulfillment Status#14520963, isCurrentQuarter#14520964, nike_po_line_items#14520965, mtz_po_line_items#14520966]
Arguments: [brand_context_id#14520954, Supplier Name#14520955, Supplier UID#14520956, PO Line Item TT#14520957, PO Line Items Due for Traceability#14520958, Traced PO Line Items#14520959, Quantity Traced#14520960, PO Line Items Traced on Time#14520961, delivery_quarter#14520962, Fulfillment Status#14520963, isCurrentQuarter#14520964, nike_po_line_items#14520965, mtz_po_line_items#14520966]

(2) InMemoryRelation
Arguments: [brand_context_id#14520954, Supplier Name#14520955, Supplier UID#14520956, PO Line Item TT#14520957, PO Line Items Due for Traceability#14520958, Traced PO Line Items#14520959, Quantity Traced#14520960, PO Line Items Traced on Time#14520961, delivery_quarter#14520962, Fulfillment Status#14520963, isCurrentQuarter#14520964, nike_po_line_items#14520965, mtz_po_line_items#14520966], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@730ae8bf,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] [brand_context_id#14520954,Supplier Name#14520955,Supplier UID#14520956,PO Line Item TT#14520957,PO Line Items Due for Traceability#14520958,Traced PO Line Items#14520959,Quantity Traced#14520960,PO Line Items Traced on Time#14520961,delivery_quarter#14520962,Fulfillment Status#14520963,isCurrentQuarter#14520964,nike_po_line_items#14520965,mtz_po_line_items#14520966] PushedFilters: [], ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Li...
,None)

(3) Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  [codegen id : 1]
Output [13]: [brand_context_id#14520954, Supplier Name#14520955, Supplier UID#14520956, PO Line Item TT#14520957, PO Line Items Due for Traceability#14520958, Traced PO Line Items#14520959, Quantity Traced#14520960, PO Line Items Traced on Time#14520961, delivery_quarter#14520962, Fulfillment Status#14520963, isCurrentQuarter#14520964, nike_po_line_items#14520965, mtz_po_line_items#14520966]
ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Line Items Due for Traceability:int,Traced PO Line Items:int,Quantity Traced:double,PO Line Items Traced on Time:int,delivery_quarter:string,Fulfillment Status:string,isCurrentQuarter:int,nike_po_line_items:int,mtz_po_line_items:int>

(4) TableCacheQueryStage
Output [13]: [brand_context_id#14520954, Supplier Name#14520955, Supplier UID#14520956, PO Line Item TT#14520957, PO Line Items Due for Traceability#14520958, Traced PO Line Items#14520959, Quantity Traced#14520960, PO Line Items Traced on Time#14520961, delivery_quarter#14520962, Fulfillment Status#14520963, isCurrentQuarter#14520964, nike_po_line_items#14520965, mtz_po_line_items#14520966]
Arguments: 0

(5) DeserializeToObject
Input [13]: [brand_context_id#14520954, Supplier Name#14520955, Supplier UID#14520956, PO Line Item TT#14520957, PO Line Items Due for Traceability#14520958, Traced PO Line Items#14520959, Quantity Traced#14520960, PO Line Items Traced on Time#14520961, delivery_quarter#14520962, Fulfillment Status#14520963, isCurrentQuarter#14520964, nike_po_line_items#14520965, mtz_po_line_items#14520966]
Arguments: createexternalrow(brand_context_id#14520954.toString, Supplier Name#14520955.toString, Supplier UID#14520956.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#14520957, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#14520958, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#14520959, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#14520960, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#14520961, true, false, true), delivery_quarter#14520962.toString, Fulfillment Status#14520963.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#14520964, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#14520965, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#14520966, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#14524239: org.apache.spark.sql.Row

(6) DeserializeToObject
Input [13]: [brand_context_id#14520954, Supplier Name#14520955, Supplier UID#14520956, PO Line Item TT#14520957, PO Line Items Due for Traceability#14520958, Traced PO Line Items#14520959, Quantity Traced#14520960, PO Line Items Traced on Time#14520961, delivery_quarter#14520962, Fulfillment Status#14520963, isCurrentQuarter#14520964, nike_po_line_items#14520965, mtz_po_line_items#14520966]
Arguments: createexternalrow(brand_context_id#14520954.toString, Supplier Name#14520955.toString, Supplier UID#14520956.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#14520957, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#14520958, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#14520959, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#14520960, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#14520961, true, false, true), delivery_quarter#14520962.toString, Fulfillment Status#14520963.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#14520964, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#14520965, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#14520966, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#14524239: org.apache.spark.sql.Row

(7) AdaptiveSparkPlan
Output [1]: [obj#14524239]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.shuffle.partitions	10