DataHubScheduler - Details for Query 1713

Submitted Time: 2026/10/17 08:07:36
Duration: 0.2 s
Succeeded Jobs: 2521

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; 1 [labelType="html" label=" DeserializeToObject "]; 2 [labelType="html" label="InMemoryTableScan number of output rows: 5"]; subgraph cluster3 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 0 ms"; 4 [labelType="html" label="Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] number of output rows: 0"]; } 1->0; 2->1; 4->2; }

AdaptiveSparkPlan isFinalPlan=true

DeserializeToObject createexternalrow(brand_context_id#994595.toString, Supplier Name#994596.toString, Supplier UID#994597.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#994598, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#994599, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#994600, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#994601, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#994602, true, false, true), delivery_quarter#994603.toString, Fulfillment Status#994604.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#994605, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#994606, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#994607, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#998366: org.apache.spark.sql.Row

InMemoryTableScan [brand_context_id#994595, Supplier Name#994596, Supplier UID#994597, PO Line Item TT#994598, PO Line Items Due for Traceability#994599, Traced PO Line Items#994600, Quantity Traced#994601, PO Line Items Traced on Time#994602, delivery_quarter#994603, Fulfillment Status#994604, isCurrentQuarter#994605, nike_po_line_items#994606, mtz_po_line_items#994607]

Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] [brand_context_id#994595,Supplier Name#994596,Supplier UID#994597,PO Line Item TT#994598,PO Line Items Due for Traceability#994599,Traced PO Line Items#994600,Quantity Traced#994601,PO Line Items Traced on Time#994602,delivery_quarter#994603,Fulfillment Status#994604,isCurrentQuarter#994605,nike_po_line_items#994606,mtz_po_line_items#994607] PushedFilters: [], ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Li...

WholeStageCodegen (1)

Details

== Physical Plan ==
AdaptiveSparkPlan (7)
+- == Final Plan ==
   DeserializeToObject (5)
   +- TableCacheQueryStage (4), Statistics(sizeInBytes=655.0 B, rowCount=5)
      +- InMemoryTableScan (1)
            +- InMemoryRelation (2)
                  +- * Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  (3)
+- == Initial Plan ==
   DeserializeToObject (6)
   +- InMemoryTableScan (1)
         +- InMemoryRelation (2)
               +- * Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  (3)


(1) InMemoryTableScan
Output [13]: [brand_context_id#994595, Supplier Name#994596, Supplier UID#994597, PO Line Item TT#994598, PO Line Items Due for Traceability#994599, Traced PO Line Items#994600, Quantity Traced#994601, PO Line Items Traced on Time#994602, delivery_quarter#994603, Fulfillment Status#994604, isCurrentQuarter#994605, nike_po_line_items#994606, mtz_po_line_items#994607]
Arguments: [brand_context_id#994595, Supplier Name#994596, Supplier UID#994597, PO Line Item TT#994598, PO Line Items Due for Traceability#994599, Traced PO Line Items#994600, Quantity Traced#994601, PO Line Items Traced on Time#994602, delivery_quarter#994603, Fulfillment Status#994604, isCurrentQuarter#994605, nike_po_line_items#994606, mtz_po_line_items#994607]

(2) InMemoryRelation
Arguments: [brand_context_id#994595, Supplier Name#994596, Supplier UID#994597, PO Line Item TT#994598, PO Line Items Due for Traceability#994599, Traced PO Line Items#994600, Quantity Traced#994601, PO Line Items Traced on Time#994602, delivery_quarter#994603, Fulfillment Status#994604, isCurrentQuarter#994605, nike_po_line_items#994606, mtz_po_line_items#994607], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@730ae8bf,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1] [brand_context_id#994595,Supplier Name#994596,Supplier UID#994597,PO Line Item TT#994598,PO Line Items Due for Traceability#994599,Traced PO Line Items#994600,Quantity Traced#994601,PO Line Items Traced on Time#994602,delivery_quarter#994603,Fulfillment Status#994604,isCurrentQuarter#994605,nike_po_line_items#994606,mtz_po_line_items#994607] PushedFilters: [], ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Li...
,None)

(3) Scan JDBCRelation(dbo.fact_supplier_performance_po_line_item) [numPartitions=1]  [codegen id : 1]
Output [13]: [brand_context_id#994595, Supplier Name#994596, Supplier UID#994597, PO Line Item TT#994598, PO Line Items Due for Traceability#994599, Traced PO Line Items#994600, Quantity Traced#994601, PO Line Items Traced on Time#994602, delivery_quarter#994603, Fulfillment Status#994604, isCurrentQuarter#994605, nike_po_line_items#994606, mtz_po_line_items#994607]
ReadSchema: struct<brand_context_id:string,Supplier Name:string,Supplier UID:string,PO Line Item TT:int,PO Line Items Due for Traceability:int,Traced PO Line Items:int,Quantity Traced:double,PO Line Items Traced on Time:int,delivery_quarter:string,Fulfillment Status:string,isCurrentQuarter:int,nike_po_line_items:int,mtz_po_line_items:int>

(4) TableCacheQueryStage
Output [13]: [brand_context_id#994595, Supplier Name#994596, Supplier UID#994597, PO Line Item TT#994598, PO Line Items Due for Traceability#994599, Traced PO Line Items#994600, Quantity Traced#994601, PO Line Items Traced on Time#994602, delivery_quarter#994603, Fulfillment Status#994604, isCurrentQuarter#994605, nike_po_line_items#994606, mtz_po_line_items#994607]
Arguments: 0

(5) DeserializeToObject
Input [13]: [brand_context_id#994595, Supplier Name#994596, Supplier UID#994597, PO Line Item TT#994598, PO Line Items Due for Traceability#994599, Traced PO Line Items#994600, Quantity Traced#994601, PO Line Items Traced on Time#994602, delivery_quarter#994603, Fulfillment Status#994604, isCurrentQuarter#994605, nike_po_line_items#994606, mtz_po_line_items#994607]
Arguments: createexternalrow(brand_context_id#994595.toString, Supplier Name#994596.toString, Supplier UID#994597.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#994598, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#994599, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#994600, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#994601, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#994602, true, false, true), delivery_quarter#994603.toString, Fulfillment Status#994604.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#994605, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#994606, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#994607, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#998366: org.apache.spark.sql.Row

(6) DeserializeToObject
Input [13]: [brand_context_id#994595, Supplier Name#994596, Supplier UID#994597, PO Line Item TT#994598, PO Line Items Due for Traceability#994599, Traced PO Line Items#994600, Quantity Traced#994601, PO Line Items Traced on Time#994602, delivery_quarter#994603, Fulfillment Status#994604, isCurrentQuarter#994605, nike_po_line_items#994606, mtz_po_line_items#994607]
Arguments: createexternalrow(brand_context_id#994595.toString, Supplier Name#994596.toString, Supplier UID#994597.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Item TT#994598, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Due for Traceability#994599, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, Traced PO Line Items#994600, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, Quantity Traced#994601, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, PO Line Items Traced on Time#994602, true, false, true), delivery_quarter#994603.toString, Fulfillment Status#994604.toString, staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, isCurrentQuarter#994605, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, nike_po_line_items#994606, true, false, true), staticinvoke(class java.lang.Integer, ObjectType(class java.lang.Integer), valueOf, mtz_po_line_items#994607, true, false, true), StructField(brand_context_id,StringType,true), StructField(Supplier Name,StringType,true), StructField(Supplier UID,StringType,true), StructField(PO Line Item TT,IntegerType,true), StructField(PO Line Items Due for Traceability,IntegerType,true), StructField(Traced PO Line Items,IntegerType,true), StructField(Quantity Traced,DoubleType,true), StructField(PO Line Items Traced on Time,IntegerType,true), StructField(delivery_quarter,StringType,true), StructField(Fulfillment Status,StringType,true), StructField(isCurrentQuarter,IntegerType,true), ... 2 more fields), obj#998366: org.apache.spark.sql.Row

(7) AdaptiveSparkPlan
Output [1]: [obj#998366]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.shuffle.partitions	10