RDD Storage Info for AdaptiveSparkPlan isFinalPlan=false +- Filter isnotnull(canonical_id#8983068) +- InMemoryTableScan [brand_context_id#8983060, supplier_id#8983061, canonical_id#8983068, is_primary#8983069, entity_name#8983062, city#8983063, state#8983064, country#8983065, threshold#8983070, create_date#8983071], [isnotnull(canonical_id#8983068)] +- InMemoryRelation [brand_context_id#8983060, supplier_id#8983061, entity_name#8983062, city#8983063, state#8983064, country#8983065, supplier_type#8983066, declaring_supplier_id#8983067, canonical_id#8983068, is_primary#8983069, threshold#8983070, create_date#8983071], StorageLevel(disk, memory, deserialized, 1 replicas) +- *(1) Scan JDBCRelation(( SELECT DISTINCT v.brand_context_id, v.supplier_id, v.entity_name, v.city, v.state, v.country, v.supplier_type, v.declaring_supplier_id, v.canonical_id, ...

  • Storage Level: Disk Memory Deserialized 1x Replicated
  • Cached Partitions: 1
  • Total Partitions: 1
  • Memory Size: 0.0 B
  • Disk Size: 450.7 KiB

Data Distribution on 1 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.244.3.26:41441 0.0 B (4.0 GiB Remaining) 0.0 B (0.0 B Remaining) 450.7 KiB

1 Partitions

Page:
Block Name Storage Level ▴ Size in Memory Size on Disk Executors
rdd_63187_0 Disk Serialized 1x Replicated 0.0 B 450.7 KiB 10.244.3.26:41441
Page: