RDD Storage Info for AdaptiveSparkPlan isFinalPlan=false +- Filter isnotnull(canonical_id#14936236) +- InMemoryTableScan [brand_context_id#14936228, supplier_id#14936229, canonical_id#14936236, is_primary#14936237, entity_name#14936230, city#14936231, state#14936232, country#14936233, threshold#14936238, create_date#14936239], [isnotnull(canonical_id#14936236)] +- InMemoryRelation [brand_context_id#14936228, supplier_id#14936229, entity_name#14936230, city#14936231, state#14936232, country#14936233, supplier_type#14936234, declaring_supplier_id#14936235, canonical_id#14936236, is_primary#14936237, threshold#14936238, create_date#14936239], StorageLevel(disk, memory, deserialized, 1 replicas) +- *(1) Scan JDBCRelation(( SELECT DISTINCT v.brand_context_id, v.supplier_id, v.entity_name, v.city, v.state, v.country, v.supplier_type, v.declaring_supplier_id, ...

  • Storage Level: Disk Memory Deserialized 1x Replicated
  • Cached Partitions: 1
  • Total Partitions: 1
  • Memory Size: 1043.2 KiB
  • Disk Size: 0.0 B

Data Distribution on 1 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.244.3.32:44655 1043.2 KiB (4.0 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B

1 Partitions

Page:
Block Name Storage Level Size in Memory ▴ Size on Disk Executors
rdd_158475_0 Memory Deserialized 1x Replicated 1043.2 KiB 0.0 B 10.244.3.32:44655
Page: