3.5.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
DataHubScheduler
application UI
Details for Stage 34045 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
8 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
18.1 KiB / 1
Associated Job Ids:
24294
DAG Visualization
digraph G { subgraph clusterstage_34045 { label="Stage 34045"; 148105 [labelType="html" label="JDBCRDD [148105]<br>cache at <unknown>:0"]; subgraph cluster357905 { label="WholeStageCodegen (1)"; 148269 [labelType="html" label="MapPartitionsRDD [148269]<br>javaToPython at <unknown>:0"]; } subgraph cluster357904 { label="AdaptiveSparkPlan"; 148270 [labelType="html" label="MapPartitionsRDD [148270]<br>javaToPython at <unknown>:0"]; 148271 [labelType="html" label="*(1) Project [Country#14184882, ISO3#14184883, ISO2#14184884, Region#14184885, GHG_Emissions#14184886, Trade_Unions#14184887, Wages#14184888, Working_Time#14184889, Gender_Based_Violence#14184890, Hazardous_Chemicals#14184891, Bribery_and_Corruption#14184892, Water#14184893, Health_and_Safety#14184894, Forced_Labor#14184895, Child_Labor#14184896, Land_Use_and_Biodiversity#14184897, lower(trim(Country#14184882, None)) AS _country_key#14184914, CASE WHEN ((((((((((((CASE WHEN isnotnull(Child_Labor#14184896) THEN 1 ELSE 0 END + CASE WHEN isnotnull(Forced_Labor#14184895) THEN 1 ELSE 0 END) + CASE WHEN isnotnull(Gender_Based_Violence#14184890) THEN 1 ELSE 0 END) + CASE WHEN isnotnull(Wages#14184888) THEN 1 ELSE 0 END) + CASE WHEN isnotnull(Working_Time#14184889) THEN 1 ELSE 0 END) + CASE WHEN isnotnull(Trade_Unions#14184887) THEN 1 ELSE 0 END) + CASE WHEN isnotnull(Health_and_Safety#14184894) THEN 1 ELSE 0 END) + CASE WHEN isnotnull(GHG_Emissions#14184886) THEN 1 ELSE 0 END) + CASE WHEN isnotnull(Hazardous_Chem... [148271] [Cached]<br>javaToPython at <unknown>:0"]; } subgraph cluster361889 { label="InMemoryTableScan"; 149804 [labelType="html" label="MapPartitionsRDD [149804]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; 149805 [labelType="html" label="MapPartitionsRDD [149805]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; 149806 [labelType="html" label="MapPartitionsRDD [149806]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } subgraph cluster361885 { label="WholeStageCodegen (1)"; 149807 [labelType="html" label="MapPartitionsRDD [149807]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } subgraph cluster361884 { label="BroadcastExchange"; 149808 [labelType="html" label="MapPartitionsRDD [149808]<br>$anonfun$withThreadLocalCaptured$1 at <unknown>:0"]; } } 148105->148269; 148269->148270; 148270->148271; 148271->149804; 149804->149805; 149805->149806; 149806->149807; 149807->149808; }
148271
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time