Spark Jobs (?)

  • User: spark
  • Total Uptime: 85.4 h
  • Scheduling Mode: FAIR
  • Completed Jobs: 34161, only showing 961
Event Timeline

Completed Jobs (34161, only showing 961)

Job Id ▾ Description Submitted Duration Stages: Succeeded/Total Tasks (for all stages): Succeeded/Total
34160 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:13:06 23 ms 1/1 (1 skipped)
1/1 (1 skipped)
34159 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:13:06 7 ms 1/1
1/1
34158 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:13:06 48 ms 1/1
1/1
34157 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:13:06 6 ms 1/1 (1 skipped)
1/1
34156 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:13:05 7 ms 1/1
1/1
34155 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:13:05 6 ms 1/1 (1 skipped)
1/1 (1 skipped)
34154 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:13:05 7 ms 1/1
1/1
34153 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:13:05 0.4 s 1/1
1/1
34152 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 06:03:00 0.2 s 1/1 (2 skipped)
21/21 (2 skipped)
34151 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:03:00 7 ms 1/1 (3 skipped)
1/1 (23 skipped)
34150 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:03:00 91 ms 1/1 (2 skipped)
21/21 (2 skipped)
34149 collect at /opt/app/scheduler/jobs/dedup_job.py:386 collect at /opt/app/scheduler/jobs/dedup_job.py:386 2026/10/20 06:03:00 14 ms 1/1 (3 skipped)
1/1 (23 skipped)
34148 collect at /opt/app/scheduler/jobs/dedup_job.py:386 collect at /opt/app/scheduler/jobs/dedup_job.py:386 2026/10/20 06:02:59 0.1 s 1/1 (2 skipped)
21/21 (2 skipped)
34147 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:59 7 ms 1/1 (3 skipped)
1/1 (23 skipped)
34146 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:59 93 ms 1/1 (2 skipped)
21/21 (2 skipped)
34145 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:59 0.1 s 1/1 (2 skipped)
21/21 (2 skipped)
34144 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 06:02:57 2 s 1/1 (1 skipped)
1/1 (1 skipped)
34143 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:55 4 s 1/1
1/1
34142 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:55 2 s 1/1
1/1
34141 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 06:02:55 55 ms 1/1 (1 skipped)
1/1 (1 skipped)
34140 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 06:02:55 35 ms 1/1 (1 skipped)
1/1 (1 skipped)
34139 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:55 0.3 s 1/1
1/1
34138 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:55 0.3 s 1/1
1/1
34137 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:55 0.3 s 1/1
1/1
34136 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:55 0.3 s 1/1
1/1
34135 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:55 0.2 s 1/1
1/1
34134 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:55 0.2 s 1/1
1/1
34133 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 06:02:54 97 ms 1/1
1/1
34132 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 06:02:54 92 ms 1/1
1/1
34131 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 06:02:54 57 ms 1/1
1/1
34130 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 06:02:54 20 ms 1/1
1/1
34129 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:54 5 ms 1/1 (1 skipped)
1/1 (1 skipped)
34128 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:54 6 ms 1/1
1/1
34127 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:54 10 ms 1/1 (1 skipped)
1/1 (1 skipped)
34126 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:54 6 ms 1/1
1/1
34125 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:54 40 ms 1/1
1/1
34124 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:54 6 ms 1/1 (1 skipped)
1/1 (1 skipped)
34123 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:54 6 ms 1/1
1/1
34122 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:54 8 ms 1/1
1/1
34121 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:54 6 ms 1/1 (1 skipped)
1/1 (1 skipped)
34120 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:54 7 ms 1/1
1/1
34119 count at <unknown>:0 count at <unknown>:0 2026/10/20 06:02:53 0.4 s 1/1
1/1
34118 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:52:56 24 ms 1/1 (1 skipped)
1/1 (1 skipped)
34117 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:52:56 7 ms 1/1
1/1
34116 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:52:56 46 ms 1/1
1/1
34115 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:52:56 6 ms 1/1 (1 skipped)
1/1
34114 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:52:56 13 ms 1/1
1/1
34113 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:52:56 6 ms 1/1 (1 skipped)
1/1 (1 skipped)
34112 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:52:56 7 ms 1/1
1/1
34111 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:52:56 0.3 s 1/1
1/1
34110 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:42:52 8 ms 1/1 (1 skipped)
1/1 (1 skipped)
34109 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:42:52 7 ms 1/1
1/1
34108 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:42:52 90 ms 1/1
1/1
34107 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:42:52 5 ms 1/1 (1 skipped)
1/1
34106 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:42:52 19 ms 1/1
1/1
34105 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:42:52 6 ms 1/1 (1 skipped)
1/1 (1 skipped)
34104 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:42:52 7 ms 1/1
1/1
34103 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:42:52 0.4 s 1/1
1/1
34102 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 05:40:00 0.8 s 1/1
1/1
34101 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:40:00 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
34100 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:40:00 33 ms 1/1
1/1
34099 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:40:00 0.3 s 1/1
1/1
34098 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 05:39:59 1 s 1/1
1/1
34097 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:59 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
34096 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:59 29 ms 1/1
1/1
34095 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:58 0.3 s 1/1
1/1
34094 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 05:39:57 0.9 s 1/1
1/1
34093 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:57 6 ms 1/1 (1 skipped)
1/1 (1 skipped)
34092 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:57 7 ms 1/1
1/1
34091 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:57 0.3 s 1/1
1/1
34090 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 05:39:56 1.0 s 1/1
1/1
34089 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:56 6 ms 1/1 (1 skipped)
1/1 (1 skipped)
34088 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:56 6 ms 1/1
1/1
34087 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:55 0.4 s 1/1
1/1
34086 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 05:39:55 0.2 s 1/1
1/1
34085 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:55 6 ms 1/1 (1 skipped)
1/1 (1 skipped)
34084 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:54 1 s 1/1
1/1
34083 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 05:39:54 1 s 1/1
1/1
34082 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:54 0.2 s 1/1
1/1
34081 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 05:39:54 97 ms 1/1
1/1
34080 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 2026/10/20 05:39:54 74 ms 1/1
1/1
34079 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/20 05:39:54 80 ms 1/1
1/1
34078 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:54 63 ms 1/1 (1 skipped)
1/1 (1 skipped)
34077 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 2026/10/20 05:39:54 59 ms 1/1 (1 skipped)
1/1 (1 skipped)
34076 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:54 58 ms 1/1 (1 skipped)
1/1 (1 skipped)
34075 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/20 05:39:54 92 ms 1/1
1/1
34074 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:54 45 ms 1/1
1/1
34073 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 2026/10/20 05:39:54 95 ms 1/1
1/1
34072 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:54 0.1 s 1/1
1/1
34071 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 2026/10/20 05:39:53 0.3 s 1/1
1/1
34070 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:53 0.3 s 1/1
1/1
34069 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/20 05:39:53 0.3 s 1/1 (1 skipped)
1/1 (1 skipped)
34068 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 2026/10/20 05:39:53 0.4 s 1/1
1/1
34067 count at <unknown>:0 count at <unknown>:0 2026/10/20 05:39:53 0.4 s 1/1
1/1
34066 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/20 05:39:53 0.2 s 1/1
1/1
34065 collectToPython at <unknown>:0 collectToPython at <unknown>:0 2026/10/20 05:39:52 2 s 1/1
1/1
34064 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 2026/10/20 05:39:52 2 s 1/1
1/1
34063 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 2026/10/20 05:39:52 2 s 1/1
1/1
34062 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/20 05:39:52 2 s 1/1
1/1
34061 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 05:39:52 1 s 1/1
1/1