Spark Jobs (?)

  • User: spark
  • Total Uptime: 64.0 h
  • Scheduling Mode: FAIR
  • Completed Jobs: 27752, only showing 952
Event Timeline

Completed Jobs (27752, only showing 952)

Job Id ▾ Description Submitted Duration Stages: Succeeded/Total Tasks (for all stages): Succeeded/Total
27751 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:52:56 6 ms 1/1 (1 skipped)
1/1 (1 skipped)
27750 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:52:56 8 ms 1/1
1/1
27749 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:52:56 37 ms 1/1
1/1
27748 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:52:56 6 ms 1/1 (1 skipped)
1/1
27747 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:52:56 6 ms 1/1
1/1
27746 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:52:56 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
27745 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:52:56 7 ms 1/1
1/1
27744 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:52:56 0.4 s 1/1
1/1
27743 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:42:53 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
27742 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:42:53 8 ms 1/1
1/1
27741 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:42:53 38 ms 1/1
1/1
27740 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:42:53 7 ms 1/1 (1 skipped)
1/1
27739 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:42:53 7 ms 1/1
1/1
27738 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:42:53 8 ms 1/1 (1 skipped)
1/1 (1 skipped)
27737 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:42:53 8 ms 1/1
1/1
27736 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:42:53 0.3 s 1/1
1/1
27735 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:32:59 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
27734 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:32:59 7 ms 1/1
1/1
27733 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:32:59 40 ms 1/1
1/1
27732 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:32:59 7 ms 1/1 (1 skipped)
1/1
27731 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:32:59 7 ms 1/1
1/1
27730 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:32:59 8 ms 1/1 (1 skipped)
1/1 (1 skipped)
27729 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:32:59 9 ms 1/1
1/1
27728 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:32:59 0.4 s 1/1
1/1
27727 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:23:14 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
27726 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:23:14 17 ms 1/1
1/1
27725 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:23:13 50 ms 1/1
1/1
27724 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:23:13 6 ms 1/1 (1 skipped)
1/1
27723 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:23:13 8 ms 1/1
1/1
27722 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:23:13 8 ms 1/1 (1 skipped)
1/1 (1 skipped)
27721 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:23:13 8 ms 1/1
1/1
27720 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:23:13 0.3 s 1/1
1/1
27719 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/19 08:13:18 0.2 s 1/1 (2 skipped)
21/21 (2 skipped)
27718 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:18 7 ms 1/1 (3 skipped)
1/1 (23 skipped)
27717 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:17 0.1 s 1/1 (2 skipped)
21/21 (2 skipped)
27716 collect at /opt/app/scheduler/jobs/dedup_job.py:386 collect at /opt/app/scheduler/jobs/dedup_job.py:386 2026/10/19 08:13:17 15 ms 1/1 (3 skipped)
1/1 (23 skipped)
27715 collect at /opt/app/scheduler/jobs/dedup_job.py:386 collect at /opt/app/scheduler/jobs/dedup_job.py:386 2026/10/19 08:13:17 0.2 s 1/1 (2 skipped)
21/21 (2 skipped)
27714 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:17 8 ms 1/1 (3 skipped)
1/1 (23 skipped)
27713 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:17 0.1 s 1/1 (2 skipped)
21/21 (2 skipped)
27712 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:17 0.2 s 1/1 (2 skipped)
21/21 (2 skipped)
27711 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/19 08:13:17 33 ms 1/1 (1 skipped)
1/1 (1 skipped)
27710 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:12 4 s 1/1
1/1
27709 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:12 2 s 1/1
1/1
27708 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/19 08:13:12 15 ms 1/1 (1 skipped)
1/1 (1 skipped)
27707 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/19 08:13:12 96 ms 1/1 (1 skipped)
1/1 (1 skipped)
27706 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:12 0.3 s 1/1
1/1
27705 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:12 0.3 s 1/1
1/1
27704 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:12 0.5 s 1/1
1/1
27703 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:12 0.5 s 1/1
1/1
27702 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/19 08:13:12 0.2 s 1/1
1/1
27701 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/19 08:13:12 0.2 s 1/1
1/1
27700 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:12 0.3 s 1/1
1/1
27699 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:12 0.3 s 1/1
1/1
27698 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/19 08:13:12 89 ms 1/1
1/1
27697 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/19 08:13:12 22 ms 1/1
1/1
27696 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:11 26 ms 1/1 (1 skipped)
1/1 (1 skipped)
27695 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:11 7 ms 1/1
1/1
27694 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:11 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
27693 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:11 48 ms 1/1
1/1
27692 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:11 0.1 s 1/1
1/1
27691 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:11 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
27690 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:11 7 ms 1/1
1/1
27689 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:11 53 ms 1/1
1/1
27688 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:11 42 ms 1/1 (1 skipped)
1/1 (1 skipped)
27687 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:11 9 ms 1/1
1/1
27686 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:13:10 0.4 s 1/1
1/1
27685 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:44 0.7 s 1/1
1/1
27684 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:44 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
27683 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:44 8 ms 1/1
1/1
27682 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:44 0.2 s 1/1
1/1
27681 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:43 1 s 1/1
1/1
27680 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:42 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
27679 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:42 8 ms 1/1
1/1
27678 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:42 0.3 s 1/1
1/1
27677 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:41 1 s 1/1
1/1
27676 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:41 26 ms 1/1 (1 skipped)
1/1 (1 skipped)
27675 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:41 8 ms 1/1
1/1
27674 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:41 0.3 s 1/1
1/1
27673 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:39 1 s 1/1
1/1
27672 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:39 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
27671 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:39 7 ms 1/1
1/1
27670 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:39 0.4 s 1/1
1/1
27669 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/19 08:07:39 0.1 s 1/1
1/1
27668 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:07:39 8 ms 1/1 (1 skipped)
1/1 (1 skipped)
27667 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:07:38 1 s 1/1
1/1
27666 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:38 1 s 1/1
1/1
27665 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:07:37 66 ms 1/1
1/1
27664 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:37 6 ms 1/1 (1 skipped)
1/1 (1 skipped)
27663 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:37 0.1 s 1/1
1/1
27662 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:37 0.4 s 1/1
1/1
27661 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/19 08:07:37 0.4 s 1/1
1/1
27660 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:37 0.4 s 1/1
1/1
27659 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/19 08:07:37 0.1 s 1/1
1/1
27658 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:07:37 98 ms 1/1 (1 skipped)
1/1 (1 skipped)
27657 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:169 2026/10/19 08:07:36 1 s 1/1
1/1
27656 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/19 08:07:36 1 s 1/1
1/1
27655 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:07:35 1 s 1/1 (1 skipped)
1/1 (1 skipped)
27654 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:07:35 1 s 1/1
1/1
27653 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 first at /opt/app/scheduler/jobs/batch_table_copy_job.py:182 2026/10/19 08:07:35 1 s 1/1
1/1
27652 count at <unknown>:0 count at <unknown>:0 2026/10/19 08:07:35 0.2 s 1/1 (1 skipped)
1/1 (1 skipped)