Spark Jobs (?)

  • User: spark
  • Total Uptime: 86.9 h
  • Scheduling Mode: FAIR
  • Completed Jobs: 34936, only showing 936
Event Timeline

Completed Jobs (34936, only showing 936)

Job Id ▾ Description Submitted Duration Stages: Succeeded/Total Tasks (for all stages): Succeeded/Total
34935 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:42:54 26 ms 1/1 (1 skipped)
1/1 (1 skipped)
34934 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:42:54 15 ms 1/1
1/1
34933 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:42:54 59 ms 1/1
1/1
34932 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:42:54 5 ms 1/1 (1 skipped)
1/1
34931 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:42:54 9 ms 1/1
1/1
34930 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:42:54 6 ms 1/1 (1 skipped)
1/1 (1 skipped)
34929 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:42:54 7 ms 1/1
1/1
34928 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:42:54 0.3 s 1/1
1/1
34927 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:32:59 0.4 s 1/1 (2 skipped)
21/21 (2 skipped)
34926 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:59 7 ms 1/1 (3 skipped)
1/1 (23 skipped)
34925 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:59 95 ms 1/1 (2 skipped)
21/21 (2 skipped)
34924 collect at /opt/app/scheduler/jobs/dedup_job.py:386 collect at /opt/app/scheduler/jobs/dedup_job.py:386 2026/10/20 07:32:59 14 ms 1/1 (3 skipped)
1/1 (23 skipped)
34923 collect at /opt/app/scheduler/jobs/dedup_job.py:386 collect at /opt/app/scheduler/jobs/dedup_job.py:386 2026/10/20 07:32:58 0.2 s 1/1 (2 skipped)
21/21 (2 skipped)
34922 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:58 6 ms 1/1 (3 skipped)
1/1 (23 skipped)
34921 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:58 93 ms 1/1 (2 skipped)
21/21 (2 skipped)
34920 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:58 0.1 s 1/1 (2 skipped)
21/21 (2 skipped)
34919 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:32:58 27 ms 1/1 (1 skipped)
1/1 (1 skipped)
34918 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:54 4 s 1/1
1/1
34917 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:54 2 s 1/1
1/1
34916 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:32:54 61 ms 1/1 (1 skipped)
1/1 (1 skipped)
34915 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:32:54 63 ms 1/1 (1 skipped)
1/1 (1 skipped)
34914 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:54 0.3 s 1/1
1/1
34913 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:54 0.5 s 1/1
1/1
34912 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:54 0.5 s 1/1
1/1
34911 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:54 0.5 s 1/1
1/1
34910 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:54 0.3 s 1/1
1/1
34909 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:32:54 0.3 s 1/1
1/1
34908 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:54 0.3 s 1/1
1/1
34907 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:32:53 0.1 s 1/1
1/1
34906 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:32:53 76 ms 1/1
1/1
34905 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:32:53 69 ms 1/1
1/1
34904 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:53 15 ms 1/1 (1 skipped)
1/1 (1 skipped)
34903 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:53 11 ms 1/1
1/1
34902 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:53 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
34901 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:53 30 ms 1/1
1/1
34900 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:53 62 ms 1/1
1/1
34899 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:53 6 ms 1/1 (1 skipped)
1/1 (1 skipped)
34898 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:53 6 ms 1/1
1/1
34897 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:53 18 ms 1/1
1/1
34896 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:53 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
34895 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:53 8 ms 1/1
1/1
34894 count at <unknown>:0 count at <unknown>:0 2026/10/20 07:32:52 0.4 s 1/1
1/1
34893 collect at /opt/app/scheduler/jobs/memory_probe.py:76 collect at /opt/app/scheduler/jobs/memory_probe.py:76 2026/10/20 07:30:33 0.2 s 1/1
2/2
34892 collect at /opt/app/scheduler/jobs/memory_probe.py:76 collect at /opt/app/scheduler/jobs/memory_probe.py:76 2026/10/20 07:30:25 0.2 s 1/1
2/2
34891 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:25 0.2 s 1/1 (1 skipped)
5/5 (1 skipped)
34890 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:25 44 ms 1/1
1/1
34889 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:25 94 ms 1/1
1/1
34888 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:23 2 s 1/1 (1 skipped)
5/5 (1 skipped)
34887 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:22 0.3 s 1/1 (1 skipped)
5/5 (1 skipped)
34886 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:22 0.2 s 1/1 (1 skipped)
5/5 (1 skipped)
34885 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:22 74 ms 1/1
1/1
34884 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:22 0.6 s 1/1 (1 skipped)
5/5 (1 skipped)
34883 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:21 92 ms 1/1
1/1
34882 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:19 2 s 1/1 (1 skipped)
5/5 (1 skipped)
34881 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:19 2 s 1/1 (1 skipped)
5/5 (1 skipped)
34880 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:19 0.1 s 1/1
1/1
34879 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:19 0.2 s 1/1 (1 skipped)
5/5 (1 skipped)
34878 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:18 0.7 s 1/1 (1 skipped)
5/5 (1 skipped)
34877 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:18 0.3 s 1/1 (1 skipped)
5/5 (1 skipped)
34876 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:18 50 ms 1/1 (1 skipped)
5/5 (1 skipped)
34875 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:18 0.7 s 1/1 (1 skipped)
5/5 (1 skipped)
34874 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:18 0.6 s 1/1
1/1
34873 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:30:17 21 ms 1/1 (1 skipped)
5/5 (1 skipped)
34872 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:17 0.2 s 1/1 (1 skipped)
5/5 (1 skipped)
34871 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:17 66 ms 1/1
1/1
34870 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:17 94 ms 1/1
1/1
34869 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:15 2 s 1/1 (1 skipped)
5/5 (1 skipped)
34868 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:15 0.2 s 1/1 (1 skipped)
2/2 (1 skipped)
34867 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:15 53 ms 1/1
1/1
34866 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:15 0.1 s 1/1
1/1
34865 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:14 1 s 1/1 (1 skipped)
5/5 (1 skipped)
34864 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:14 0.9 s 1/1 (1 skipped)
2/2 (1 skipped)
34863 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:13 4 s 1/1 (1 skipped)
5/5 (1 skipped)
34862 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:13 0.3 s 1/1 (1 skipped)
5/5 (1 skipped)
34861 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:13 0.2 s 1/1 (1 skipped)
2/2 (1 skipped)
34860 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:13 0.1 s 1/1 (1 skipped)
5/5 (1 skipped)
34859 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:13 28 ms 1/1 (1 skipped)
5/5 (1 skipped)
34858 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:13 0.2 s 1/1
1/1
34857 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:13 0.2 s 1/1 (1 skipped)
2/2 (1 skipped)
34856 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:13 5 s 1/2
5/6
34855 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:13 5 s 1/1 (1 skipped)
5/5 (1 skipped)
34854 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:30:13 0.3 s 1/1 (1 skipped)
5/5 (1 skipped)
34853 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:13 68 ms 1/1 (1 skipped)
2/2 (1 skipped)
34852 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:12 0.1 s 1/1
1/1
34851 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:12 0.4 s 1/1 (1 skipped)
5/5 (1 skipped)
34850 jdbc at <unknown>:0 jdbc at <unknown>:0 2026/10/20 07:30:12 0.2 s 1/1 (1 skipped)
2/2 (1 skipped)
34849 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:12 0.1 s 1/1 (1 skipped)
5/5 (1 skipped)
34848 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:12 0.7 s 1/2
5/6
34847 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:12 0.2 s 1/1 (1 skipped)
5/5 (1 skipped)
34846 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:12 84 ms 1/1 (1 skipped)
2/2 (1 skipped)
34845 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:30:12 0.1 s 1/1 (1 skipped)
5/5 (1 skipped)
34844 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:30:12 20 ms 1/1 (1 skipped)
2/2 (1 skipped)
34843 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:30:12 0.2 s 1/1
1/1
34842 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 $anonfun$withThreadLocalCaptured$1 at <unknown>:0 2026/10/20 07:30:12 1.0 s 1/1
1/1
34841 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:12 0.2 s 1/1
1/1
34840 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:12 0.3 s 1/1
1/1
34839 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:12 0.1 s 1/2
2/3
34838 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:12 0.1 s 1/1 (1 skipped)
2/2 (1 skipped)
34837 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:12 0.3 s 1/2
5/6
34836 javaToPython at <unknown>:0 javaToPython at <unknown>:0 2026/10/20 07:30:12 0.3 s 1/1 (1 skipped)
5/5 (1 skipped)