| Stage Id ▾ | Pool Name | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write |
|---|---|---|---|---|---|---|---|---|---|
| 30038 | default | collect at /opt/app/scheduler/jobs/memory_probe.py:76 org.apache.spark.rdd.RDD.collect(RDD.scala:1048) org.apache.spark.api.python.PythonRDD$.collectAndServe(PythonRDD.scala:195) org.apache.spark.api.python.PythonRDD.collectAndServe(PythonRDD.scala) jdk.internal.reflect.GeneratedMethodAccessor477.invoke(Unknown Source) java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.base/java.lang.reflect.Method.invoke(Unknown Source) py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244) py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:374) py4j.Gateway.invoke(Gateway.java:282) py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132) py4j.commands.CallCommand.execute(CallCommand.java:79) py4j.ClientServerConnection.waitForCommands(ClientServerConnection.java:182) py4j.ClientServerConnection.run(ClientServerConnection.java:106) java.base/java.lang.Thread.run(Unknown Source) | 2026/10/18 07:30:00 | 1 s |
2/2
|