You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The spark driver will not exist when job is finished.
Affects Versions
master
What engines are you seeing the problem on?
Core
How to reproduce
Submit a spark job, and run insert overwrite.
The driver process will not exist when job finished.
Relevant log output
"pool-31-thread-1"#215 prio=5 os_prio=0 tid=0x00007f6ea5392000 nid=0x202fe waiting on condition [0x00007f6e9dda4000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to waitfor<0x00000000ad53afb8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Anything else
The RenewableBlocker create a thread pool which creating not daemon thead.
Are you willing to submit a PR?
Yes I am willing to submit a PR!
Code of Conduct
I agree to follow this project's Code of Conduct
The text was updated successfully, but these errors were encountered:
What happened?
The spark driver will not exist when job is finished.
Affects Versions
master
What engines are you seeing the problem on?
Core
How to reproduce
Submit a spark job, and run insert overwrite.
The driver process will not exist when job finished.
Relevant log output
Anything else
The RenewableBlocker create a thread pool which creating not daemon thead.
Are you willing to submit a PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: