Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
To regulate pending and running executors we determine the executors which are eligible to kill and kill them iteratively rather than a loop. This does an RPC call and is synchronized leading to lock contention for SparkListenerBus.
Side effect - listener bus is blocked while we iteratively remove executors.