diff options
| author | Thomas Graves <tgraves@apache.org> | 2014-10-02 13:52:54 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@apache.org> | 2014-10-02 13:52:54 -0700 |
| commit | 127e97bee1e6aae7b70263bc5944b7be6f4e6fea (patch) | |
| tree | 7a6f5b7ae2fc2f058a803bcb85a71354de2b1ca9 /docs/mllib-naive-bayes.md | |
| parent | 5db78e6b87d33ac2d48a997e69b46e9be3b63137 (diff) | |
| download | spark-127e97bee1e6aae7b70263bc5944b7be6f4e6fea.tar.gz spark-127e97bee1e6aae7b70263bc5944b7be6f4e6fea.tar.bz2 spark-127e97bee1e6aae7b70263bc5944b7be6f4e6fea.zip | |
[SPARK-3632] ConnectionManager can run out of receive threads with authentication on
If you turn authentication on and you are using a lot of executors. There is a chance that all the of the threads in the handleMessageExecutor could be waiting to send a message because they are blocked waiting on authentication to happen. This can cause a temporary deadlock until the connection times out.
To fix it, I got rid of the wait/notify and use a single outbox but only send security messages from it until authentication has completed.
Author: Thomas Graves <tgraves@apache.org>
Closes #2484 from tgravescs/cm_threads_auth and squashes the following commits:
a0a961d [Thomas Graves] give it a type
b6bc80b [Thomas Graves] Rework comments
d6d4175 [Thomas Graves] update from comments
081b765 [Thomas Graves] cleanup
4d7f8f5 [Thomas Graves] Change to not use wait/notify while waiting for authentication
Diffstat (limited to 'docs/mllib-naive-bayes.md')
0 files changed, 0 insertions, 0 deletions