diff options
| author | Aaron Davidson <aaron@databricks.com> | 2014-07-16 14:10:17 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-07-16 14:10:17 -0700 |
| commit | 8867cd0bc2961fefed84901b8b14e9676ae6ab18 (patch) | |
| tree | 8abf9ad898a58b6dad65d4ec155c01ed622ec4f4 /conf | |
| parent | 7c8d123225bbdcc605642099b107c2d843e87340 (diff) | |
| download | spark-8867cd0bc2961fefed84901b8b14e9676ae6ab18.tar.gz spark-8867cd0bc2961fefed84901b8b14e9676ae6ab18.tar.bz2 spark-8867cd0bc2961fefed84901b8b14e9676ae6ab18.zip | |
SPARK-1097: Do not introduce deadlock while fixing concurrency bug
We recently added this lock on 'conf' in order to prevent concurrent creation. However, it turns out that this can introduce a deadlock because Hadoop also synchronizes on the Configuration objects when creating new Configurations (and they do so via a static REGISTRY which contains all created Configurations).
This fix forces all Spark initialization of Configuration objects to occur serially by using a static lock that we control, and thus also prevents introducing the deadlock.
Author: Aaron Davidson <aaron@databricks.com>
Closes #1409 from aarondav/1054 and squashes the following commits:
7d1b769 [Aaron Davidson] SPARK-1097: Do not introduce deadlock while fixing concurrency bug
Diffstat (limited to 'conf')
0 files changed, 0 insertions, 0 deletions