diff options
| author | Josh Rosen <joshrosen@databricks.com> | 2016-03-14 10:48:24 -0700 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2016-03-14 10:48:24 -0700 |
| commit | 9a87afd7d1dbcee993d58e648c74aa683d91f07e (patch) | |
| tree | 80b0652ccc8c55228cc05423bcc2ad6c6f39b4f1 /bin | |
| parent | 9a1680c2c85da4096bad71743debb2ccacdfd79f (diff) | |
| download | spark-9a87afd7d1dbcee993d58e648c74aa683d91f07e.tar.gz spark-9a87afd7d1dbcee993d58e648c74aa683d91f07e.tar.bz2 spark-9a87afd7d1dbcee993d58e648c74aa683d91f07e.zip | |
[SPARK-13833] Guard against race condition when re-caching disk blocks in memory
When reading data from the DiskStore and attempting to cache it back into the memory store, we should guard against race conditions where multiple readers are attempting to re-cache the same block in memory.
This patch accomplishes this by synchronizing on the block's `BlockInfo` object while trying to re-cache a block.
(Will file JIRA as soon as ASF JIRA stops being down / laggy).
Author: Josh Rosen <joshrosen@databricks.com>
Closes #11660 from JoshRosen/concurrent-recaching-fixes.
Diffstat (limited to 'bin')
0 files changed, 0 insertions, 0 deletions