diff options
| author | Andrew Or <andrew@databricks.com> | 2014-10-25 20:07:44 -0700 |
|---|---|---|
| committer | Josh Rosen <joshrosen@databricks.com> | 2014-10-25 20:07:44 -0700 |
| commit | c6834440085b79f6d3e011f9e55ffd672be855fe (patch) | |
| tree | 39b61fcfbed7ebbb0cf3994b8be0955e16bff15b /sql | |
| parent | 2e52e4f815b3110912ecdb8ed18aa4b2209abcfb (diff) | |
| download | spark-c6834440085b79f6d3e011f9e55ffd672be855fe.tar.gz spark-c6834440085b79f6d3e011f9e55ffd672be855fe.tar.bz2 spark-c6834440085b79f6d3e011f9e55ffd672be855fe.zip | |
[SPARK-4071] Unroll fails silently if BlockManager is small
In tests, we may want to have BlockManagers of size < 1MB (spark.storage.unrollMemoryThreshold). However, these BlockManagers are useless because we can't unroll anything in them ever. At the very least we need to log a warning.
tdas
Author: Andrew Or <andrew@databricks.com>
Closes #2917 from andrewor14/unroll-safely-logging and squashes the following commits:
38947e3 [Andrew Or] Warn against starting a block manager that's too small
fd621b4 [Andrew Or] Warn against failure to reserve initial memory threshold
Diffstat (limited to 'sql')
0 files changed, 0 insertions, 0 deletions