diff options
| author | Reynold Xin <rxin@databricks.com> | 2016-02-26 22:35:12 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-02-26 22:35:12 -0800 |
| commit | 59e3e10be2f9a1c53979ca72c038adb4fa17ca64 (patch) | |
| tree | 3d6b2246738484273d36d0ccbec66b733930a3e0 /docs/configuration.md | |
| parent | f77dc4e1e202942aa8393fb5d8f492863973fe17 (diff) | |
| download | spark-59e3e10be2f9a1c53979ca72c038adb4fa17ca64.tar.gz spark-59e3e10be2f9a1c53979ca72c038adb4fa17ca64.tar.bz2 spark-59e3e10be2f9a1c53979ca72c038adb4fa17ca64.zip | |
[SPARK-13521][BUILD] Remove reference to Tachyon in cluster & release scripts
## What changes were proposed in this pull request?
We provide a very limited set of cluster management script in Spark for Tachyon, although Tachyon itself provides a much better version of it. Given now Spark users can simply use Tachyon as a normal file system and does not require extensive configurations, we can remove this management capabilities to simplify Spark bash scripts.
Note that this also reduces coupling between a 3rd party external system and Spark's release scripts, and would eliminate possibility for failures such as Tachyon being renamed or the tar balls being relocated.
## How was this patch tested?
N/A
Author: Reynold Xin <rxin@databricks.com>
Closes #11400 from rxin/release-script.
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 24 |
1 files changed, 0 insertions, 24 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 4b1b00720b..e9b66238bd 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -929,30 +929,6 @@ Apart from these, the following properties are also available, and may be useful mapping has high overhead for blocks close to or below the page size of the operating system. </td> </tr> -<tr> - <td><code>spark.externalBlockStore.blockManager</code></td> - <td>org.apache.spark.storage.TachyonBlockManager</td> - <td> - Implementation of external block manager (file system) that store RDDs. The file system's URL is set by - <code>spark.externalBlockStore.url</code>. - </td> -</tr> -<tr> - <td><code>spark.externalBlockStore.baseDir</code></td> - <td>System.getProperty("java.io.tmpdir")</td> - <td> - Directories of the external block store that store RDDs. The file system's URL is set by - <code>spark.externalBlockStore.url</code> It can also be a comma-separated list of multiple - directories on Tachyon file system. - </td> -</tr> -<tr> - <td><code>spark.externalBlockStore.url</code></td> - <td>tachyon://localhost:19998 for Tachyon</td> - <td> - The URL of the underlying external blocker file system in the external block store. - </td> -</tr> </table> #### Networking |