aboutsummaryrefslogtreecommitdiff
path: root/docs
diff options
context:
space:
mode:
authorAndrew Or <andrew@databricks.com>2014-12-04 21:53:49 -0800
committerAndrew Or <andrew@databricks.com>2014-12-04 21:53:49 -0800
commitfd8525334c443fbdc7dd58a62cb1aecae51b460b (patch)
tree68f935d34051ae6eb65bd8f46f354c8d0d631ae7 /docs
parent87437df036305c6f467dc6e0bf7891d27d266a6b (diff)
downloadspark-fd8525334c443fbdc7dd58a62cb1aecae51b460b.tar.gz
spark-fd8525334c443fbdc7dd58a62cb1aecae51b460b.tar.bz2
spark-fd8525334c443fbdc7dd58a62cb1aecae51b460b.zip
Revert "SPARK-2624 add datanucleus jars to the container in yarn-cluster"
This reverts commit a975dc32799bb8a14f9e1c76defaaa7cfbaf8b53.
Diffstat (limited to 'docs')
-rw-r--r--docs/running-on-yarn.md15
1 files changed, 0 insertions, 15 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md
index e97ac9f0c4..16897dbb65 100644
--- a/docs/running-on-yarn.md
+++ b/docs/running-on-yarn.md
@@ -139,21 +139,6 @@ Most of the configs are the same for Spark on YARN as for other deployment modes
The maximum number of threads to use in the application master for launching executor containers.
</td>
</tr>
-<tr>
- <td><code>spark.yarn.datanucleus.dir</code></td>
- <td>$SPARK_HOME/lib</td>
- <td>
- The location of the DataNucleus jars, in case overriding the default location is desired.
- By default, Spark on YARN will use the DataNucleus jars installed at
- <code>$SPARK_HOME/lib</code>, but the jars can also be in a world-readable location on HDFS.
- This allows YARN to cache it on nodes so that it doesn't need to be distributed each time an
- application runs. To point to a directory on HDFS, for example, set this configuration to
- "hdfs:///some/path".
-
- This is required because the datanucleus jars cannot be packaged into the
- assembly jar due to metadata conflicts (involving <code>plugin.xml</code>.)
- </td>
-</tr>
</table>
# Launching Spark on YARN