diff options
| author | Kousuke Saruta <sarutak@oss.nttdata.co.jp> | 2014-09-05 11:07:00 -0700 |
|---|---|---|
| committer | Josh Rosen <joshrosen@apache.org> | 2014-09-05 11:07:00 -0700 |
| commit | 7ff8c45d714e0f2315910838b739c0c034672015 (patch) | |
| tree | b7f108326c72e2e11178c9eb26a067593b9d29e0 /bin/pyspark | |
| parent | 62c557609929982eeec170fe12f810bedfcf97f2 (diff) | |
| download | spark-7ff8c45d714e0f2315910838b739c0c034672015.tar.gz spark-7ff8c45d714e0f2315910838b739c0c034672015.tar.bz2 spark-7ff8c45d714e0f2315910838b739c0c034672015.zip | |
[SPARK-3399][PySpark] Test for PySpark should ignore HADOOP_CONF_DIR and YARN_CONF_DIR
Author: Kousuke Saruta <sarutak@oss.nttdata.co.jp>
Closes #2270 from sarutak/SPARK-3399 and squashes the following commits:
7613be6 [Kousuke Saruta] Modified pyspark script to ignore environment variables YARN_CONF_DIR and HADOOP_CONF_DIR while testing
Diffstat (limited to 'bin/pyspark')
| -rwxr-xr-x | bin/pyspark | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/bin/pyspark b/bin/pyspark index f553b314c5..26a16dd600 100755 --- a/bin/pyspark +++ b/bin/pyspark @@ -85,6 +85,8 @@ export PYSPARK_SUBMIT_ARGS # For pyspark tests if [[ -n "$SPARK_TESTING" ]]; then + unset YARN_CONF_DIR + unset HADOOP_CONF_DIR if [[ -n "$PYSPARK_DOC_TEST" ]]; then exec "$PYSPARK_PYTHON" -m doctest $1 else |