diff options
| author | Josh Rosen <joshrosen@apache.org> | 2014-08-11 11:54:09 -0700 |
|---|---|---|
| committer | Josh Rosen <joshrosen@apache.org> | 2014-08-11 11:54:09 -0700 |
| commit | db06a81fb7a413faa3fe0f8c35918f70454cb05d (patch) | |
| tree | 7d6b7e1766aadf0a875d5577ee349b73c817ceef /python/run-tests | |
| parent | ba28a8fcbc3ba432e7ea4d6f0b535450a6ec96c6 (diff) | |
| download | spark-db06a81fb7a413faa3fe0f8c35918f70454cb05d.tar.gz spark-db06a81fb7a413faa3fe0f8c35918f70454cb05d.tar.bz2 spark-db06a81fb7a413faa3fe0f8c35918f70454cb05d.zip | |
[PySpark] [SPARK-2954] [SPARK-2948] [SPARK-2910] [SPARK-2101] Python 2.6 Fixes
- Modify python/run-tests to test with Python 2.6
- Use unittest2 when running on Python 2.6.
- Fix issue with namedtuple.
- Skip TestOutputFormat.test_newhadoop on Python 2.6 until SPARK-2951 is fixed.
- Fix MLlib _deserialize_double on Python 2.6.
Closes #1868. Closes #1042.
Author: Josh Rosen <joshrosen@apache.org>
Closes #1874 from JoshRosen/python2.6 and squashes the following commits:
983d259 [Josh Rosen] [SPARK-2954] Fix MLlib _deserialize_double on Python 2.6.
5d18fd7 [Josh Rosen] [SPARK-2948] [SPARK-2910] [SPARK-2101] Python 2.6 fixes
Diffstat (limited to 'python/run-tests')
| -rwxr-xr-x | python/run-tests | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/python/run-tests b/python/run-tests index 48feba2f5b..1218edcbd7 100755 --- a/python/run-tests +++ b/python/run-tests @@ -48,6 +48,14 @@ function run_test() { echo "Running PySpark tests. Output is in python/unit-tests.log." +# Try to test with Python 2.6, since that's the minimum version that we support: +if [ $(which python2.6) ]; then + export PYSPARK_PYTHON="python2.6" +fi + +echo "Testing with Python version:" +$PYSPARK_PYTHON --version + run_test "pyspark/rdd.py" run_test "pyspark/context.py" run_test "pyspark/conf.py" |