diff options
author | Matei Zaharia <matei@databricks.com> | 2014-04-05 20:52:05 -0700 |
---|---|---|
committer | Matei Zaharia <matei@databricks.com> | 2014-04-05 20:52:05 -0700 |
commit | 0b855167818b9afd2d2aa9f617b9861d77b2425d (patch) | |
tree | c0f4258b8b6ec6ffcdc805a069e77bbfe1cab84f /docs | |
parent | 890d63bd4e16296ac70e151b3754727ea42b583c (diff) | |
download | spark-0b855167818b9afd2d2aa9f617b9861d77b2425d.tar.gz spark-0b855167818b9afd2d2aa9f617b9861d77b2425d.tar.bz2 spark-0b855167818b9afd2d2aa9f617b9861d77b2425d.zip |
SPARK-1421. Make MLlib work on Python 2.6
The reason it wasn't working was passing a bytearray to stream.write(), which is not supported in Python 2.6 but is in 2.7. (This array came from NumPy when we converted data to send it over to Java). Now we just convert those bytearrays to strings of bytes, which preserves nonprintable characters as well.
Author: Matei Zaharia <matei@databricks.com>
Closes #335 from mateiz/mllib-python-2.6 and squashes the following commits:
f26c59f [Matei Zaharia] Update docs to no longer say we need Python 2.7
a84d6af [Matei Zaharia] SPARK-1421. Make MLlib work on Python 2.6
Diffstat (limited to 'docs')
-rw-r--r-- | docs/mllib-guide.md | 3 | ||||
-rw-r--r-- | docs/python-programming-guide.md | 2 |
2 files changed, 2 insertions, 3 deletions
diff --git a/docs/mllib-guide.md b/docs/mllib-guide.md index 203d235bf9..a5e0cc5080 100644 --- a/docs/mllib-guide.md +++ b/docs/mllib-guide.md @@ -38,6 +38,5 @@ depends on native Fortran routines. You may need to install the if it is not already present on your nodes. MLlib will throw a linking error if it cannot detect these libraries automatically. -To use MLlib in Python, you will need [NumPy](http://www.numpy.org) version 1.7 or newer -and Python 2.7. +To use MLlib in Python, you will need [NumPy](http://www.numpy.org) version 1.7 or newer. diff --git a/docs/python-programming-guide.md b/docs/python-programming-guide.md index cbe7d820b4..c2e5327324 100644 --- a/docs/python-programming-guide.md +++ b/docs/python-programming-guide.md @@ -152,7 +152,7 @@ Many of the methods also contain [doctests](http://docs.python.org/2/library/doc # Libraries [MLlib](mllib-guide.html) is also available in PySpark. To use it, you'll need -[NumPy](http://www.numpy.org) version 1.7 or newer, and Python 2.7. The [MLlib guide](mllib-guide.html) contains +[NumPy](http://www.numpy.org) version 1.7 or newer. The [MLlib guide](mllib-guide.html) contains some example applications. # Where to Go from Here |