diff options
author | Sandeep <sandeep@techaddict.me> | 2014-04-15 00:19:43 -0700 |
---|---|---|
committer | Matei Zaharia <matei@databricks.com> | 2014-04-15 00:19:43 -0700 |
commit | df360917990ad95dde3c8e016ec42507d1566355 (patch) | |
tree | 621930a449382e043e58628a08db6e00d0843261 /docs | |
parent | c99bcb7feaa761c5826f2e1d844d0502a3b79538 (diff) | |
download | spark-df360917990ad95dde3c8e016ec42507d1566355.tar.gz spark-df360917990ad95dde3c8e016ec42507d1566355.tar.bz2 spark-df360917990ad95dde3c8e016ec42507d1566355.zip |
SPARK-1426: Make MLlib work with NumPy versions older than 1.7
Currently it requires NumPy 1.7 due to using the copyto method (http://docs.scipy.org/doc/numpy/reference/generated/numpy.copyto.html) for extracting data out of an array.
Replace it with a fallback
Author: Sandeep <sandeep@techaddict.me>
Closes #391 from techaddict/1426 and squashes the following commits:
d365962 [Sandeep] SPARK-1426: Make MLlib work with NumPy versions older than 1.7 Currently it requires NumPy 1.7 due to using the copyto method (http://docs.scipy.org/doc/numpy/reference/generated/numpy.copyto.html) for extracting data out of an array. Replace it with a fallback
Diffstat (limited to 'docs')
-rw-r--r-- | docs/mllib-guide.md | 9 | ||||
-rw-r--r-- | docs/python-programming-guide.md | 6 |
2 files changed, 7 insertions, 8 deletions
diff --git a/docs/mllib-guide.md b/docs/mllib-guide.md index a5e0cc5080..eff856104c 100644 --- a/docs/mllib-guide.md +++ b/docs/mllib-guide.md @@ -11,7 +11,7 @@ namely, binary classification, regression, clustering and collaborative filtering, as well as an underlying gradient descent optimization primitive. # Available Methods -The following links provide a detailed explanation of the methods and usage examples for each of them: +The following links provide a detailed explanation of the methods and usage examples for each of them: * <a href="mllib-classification-regression.html">Classification and Regression</a> * Binary Classification @@ -33,10 +33,9 @@ The following links provide a detailed explanation of the methods and usage exam # Dependencies MLlib uses the [jblas](https://github.com/mikiobraun/jblas) linear algebra library, which itself -depends on native Fortran routines. You may need to install the +depends on native Fortran routines. You may need to install the [gfortran runtime library](https://github.com/mikiobraun/jblas/wiki/Missing-Libraries) -if it is not already present on your nodes. MLlib will throw a linking error if it cannot +if it is not already present on your nodes. MLlib will throw a linking error if it cannot detect these libraries automatically. -To use MLlib in Python, you will need [NumPy](http://www.numpy.org) version 1.7 or newer. - +To use MLlib in Python, you will need [NumPy](http://www.numpy.org) version 1.4 or newer. diff --git a/docs/python-programming-guide.md b/docs/python-programming-guide.md index 888631e702..39de603b29 100644 --- a/docs/python-programming-guide.md +++ b/docs/python-programming-guide.md @@ -100,8 +100,8 @@ $ MASTER=local[4] ./bin/pyspark ## IPython -It is also possible to launch PySpark in [IPython](http://ipython.org), the -enhanced Python interpreter. PySpark works with IPython 1.0.0 and later. To +It is also possible to launch PySpark in [IPython](http://ipython.org), the +enhanced Python interpreter. PySpark works with IPython 1.0.0 and later. To use IPython, set the `IPYTHON` variable to `1` when running `bin/pyspark`: {% highlight bash %} @@ -153,7 +153,7 @@ Many of the methods also contain [doctests](http://docs.python.org/2/library/doc # Libraries [MLlib](mllib-guide.html) is also available in PySpark. To use it, you'll need -[NumPy](http://www.numpy.org) version 1.7 or newer. The [MLlib guide](mllib-guide.html) contains +[NumPy](http://www.numpy.org) version 1.4 or newer. The [MLlib guide](mllib-guide.html) contains some example applications. # Where to Go from Here |