aboutsummaryrefslogtreecommitdiff
path: root/pyspark/pyspark/__init__.py
diff options
context:
space:
mode:
authorJosh Rosen <joshrosen@eecs.berkeley.edu>2012-12-27 22:47:37 -0800
committerJosh Rosen <joshrosen@eecs.berkeley.edu>2012-12-27 22:47:37 -0800
commit665466dfff4f89196627a0777eabd3d3894cd296 (patch)
tree7fa580209756c5fdbb0a52930f30959bbbbc2ba3 /pyspark/pyspark/__init__.py
parentac32447cd38beac8f6bc7a90be9fd24666bb46ad (diff)
downloadspark-665466dfff4f89196627a0777eabd3d3894cd296.tar.gz
spark-665466dfff4f89196627a0777eabd3d3894cd296.tar.bz2
spark-665466dfff4f89196627a0777eabd3d3894cd296.zip
Simplify PySpark installation.
- Bundle Py4J binaries, since it's hard to install - Uses Spark's `run` script to launch the Py4J gateway, inheriting the settings in spark-env.sh With these changes, (hopefully) nothing more than running `sbt/sbt package` will be necessary to run PySpark.
Diffstat (limited to 'pyspark/pyspark/__init__.py')
-rw-r--r--pyspark/pyspark/__init__.py3
1 files changed, 3 insertions, 0 deletions
diff --git a/pyspark/pyspark/__init__.py b/pyspark/pyspark/__init__.py
index e69de29bb2..549c2d2711 100644
--- a/pyspark/pyspark/__init__.py
+++ b/pyspark/pyspark/__init__.py
@@ -0,0 +1,3 @@
+import sys
+import os
+sys.path.insert(0, os.path.join(os.environ["SPARK_HOME"], "pyspark/lib/py4j0.7.egg"))