| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | Do not launch JavaGateways on workers (SPARK-674). | Josh Rosen | 2013-02-01 | 1 | -1/+1 |
| | | | | | | | | | | | | The problem was that the gateway was being initialized whenever the pyspark.context module was loaded. The fix uses lazy initialization that occurs only when SparkContext instances are actually constructed. I also made the gateway and jvm variables private. This change results in ~3-4x performance improvement when running the PySpark unit tests. | ||||
| * | Fix stdout redirection in PySpark. | Josh Rosen | 2013-02-01 | 1 | -0/+9 |
| | | |||||
| * | Replace old 'master' term with 'driver'. | Stephen Haberman | 2013-01-25 | 1 | -1/+1 |
| | | |||||
| * | Allow PySpark's SparkFiles to be used from driver | Josh Rosen | 2013-01-23 | 1 | -0/+23 |
| | | | | | Fix minor documentation formatting issues. | ||||
| * | Fix sys.path bug in PySpark SparkContext.addPyFile | Josh Rosen | 2013-01-22 | 1 | -5/+33 |
| | | |||||
| * | Clean up setup code in PySpark checkpointing tests | Josh Rosen | 2013-01-20 | 1 | -14/+5 |
| | | |||||
| * | Add checkpointFile() and more tests to PySpark. | Josh Rosen | 2013-01-20 | 1 | -0/+24 |
| | | |||||
| * | Add RDD checkpointing to Python API. | Josh Rosen | 2013-01-20 | 1 | -0/+46 |
 |
index : spark | |
| Mirror of Apache Spark |
| aboutsummaryrefslogtreecommitdiff |