aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Update issue tracker link in contributing guide.Josh Rosen2013-02-101-1/+1
|
* Merge pull request #460 from markhamstra/404Matei Zaharia2013-02-101-1/+1
|\ | | | | Fixed a 404 in 'Tuning Spark' -- missing '.html'
| * Fixed a 404 -- missing '.html'Mark Hamstra2013-02-101-1/+1
| |
* | Merge pull request #448 from squito/fetch_maxBytesInFlightMatei Zaharia2013-02-091-1/+1
|\ \ | | | | | | add as many fetch requests as we can, subject to maxBytesInFlight
| * | add as many fetch requests as we can, subject to maxBytesInFlightImran Rashid2013-02-051-1/+1
| | |
* | | Merge pull request #446 from pwendell/olap-exampleMatei Zaharia2013-02-091-0/+66
|\ \ \ | | | | | | | | SPARK-678: Adding an example with an OLAP roll-up
| * | | Fixing to match Spark styleguidePatrick Wendell2013-02-051-8/+8
| | | |
| * | | Adding an example with an OLAP roll-upPatrick Wendell2013-02-041-0/+66
| |/ /
* | | Merge pull request #452 from stephenh/miscMatei Zaharia2013-02-0926-98/+89
|\ \ \ | | | | | | | | Add RDD.coalesce, clean up some RDDs, other misc.
| * | | Move JavaRDDLike.coalesce into the right places.Stephen Haberman2013-02-094-5/+15
| | | |
| * | | Fix JavaRDDLike.coalesce return type.Stephen Haberman2013-02-091-1/+1
| | | |
| * | | Add back return types.Stephen Haberman2013-02-0919-31/+35
| | | |
| * | | Remove RDD.coalesce default arguments.Stephen Haberman2013-02-092-7/+1
| | | |
| * | | Clean up RDDs, mainly to use getSplits.Stephen Haberman2013-02-0511-59/+30
| | | | | | | | | | | | | | | | | | | | | | | | Also made sure clearDependencies() was calling super, to ensure the getSplits/getDependencies vars in the RDD base class get cleaned up.
| * | | Remove unneeded zipWithIndex.Stephen Haberman2013-02-051-5/+7
| | | | | | | | | | | | | | | | Also rename r->rdd and remove unneeded extra type info.
| * | | Add RDD.coalesce.Stephen Haberman2013-02-054-6/+23
| | | |
| * | | Add private, minor formatting.Stephen Haberman2013-02-051-21/+14
| | | |
* | | | Merge pull request #457 from markhamstra/commutativeJosh Rosen2013-02-091-2/+2
|\ \ \ \ | | | | | | | | | | Add commutative requirement for 'reduce' to Python docstring.
| * | | | Add commutative requirement for 'reduce' to Python docstring.Mark Hamstra2013-02-091-2/+2
|/ / / /
* | | | Merge pull request #453 from markhamstra/commutativeMatei Zaharia2013-02-093-3/+3
|\ \ \ \ | | | | | | | | | | Change docs on 'reduce' since the merging of local reduces no longer pre...
| * \ \ \ Merge branch 'master' of https://github.com/mesos/spark into commutativeMark Hamstra2013-02-08282-2463/+18369
| |\ \ \ \ | |/ / / / |/| | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/RDD.scala
* | | | | Merge pull request #454 from MLnick/ipythonMatei Zaharia2013-02-071-1/+6
|\ \ \ \ \ | |_|/ / / |/| | | | SPARK-685 Adding IPYTHON environment variable support for launching pyspark using ...
| * | | | Adding IPYTHON environment variable support for launching pyspark using ↵Nick Pentreath2013-02-071-1/+6
|/ / / / | | | | | | | | | | | | ipython shell
* | | | Merge pull request #450 from stephenh/inlinemergepairMatei Zaharia2013-02-051-6/+4
|\ \ \ \ | | | | | | | | | | Inline mergePair to look more like the narrow dep branch.
| * | | | Inline mergePair to look more like the narrow dep branch.Stephen Haberman2013-02-051-6/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | No functionality changes, I think this is just more consistent given mergePair isn't called multiple times/recursive. Also added a comment to explain the usual case of having two parent RDDs.
* | | | | Merge pull request #451 from stephenh/fixdeathpactexceptionMatei Zaharia2013-02-052-19/+13
|\ \ \ \ \ | | | | | | | | | | | | Handle Terminated to avoid endless DeathPactExceptions.
| * \ \ \ \ Merge branch 'master' into fixdeathpactexceptionStephen Haberman2013-02-0530-258/+991
| |\ \ \ \ \ | |/ / / / / |/| | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/deploy/worker/Worker.scala
* | | | | | Merge pull request #449 from stephenh/longerdriversuiteMatei Zaharia2013-02-051-1/+2
|\ \ \ \ \ \ | | | | | | | | | | | | | | Increase DriverSuite timeout.
| * | | | | | Increase DriverSuite timeout.Stephen Haberman2013-02-051-1/+2
| | |/ / / / | |/| | | |
* | | | | | Merge pull request #447 from pwendell/streaming-constructorMatei Zaharia2013-02-051-0/+8
|\ \ \ \ \ \ | |_|_|_|/ / |/| | | | | Streaming constructor which takes JavaSparkContext
| * | | | | Streaming constructor which takes JavaSparkContextPatrick Wendell2013-02-051-0/+8
|/ / / / / | | | | | | | | | | | | | | | | | | | | It's sometimes helpful to directly pass a JavaSparkContext, and take advantage of the various constructors available for that.
* | | | | Small fix to test for distinctMatei Zaharia2013-02-041-1/+1
| | | | |
* | | | | Fix failing testMatei Zaharia2013-02-041-2/+1
| | | | |
* | | | | Merge pull request #445 from JoshRosen/pyspark_fixesMatei Zaharia2013-02-035-22/+19
|\ \ \ \ \ | | | | | | | | | | | | Fix exit status in PySpark unit tests; fix/optimize PySpark's RDD.take()
| * | | | | Remove unnecessary doctest __main__ methods.Josh Rosen2013-02-032-18/+0
| | | | | |
| * | | | | Fetch fewer objects in PySpark's take() method.Josh Rosen2013-02-032-2/+13
| | | | | |
| * | | | | Fix reporting of PySpark doctest failures.Josh Rosen2013-02-032-2/+6
| |/ / / /
* | | | | Merge pull request #379 from stephenh/sparkmemMatei Zaharia2013-02-026-35/+17
|\ \ \ \ \ | | | | | | | | | | | | Add spark.executor.memory to differentiate executor memory from spark-shell
| * | | | | Fix dangling old variable names.Stephen Haberman2013-02-021-2/+2
| | | | | |
| * | | | | Move executorMemory up into SchedulerBackend.Stephen Haberman2013-02-024-29/+12
| | | | | |
| * | | | | Merge branch 'master' into sparkmemStephen Haberman2013-02-02254-2124/+13947
| |\| | | |
| * | | | | Fix SPARK_MEM in ExecutorRunner.Stephen Haberman2013-01-221-1/+1
| | | | | |
| * | | | | Restore SPARK_MEM in executorEnvs.Stephen Haberman2013-01-221-2/+3
| | | | | |
| * | | | | Add spark.executor.memory to differentiate executor memory from spark-shell ↵Stephen Haberman2013-01-153-10/+8
| | | | | | | | | | | | | | | | | | | | | | | | memory.
* | | | | | Merge pull request #422 from squito/blockmanager_infoMatei Zaharia2013-02-026-38/+59
|\ \ \ \ \ \ | | | | | | | | | | | | | | RDDInfo available from SparkContext
| * | | | | | remove unneeded (and unused) filter on block infoImran Rashid2013-02-011-2/+0
| | | | | | |
| * | | | | | track total partitions, in addition to cached partitions; use scala string ↵Imran Rashid2013-02-013-9/+13
| | | | | | | | | | | | | | | | | | | | | | | | | | | | formatting
| * | | | | | fixup merge (master -> driver renaming)Imran Rashid2013-02-011-1/+1
| | | | | | |
| * | | | | | Merge branch 'master' into blockmanager_infoImran Rashid2013-01-3043-246/+291
| |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/storage/BlockManagerMaster.scala
| * | | | | | | rename Slaves --> ExecutorImran Rashid2013-01-302-5/+5
| | | | | | | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-07-10 19:55:38 +0000