aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* merged dev branchDenny2012-08-0230-107/+981
|\
| * Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-08-023-60/+13
| |\ | | | | | | | | | | | | Conflicts: project/SparkBuild.scala
| | * Merge pull request #162 from shivaram/devMatei Zaharia2012-08-022-5/+10
| | |\ | | | | | | | | Use maxMemory to better estimate memory available for BlockManager cache
| | | * Avoid an extra partition copy by passing an iterator to blockManager.putShivaram Venkataraman2012-08-021-4/+9
| | | |
| | | * Use maxMemory to better estimate memory available for BlockManager cacheShivaram Venkataraman2012-08-021-1/+1
| | |/
| | * Merge pull request #161 from JoshRosen/fix/assembly-akka-configMatei Zaharia2012-08-021-55/+3
| | |\ | | | | | | | | Use sbt mergeStrategy for reference.conf files.
| | | * Use sbt mergeStrategy for reference.conf files.Josh Rosen2012-08-021-55/+3
| | | | | | | | | | | | | | | | Cleans up #158 / 509b721.
| * | | Use spray's implicit Marshaller for Futures.Denny2012-08-022-27/+25
| | | |
| * | | Mostly stlyistic changes.Denny2012-08-024-6/+12
| | | |
| * | | Moved resources into static folderDenny2012-08-0211-517/+12
| | | |
| * | | Webui improvements.Denny2012-08-0123-47/+1108
| | | |
| * | | merge dev branchDenny2012-08-0115-125/+268
| |\| |
| * | | Compact job page.Denny2012-08-011-3/+1
| | | |
| * | | Spark WebUI Implementation.Denny2012-08-0124-36/+399
| | | |
* | | | Settings variables and bugfix for stop script.Denny2012-08-025-5/+38
| | | |
* | | | Merged standalone and mesos EC2 scriptsDenny2012-08-023-516/+57
| | | |
* | | | Spark standalone mode cluster scripts.Denny2012-08-0118-4/+825
| |/ / |/| | | | | | | | Heavily inspired by Hadoop cluster scripts ;-)
* | | Merge pull request #158 from JoshRosen/fix/assembly-akka-configMatei Zaharia2012-07-301-2/+55
|\ \ \ | | |/ | |/| Merge Akka reference.conf files in sbt assembly task
| * | Fix Akka configuration in assembly jar.Josh Rosen2012-07-301-2/+55
|/ / | | | | | | | | | | | | | | | | This resolves an issue where running Spark from the assembly jar would cause a "No configuration setting found for key 'akka.version'" exception. This solution is from the Akka Team Blog: http://letitcrash.com/post/21025950392/
* | Merge branch 'block-manager-fix' into devMatei Zaharia2012-07-309-88/+83
|\ \
| * | Made BlockManagerMaster no longer be a singleton.Matei Zaharia2012-07-309-88/+83
| |/ | | | | | | Also cleaned up a few formatting things throughout block manager code.
* | Merge branch 'dev' of git://github.com/tdas/spark into devMatei Zaharia2012-07-306-35/+130
|\ \ | |/ |/|
| * Updated the new checkpoint RDD to remember partitioning of the original RDD.Tathagata Das2012-07-271-1/+6
| |
| * Merge branch 'dev' of github.com:tdas/spark into devTathagata Das2012-07-271-4/+8
| |\
| | * Fixed more stuff in BoundedMemoryCache.Tathagata Das2012-07-271-4/+8
| | |
| * | Added BlockRDD and a first-cut version of checkpoint() to RDD class.Tathagata Das2012-07-273-0/+63
| |/
| * Fixed bug in BoundedMemoryCache.Tathagata Das2012-07-271-1/+5
| |
| * Fixed bugs in block dropping code of MemoryStore and changed synchronized ↵Tathagata Das2012-07-272-14/+8
| | | | | | | | HashMap to ConcurrentHashMap in BlockManager.
| * Modified the block dropping code for better performance.Tathagata Das2012-07-262-25/+51
| |
* | Various reorganization and formatting fixesMatei Zaharia2012-07-304-57/+79
| |
* | Fixed AccumulatorSuite to clean up SparkContext with BeforeAndAfterMatei Zaharia2012-07-281-10/+20
| |
* | tasks cannot access value of accumulatorImran Rashid2012-07-282-56/+21
| |
* | one more minor cleanup to scaladocImran Rashid2012-07-281-2/+2
| |
* | fix up scaladoc, naming of type parametersImran Rashid2012-07-282-15/+12
| |
* | rename addToAccum to addAccumulatorImran Rashid2012-07-282-4/+4
| |
* | add some functionality to Vector, delete copy in AccumulatorSuiteImran Rashid2012-07-282-113/+33
| |
* | move Vector class into core and spark.util packageImran Rashid2012-07-287-10/+12
| |
* | Accumulator now inherits from Accumulable, whcih simplifies a bunch of other ↵Imran Rashid2012-07-283-46/+64
| | | | | | | | | | | | | | | | things (eg., no +:=) Conflicts: core/src/main/scala/spark/Accumulators.scala
* | improve scaladocImran Rashid2012-07-281-1/+1
| |
* | add Accumulatable, add corresponding docs & tests for accumulatorsImran Rashid2012-07-283-0/+276
| |
* | Fixed SPARK_MEM not being passed when runner is javaMatei Zaharia2012-07-281-1/+4
| |
* | Add a sleep to prevent a failing test.Matei Zaharia2012-07-271-0/+1
| | | | | | | | | | | | | | | | The BlockManager's put seems to be slightly asynchronous, which can cause it to fail this test by not removing stuff from the cache before we put the next value. We should probably change the semantics of put() in this case but it's hard right now. It will also be hard for asynchronously replicated puts.
* | Renamed test more descriptivelyMatei Zaharia2012-07-271-1/+1
| |
* | Added a second version of union() without varargs.Matei Zaharia2012-07-273-4/+17
| |
* | Fixed Java union methods having same erasure.Matei Zaharia2012-07-273-25/+47
| | | | | | | | | | | | | | Changed union() methods on lists to take a separate "first element" argument in order to differentiate them to the compiler, because Java 7 considered it an error to have them all take Lists parameterized with different types.
* | Merge pull request #153 from JoshRosen/new-java-apiMatei Zaharia2012-07-2624-4/+1822
|\ \ | | | | | | Java API
| * | Add persist(), splits(), glom(), and mapPartitions() to Java API.Josh Rosen2012-07-265-3/+83
| | |
| * | Remove StringOps.split() from Java WordCount.Josh Rosen2012-07-251-5/+2
| | |
| * | Minor cleanup and optimizations in Java API.Josh Rosen2012-07-248-25/+25
| | | | | | | | | | | | | | | | | | - Add override keywords. - Cache RDDs and counts in TC example. - Clean up JavaRDDLike's abstract methods.
| * | Add type annotations to Java API methods.Josh Rosen2012-07-226-43/+90
| | | | | | | | | | | | Add missing Scala Map to java.util.Map conversions.