aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
* Added a pointer to wiki in readmeMatei Zaharia2011-02-081-0/+7
|
* Updated readmeMatei Zaharia2011-02-021-8/+7
|
* Added SBT target for building a single JAR with Spark Core and itsMatei Zaharia2011-02-023-11/+40
| | | | dependencies
* Moved examples to spark.examples packageMatei Zaharia2011-02-0214-2/+28
|
* Added IntelliJ's build directory to gitignoreMatei Zaharia2011-02-021-0/+1
|
* Merge branch 'master' into sbtMatei Zaharia2011-02-0217-1195/+2371
|\ | | | | | | | | | | | | | | | | | | Conflicts: Makefile core/src/main/java/spark/compress/lzf/LZF.java core/src/main/java/spark/compress/lzf/LZFInputStream.java core/src/main/java/spark/compress/lzf/LZFOutputStream.java core/src/main/native/spark_compress_lzf_LZF.c run
| * Merge branch 'master' of github.com:mesos/sparkMatei Zaharia2010-12-151-14/+1
| |\
| | * Removed some unused imports from Broadcast.scalaMosharaf Chowdhury2010-12-151-12/+1
| | |
| | * - Fixed an compilation error due to wrong 'import' of legacy lzf libraries ↵Mosharaf Chowdhury2010-12-152-3/+1
| | | | | | | | | | | | | | | | | | | | | in DfsBroadcast.scala - Updated to use ning libraries. - Passes all unit tests
| * | Fixed importMatei Zaharia2010-12-151-1/+1
| |/
| * Merge branch 'master' into mos-btMatei Zaharia2010-12-1512-427/+61
| |\ | | | | | | | | | | | | Conflicts: src/scala/spark/Broadcast.scala
| | * Someone forgot to pass the parameters: fixes SPARK_MEM set from main script ↵Timothy Hunter2010-12-121-1/+1
| | | | | | | | | | | | but not passed to executor.
| | * Added BSD licenseMatei Zaharia2010-12-071-0/+27
| | |
| | * Adding license file for compress-lzfJoshua Hartman2010-12-071-0/+11
| | |
| | * Replacing the native lzf compression code with the ning open-source ↵Joshua Hartman2010-12-059-425/+8
| | | | | | | | | | | | compress-lzf library. (Apache 2.0 liscense)
| * | - Default broadcast mechanism is set to DfsBroadcastMosharaf Chowdhury2010-12-134-33/+28
| | | | | | | | | | | | | | | | | | - Configuration parameters are renamed to follow our convention - Master now automatically supplies its hostAddress instead of reading from config file - sendBroadcast has been removed from the Broadcast trait
| * | - Removed config files from git's control.Mosharaf Chowdhury2010-12-074-23/+1
| | | | | | | | | | | | - Changed DfsShuffle to default in RDD.scala.
| * | Made the root Broadcast object initilization method 'synchronized'.Mosharaf Chowdhury2010-12-021-1/+1
| | |
| * | Removed deprecated repl file ClassServer.scalaMosharaf Chowdhury2010-11-301-77/+0
| | |
| * | Merge branch 'multi-tracker' into mos-btMosharaf Chowdhury2010-11-304-7/+878
| |\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: conf/java-opts src/scala/spark/Broadcast.scala src/scala/spark/DfsBroadcast.scala src/scala/spark/SparkContext.scala
| | * | - Using the new Cache implementation.Mosharaf Chowdhury2010-11-293-10/+6
| | | | | | | | | | | | | | | | - Removed unused code related to dualMode (deprecated).
| | * | Made LocalFileShuffle to be the default.Mosharaf Chowdhury2010-11-291-1/+1
| | | |
| | * | Variable renaming.Mosharaf Chowdhury2010-11-291-4/+4
| | | |
| | * | Merge branch 'master' into multi-trackerMosharaf Chowdhury2010-11-2738-520/+1957
| | |\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: Makefile run src/scala/spark/Broadcast.scala src/scala/spark/Executor.scala src/scala/spark/HdfsFile.scala src/scala/spark/MesosScheduler.scala src/scala/spark/RDD.scala src/scala/spark/SparkContext.scala src/scala/spark/Split.scala src/scala/spark/Utils.scala src/scala/spark/repl/SparkInterpreter.scala third_party/mesos.jar
| | * | - Moved DaemonThreadPool factory methods to the Broadcast Object.Mosharaf Chowdhury2010-11-273-37/+49
| | | | | | | | | | | | | | | | - Reflection-based broadcast class loading is still not working.
| | * | Moved ChaninedStreaming to a separate file and renamed to ChainedBroadcast.Mosharaf Chowdhury2010-11-263-909/+912
| | | |
| | * | - Removed dual ModeMosharaf Chowdhury2010-11-264-182/+148
| | | | | | | | | | | | | | | | | | | | - Removed ununsed speed-related stuff - Moved (H)DfsBroadcast to its own file
| | * | Solved compilation issue. Should've been more careful to do a clean ↵Mosharaf Chowdhury2010-11-261-1/+1
| | | | | | | | | | | | | | | | compilation before committing.
| | * | Removed everything related to SplitStreaming...Mosharaf Chowdhury2010-11-262-480/+2
| | | |
| | * | Slaves weren't printing hostAddress. Fixed.Mosharaf Chowdhury2010-11-181-0/+2
| | | |
| | * | Everyone logs local hostAddress.Mosharaf Chowdhury2010-11-181-0/+2
| | | |
| | * | All daemon => Fast shutdown :)Mosharaf Chowdhury2010-11-091-15/+49
| | | |
| | * | Bug fix: java-opts had wrong (non-capitalized) variable names.Mosharaf Chowdhury2010-11-082-3/+3
| | | |
| | * | Graceful shutdown is working with dualMode=false. Probably will have to ↵Mosharaf Chowdhury2010-11-061-57/+166
| | | | | | | | | | | | | | | | | | | | | | | | remove dualMode completely. Made BroadcastCS code more consistent with BT branches.
| | * | Updated log outputs for consistency with BT branches.Mosharaf Chowdhury2010-11-063-134/+209
| | | | | | | | | | | | | | | | Code formatting.
| * | | Made Broadcast Pluggable. Finally!Mosharaf Chowdhury2010-11-305-59/+95
| | | |
| * | | Makes transfer faster for small swarms (with size < MaxRxPeers)Mosharaf Chowdhury2010-11-301-6/+10
| | | |
| * | | - Using the new Cache implementation.Mosharaf Chowdhury2010-11-292-7/+3
| | | |
| * | | Made LocalFileShuffle to be the default.Mosharaf Chowdhury2010-11-291-1/+1
| | | |
| * | | Variable renaming.Mosharaf Chowdhury2010-11-291-2/+2
| | | |
| * | | Removed unused third party libraries.Mosharaf Chowdhury2010-11-294-230/+0
| | | |
| * | | Merge branch 'master' into mos-btMosharaf Chowdhury2010-11-2937-524/+2191
| |\ \ \ | | | |/ | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: Makefile run src/scala/spark/Broadcast.scala src/scala/spark/Executor.scala src/scala/spark/HdfsFile.scala src/scala/spark/MesosScheduler.scala src/scala/spark/RDD.scala src/scala/spark/SparkContext.scala src/scala/spark/Split.scala src/scala/spark/Utils.scala src/scala/spark/repl/SparkInterpreter.scala third_party/mesos.jar
| | * | Remove -unchecked compiler parameterMatei Zaharia2010-11-131-1/+1
| | | |
| * | | Moved broadcast implementations to separate files. Ready to merge with 'master'Mosharaf Chowdhury2010-11-294-1346/+1363
| | | |
| * | | - Resolved some of the simpler TODOs related to different timeout and wait ↵Mosharaf Chowdhury2010-11-291-66/+14
| | | | | | | | | | | | | | | | | | | | | | | | periods. - Removed unused code.
| * | | Updated some comments.Mosharaf Chowdhury2010-11-251-4/+1
| | | |
| * | | Slaves weren't logging hostAddress. Fixed.Mosharaf Chowdhury2010-11-181-0/+2
| | | |
| * | | Everyone logs their local hostAddress.Mosharaf Chowdhury2010-11-181-0/+2
| | | |
| * | | Guide now select random peers to select sources instead of rolling statically.Mosharaf Chowdhury2010-11-131-12/+30
| | | | | | | | | | | | | | | | Random is good. Deterministic is bad. Well, mostly.
| * | | Added BroadcastBT.EndGameFraction config option to control when to start end ↵Mosharaf Chowdhury2010-11-122-4/+16
| | | | | | | | | | | | | | | | game.