Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | Added a pointer to wiki in readme | Matei Zaharia | 2011-02-08 | 1 | -0/+7 | |
| | ||||||
* | Updated readme | Matei Zaharia | 2011-02-02 | 1 | -8/+7 | |
| | ||||||
* | Added SBT target for building a single JAR with Spark Core and its | Matei Zaharia | 2011-02-02 | 3 | -11/+40 | |
| | | | | dependencies | |||||
* | Moved examples to spark.examples package | Matei Zaharia | 2011-02-02 | 14 | -2/+28 | |
| | ||||||
* | Added IntelliJ's build directory to gitignore | Matei Zaharia | 2011-02-02 | 1 | -0/+1 | |
| | ||||||
* | Merge branch 'master' into sbt | Matei Zaharia | 2011-02-02 | 17 | -1195/+2371 | |
|\ | | | | | | | | | | | | | | | | | | | Conflicts: Makefile core/src/main/java/spark/compress/lzf/LZF.java core/src/main/java/spark/compress/lzf/LZFInputStream.java core/src/main/java/spark/compress/lzf/LZFOutputStream.java core/src/main/native/spark_compress_lzf_LZF.c run | |||||
| * | Merge branch 'master' of github.com:mesos/spark | Matei Zaharia | 2010-12-15 | 1 | -14/+1 | |
| |\ | ||||||
| | * | Removed some unused imports from Broadcast.scala | Mosharaf Chowdhury | 2010-12-15 | 1 | -12/+1 | |
| | | | ||||||
| | * | - Fixed an compilation error due to wrong 'import' of legacy lzf libraries ↵ | Mosharaf Chowdhury | 2010-12-15 | 2 | -3/+1 | |
| | | | | | | | | | | | | | | | | | | | | | in DfsBroadcast.scala - Updated to use ning libraries. - Passes all unit tests | |||||
| * | | Fixed import | Matei Zaharia | 2010-12-15 | 1 | -1/+1 | |
| |/ | ||||||
| * | Merge branch 'master' into mos-bt | Matei Zaharia | 2010-12-15 | 12 | -427/+61 | |
| |\ | | | | | | | | | | | | | Conflicts: src/scala/spark/Broadcast.scala | |||||
| | * | Someone forgot to pass the parameters: fixes SPARK_MEM set from main script ↵ | Timothy Hunter | 2010-12-12 | 1 | -1/+1 | |
| | | | | | | | | | | | | but not passed to executor. | |||||
| | * | Added BSD license | Matei Zaharia | 2010-12-07 | 1 | -0/+27 | |
| | | | ||||||
| | * | Adding license file for compress-lzf | Joshua Hartman | 2010-12-07 | 1 | -0/+11 | |
| | | | ||||||
| | * | Replacing the native lzf compression code with the ning open-source ↵ | Joshua Hartman | 2010-12-05 | 9 | -425/+8 | |
| | | | | | | | | | | | | compress-lzf library. (Apache 2.0 liscense) | |||||
| * | | - Default broadcast mechanism is set to DfsBroadcast | Mosharaf Chowdhury | 2010-12-13 | 4 | -33/+28 | |
| | | | | | | | | | | | | | | | | | | - Configuration parameters are renamed to follow our convention - Master now automatically supplies its hostAddress instead of reading from config file - sendBroadcast has been removed from the Broadcast trait | |||||
| * | | - Removed config files from git's control. | Mosharaf Chowdhury | 2010-12-07 | 4 | -23/+1 | |
| | | | | | | | | | | | | - Changed DfsShuffle to default in RDD.scala. | |||||
| * | | Made the root Broadcast object initilization method 'synchronized'. | Mosharaf Chowdhury | 2010-12-02 | 1 | -1/+1 | |
| | | | ||||||
| * | | Removed deprecated repl file ClassServer.scala | Mosharaf Chowdhury | 2010-11-30 | 1 | -77/+0 | |
| | | | ||||||
| * | | Merge branch 'multi-tracker' into mos-bt | Mosharaf Chowdhury | 2010-11-30 | 4 | -7/+878 | |
| |\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: conf/java-opts src/scala/spark/Broadcast.scala src/scala/spark/DfsBroadcast.scala src/scala/spark/SparkContext.scala | |||||
| | * | | - Using the new Cache implementation. | Mosharaf Chowdhury | 2010-11-29 | 3 | -10/+6 | |
| | | | | | | | | | | | | | | | | - Removed unused code related to dualMode (deprecated). | |||||
| | * | | Made LocalFileShuffle to be the default. | Mosharaf Chowdhury | 2010-11-29 | 1 | -1/+1 | |
| | | | | ||||||
| | * | | Variable renaming. | Mosharaf Chowdhury | 2010-11-29 | 1 | -4/+4 | |
| | | | | ||||||
| | * | | Merge branch 'master' into multi-tracker | Mosharaf Chowdhury | 2010-11-27 | 38 | -520/+1957 | |
| | |\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: Makefile run src/scala/spark/Broadcast.scala src/scala/spark/Executor.scala src/scala/spark/HdfsFile.scala src/scala/spark/MesosScheduler.scala src/scala/spark/RDD.scala src/scala/spark/SparkContext.scala src/scala/spark/Split.scala src/scala/spark/Utils.scala src/scala/spark/repl/SparkInterpreter.scala third_party/mesos.jar | |||||
| | * | | - Moved DaemonThreadPool factory methods to the Broadcast Object. | Mosharaf Chowdhury | 2010-11-27 | 3 | -37/+49 | |
| | | | | | | | | | | | | | | | | - Reflection-based broadcast class loading is still not working. | |||||
| | * | | Moved ChaninedStreaming to a separate file and renamed to ChainedBroadcast. | Mosharaf Chowdhury | 2010-11-26 | 3 | -909/+912 | |
| | | | | ||||||
| | * | | - Removed dual Mode | Mosharaf Chowdhury | 2010-11-26 | 4 | -182/+148 | |
| | | | | | | | | | | | | | | | | | | | | - Removed ununsed speed-related stuff - Moved (H)DfsBroadcast to its own file | |||||
| | * | | Solved compilation issue. Should've been more careful to do a clean ↵ | Mosharaf Chowdhury | 2010-11-26 | 1 | -1/+1 | |
| | | | | | | | | | | | | | | | | compilation before committing. | |||||
| | * | | Removed everything related to SplitStreaming... | Mosharaf Chowdhury | 2010-11-26 | 2 | -480/+2 | |
| | | | | ||||||
| | * | | Slaves weren't printing hostAddress. Fixed. | Mosharaf Chowdhury | 2010-11-18 | 1 | -0/+2 | |
| | | | | ||||||
| | * | | Everyone logs local hostAddress. | Mosharaf Chowdhury | 2010-11-18 | 1 | -0/+2 | |
| | | | | ||||||
| | * | | All daemon => Fast shutdown :) | Mosharaf Chowdhury | 2010-11-09 | 1 | -15/+49 | |
| | | | | ||||||
| | * | | Bug fix: java-opts had wrong (non-capitalized) variable names. | Mosharaf Chowdhury | 2010-11-08 | 2 | -3/+3 | |
| | | | | ||||||
| | * | | Graceful shutdown is working with dualMode=false. Probably will have to ↵ | Mosharaf Chowdhury | 2010-11-06 | 1 | -57/+166 | |
| | | | | | | | | | | | | | | | | | | | | | | | | remove dualMode completely. Made BroadcastCS code more consistent with BT branches. | |||||
| | * | | Updated log outputs for consistency with BT branches. | Mosharaf Chowdhury | 2010-11-06 | 3 | -134/+209 | |
| | | | | | | | | | | | | | | | | Code formatting. | |||||
| * | | | Made Broadcast Pluggable. Finally! | Mosharaf Chowdhury | 2010-11-30 | 5 | -59/+95 | |
| | | | | ||||||
| * | | | Makes transfer faster for small swarms (with size < MaxRxPeers) | Mosharaf Chowdhury | 2010-11-30 | 1 | -6/+10 | |
| | | | | ||||||
| * | | | - Using the new Cache implementation. | Mosharaf Chowdhury | 2010-11-29 | 2 | -7/+3 | |
| | | | | ||||||
| * | | | Made LocalFileShuffle to be the default. | Mosharaf Chowdhury | 2010-11-29 | 1 | -1/+1 | |
| | | | | ||||||
| * | | | Variable renaming. | Mosharaf Chowdhury | 2010-11-29 | 1 | -2/+2 | |
| | | | | ||||||
| * | | | Removed unused third party libraries. | Mosharaf Chowdhury | 2010-11-29 | 4 | -230/+0 | |
| | | | | ||||||
| * | | | Merge branch 'master' into mos-bt | Mosharaf Chowdhury | 2010-11-29 | 37 | -524/+2191 | |
| |\ \ \ | | | |/ | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: Makefile run src/scala/spark/Broadcast.scala src/scala/spark/Executor.scala src/scala/spark/HdfsFile.scala src/scala/spark/MesosScheduler.scala src/scala/spark/RDD.scala src/scala/spark/SparkContext.scala src/scala/spark/Split.scala src/scala/spark/Utils.scala src/scala/spark/repl/SparkInterpreter.scala third_party/mesos.jar | |||||
| | * | | Remove -unchecked compiler parameter | Matei Zaharia | 2010-11-13 | 1 | -1/+1 | |
| | | | | ||||||
| * | | | Moved broadcast implementations to separate files. Ready to merge with 'master' | Mosharaf Chowdhury | 2010-11-29 | 4 | -1346/+1363 | |
| | | | | ||||||
| * | | | - Resolved some of the simpler TODOs related to different timeout and wait ↵ | Mosharaf Chowdhury | 2010-11-29 | 1 | -66/+14 | |
| | | | | | | | | | | | | | | | | | | | | | | | | periods. - Removed unused code. | |||||
| * | | | Updated some comments. | Mosharaf Chowdhury | 2010-11-25 | 1 | -4/+1 | |
| | | | | ||||||
| * | | | Slaves weren't logging hostAddress. Fixed. | Mosharaf Chowdhury | 2010-11-18 | 1 | -0/+2 | |
| | | | | ||||||
| * | | | Everyone logs their local hostAddress. | Mosharaf Chowdhury | 2010-11-18 | 1 | -0/+2 | |
| | | | | ||||||
| * | | | Guide now select random peers to select sources instead of rolling statically. | Mosharaf Chowdhury | 2010-11-13 | 1 | -12/+30 | |
| | | | | | | | | | | | | | | | | Random is good. Deterministic is bad. Well, mostly. | |||||
| * | | | Added BroadcastBT.EndGameFraction config option to control when to start end ↵ | Mosharaf Chowdhury | 2010-11-12 | 2 | -4/+16 | |
| | | | | | | | | | | | | | | | | game. |