Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Merge pull request #217 from rxin/dev | Matei Zaharia | 2012-09-24 | 1 | -0/+2 |
|\ | | | | | Added a method to RDD to expose the ClassManifest. | ||||
| * | Renamed RDD.manifest to RDD.elementClassManifest | Reynold Xin | 2012-09-24 | 1 | -1/+1 |
| | | |||||
| * | Added a method to RDD to expose the ClassManifest. | Reynold Xin | 2012-09-24 | 1 | -0/+2 |
| | | |||||
* | | Merge pull request #218 from rnpandya/dev | Matei Zaharia | 2012-09-24 | 1 | -1/+2 |
|\ \ | | | | | | | Scripts to start Spark under windows | ||||
| * | | Windows command scripts for sbt and run | Ravi Pandya | 2012-09-24 | 1 | -1/+2 |
| |/ | |||||
* / | Fix some test issues | Matei Zaharia | 2012-09-24 | 3 | -12/+16 |
|/ | |||||
* | Merge pull request #208 from rxin/dev | Matei Zaharia | 2012-09-24 | 5 | -62/+128 |
|\ | | | | | Separated ShuffledRDD into multiple classes. | ||||
| * | Separated ShuffledRDD into multiple classes: RepartitionShuffledRDD, | Reynold Xin | 2012-09-19 | 5 | -62/+128 |
| | | | | | | | | ShuffledSortedRDD, and ShuffledAggregatedRDD. | ||||
* | | Make default number of parallel fetches slightly smaller since it doesn't ↵ | root | 2012-09-23 | 1 | -1/+1 |
| | | | | | | | | seem to hurt performance much and it will cause slightly less GC. | ||||
* | | Avoid creating an extra buffer when saving a stream of values as DISK_ONLY | root | 2012-09-23 | 1 | -20/+24 |
| | | |||||
* | | HTTP File server fixes. | Denny | 2012-09-21 | 1 | -3/+5 |
| | | |||||
* | | Rename our toIterator method into asIterator to prevent confusion with the | root | 2012-09-21 | 2 | -5/+4 |
| | | | | | | | | Scala collection one, which often *copies* a collection. | ||||
* | | Fixed a performance bug in BlockManager that was creating garbage when | root | 2012-09-21 | 1 | -1/+1 |
| | | | | | | | | returning deserialized, in-memory RDDs. | ||||
* | | Fixed an issue with ordering of classloader setup that was causing Java ↵ | root | 2012-09-21 | 1 | -5/+4 |
| | | | | | | | | deserializer to break | ||||
* | | Set a limited number of retry in standalone deploy mode. | Reynold Xin | 2012-09-19 | 3 | -14/+34 |
|/ | |||||
* | When a file is downloaded, make it executable. That's neccsary for scripts ↵ | Denny | 2012-09-17 | 1 | -0/+2 |
| | | | | (e.g. in Shark) | ||||
* | Change default serializer to Java.. it had accidentally become Kryo. | Matei Zaharia | 2012-09-13 | 1 | -1/+1 |
| | |||||
* | Store shuffle map outputs as DISK_ONLY | Matei Zaharia | 2012-09-12 | 1 | -1/+1 |
| | |||||
* | Ported performance and FT improvements from latest streaming work | Matei Zaharia | 2012-09-12 | 18 | -61/+153 |
| | |||||
* | Fix bugs with Connection's shutdown callback failing to get its address | Matei Zaharia | 2012-09-12 | 2 | -6/+19 |
| | |||||
* | Wait for Akka to really shut down in SparkEnv.stop() | Matei Zaharia | 2012-09-12 | 1 | -0/+4 |
| | |||||
* | Merge branch 'dev' into feature/fileserver | Denny | 2012-09-11 | 4 | -3/+61 |
|\ | | | | | | | | | Conflicts: core/src/main/scala/spark/SparkContext.scala | ||||
| * | Merge branch 'dev' of github.com:mesos/spark into dev | Matei Zaharia | 2012-09-11 | 1 | -1/+1 |
| |\ | |||||
| | * | Updated the logError call from the previous commit to conform to | Reynold Xin | 2012-09-11 | 1 | -1/+1 |
| | | | | | | | | | | | | logError API. | ||||
| | * | Log entire exception (including stack trace) in BlockManagerWorker. | Reynold Xin | 2012-09-11 | 1 | -1/+1 |
| | | | |||||
| * | | Manually merge pull request #175 by Imran Rashid | Matei Zaharia | 2012-09-11 | 3 | -2/+60 |
| |/ | |||||
| * | Added a unit test for local-cluster mode and simplified some of the code ↵ | Matei Zaharia | 2012-09-07 | 7 | -48/+119 |
| | | | | | | | | involved in that | ||||
| * | Merge pull request #189 from dennybritz/feature/localcluster | Matei Zaharia | 2012-09-07 | 4 | -1/+104 |
| |\ | | | | | | | Simulating a Spark standalone cluster locally | ||||
| | * | Add shutdown hook to Executor Runner and execute code to shutdown local ↵ | Denny | 2012-09-07 | 4 | -14/+29 |
| | | | | | | | | | | | | cluster in Scheduler Backend | ||||
| | * | Set SPARK_LAUNCH_WITH_SCALA=0 in Executor Runner | Denny | 2012-09-07 | 2 | -3/+20 |
| | | | |||||
| | * | Renamed spark-cluster to spark-local. | Denny | 2012-09-05 | 2 | -2/+2 |
| | | | |||||
| | * | Fix wrong counting | Denny | 2012-09-04 | 1 | -1/+1 |
| | | | |||||
| | * | Delete old DeployUtils. | Denny | 2012-09-04 | 1 | -53/+0 |
| | | | |||||
| | * | Renamed class. | Denny | 2012-09-04 | 2 | -2/+63 |
| | | | |||||
| | * | Start a standalone cluster locally. | Denny | 2012-09-04 | 2 | -1/+64 |
| | | | |||||
* | | | Formatting | Denny | 2012-09-11 | 1 | -1/+2 |
| | | | |||||
* | | | Subclass URLClassLoader instead of using reflection | Denny | 2012-09-11 | 1 | -10/+11 |
| | | | |||||
* | | | Use stageId as index for fileSet caches. | Denny | 2012-09-11 | 1 | -5/+7 |
| | | | |||||
* | | | Fix serialization bugs and added local cluster tests | Denny | 2012-09-10 | 3 | -4/+33 |
| | | | |||||
* | | | Dynamically adding jar files and caching fileSets. | Denny | 2012-09-10 | 10 | -114/+246 |
| | | | |||||
* | | | General FileServer | Denny | 2012-09-10 | 10 | -71/+204 |
| | | | | | | | | | | | | A general fileserver for both JARs and regular files. | ||||
* | | | Added a unit test for local-cluster mode and simplified some of the code ↵ | Matei Zaharia | 2012-09-10 | 7 | -48/+119 |
| | | | | | | | | | | | | involved in that | ||||
* | | | Add shutdown hook to Executor Runner and execute code to shutdown local ↵ | Denny | 2012-09-10 | 4 | -14/+29 |
| | | | | | | | | | | | | cluster in Scheduler Backend | ||||
* | | | Set SPARK_LAUNCH_WITH_SCALA=0 in Executor Runner | Denny | 2012-09-10 | 2 | -3/+20 |
| | | | |||||
* | | | Renamed spark-cluster to spark-local. | Denny | 2012-09-10 | 2 | -2/+2 |
| | | | |||||
* | | | Fix wrong counting | Denny | 2012-09-10 | 1 | -1/+1 |
| | | | |||||
* | | | Delete old DeployUtils. | Denny | 2012-09-10 | 1 | -53/+0 |
| | | | |||||
* | | | Renamed class. | Denny | 2012-09-10 | 2 | -2/+63 |
| | | | |||||
* | | | Start a standalone cluster locally. | Denny | 2012-09-10 | 2 | -1/+64 |
|/ / | |||||
* | | Randomize the order of block fetches in getMultiple | root | 2012-09-06 | 1 | -2/+5 |
| | |