Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | | Updates to standalone cluster, web UI and deploy docs. | Matei Zaharia | 2012-09-26 | 17 | -19/+42 | |
| | | ||||||
* | | Allow controlling number of splits in sortByKey. | Matei Zaharia | 2012-09-26 | 3 | -7/+7 | |
| | | ||||||
* | | Look for Kryo registrator using context class loader | Matei Zaharia | 2012-09-26 | 1 | -1/+2 | |
|/ | ||||||
* | Fixed a test that was getting extremely lucky before, and increased the | Matei Zaharia | 2012-09-26 | 2 | -3/+7 | |
| | | | | number of samples used for sorting | |||||
* | Several fixes to sampling issues pointed out by Henry Milner: | Matei Zaharia | 2012-09-25 | 3 | -28/+35 | |
| | | | | | | | - takeSample was biased towards earlier partitions - There were some range errors in takeSample - SampledRDDs with replacement didn't produce appropriate counts across partitions (we took exactly frac of each one) | |||||
* | Merge pull request #217 from rxin/dev | Matei Zaharia | 2012-09-24 | 1 | -0/+2 | |
|\ | | | | | Added a method to RDD to expose the ClassManifest. | |||||
| * | Renamed RDD.manifest to RDD.elementClassManifest | Reynold Xin | 2012-09-24 | 1 | -1/+1 | |
| | | ||||||
| * | Added a method to RDD to expose the ClassManifest. | Reynold Xin | 2012-09-24 | 1 | -0/+2 | |
| | | ||||||
* | | Merge pull request #218 from rnpandya/dev | Matei Zaharia | 2012-09-24 | 1 | -1/+2 | |
|\ \ | | | | | | | Scripts to start Spark under windows | |||||
| * | | Windows command scripts for sbt and run | Ravi Pandya | 2012-09-24 | 1 | -1/+2 | |
| |/ | ||||||
* / | Fix some test issues | Matei Zaharia | 2012-09-24 | 1 | -0/+2 | |
|/ | ||||||
* | Merge pull request #208 from rxin/dev | Matei Zaharia | 2012-09-24 | 4 | -53/+119 | |
|\ | | | | | Separated ShuffledRDD into multiple classes. | |||||
| * | Separated ShuffledRDD into multiple classes: RepartitionShuffledRDD, | Reynold Xin | 2012-09-19 | 4 | -53/+119 | |
| | | | | | | | | ShuffledSortedRDD, and ShuffledAggregatedRDD. | |||||
* | | Make default number of parallel fetches slightly smaller since it doesn't ↵ | root | 2012-09-23 | 1 | -1/+1 | |
| | | | | | | | | seem to hurt performance much and it will cause slightly less GC. | |||||
* | | Avoid creating an extra buffer when saving a stream of values as DISK_ONLY | root | 2012-09-23 | 1 | -20/+24 | |
| | | ||||||
* | | HTTP File server fixes. | Denny | 2012-09-21 | 1 | -3/+5 | |
| | | ||||||
* | | Rename our toIterator method into asIterator to prevent confusion with the | root | 2012-09-21 | 2 | -5/+4 | |
| | | | | | | | | Scala collection one, which often *copies* a collection. | |||||
* | | Fixed a performance bug in BlockManager that was creating garbage when | root | 2012-09-21 | 1 | -1/+1 | |
| | | | | | | | | returning deserialized, in-memory RDDs. | |||||
* | | Fixed an issue with ordering of classloader setup that was causing Java ↵ | root | 2012-09-21 | 1 | -5/+4 | |
| | | | | | | | | deserializer to break | |||||
* | | Set a limited number of retry in standalone deploy mode. | Reynold Xin | 2012-09-19 | 3 | -14/+34 | |
|/ | ||||||
* | When a file is downloaded, make it executable. That's neccsary for scripts ↵ | Denny | 2012-09-17 | 1 | -0/+2 | |
| | | | | (e.g. in Shark) | |||||
* | Change default serializer to Java.. it had accidentally become Kryo. | Matei Zaharia | 2012-09-13 | 1 | -1/+1 | |
| | ||||||
* | Store shuffle map outputs as DISK_ONLY | Matei Zaharia | 2012-09-12 | 1 | -1/+1 | |
| | ||||||
* | Ported performance and FT improvements from latest streaming work | Matei Zaharia | 2012-09-12 | 18 | -61/+153 | |
| | ||||||
* | Fix bugs with Connection's shutdown callback failing to get its address | Matei Zaharia | 2012-09-12 | 2 | -6/+19 | |
| | ||||||
* | Wait for Akka to really shut down in SparkEnv.stop() | Matei Zaharia | 2012-09-12 | 1 | -0/+4 | |
| | ||||||
* | Merge branch 'dev' into feature/fileserver | Denny | 2012-09-11 | 3 | -1/+36 | |
|\ | | | | | | | | | Conflicts: core/src/main/scala/spark/SparkContext.scala | |||||
| * | Merge branch 'dev' of github.com:mesos/spark into dev | Matei Zaharia | 2012-09-11 | 1 | -1/+1 | |
| |\ | ||||||
| | * | Updated the logError call from the previous commit to conform to | Reynold Xin | 2012-09-11 | 1 | -1/+1 | |
| | | | | | | | | | | | | logError API. | |||||
| | * | Log entire exception (including stack trace) in BlockManagerWorker. | Reynold Xin | 2012-09-11 | 1 | -1/+1 | |
| | | | ||||||
| * | | Manually merge pull request #175 by Imran Rashid | Matei Zaharia | 2012-09-11 | 2 | -0/+35 | |
| |/ | ||||||
| * | Added a unit test for local-cluster mode and simplified some of the code ↵ | Matei Zaharia | 2012-09-07 | 6 | -48/+51 | |
| | | | | | | | | involved in that | |||||
| * | Merge pull request #189 from dennybritz/feature/localcluster | Matei Zaharia | 2012-09-07 | 4 | -1/+104 | |
| |\ | | | | | | | Simulating a Spark standalone cluster locally | |||||
| | * | Add shutdown hook to Executor Runner and execute code to shutdown local ↵ | Denny | 2012-09-07 | 4 | -14/+29 | |
| | | | | | | | | | | | | cluster in Scheduler Backend | |||||
| | * | Set SPARK_LAUNCH_WITH_SCALA=0 in Executor Runner | Denny | 2012-09-07 | 2 | -3/+20 | |
| | | | ||||||
| | * | Renamed spark-cluster to spark-local. | Denny | 2012-09-05 | 2 | -2/+2 | |
| | | | ||||||
| | * | Fix wrong counting | Denny | 2012-09-04 | 1 | -1/+1 | |
| | | | ||||||
| | * | Delete old DeployUtils. | Denny | 2012-09-04 | 1 | -53/+0 | |
| | | | ||||||
| | * | Renamed class. | Denny | 2012-09-04 | 2 | -2/+63 | |
| | | | ||||||
| | * | Start a standalone cluster locally. | Denny | 2012-09-04 | 2 | -1/+64 | |
| | | | ||||||
* | | | Formatting | Denny | 2012-09-11 | 1 | -1/+2 | |
| | | | ||||||
* | | | Subclass URLClassLoader instead of using reflection | Denny | 2012-09-11 | 1 | -10/+11 | |
| | | | ||||||
* | | | Use stageId as index for fileSet caches. | Denny | 2012-09-11 | 1 | -5/+7 | |
| | | | ||||||
* | | | Fix serialization bugs and added local cluster tests | Denny | 2012-09-10 | 2 | -2/+2 | |
| | | | ||||||
* | | | Dynamically adding jar files and caching fileSets. | Denny | 2012-09-10 | 8 | -105/+216 | |
| | | | ||||||
* | | | General FileServer | Denny | 2012-09-10 | 9 | -71/+161 | |
| | | | | | | | | | | | | A general fileserver for both JARs and regular files. | |||||
* | | | Added a unit test for local-cluster mode and simplified some of the code ↵ | Matei Zaharia | 2012-09-10 | 6 | -48/+51 | |
| | | | | | | | | | | | | involved in that | |||||
* | | | Add shutdown hook to Executor Runner and execute code to shutdown local ↵ | Denny | 2012-09-10 | 4 | -14/+29 | |
| | | | | | | | | | | | | cluster in Scheduler Backend | |||||
* | | | Set SPARK_LAUNCH_WITH_SCALA=0 in Executor Runner | Denny | 2012-09-10 | 2 | -3/+20 | |
| | | | ||||||
* | | | Renamed spark-cluster to spark-local. | Denny | 2012-09-10 | 2 | -2/+2 | |
| | | |