aboutsummaryrefslogtreecommitdiff
path: root/core
Commit message (Collapse)AuthorAgeFilesLines
* Merge pull request #217 from rxin/devMatei Zaharia2012-09-241-0/+2
|\ | | | | Added a method to RDD to expose the ClassManifest.
| * Renamed RDD.manifest to RDD.elementClassManifestReynold Xin2012-09-241-1/+1
| |
| * Added a method to RDD to expose the ClassManifest.Reynold Xin2012-09-241-0/+2
| |
* | Merge pull request #218 from rnpandya/devMatei Zaharia2012-09-241-1/+2
|\ \ | | | | | | Scripts to start Spark under windows
| * | Windows command scripts for sbt and runRavi Pandya2012-09-241-1/+2
| |/
* / Fix some test issuesMatei Zaharia2012-09-243-12/+16
|/
* Merge pull request #208 from rxin/devMatei Zaharia2012-09-245-62/+128
|\ | | | | Separated ShuffledRDD into multiple classes.
| * Separated ShuffledRDD into multiple classes: RepartitionShuffledRDD,Reynold Xin2012-09-195-62/+128
| | | | | | | | ShuffledSortedRDD, and ShuffledAggregatedRDD.
* | Make default number of parallel fetches slightly smaller since it doesn't ↵root2012-09-231-1/+1
| | | | | | | | seem to hurt performance much and it will cause slightly less GC.
* | Avoid creating an extra buffer when saving a stream of values as DISK_ONLYroot2012-09-231-20/+24
| |
* | HTTP File server fixes.Denny2012-09-211-3/+5
| |
* | Rename our toIterator method into asIterator to prevent confusion with theroot2012-09-212-5/+4
| | | | | | | | Scala collection one, which often *copies* a collection.
* | Fixed a performance bug in BlockManager that was creating garbage whenroot2012-09-211-1/+1
| | | | | | | | returning deserialized, in-memory RDDs.
* | Fixed an issue with ordering of classloader setup that was causing Java ↵root2012-09-211-5/+4
| | | | | | | | deserializer to break
* | Set a limited number of retry in standalone deploy mode.Reynold Xin2012-09-193-14/+34
|/
* When a file is downloaded, make it executable. That's neccsary for scripts ↵Denny2012-09-171-0/+2
| | | | (e.g. in Shark)
* Change default serializer to Java.. it had accidentally become Kryo.Matei Zaharia2012-09-131-1/+1
|
* Store shuffle map outputs as DISK_ONLYMatei Zaharia2012-09-121-1/+1
|
* Ported performance and FT improvements from latest streaming workMatei Zaharia2012-09-1218-61/+153
|
* Fix bugs with Connection's shutdown callback failing to get its addressMatei Zaharia2012-09-122-6/+19
|
* Wait for Akka to really shut down in SparkEnv.stop()Matei Zaharia2012-09-121-0/+4
|
* Merge branch 'dev' into feature/fileserverDenny2012-09-114-3/+61
|\ | | | | | | | | Conflicts: core/src/main/scala/spark/SparkContext.scala
| * Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-09-111-1/+1
| |\
| | * Updated the logError call from the previous commit to conform toReynold Xin2012-09-111-1/+1
| | | | | | | | | | | | logError API.
| | * Log entire exception (including stack trace) in BlockManagerWorker.Reynold Xin2012-09-111-1/+1
| | |
| * | Manually merge pull request #175 by Imran RashidMatei Zaharia2012-09-113-2/+60
| |/
| * Added a unit test for local-cluster mode and simplified some of the code ↵Matei Zaharia2012-09-077-48/+119
| | | | | | | | involved in that
| * Merge pull request #189 from dennybritz/feature/localclusterMatei Zaharia2012-09-074-1/+104
| |\ | | | | | | Simulating a Spark standalone cluster locally
| | * Add shutdown hook to Executor Runner and execute code to shutdown local ↵Denny2012-09-074-14/+29
| | | | | | | | | | | | cluster in Scheduler Backend
| | * Set SPARK_LAUNCH_WITH_SCALA=0 in Executor RunnerDenny2012-09-072-3/+20
| | |
| | * Renamed spark-cluster to spark-local.Denny2012-09-052-2/+2
| | |
| | * Fix wrong countingDenny2012-09-041-1/+1
| | |
| | * Delete old DeployUtils.Denny2012-09-041-53/+0
| | |
| | * Renamed class.Denny2012-09-042-2/+63
| | |
| | * Start a standalone cluster locally.Denny2012-09-042-1/+64
| | |
* | | FormattingDenny2012-09-111-1/+2
| | |
* | | Subclass URLClassLoader instead of using reflectionDenny2012-09-111-10/+11
| | |
* | | Use stageId as index for fileSet caches.Denny2012-09-111-5/+7
| | |
* | | Fix serialization bugs and added local cluster testsDenny2012-09-103-4/+33
| | |
* | | Dynamically adding jar files and caching fileSets.Denny2012-09-1010-114/+246
| | |
* | | General FileServerDenny2012-09-1010-71/+204
| | | | | | | | | | | | A general fileserver for both JARs and regular files.
* | | Added a unit test for local-cluster mode and simplified some of the code ↵Matei Zaharia2012-09-107-48/+119
| | | | | | | | | | | | involved in that
* | | Add shutdown hook to Executor Runner and execute code to shutdown local ↵Denny2012-09-104-14/+29
| | | | | | | | | | | | cluster in Scheduler Backend
* | | Set SPARK_LAUNCH_WITH_SCALA=0 in Executor RunnerDenny2012-09-102-3/+20
| | |
* | | Renamed spark-cluster to spark-local.Denny2012-09-102-2/+2
| | |
* | | Fix wrong countingDenny2012-09-101-1/+1
| | |
* | | Delete old DeployUtils.Denny2012-09-101-53/+0
| | |
* | | Renamed class.Denny2012-09-102-2/+63
| | |
* | | Start a standalone cluster locally.Denny2012-09-102-1/+64
|/ /
* | Randomize the order of block fetches in getMultipleroot2012-09-061-2/+5
| |