aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Adding docs directory containing documentation currently on the wikiAndy Konwinski2012-09-1226-0/+9866
| | | | | | which can be compiled via jekyll, using the command `jekyll`. To compile and run a local webserver to serve the doc as a website, run `jekyll --server`.
* Merge pull request #195 from dennybritz/feature/fileserverMatei Zaharia2012-09-1112-116/+414
|\ | | | | Spark HTTP FileServer
| * Merge branch 'dev' into feature/fileserverDenny2012-09-114-3/+61
| |\ | |/ |/| | | | | Conflicts: core/src/main/scala/spark/SparkContext.scala
* | Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-09-111-1/+1
|\ \
| * \ Merge pull request #196 from rxin/devMatei Zaharia2012-09-111-1/+1
| |\ \ | | | | | | | | Log entire exception (including stack trace) in BlockManagerWorker.
| | * | Updated the logError call from the previous commit to conform toReynold Xin2012-09-111-1/+1
| | | | | | | | | | | | | | | | logError API.
| | * | Log entire exception (including stack trace) in BlockManagerWorker.Reynold Xin2012-09-111-1/+1
| |/ /
* / / Manually merge pull request #175 by Imran RashidMatei Zaharia2012-09-113-2/+60
|/ /
| * FormattingDenny2012-09-111-1/+2
| |
| * Subclass URLClassLoader instead of using reflectionDenny2012-09-111-10/+11
| |
| * Use stageId as index for fileSet caches.Denny2012-09-111-5/+7
| |
| * Fix serialization bugs and added local cluster testsDenny2012-09-103-4/+33
| |
| * Merge branch 'dev' of git://github.com/mesos/spark into feature/fileserverDenny2012-09-100-0/+0
| |\ | |/ |/|
* | Added a unit test for local-cluster mode and simplified some of the code ↵Matei Zaharia2012-09-078-48/+120
| | | | | | | | involved in that
* | Merge pull request #189 from dennybritz/feature/localclusterMatei Zaharia2012-09-074-1/+104
|\ \ | | | | | | Simulating a Spark standalone cluster locally
| * | Add shutdown hook to Executor Runner and execute code to shutdown local ↵Denny2012-09-074-14/+29
| | | | | | | | | | | | cluster in Scheduler Backend
| * | Set SPARK_LAUNCH_WITH_SCALA=0 in Executor RunnerDenny2012-09-072-3/+20
| | |
| * | Renamed spark-cluster to spark-local.Denny2012-09-052-2/+2
| | |
| * | Fix wrong countingDenny2012-09-041-1/+1
| | |
| * | Delete old DeployUtils.Denny2012-09-041-53/+0
| | |
| * | Renamed class.Denny2012-09-042-2/+63
| | |
| * | Start a standalone cluster locally.Denny2012-09-042-1/+64
| | |
| | * Dynamically adding jar files and caching fileSets.Denny2012-09-1010-114/+246
| | |
| | * General FileServerDenny2012-09-1010-71/+204
| | | | | | | | | | | | A general fileserver for both JARs and regular files.
| | * Added a unit test for local-cluster mode and simplified some of the code ↵Matei Zaharia2012-09-108-48/+120
| | | | | | | | | | | | involved in that
| | * Add shutdown hook to Executor Runner and execute code to shutdown local ↵Denny2012-09-104-14/+29
| | | | | | | | | | | | cluster in Scheduler Backend
| | * Set SPARK_LAUNCH_WITH_SCALA=0 in Executor RunnerDenny2012-09-102-3/+20
| | |
| | * Renamed spark-cluster to spark-local.Denny2012-09-102-2/+2
| | |
| | * Fix wrong countingDenny2012-09-101-1/+1
| | |
| | * Delete old DeployUtils.Denny2012-09-101-53/+0
| | |
| | * Renamed class.Denny2012-09-102-2/+63
| | |
| | * Start a standalone cluster locally.Denny2012-09-102-1/+64
| |/ |/|
* | Randomize the order of block fetches in getMultipleroot2012-09-061-2/+5
| |
* | Merge pull request #190 from rxin/devMatei Zaharia2012-09-059-125/+143
|\ \ | | | | | | Log cache add/remove messages in block manager.
| * | Removed cache add/remove log messages from CacheTracker.Reynold Xin2012-09-059-125/+143
|/ / | | | | | | | | Added log messages on BlockManagerMaster to reflect block add/remove. Also did some minor cleanup of storage package code.
* | Minor formatting fixesMatei Zaharia2012-09-031-12/+15
| |
* | Merge pull request #182 from HarveyFeng/dev-fetchMatei Zaharia2012-09-031-26/+50
|\ \ | | | | | | Add a limit on the number of parallel fetches in the reduce stage
| * | Start fetching a remote block when a received remote block has been passedHarvey2012-09-011-26/+50
|/ / | | | | | | to the reduce function
* | End runJob() with a SparkException when a task fails too many times inMatei Zaharia2012-08-315-12/+66
| | | | | | | | one of the cluster schedulers.
* | Deserialize multi-get results in the caller's thread. This fixes anMatei Zaharia2012-08-302-31/+27
| | | | | | | | issue with shared buffers in the KryoSerializer.
* | Merge pull request #184 from rxin/devMatei Zaharia2012-08-304-21/+110
|\ \ | |/ |/| Disable running combiners on map tasks when mergeCombiners function is not specified by the user.
| * Added a test for testing map-side combine on/off switch.Reynold Xin2012-08-301-1/+44
| |
| * Added a new flag in Aggregator to indicate applying map side combiners.Reynold Xin2012-08-293-9/+18
| |
| * Merge branch 'dev' of github.com:mesos/spark into devReynold Xin2012-08-2911-16/+81
| |\ | |/ |/|
* | Made region used by spark-ec2 configurable.Matei Zaharia2012-08-281-2/+4
| |
* | Fault tolerance and block store fixes discovered through streaming tests.Matei Zaharia2012-08-2710-14/+77
| |
* | Merge pull request #181 from rxin/devMatei Zaharia2012-08-271-17/+12
|\ \ | | | | | | Removed the deserialization cache for ShuffleMapTask
| | * Disable running combiners on map tasks when mergeCombiners function isReynold Xin2012-08-292-19/+56
| |/ | | | | | | not specified by the user.
| * Removed the deserialization cache for ShuffleMapTask because it wasReynold Xin2012-08-271-17/+12
|/ | | | | | causing concurrency problems (some variables in Shark get set to null). The cost of task deserialization on slaves is trivial compared with the execution time of the task anyway.
* Merge pull request #179 from JoshRosen/fix/sparklr-cachingMatei Zaharia2012-08-261-2/+2
|\ | | | | Cache points in SparkLR example
generated by cgit v1.2.3 (git 2.39.1) at 2024-08-22 22:20:40 +0000