Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Fixed an issue with ordering of classloader setup that was causing Java ↵ | root | 2012-09-21 | 1 | -5/+4 |
| | | | | deserializer to break | ||||
* | Set a limited number of retry in standalone deploy mode. | Reynold Xin | 2012-09-19 | 3 | -14/+34 |
| | |||||
* | When a file is downloaded, make it executable. That's neccsary for scripts ↵ | Denny | 2012-09-17 | 1 | -0/+2 |
| | | | | (e.g. in Shark) | ||||
* | Change default serializer to Java.. it had accidentally become Kryo. | Matei Zaharia | 2012-09-13 | 1 | -1/+1 |
| | |||||
* | Store shuffle map outputs as DISK_ONLY | Matei Zaharia | 2012-09-12 | 1 | -1/+1 |
| | |||||
* | Ported performance and FT improvements from latest streaming work | Matei Zaharia | 2012-09-12 | 18 | -61/+153 |
| | |||||
* | Fix bugs with Connection's shutdown callback failing to get its address | Matei Zaharia | 2012-09-12 | 2 | -6/+19 |
| | |||||
* | Wait for Akka to really shut down in SparkEnv.stop() | Matei Zaharia | 2012-09-12 | 1 | -0/+4 |
| | |||||
* | Merge branch 'dev' into feature/fileserver | Denny | 2012-09-11 | 4 | -3/+61 |
|\ | | | | | | | | | Conflicts: core/src/main/scala/spark/SparkContext.scala | ||||
| * | Merge branch 'dev' of github.com:mesos/spark into dev | Matei Zaharia | 2012-09-11 | 1 | -1/+1 |
| |\ | |||||
| | * | Updated the logError call from the previous commit to conform to | Reynold Xin | 2012-09-11 | 1 | -1/+1 |
| | | | | | | | | | | | | logError API. | ||||
| | * | Log entire exception (including stack trace) in BlockManagerWorker. | Reynold Xin | 2012-09-11 | 1 | -1/+1 |
| | | | |||||
| * | | Manually merge pull request #175 by Imran Rashid | Matei Zaharia | 2012-09-11 | 3 | -2/+60 |
| |/ | |||||
| * | Added a unit test for local-cluster mode and simplified some of the code ↵ | Matei Zaharia | 2012-09-07 | 7 | -48/+119 |
| | | | | | | | | involved in that | ||||
| * | Merge pull request #189 from dennybritz/feature/localcluster | Matei Zaharia | 2012-09-07 | 4 | -1/+104 |
| |\ | | | | | | | Simulating a Spark standalone cluster locally | ||||
| | * | Add shutdown hook to Executor Runner and execute code to shutdown local ↵ | Denny | 2012-09-07 | 4 | -14/+29 |
| | | | | | | | | | | | | cluster in Scheduler Backend | ||||
| | * | Set SPARK_LAUNCH_WITH_SCALA=0 in Executor Runner | Denny | 2012-09-07 | 2 | -3/+20 |
| | | | |||||
| | * | Renamed spark-cluster to spark-local. | Denny | 2012-09-05 | 2 | -2/+2 |
| | | | |||||
| | * | Fix wrong counting | Denny | 2012-09-04 | 1 | -1/+1 |
| | | | |||||
| | * | Delete old DeployUtils. | Denny | 2012-09-04 | 1 | -53/+0 |
| | | | |||||
| | * | Renamed class. | Denny | 2012-09-04 | 2 | -2/+63 |
| | | | |||||
| | * | Start a standalone cluster locally. | Denny | 2012-09-04 | 2 | -1/+64 |
| | | | |||||
* | | | Formatting | Denny | 2012-09-11 | 1 | -1/+2 |
| | | | |||||
* | | | Subclass URLClassLoader instead of using reflection | Denny | 2012-09-11 | 1 | -10/+11 |
| | | | |||||
* | | | Use stageId as index for fileSet caches. | Denny | 2012-09-11 | 1 | -5/+7 |
| | | | |||||
* | | | Fix serialization bugs and added local cluster tests | Denny | 2012-09-10 | 3 | -4/+33 |
| | | | |||||
* | | | Dynamically adding jar files and caching fileSets. | Denny | 2012-09-10 | 10 | -114/+246 |
| | | | |||||
* | | | General FileServer | Denny | 2012-09-10 | 10 | -71/+204 |
| | | | | | | | | | | | | A general fileserver for both JARs and regular files. | ||||
* | | | Added a unit test for local-cluster mode and simplified some of the code ↵ | Matei Zaharia | 2012-09-10 | 7 | -48/+119 |
| | | | | | | | | | | | | involved in that | ||||
* | | | Add shutdown hook to Executor Runner and execute code to shutdown local ↵ | Denny | 2012-09-10 | 4 | -14/+29 |
| | | | | | | | | | | | | cluster in Scheduler Backend | ||||
* | | | Set SPARK_LAUNCH_WITH_SCALA=0 in Executor Runner | Denny | 2012-09-10 | 2 | -3/+20 |
| | | | |||||
* | | | Renamed spark-cluster to spark-local. | Denny | 2012-09-10 | 2 | -2/+2 |
| | | | |||||
* | | | Fix wrong counting | Denny | 2012-09-10 | 1 | -1/+1 |
| | | | |||||
* | | | Delete old DeployUtils. | Denny | 2012-09-10 | 1 | -53/+0 |
| | | | |||||
* | | | Renamed class. | Denny | 2012-09-10 | 2 | -2/+63 |
| | | | |||||
* | | | Start a standalone cluster locally. | Denny | 2012-09-10 | 2 | -1/+64 |
|/ / | |||||
* | | Randomize the order of block fetches in getMultiple | root | 2012-09-06 | 1 | -2/+5 |
| | | |||||
* | | Removed cache add/remove log messages from CacheTracker. | Reynold Xin | 2012-09-05 | 9 | -125/+143 |
| | | | | | | | | | | Added log messages on BlockManagerMaster to reflect block add/remove. Also did some minor cleanup of storage package code. | ||||
* | | Minor formatting fixes | Matei Zaharia | 2012-09-03 | 1 | -12/+15 |
| | | |||||
* | | Start fetching a remote block when a received remote block has been passed | Harvey | 2012-09-01 | 1 | -26/+50 |
| | | | | | | | | to the reduce function | ||||
* | | End runJob() with a SparkException when a task fails too many times in | Matei Zaharia | 2012-08-31 | 5 | -12/+66 |
| | | | | | | | | one of the cluster schedulers. | ||||
* | | Deserialize multi-get results in the caller's thread. This fixes an | Matei Zaharia | 2012-08-30 | 2 | -31/+27 |
| | | | | | | | | issue with shared buffers in the KryoSerializer. | ||||
* | | Added a test for testing map-side combine on/off switch. | Reynold Xin | 2012-08-30 | 1 | -1/+44 |
| | | |||||
* | | Added a new flag in Aggregator to indicate applying map side combiners. | Reynold Xin | 2012-08-29 | 3 | -9/+18 |
| | | |||||
* | | Merge branch 'dev' of github.com:mesos/spark into dev | Reynold Xin | 2012-08-29 | 10 | -14/+77 |
|\| | |||||
| * | Fault tolerance and block store fixes discovered through streaming tests. | Matei Zaharia | 2012-08-27 | 10 | -14/+77 |
| | | |||||
* | | Disable running combiners on map tasks when mergeCombiners function is | Reynold Xin | 2012-08-29 | 2 | -19/+56 |
|/ | | | | not specified by the user. | ||||
* | Removed the deserialization cache for ShuffleMapTask because it was | Reynold Xin | 2012-08-27 | 1 | -17/+12 |
| | | | | | | causing concurrency problems (some variables in Shark get set to null). The cost of task deserialization on slaves is trivial compared with the execution time of the task anyway. | ||||
* | Set log level in tests to WARN | Matei Zaharia | 2012-08-23 | 1 | -0/+8 |
| | |||||
* | Fix further issues with tests and broadcast. | Matei Zaharia | 2012-08-23 | 13 | -15/+28 |
| | | | | | The broadcast fix is to store values as MEMORY_ONLY_DESER instead of MEMORY_ONLY, which will save substantial time on serialization. |