aboutsummaryrefslogtreecommitdiff
path: root/core
Commit message (Expand)AuthorAgeFilesLines
* Add pipe(), saveAsTextFile(), sc.union() to Python API.Josh Rosen2012-08-271-2/+6
* Simplify Python worker; pipeline the map step of partitionBy().Josh Rosen2012-08-271-27/+7
* Add broadcast variables to Python API.Josh Rosen2012-08-271-17/+26
* Use numpy in Python k-means example.Josh Rosen2012-08-221-1/+7
* Use only cPickle for serialization in Python API.Josh Rosen2012-08-211-44/+148
* Add Python API.Josh Rosen2012-08-181-0/+147
* Change BlockManagerSuite test cases to use a deterministic size estimator andShivaram Venkataraman2012-08-131-9/+31
* Add test-cases for 32-bit and no-compressed oops scenarios.Shivaram Venkataraman2012-08-132-14/+46
* Update test cases to match the new size estimates. Uses 64-bit and compressedShivaram Venkataraman2012-08-132-35/+77
* Move object size and pointer size initialization into a function to enable un...Shivaram Venkataraman2012-08-131-21/+31
* If spark.test.useCompressedOops is set, use that to infer compressed oopsShivaram Venkataraman2012-08-131-0/+3
* Use HotSpotDiagnosticMXBean to get if CompressedOops are in use or notShivaram Venkataraman2012-08-131-3/+28
* Add link to Java wiki which specifies what changes with compressed oopsShivaram Venkataraman2012-08-131-0/+3
* Changes to make size estimator more accurate. Fixes object size, pointer sizeShivaram Venkataraman2012-08-131-4/+38
* Renamed apply() to call() in Java API and allowed it to throw ExceptionsMatei Zaharia2012-08-1211-42/+80
* Use Promises instead of having a Future wait on a thread inMatei Zaharia2012-08-121-27/+25
* Return remotely fetched blocks in a pipelined fashion from BlockManagerMatei Zaharia2012-08-124-41/+44
* Switch to Akka futures in connection manager.Matei Zaharia2012-08-122-18/+17
* Changed multi-get method in BlockManager to return an iteratorMatei Zaharia2012-08-122-9/+13
* Merge pull request #168 from shivaram/devMatei Zaharia2012-08-101-11/+4
|\
| * Use an implicit conversion to get the scala iteratorShivaram Venkataraman2012-08-081-2/+2
| * Use JavaConversion to get a scala iteratorShivaram Venkataraman2012-08-081-11/+4
* | Merge pull request #167 from JoshRosen/piped-rdd-fixesMatei Zaharia2012-08-102-1/+24
|\ \ | |/ |/|
| * Print exit status in PipedRDD failure exception.Josh Rosen2012-08-101-2/+3
| * Detect non-zero exit status from PipedRDD process.Josh Rosen2012-07-262-1/+23
* | Avoid a copy in ShuffleMapTask by creating an iterator that will be used by theShivaram Venkataraman2012-08-081-5/+9
* | Merge pull request #160 from dennybritz/clusterscriptsMatei Zaharia2012-08-044-4/+29
|\ \
| * \ merged dev branchDenny2012-08-0227-49/+969
| |\ \
| * | | Settings variables and bugfix for stop script.Denny2012-08-022-2/+27
| * | | Spark standalone mode cluster scripts.Denny2012-08-012-2/+2
* | | | Fix testcheckpoint to reuse spark context defined in the classShivaram Venkataraman2012-08-031-2/+1
* | | | Made range partition balance tests more aggressive.Matei Zaharia2012-08-031-8/+8
* | | | Added a unit test for cross-partition balancing in sort, and changes toMatei Zaharia2012-08-033-41/+84
* | | | Fix for partitioning when sorting in descending orderHarvey2012-08-031-2/+1
* | | | Logging Throwables in Info and DebugPaul Cavallaro2012-08-031-3/+3
| |/ / |/| |
* | | Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-08-022-5/+10
|\ \ \
| * | | Avoid an extra partition copy by passing an iterator to blockManager.putShivaram Venkataraman2012-08-021-4/+9
| * | | Use maxMemory to better estimate memory available for BlockManager cacheShivaram Venkataraman2012-08-021-1/+1
| |/ /
* | | Use spray's implicit Marshaller for Futures.Denny2012-08-022-27/+25
* | | Mostly stlyistic changes.Denny2012-08-023-5/+11
* | | Moved resources into static folderDenny2012-08-0211-517/+12
* | | Webui improvements.Denny2012-08-0122-47/+1107
* | | merge dev branchDenny2012-08-0114-123/+213
|\| |
| * | Merge branch 'block-manager-fix' into devMatei Zaharia2012-07-309-88/+83
| |\ \
| | * | Made BlockManagerMaster no longer be a singleton.Matei Zaharia2012-07-309-88/+83
| * | | Merge branch 'dev' of git://github.com/tdas/spark into devMatei Zaharia2012-07-306-35/+130
| |\ \ \ | | |/ / | |/| |
| | * | Updated the new checkpoint RDD to remember partitioning of the original RDD.Tathagata Das2012-07-271-1/+6
| | * | Merge branch 'dev' of github.com:tdas/spark into devTathagata Das2012-07-271-4/+8
| | |\ \
| | | * | Fixed more stuff in BoundedMemoryCache.Tathagata Das2012-07-271-4/+8
| | * | | Added BlockRDD and a first-cut version of checkpoint() to RDD class.Tathagata Das2012-07-273-0/+63
| | |/ /