aboutsummaryrefslogtreecommitdiff
Commit message (Expand)AuthorAgeFilesLines
* Use numpy in Python k-means example.Josh Rosen2012-08-224-27/+21
* Use only cPickle for serialization in Python API.Josh Rosen2012-08-217-604/+381
* Bundle cloudpickle with pyspark.Josh Rosen2012-08-194-5/+976
* Add Python API.Josh Rosen2012-08-1814-0/+1339
* Merge pull request #172 from dennybritz/devMatei Zaharia2012-08-141-2/+2
|\
| * Use root login in standalone AMIDenny2012-08-141-1/+1
| * rsync root directory in EC2 scriptDenny2012-08-141-1/+1
|/
* Merge pull request #171 from shivaram/for-size-estimator-pullMatei Zaharia2012-08-134-53/+224
|\
| * Change BlockManagerSuite test cases to use a deterministic size estimator andShivaram Venkataraman2012-08-131-9/+31
| * Add test-cases for 32-bit and no-compressed oops scenarios.Shivaram Venkataraman2012-08-132-14/+46
| * Update test cases to match the new size estimates. Uses 64-bit and compressedShivaram Venkataraman2012-08-132-35/+77
| * Move object size and pointer size initialization into a function to enable un...Shivaram Venkataraman2012-08-131-21/+31
| * If spark.test.useCompressedOops is set, use that to infer compressed oopsShivaram Venkataraman2012-08-131-0/+3
| * Use HotSpotDiagnosticMXBean to get if CompressedOops are in use or notShivaram Venkataraman2012-08-131-3/+28
| * Add link to Java wiki which specifies what changes with compressed oopsShivaram Venkataraman2012-08-131-0/+3
| * Changes to make size estimator more accurate. Fixes object size, pointer sizeShivaram Venkataraman2012-08-131-4/+38
|/
* Renamed apply() to call() in Java API and allowed it to throw ExceptionsMatei Zaharia2012-08-1215-63/+105
* Use Promises instead of having a Future wait on a thread inMatei Zaharia2012-08-121-27/+25
* Return remotely fetched blocks in a pipelined fashion from BlockManagerMatei Zaharia2012-08-124-41/+44
* Switch to Akka futures in connection manager.Matei Zaharia2012-08-122-18/+17
* Changed multi-get method in BlockManager to return an iteratorMatei Zaharia2012-08-122-9/+13
* Merge pull request #168 from shivaram/devMatei Zaharia2012-08-101-11/+4
|\
| * Use an implicit conversion to get the scala iteratorShivaram Venkataraman2012-08-081-2/+2
| * Use JavaConversion to get a scala iteratorShivaram Venkataraman2012-08-081-11/+4
* | Merge pull request #167 from JoshRosen/piped-rdd-fixesMatei Zaharia2012-08-102-1/+24
|\ \
| * | Print exit status in PipedRDD failure exception.Josh Rosen2012-08-101-2/+3
| * | Detect non-zero exit status from PipedRDD process.Josh Rosen2012-07-262-1/+23
* | | Removed separate launcher for EC2 standalone clusterMatei Zaharia2012-08-091-20/+0
* | | Merge pull request #166 from shivaram/devMatei Zaharia2012-08-081-5/+9
|\ \ \ | | |/ | |/|
| * | Avoid a copy in ShuffleMapTask by creating an iterator that will be used by theShivaram Venkataraman2012-08-081-5/+9
|/ /
* | Merge pull request #160 from dennybritz/clusterscriptsMatei Zaharia2012-08-0420-31/+460
|\ \
| * | Add Apache license to non-trivial scripts taken from Hadoop.Denny2012-08-042-0/+30
| * | Read config variables before to get the master portDenny2012-08-021-0/+4
| * | merged dev branchDenny2012-08-0230-107/+981
| |\ \
| * | | Settings variables and bugfix for stop script.Denny2012-08-025-5/+38
| * | | Merged standalone and mesos EC2 scriptsDenny2012-08-023-516/+57
| * | | Spark standalone mode cluster scripts.Denny2012-08-0118-4/+825
* | | | Merge pull request #165 from shivaram/devMatei Zaharia2012-08-031-2/+1
|\ \ \ \
| * | | | Fix testcheckpoint to reuse spark context defined in the classShivaram Venkataraman2012-08-031-2/+1
|/ / / /
* | | | Made range partition balance tests more aggressive.Matei Zaharia2012-08-031-8/+8
* | | | Added a unit test for cross-partition balancing in sort, and changes toMatei Zaharia2012-08-033-41/+84
* | | | Fix for partitioning when sorting in descending orderHarvey2012-08-031-2/+1
* | | | Logging Throwables in Info and DebugPaul Cavallaro2012-08-031-3/+3
| |/ / |/| |
* | | Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-08-023-60/+13
|\ \ \
| * \ \ Merge pull request #162 from shivaram/devMatei Zaharia2012-08-022-5/+10
| |\ \ \
| | * | | Avoid an extra partition copy by passing an iterator to blockManager.putShivaram Venkataraman2012-08-021-4/+9
| | * | | Use maxMemory to better estimate memory available for BlockManager cacheShivaram Venkataraman2012-08-021-1/+1
| |/ / /
| * | | Merge pull request #161 from JoshRosen/fix/assembly-akka-configMatei Zaharia2012-08-021-55/+3
| |\ \ \ | | |/ / | |/| |
| | * | Use sbt mergeStrategy for reference.conf files.Josh Rosen2012-08-021-55/+3
* | | | Use spray's implicit Marshaller for Futures.Denny2012-08-022-27/+25
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-20 15:47:09 +0000