aboutsummaryrefslogtreecommitdiff
path: root/core
Commit message (Expand)AuthorAgeFilesLines
* Fix bug (introduced by batching) in PySpark take()Josh Rosen2012-12-281-1/+1
* Mark api.python classes as private; echo Java output to stderr.Josh Rosen2012-12-282-30/+22
* Remove debug output from PythonPartitioner.Josh Rosen2012-12-261-2/+0
* Use filesystem to collect RDDs in PySpark.Josh Rosen2012-12-241-42/+24
* Fix PySpark hash partitioning bug.Josh Rosen2012-10-282-6/+45
* Remove PYTHONPATH from SparkContext's executorEnvs.Josh Rosen2012-10-222-9/+8
* Add PySpark README and run scripts.Josh Rosen2012-10-201-1/+1
* Update Python API for v0.6.0 compatibility.Josh Rosen2012-10-192-8/+12
* Merge tag 'v0.6.0' into python-apiJosh Rosen2012-10-19194-3797/+5767
|\
| * Made ShuffleDependency automatically find a shuffle ID for itselfMatei Zaharia2012-10-143-5/+6
| * Take executor environment vars as an arguemnt to SparkContextMatei Zaharia2012-10-137-79/+107
| * Protect from null env variables in mesos.Denny2012-10-132-8/+16
| * Protect from setting null environment variables.Denny2012-10-131-1/+5
| * Don't use system envs for Mesos.Denny2012-10-132-2/+2
| * Let the user specify environment variables to be passed to the Executors.Denny2012-10-135-48/+21
| * More doc updates, and moved Serializer to a subpackage.Matei Zaharia2012-10-1212-25/+51
| * Some doc and usability improvements:Matei Zaharia2012-10-1211-22/+83
| * Added a test for when an RDD only partially fits in memoryMatei Zaharia2012-10-121-2/+18
| * Document cartesian() operationMatei Zaharia2012-10-122-0/+8
| * Merge pull request #271 from shivaram/block-manager-npe-fixMatei Zaharia2012-10-128-39/+58
| |\
| | * Add test to verify if RDD is computed even if block manager has insufficientShivaram Venkataraman2012-10-121-0/+10
| | * Change block manager to accept a ArrayBuffer instead of an iterator to ensureShivaram Venkataraman2012-10-117-39/+48
| * | Adding Java documentationPatrick Wendell2012-10-116-10/+454
| |/
| * Fixed bug when fetching Jar dependencies.Denny2012-10-102-6/+6
| * Added documentation to all the *RDDFunction classes, and moved them intoMatei Zaharia2012-10-099-54/+273
| * Updates to documentation:Matei Zaharia2012-10-091-1/+1
| * Fixes a typo, adds scaladoc comments to SparkContext constructors.Andy Konwinski2012-10-082-5/+11
| * More docs in RDD classPatrick Wendell2012-10-081-1/+45
| * A start on scaladoc for the public APIs.Andy Konwinski2012-10-081-6/+29
| * Merge branch 'dev' into bc-fix-devMosharaf Chowdhury2012-10-0871-477/+1108
| |\
| | * Made compression configurable separately for shuffle, broadcast and RDDsMatei Zaharia2012-10-074-38/+118
| | * Merge pull request #251 from JoshRosen/docs/internalsMatei Zaharia2012-10-075-11/+40
| | |\
| | | * Make ShuffleDependency.aggregator explicitly optional.Josh Rosen2012-10-074-7/+11
| | | * Document the Dependency classes.Josh Rosen2012-10-072-1/+26
| | | * Remove unused isShuffle field from Dependency.Josh Rosen2012-10-071-3/+3
| | * | Changed the println to logInfo in Utils.fetchFile.Reynold Xin2012-10-071-1/+1
| | * | Merge pull request #250 from rxin/devMatei Zaharia2012-10-072-18/+40
| | |\ \
| | | * | Fixed a bug in addFile that if the file is specified as "file:///", theReynold Xin2012-10-072-18/+40
| | * | | Improve error messageMatei Zaharia2012-10-071-1/+1
| | * | | Don't crash on ask timeout exceptions in deploy.Client.stop() (fixes a crash ...Matei Zaharia2012-10-071-3/+8
| | |/ /
| | * / Removed the need to sleep in tests due to waiting for Akka to shut downMatei Zaharia2012-10-0715-23/+40
| | |/
| | * Log messageMatei Zaharia2012-10-071-1/+1
| | * More loggingMatei Zaharia2012-10-071-4/+7
| | * Log more info in MapOutputTrackerroot2012-10-071-4/+7
| | * Made Akka thread pool and message batch sizes configurableroot2012-10-071-3/+5
| | * Made run script add test-classes onto the classpath only if SPARK_TESTING is ...root2012-10-073-3/+6
| | * Avoid acquiring locks in BlockManager when fetching shuffle outputsroot2012-10-071-0/+24
| | * Log initial number of fetches in reducerroot2012-10-071-1/+2
| | * Modified shuffle to limit the maximum outstanding data size in bytes,Matei Zaharia2012-10-064-61/+109
| | * Pass sizes of map outputs back to MapOutputTrackerMatei Zaharia2012-10-069-83/+152