aboutsummaryrefslogtreecommitdiff
path: root/python/pyspark/worker.py
Commit message (Expand)AuthorAgeFilesLines
* [SPARK-6216] [PYSPARK] check python version of worker with driverDavies Liu2015-05-181-5/+7
* [SPARK-4897] [PySpark] Python 3 supportDavies Liu2015-04-161-6/+10
* [SPARK-6216] [PySpark] check the python version in workerDavies Liu2015-04-101-1/+5
* Revert "[SPARK-5363] [PySpark] check ending mark in non-block way"Josh Rosen2015-02-171-1/+0
* [SPARK-5363] [PySpark] check ending mark in non-block wayDavies Liu2015-02-161-0/+1
* [SPARK-4387][PySpark] Refactoring python profiling code to make it extensibleYandu Oppacher2015-01-281-9/+3
* [SPARK-4548] []SPARK-4517] improve performance of python broadcastDavies Liu2014-11-241-7/+3
* [SPARK-3721] [PySpark] broadcast objects larger than 2GDavies Liu2014-11-181-3/+5
* [SPARK-3993] [PySpark] fix bug while reuse worker after take()Davies Liu2014-10-231-2/+9
* [SPARK-3478] [PySpark] Profile the Python tasksDavies Liu2014-09-301-3/+16
* Revert "[SPARK-3478] [PySpark] Profile the Python tasks"Josh Rosen2014-09-261-16/+3
* [SPARK-3478] [PySpark] Profile the Python tasksDavies Liu2014-09-261-3/+16
* [SPARK-3634] [PySpark] User's module should take precedence over system modulesDavies Liu2014-09-241-2/+9
* [SPARK-3554] [PySpark] use broadcast automatically for large closureDavies Liu2014-09-181-1/+3
* [SPARK-3463] [PySpark] aggregate and show spilled bytes in PythonDavies Liu2014-09-131-4/+10
* [SPARK-3030] [PySpark] Reuse Python workerDavies Liu2014-09-131-2/+7
* [SPARK-3114] [PySpark] Fix Python UDFs in Spark SQL.Josh Rosen2014-08-181-1/+1
* [SPARK-1065] [PySpark] improve supporting for large broadcastDavies Liu2014-08-161-3/+5
* [SPARK-2580] [PySpark] keep silent in worker if JVM close the socketDavies Liu2014-07-291-8/+13
* [SPARK-2470] PEP8 fixes to PySparkNicholas Chammas2014-07-211-2/+2
* Add Python includes to path before depickling broadcast valuesBouke van der Bijl2014-05-101-7/+7
* SPARK-1115: Catch depickling errorsBouke van der Bijl2014-02-261-24/+24
* Fixed minor typo in worker.pyjyotiska2014-02-221-1/+1
* Switch from MUTF8 to UTF8 in PySpark serializers.Josh Rosen2014-01-281-4/+4
* Log Python exceptions to stderr as wellMatei Zaharia2014-01-121-0/+4
* FramedSerializer: _dumps => dumps, _loads => loads.Josh Rosen2013-11-101-2/+2
* Send PySpark commands as bytes insetad of strings.Josh Rosen2013-11-101-10/+2
* Add custom serializer support to PySpark.Josh Rosen2013-11-101-22/+19
* Remove Pickle-wrapping of Java objects in PySpark.Josh Rosen2013-11-031-5/+9
* Replace magic lengths with constants in PySpark.Josh Rosen2013-11-031-6/+7
* Allow PySpark to launch worker.py directly on WindowsMatei Zaharia2013-09-011-4/+7
* Implementing SPARK-878 for PySpark: adding zip and egg files to context and p...Andre Schumacher2013-08-161-1/+12
* Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-161-0/+17
* Fix reporting of PySpark exceptionsJey Kottalam2013-06-211-1/+1
* Add tests and fixes for Python daemon shutdownJey Kottalam2013-06-211-0/+2
* Prefork Python worker processesJey Kottalam2013-06-211-32/+29
* Add Python timing instrumentationJey Kottalam2013-06-211-1/+15
* Fix stdout redirection in PySpark.Josh Rosen2013-02-011-2/+3
* SPARK-673: Capture and re-throw Python exceptionsPatrick Wendell2013-01-311-2/+8
* Allow PySpark's SparkFiles to be used from driverJosh Rosen2013-01-231-0/+1
* Fix sys.path bug in PySpark SparkContext.addPyFileJosh Rosen2013-01-221-0/+1
* Don't download files to master's working directory.Josh Rosen2013-01-211-0/+3
* Added accumulators to PySparkMatei Zaharia2013-01-201-1/+6
* Add mapPartitionsWithSplit() to PySpark.Josh Rosen2013-01-081-1/+3
* Rename top-level 'pyspark' directory to 'python'Josh Rosen2013-01-011-0/+40