aboutsummaryrefslogtreecommitdiff
path: root/python/pyspark/shell.py
Commit message (Collapse)AuthorAgeFilesLines
* pyspark -> bin/pysparkPrashant Sharma2014-01-021-1/+1
|
* Typo: avaiable -> availableAndrew Ash2013-12-241-1/+1
|
* Update build version in masterPatrick Wendell2013-09-241-1/+1
|
* Export StorageLevel and refactorAaron Davidson2013-09-071-1/+1
|
* Remove reflection, hard-code StorageLevelsAaron Davidson2013-09-071-2/+2
| | | | | | | | | | | The sc.StorageLevel -> StorageLevel pathway is a bit janky, but otherwise the shell would have to call a private method of SparkContext. Having StorageLevel available in sc also doesn't seem like the end of the world. There may be a better solution, though. As for creating the StorageLevel object itself, this seems to be the best way in Python 2 for creating singleton, enum-like objects: http://stackoverflow.com/questions/36932/how-can-i-represent-an-enum-in-python
* SPARK-660: Add StorageLevel support in PythonAaron Davidson2013-09-051-1/+2
| | | | | It uses reflection... I am not proud of that fact, but it at least ensures compatibility (sans refactoring of the StorageLevel stuff).
* Add banner to PySpark and make wordcount output nicerMatei Zaharia2013-09-011-0/+13
|
* Merge pull request #813 from AndreSchumacher/add_files_pysparkMatei Zaharia2013-08-121-1/+6
|\ | | | | Implementing SPARK-865: Add the equivalent of ADD_JARS to PySpark
| * Implementing SPARK-865: Add the equivalent of ADD_JARS to PySparkAndre Schumacher2013-08-121-1/+6
| | | | | | | | Now ADD_FILES uses a comma as file name separator.
* | Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-161-0/+17
|/
* Make module help available in python shell.Patrick Wendell2013-01-301-0/+1
| | | | Also, adds a line in doc explaining how to use.
* Added accumulators to PySparkMatei Zaharia2013-01-201-2/+2
|
* Add `pyspark` script to replace the other scripts.Josh Rosen2013-01-011-26/+10
| | | Expand the PySpark programming guide.
* Rename top-level 'pyspark' directory to 'python'Josh Rosen2013-01-011-0/+33