aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Changed JavaStreamingContextWith*** to ***Function in streaming.api.java.*** ↵Tathagata Das2014-01-0615-76/+67
| | | | package. Also fixed packages of Flume and MQTT tests.
* Merge branch 'apache-master' into project-refactorTathagata Das2013-12-3114-67/+52
|\
| * Merge pull request #308 from kayousterhout/stage_namingPatrick Wendell2013-12-307-14/+18
| |\ | | | | | | | | | | | | | | | | | | | | | Changed naming of StageCompleted event to be consistent The rest of the SparkListener events are named with "SparkListener" as the prefix of the name; this commit renames the StageCompleted event to SparkListenerStageCompleted for consistency.
| | * Updated code style according to Patrick's commentsKay Ousterhout2013-12-291-4/+2
| | |
| | * Changed naming of StageCompleted event to be consistentKay Ousterhout2013-12-277-14/+20
| | | | | | | | | | | | | | | | | | The rest of the SparkListener events are named with "SparkListener" as the prefix of the name; this commit renames the StageCompleted event to SparkListenerStageCompleted for consistency.
| * | Revert "Merge pull request #310 from jyunfan/master"Reynold Xin2013-12-281-1/+1
| | | | | | | | | | | | | | | This reverts commit 79b20e4dbe3dcd8559ec8316784d3334bb55868b, reversing changes made to 7375047d516c5aa69221611f5f7b0f1d367039af.
| * | Merge pull request #310 from jyunfan/masterReynold Xin2013-12-281-1/+1
| |\ \ | | | | | | | | | | | | | | | | | | | | Fix typo in the Accumulators section Change 'val' to 'var'
| | * | Fix typo in the Accumulators sectionJyun-Fan Tsai2013-12-291-1/+1
| |/ / | | | | | | val => var
| * | Merge pull request #304 from kayousterhout/remove_unusedPatrick Wendell2013-12-281-6/+0
| |\ \ | | | | | | | | | | | | Removed unused failed and causeOfFailure variables (in TaskSetManager)
| | * | Removed unused failed and causeOfFailure variablesKay Ousterhout2013-12-271-6/+0
| | | |
| * | | Merge pull request #307 from kayousterhout/other_failureMatei Zaharia2013-12-272-6/+0
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Removed unused OtherFailure TaskEndReason. The OtherFailure TaskEndReason was added by @mateiz 3 years ago in this commit: https://github.com/apache/incubator-spark/commit/24a1e7f8380bfd8d4fbdda688482a451bd6ea215 Unless I am missing something, it doesn't seem to have been used then, and is not used now, so seems safe for deletion.
| | * | | Removed unused OtherFailure TaskEndReason.Kay Ousterhout2013-12-272-6/+0
| | | |/ | | |/|
| * | | Merge pull request #306 from kayousterhout/remove_pendingMatei Zaharia2013-12-274-16/+0
| |\ \ \ | | |/ / | |/| | | | | | Remove unused hasPendingTasks methods
| | * | Remove unused hasPendingTasks methodsKay Ousterhout2013-12-274-16/+0
| |/ /
| * | Merge pull request #305 from kayousterhout/line_spacingPatrick Wendell2013-12-271-15/+27
| |\ \ | | |/ | |/| | | | | | | | | | Fixed >100char lines in DAGScheduler.scala There's no changed functionality here -- only line spacing and one grammatical fix in a comment.
| | * Style fixes as per Reynold's reviewKay Ousterhout2013-12-271-6/+6
| | |
| | * Fixed >100char lines in DAGScheduler.scalaKay Ousterhout2013-12-271-15/+27
| |/
| * Merge pull request #298 from aarondav/minorReynold Xin2013-12-261-3/+3
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Minor: Decrease margin of left side of Log page Before ![before](https://f.cloud.github.com/assets/1400247/1812647/1a4be53e-6e87-11e3-9d5b-f851274be0e9.png) After ![after](https://f.cloud.github.com/assets/1400247/1812648/1ca1ea2c-6e87-11e3-946c-31be9258f450.png) It's a start anyway...
| | * Decrease margin of left side of log pageAaron Davidson2013-12-261-3/+3
| | |
| * | Merge pull request #302 from pwendell/SPARK-1007Reynold Xin2013-12-261-1/+1
| |\ \ | | | | | | | | | | | | | | | | | | | | SPARK-1007: spark-class2.cmd should change SCALA_VERSION to be 2.10 Reported by Qiuzhuang Lian
| | * | SPARK-1007: spark-class2.cmd should change SCALA_VERSION to be 2.10Patrick Wendell2013-12-261-1/+1
| |/ /
| * | Merge pull request #295 from markhamstra/JobProgressListenerNPEMatei Zaharia2013-12-261-6/+3
| |\ \ | | |/ | |/| | | | Avoid a lump of coal (NPE) in JobProgressListener's stocking.
| | * Avoid a lump of coal (NPE) in JobProgressListener's stocking.Mark Hamstra2013-12-251-6/+3
| | |
* | | Removed extra empty lines.Tathagata Das2013-12-313-3/+0
| | |
* | | Removed unnecessary comments.Tathagata Das2013-12-313-55/+8
| | |
* | | Added pom.xml for external projects and removed unnecessary dependencies and ↵Tathagata Das2013-12-319-106/+548
| | | | | | | | | | | | repositoris from other poms and sbt.
* | | Refactored kafka, flume, zeromq, mqtt as separate external projects, with ↵Tathagata Das2013-12-3050-599/+1612
| | | | | | | | | | | | their own self-contained scala API, java API, scala unit tests and java unit tests. Updated examples to use the external projects.
* | | Refactored streaming project to separate out the twitter functionality.Tathagata Das2013-12-269-14/+64
|/ /
* | Merge pull request #296 from witgo/masterMatei Zaharia2013-12-268-17/+22
|\ \ | | | | | | | | | Renamed ClusterScheduler to TaskSchedulerImpl for yarn and new-yarn package
| * | fix this import orderliguoqiang2013-12-262-2/+2
| | |
| * | Renamed ClusterScheduler to TaskSchedulerImpl for yarn and new-yarnliguoqiang2013-12-262-4/+2
| | |
| * | Renamed ClusterScheduler to TaskSchedulerImpl for yarn and new-yarnliguoqiang2013-12-268-15/+22
| |/
* | Merge pull request #283 from tmyklebu/masterMatei Zaharia2013-12-269-1/+830
|\ \ | |/ |/| | | | | | | | | | | | | | | | | | | Python bindings for mllib This pull request contains Python bindings for the regression, clustering, classification, and recommendation tools in mllib. For each 'train' frontend exposed, there is a Scala stub in PythonMLLibAPI.scala and a Python stub in mllib.py. The Python stub serialises the input RDD and any vector/matrix arguments into a mutually-understood format and calls the Scala stub. The Scala stub deserialises the RDD and the vector/matrix arguments, calls the appropriate 'train' function, serialises the resulting model, and returns the serialised model. ALSModel is slightly different since a MatrixFactorizationModel has RDDs inside. The Scala stub returns a handle to a Scala MatrixFactorizationModel; prediction is done by calling the Scala predict method. I have tested these bindings on an x86_64 machine running Linux. There is a risk that these bindings may fail on some choose-your-own-endian platform if Python's endian differs from java.nio.ByteBuffer's idea of the native byte order.
| * Remove commented code in __init__.py.Tor Myklebust2013-12-251-8/+0
| |
| * Fix copypasta in __init__.py. Don't import anything directly into ↵Tor Myklebust2013-12-251-26/+8
| | | | | | | | pyspark.mllib.
| * Initial weights in Scala are ones; do that too. Also fix some errors.Tor Myklebust2013-12-251-6/+6
| |
| * Scala stubs for updated Python bindings.Tor Myklebust2013-12-251-13/+13
| |
| * Split the mllib bindings into a whole bunch of modules and rename some things.Tor Myklebust2013-12-257-183/+409
| |
| * Remove useless line from test stub.Tor Myklebust2013-12-241-1/+0
| |
| * Python change for move of PythonMLLibAPI.Tor Myklebust2013-12-241-1/+1
| |
| * Move PythonMLLibAPI into its own package.Tor Myklebust2013-12-241-0/+1
| |
| * Fix error message ugliness.Tor Myklebust2013-12-241-2/+2
| |
| * Release JVM reference to the ALSModel when done.Tor Myklebust2013-12-221-2/+2
| |
| * Java stubs for ALSModel.Tor Myklebust2013-12-211-0/+34
| |
| * Python stubs for ALSModel.Tor Myklebust2013-12-212-8/+56
| |
| * Javadocs; also, declare some things private.Tor Myklebust2013-12-201-5/+26
| |
| * Un-semicolon mllib.py.Tor Myklebust2013-12-201-11/+11
| |
| * Change some docstrings and add some others.Tor Myklebust2013-12-201-1/+3
| |
| * Licence notice.Tor Myklebust2013-12-202-0/+34
| |
| * Whitespace.Tor Myklebust2013-12-201-1/+1
| |