Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Changed JavaStreamingContextWith*** to ***Function in streaming.api.java.*** ↵ | Tathagata Das | 2014-01-06 | 15 | -76/+67 |
| | | | | package. Also fixed packages of Flume and MQTT tests. | ||||
* | Merge branch 'apache-master' into project-refactor | Tathagata Das | 2013-12-31 | 14 | -67/+52 |
|\ | |||||
| * | Merge pull request #308 from kayousterhout/stage_naming | Patrick Wendell | 2013-12-30 | 7 | -14/+18 |
| |\ | | | | | | | | | | | | | | | | | | | | | | Changed naming of StageCompleted event to be consistent The rest of the SparkListener events are named with "SparkListener" as the prefix of the name; this commit renames the StageCompleted event to SparkListenerStageCompleted for consistency. | ||||
| | * | Updated code style according to Patrick's comments | Kay Ousterhout | 2013-12-29 | 1 | -4/+2 |
| | | | |||||
| | * | Changed naming of StageCompleted event to be consistent | Kay Ousterhout | 2013-12-27 | 7 | -14/+20 |
| | | | | | | | | | | | | | | | | | | The rest of the SparkListener events are named with "SparkListener" as the prefix of the name; this commit renames the StageCompleted event to SparkListenerStageCompleted for consistency. | ||||
| * | | Revert "Merge pull request #310 from jyunfan/master" | Reynold Xin | 2013-12-28 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | This reverts commit 79b20e4dbe3dcd8559ec8316784d3334bb55868b, reversing changes made to 7375047d516c5aa69221611f5f7b0f1d367039af. | ||||
| * | | Merge pull request #310 from jyunfan/master | Reynold Xin | 2013-12-28 | 1 | -1/+1 |
| |\ \ | | | | | | | | | | | | | | | | | | | | | Fix typo in the Accumulators section Change 'val' to 'var' | ||||
| | * | | Fix typo in the Accumulators section | Jyun-Fan Tsai | 2013-12-29 | 1 | -1/+1 |
| |/ / | | | | | | | val => var | ||||
| * | | Merge pull request #304 from kayousterhout/remove_unused | Patrick Wendell | 2013-12-28 | 1 | -6/+0 |
| |\ \ | | | | | | | | | | | | | Removed unused failed and causeOfFailure variables (in TaskSetManager) | ||||
| | * | | Removed unused failed and causeOfFailure variables | Kay Ousterhout | 2013-12-27 | 1 | -6/+0 |
| | | | | |||||
| * | | | Merge pull request #307 from kayousterhout/other_failure | Matei Zaharia | 2013-12-27 | 2 | -6/+0 |
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Removed unused OtherFailure TaskEndReason. The OtherFailure TaskEndReason was added by @mateiz 3 years ago in this commit: https://github.com/apache/incubator-spark/commit/24a1e7f8380bfd8d4fbdda688482a451bd6ea215 Unless I am missing something, it doesn't seem to have been used then, and is not used now, so seems safe for deletion. | ||||
| | * | | | Removed unused OtherFailure TaskEndReason. | Kay Ousterhout | 2013-12-27 | 2 | -6/+0 |
| | | |/ | | |/| | |||||
| * | | | Merge pull request #306 from kayousterhout/remove_pending | Matei Zaharia | 2013-12-27 | 4 | -16/+0 |
| |\ \ \ | | |/ / | |/| | | | | | | Remove unused hasPendingTasks methods | ||||
| | * | | Remove unused hasPendingTasks methods | Kay Ousterhout | 2013-12-27 | 4 | -16/+0 |
| |/ / | |||||
| * | | Merge pull request #305 from kayousterhout/line_spacing | Patrick Wendell | 2013-12-27 | 1 | -15/+27 |
| |\ \ | | |/ | |/| | | | | | | | | | | Fixed >100char lines in DAGScheduler.scala There's no changed functionality here -- only line spacing and one grammatical fix in a comment. | ||||
| | * | Style fixes as per Reynold's review | Kay Ousterhout | 2013-12-27 | 1 | -6/+6 |
| | | | |||||
| | * | Fixed >100char lines in DAGScheduler.scala | Kay Ousterhout | 2013-12-27 | 1 | -15/+27 |
| |/ | |||||
| * | Merge pull request #298 from aarondav/minor | Reynold Xin | 2013-12-26 | 1 | -3/+3 |
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Minor: Decrease margin of left side of Log page Before ![before](https://f.cloud.github.com/assets/1400247/1812647/1a4be53e-6e87-11e3-9d5b-f851274be0e9.png) After ![after](https://f.cloud.github.com/assets/1400247/1812648/1ca1ea2c-6e87-11e3-946c-31be9258f450.png) It's a start anyway... | ||||
| | * | Decrease margin of left side of log page | Aaron Davidson | 2013-12-26 | 1 | -3/+3 |
| | | | |||||
| * | | Merge pull request #302 from pwendell/SPARK-1007 | Reynold Xin | 2013-12-26 | 1 | -1/+1 |
| |\ \ | | | | | | | | | | | | | | | | | | | | | SPARK-1007: spark-class2.cmd should change SCALA_VERSION to be 2.10 Reported by Qiuzhuang Lian | ||||
| | * | | SPARK-1007: spark-class2.cmd should change SCALA_VERSION to be 2.10 | Patrick Wendell | 2013-12-26 | 1 | -1/+1 |
| |/ / | |||||
| * | | Merge pull request #295 from markhamstra/JobProgressListenerNPE | Matei Zaharia | 2013-12-26 | 1 | -6/+3 |
| |\ \ | | |/ | |/| | | | | Avoid a lump of coal (NPE) in JobProgressListener's stocking. | ||||
| | * | Avoid a lump of coal (NPE) in JobProgressListener's stocking. | Mark Hamstra | 2013-12-25 | 1 | -6/+3 |
| | | | |||||
* | | | Removed extra empty lines. | Tathagata Das | 2013-12-31 | 3 | -3/+0 |
| | | | |||||
* | | | Removed unnecessary comments. | Tathagata Das | 2013-12-31 | 3 | -55/+8 |
| | | | |||||
* | | | Added pom.xml for external projects and removed unnecessary dependencies and ↵ | Tathagata Das | 2013-12-31 | 9 | -106/+548 |
| | | | | | | | | | | | | repositoris from other poms and sbt. | ||||
* | | | Refactored kafka, flume, zeromq, mqtt as separate external projects, with ↵ | Tathagata Das | 2013-12-30 | 50 | -599/+1612 |
| | | | | | | | | | | | | their own self-contained scala API, java API, scala unit tests and java unit tests. Updated examples to use the external projects. | ||||
* | | | Refactored streaming project to separate out the twitter functionality. | Tathagata Das | 2013-12-26 | 9 | -14/+64 |
|/ / | |||||
* | | Merge pull request #296 from witgo/master | Matei Zaharia | 2013-12-26 | 8 | -17/+22 |
|\ \ | | | | | | | | | | Renamed ClusterScheduler to TaskSchedulerImpl for yarn and new-yarn package | ||||
| * | | fix this import order | liguoqiang | 2013-12-26 | 2 | -2/+2 |
| | | | |||||
| * | | Renamed ClusterScheduler to TaskSchedulerImpl for yarn and new-yarn | liguoqiang | 2013-12-26 | 2 | -4/+2 |
| | | | |||||
| * | | Renamed ClusterScheduler to TaskSchedulerImpl for yarn and new-yarn | liguoqiang | 2013-12-26 | 8 | -15/+22 |
| |/ | |||||
* | | Merge pull request #283 from tmyklebu/master | Matei Zaharia | 2013-12-26 | 9 | -1/+830 |
|\ \ | |/ |/| | | | | | | | | | | | | | | | | | | | Python bindings for mllib This pull request contains Python bindings for the regression, clustering, classification, and recommendation tools in mllib. For each 'train' frontend exposed, there is a Scala stub in PythonMLLibAPI.scala and a Python stub in mllib.py. The Python stub serialises the input RDD and any vector/matrix arguments into a mutually-understood format and calls the Scala stub. The Scala stub deserialises the RDD and the vector/matrix arguments, calls the appropriate 'train' function, serialises the resulting model, and returns the serialised model. ALSModel is slightly different since a MatrixFactorizationModel has RDDs inside. The Scala stub returns a handle to a Scala MatrixFactorizationModel; prediction is done by calling the Scala predict method. I have tested these bindings on an x86_64 machine running Linux. There is a risk that these bindings may fail on some choose-your-own-endian platform if Python's endian differs from java.nio.ByteBuffer's idea of the native byte order. | ||||
| * | Remove commented code in __init__.py. | Tor Myklebust | 2013-12-25 | 1 | -8/+0 |
| | | |||||
| * | Fix copypasta in __init__.py. Don't import anything directly into ↵ | Tor Myklebust | 2013-12-25 | 1 | -26/+8 |
| | | | | | | | | pyspark.mllib. | ||||
| * | Initial weights in Scala are ones; do that too. Also fix some errors. | Tor Myklebust | 2013-12-25 | 1 | -6/+6 |
| | | |||||
| * | Scala stubs for updated Python bindings. | Tor Myklebust | 2013-12-25 | 1 | -13/+13 |
| | | |||||
| * | Split the mllib bindings into a whole bunch of modules and rename some things. | Tor Myklebust | 2013-12-25 | 7 | -183/+409 |
| | | |||||
| * | Remove useless line from test stub. | Tor Myklebust | 2013-12-24 | 1 | -1/+0 |
| | | |||||
| * | Python change for move of PythonMLLibAPI. | Tor Myklebust | 2013-12-24 | 1 | -1/+1 |
| | | |||||
| * | Move PythonMLLibAPI into its own package. | Tor Myklebust | 2013-12-24 | 1 | -0/+1 |
| | | |||||
| * | Fix error message ugliness. | Tor Myklebust | 2013-12-24 | 1 | -2/+2 |
| | | |||||
| * | Release JVM reference to the ALSModel when done. | Tor Myklebust | 2013-12-22 | 1 | -2/+2 |
| | | |||||
| * | Java stubs for ALSModel. | Tor Myklebust | 2013-12-21 | 1 | -0/+34 |
| | | |||||
| * | Python stubs for ALSModel. | Tor Myklebust | 2013-12-21 | 2 | -8/+56 |
| | | |||||
| * | Javadocs; also, declare some things private. | Tor Myklebust | 2013-12-20 | 1 | -5/+26 |
| | | |||||
| * | Un-semicolon mllib.py. | Tor Myklebust | 2013-12-20 | 1 | -11/+11 |
| | | |||||
| * | Change some docstrings and add some others. | Tor Myklebust | 2013-12-20 | 1 | -1/+3 |
| | | |||||
| * | Licence notice. | Tor Myklebust | 2013-12-20 | 2 | -0/+34 |
| | | |||||
| * | Whitespace. | Tor Myklebust | 2013-12-20 | 1 | -1/+1 |
| | |