aboutsummaryrefslogtreecommitdiff
path: root/examples
Commit message (Collapse)AuthorAgeFilesLines
* Cache points in SparkLR example.Josh Rosen2012-08-261-2/+2
|
* Renamed apply() to call() in Java API and allowed it to throw ExceptionsMatei Zaharia2012-08-124-21/+25
|
* move Vector class into core and spark.util packageImran Rashid2012-07-287-88/+6
|
* Remove StringOps.split() from Java WordCount.Josh Rosen2012-07-251-5/+2
|
* Minor cleanup and optimizations in Java API.Josh Rosen2012-07-242-10/+13
| | | | | | - Add override keywords. - Cache RDDs and counts in TC example. - Clean up JavaRDDLike's abstract methods.
* Improve Java API examplesJosh Rosen2012-07-225-198/+143
| | | | | | - Replace JavaLR example with JavaHdfsLR example. - Use anonymous classes in JavaWordCount; add options. - Remove @Override annotations.
* Add Java APIJosh Rosen2012-07-185-0/+355
| | | | | | Add distinct() method to RDD. Fix bug in DoubleRDDFunctions.
* Add System.exit(0) at the end of all the example programs.Matei Zaharia2012-06-0512-0/+19
|
* Format the code as coding style agreed by Matei/TD/Haoyuanhaoyuan2012-02-091-1/+1
|
* Some fixes to the examples (mostly to use functional API)Matei Zaharia2012-01-314-76/+72
|
* Merge pull request #103 from edisontung/masterMatei Zaharia2012-01-132-56/+142
|\ | | | | Made improvements to takeSample. Also changed SparkLocalKMeans to SparkKMeans
| * Revert de01b6deaaee1b43321e0aac330f4a98c0ea61c6^..HEADEdison Tung2011-12-011-73/+0
| |
| * Renamed SparkLocalKMeans to SparkKMeansEdison Tung2011-12-011-56/+62
| |
| * Added KMeans examplesEdison Tung2011-11-212-0/+153
| | | | | | | | | | LocalKMeans runs locally with a randomly generated dataset. SparkLocalKMeans takes an input file and runs KMeans on it.
* | Merge commit 'ad4ebff42c1b738746b2b9ecfbb041b6d06e3e16'Matei Zaharia2011-12-141-0/+18
|\ \
| * | Report errors in tasks to the driver via a Mesos status updateAnkur Dave2011-11-141-0/+18
| |/ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When a task throws an exception, the Spark executor previously just logged it to a local file on the slave and exited. This commit causes Spark to also report the exception back to the driver using a Mesos status update, so the user doesn't have to look through a log file on the slave. Here's what the reporting currently looks like: # ./run spark.examples.ExceptionHandlingTest master@203.0.113.1:5050 [...] 11/10/26 21:04:13 INFO spark.SimpleJob: Lost TID 1 (task 0:1) 11/10/26 21:04:13 INFO spark.SimpleJob: Loss was due to java.lang.Exception: Testing exception handling [...] 11/10/26 21:04:16 INFO spark.SparkContext: Job finished in 5.988547328 s
* / Fixed LocalFileLR to deal with a change in Scala IO sourcesMatei Zaharia2011-12-011-1/+1
|/ | | | (you can no longer iterate over a Source multiple times).
* K-means exampleMatei Zaharia2011-11-012-3/+86
|
* Fix issue #65: Change @serializable to extends Serializable in 2.9 branchIsmael Juma2011-08-021-1/+1
| | | | | | Note that we use scala.Serializable introduced in Scala 2.9 instead of java.io.Serializable. Also, case classes inherit from scala.Serializable by default.
* Merge branch 'mos-bt'Matei Zaharia2011-06-265-7/+161
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | This merge keeps only the broadcast work in mos-bt because the structure of shuffle has changed with the new RDD design. We still need some kind of parallel shuffle but that will be added later. Conflicts: core/src/main/scala/spark/BitTorrentBroadcast.scala core/src/main/scala/spark/ChainedBroadcast.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/Utils.scala core/src/main/scala/spark/shuffle/BasicLocalFileShuffle.scala core/src/main/scala/spark/shuffle/DfsShuffle.scala
| * Merge branch 'mos-shuffle-tracked' into mos-btMosharaf Chowdhury2011-04-273-0/+129
| |\ | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/Broadcast.scala
| | * Merge branch 'master' into mos-shuffle-trackedMosharaf Chowdhury2011-04-273-0/+129
| | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: .gitignore core/src/main/scala/spark/LocalFileShuffle.scala src/scala/spark/BasicLocalFileShuffle.scala src/scala/spark/Broadcast.scala src/scala/spark/LocalFileShuffle.scala
| * | Merged with master. Using sbt.Mosharaf Chowdhury2011-02-091-0/+30
| | |
| * | Merge branch 'master' into mos-btMosharaf Chowdhury2011-02-091-7/+2
| |/
* | Replace deprecated fromFunction with either tabulate or fill.Ismael Juma2011-05-264-6/+6
| | | | | | | | tabulate used if indexed used by function and fill otherwise.
* | Use math instead of Math as the latter is deprecated.Ismael Juma2011-05-262-2/+2
| |
* | Initial work towards new RDD designMatei Zaharia2011-02-262-47/+0
|/
* Moved examples to spark.examples packageMatei Zaharia2011-02-0213-0/+26
|
* Made examples and core subprojectsMatei Zaharia2011-02-0113-0/+621
generated by cgit v1.2.3 (git 2.39.1) at 2024-08-14 04:26:43 +0000