Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Mark hadoop dependencies provided in all library artifacts | Thomas Dudziak | 2012-12-10 | 1 | -0/+3 |
| | |||||
* | Use the same output directories that SBT had in subprojects | Matei Zaharia | 2012-12-10 | 1 | -1/+3 |
| | | | | This will make it easier to make the "run" script work with a Maven build | ||||
* | Updated versions in the pom.xml files to match current master | Thomas Dudziak | 2012-11-27 | 1 | -1/+1 |
| | |||||
* | Addressed code review comments | Thomas Dudziak | 2012-11-27 | 1 | -0/+1 |
| | |||||
* | Added maven and debian build files | Thomas Dudziak | 2012-11-20 | 1 | -0/+100 |
| | |||||
* | Fix K-means example a little | root | 2012-11-10 | 1 | -16/+11 |
| | |||||
* | Some doc and usability improvements: | Matei Zaharia | 2012-10-12 | 2 | -2/+2 |
| | | | | | | | - Added a StorageLevels class for easy access to StorageLevel constants in Java - Added doc comments on Function classes in Java - Updated Accumulator and HadoopWriter docs slightly | ||||
* | Conflict fixed | Mosharaf Chowdhury | 2012-10-02 | 10 | -10/+10 |
|\ | |||||
| * | More updates to documentation | Matei Zaharia | 2012-09-25 | 10 | -10/+10 |
| | | |||||
* | | Bug fix. Fixed log messages. Updated BroadcastTest example to have iterations. | Mosharaf Chowdhury | 2012-08-30 | 1 | -3/+7 |
|/ | |||||
* | Cache points in SparkLR example. | Josh Rosen | 2012-08-26 | 1 | -2/+2 |
| | |||||
* | Renamed apply() to call() in Java API and allowed it to throw Exceptions | Matei Zaharia | 2012-08-12 | 4 | -21/+25 |
| | |||||
* | move Vector class into core and spark.util package | Imran Rashid | 2012-07-28 | 7 | -88/+6 |
| | |||||
* | Remove StringOps.split() from Java WordCount. | Josh Rosen | 2012-07-25 | 1 | -5/+2 |
| | |||||
* | Minor cleanup and optimizations in Java API. | Josh Rosen | 2012-07-24 | 2 | -10/+13 |
| | | | | | | - Add override keywords. - Cache RDDs and counts in TC example. - Clean up JavaRDDLike's abstract methods. | ||||
* | Improve Java API examples | Josh Rosen | 2012-07-22 | 5 | -198/+143 |
| | | | | | | - Replace JavaLR example with JavaHdfsLR example. - Use anonymous classes in JavaWordCount; add options. - Remove @Override annotations. | ||||
* | Add Java API | Josh Rosen | 2012-07-18 | 5 | -0/+355 |
| | | | | | | Add distinct() method to RDD. Fix bug in DoubleRDDFunctions. | ||||
* | Add System.exit(0) at the end of all the example programs. | Matei Zaharia | 2012-06-05 | 12 | -0/+19 |
| | |||||
* | Format the code as coding style agreed by Matei/TD/Haoyuan | haoyuan | 2012-02-09 | 1 | -1/+1 |
| | |||||
* | Some fixes to the examples (mostly to use functional API) | Matei Zaharia | 2012-01-31 | 4 | -76/+72 |
| | |||||
* | Merge pull request #103 from edisontung/master | Matei Zaharia | 2012-01-13 | 2 | -56/+142 |
|\ | | | | | Made improvements to takeSample. Also changed SparkLocalKMeans to SparkKMeans | ||||
| * | Revert de01b6deaaee1b43321e0aac330f4a98c0ea61c6^..HEAD | Edison Tung | 2011-12-01 | 1 | -73/+0 |
| | | |||||
| * | Renamed SparkLocalKMeans to SparkKMeans | Edison Tung | 2011-12-01 | 1 | -56/+62 |
| | | |||||
| * | Added KMeans examples | Edison Tung | 2011-11-21 | 2 | -0/+153 |
| | | | | | | | | | | LocalKMeans runs locally with a randomly generated dataset. SparkLocalKMeans takes an input file and runs KMeans on it. | ||||
* | | Merge commit 'ad4ebff42c1b738746b2b9ecfbb041b6d06e3e16' | Matei Zaharia | 2011-12-14 | 1 | -0/+18 |
|\ \ | |||||
| * | | Report errors in tasks to the driver via a Mesos status update | Ankur Dave | 2011-11-14 | 1 | -0/+18 |
| |/ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When a task throws an exception, the Spark executor previously just logged it to a local file on the slave and exited. This commit causes Spark to also report the exception back to the driver using a Mesos status update, so the user doesn't have to look through a log file on the slave. Here's what the reporting currently looks like: # ./run spark.examples.ExceptionHandlingTest master@203.0.113.1:5050 [...] 11/10/26 21:04:13 INFO spark.SimpleJob: Lost TID 1 (task 0:1) 11/10/26 21:04:13 INFO spark.SimpleJob: Loss was due to java.lang.Exception: Testing exception handling [...] 11/10/26 21:04:16 INFO spark.SparkContext: Job finished in 5.988547328 s | ||||
* / | Fixed LocalFileLR to deal with a change in Scala IO sources | Matei Zaharia | 2011-12-01 | 1 | -1/+1 |
|/ | | | | (you can no longer iterate over a Source multiple times). | ||||
* | K-means example | Matei Zaharia | 2011-11-01 | 2 | -3/+86 |
| | |||||
* | Fix issue #65: Change @serializable to extends Serializable in 2.9 branch | Ismael Juma | 2011-08-02 | 1 | -1/+1 |
| | | | | | | Note that we use scala.Serializable introduced in Scala 2.9 instead of java.io.Serializable. Also, case classes inherit from scala.Serializable by default. | ||||
* | Merge branch 'mos-bt' | Matei Zaharia | 2011-06-26 | 5 | -7/+161 |
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This merge keeps only the broadcast work in mos-bt because the structure of shuffle has changed with the new RDD design. We still need some kind of parallel shuffle but that will be added later. Conflicts: core/src/main/scala/spark/BitTorrentBroadcast.scala core/src/main/scala/spark/ChainedBroadcast.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/SparkContext.scala core/src/main/scala/spark/Utils.scala core/src/main/scala/spark/shuffle/BasicLocalFileShuffle.scala core/src/main/scala/spark/shuffle/DfsShuffle.scala | ||||
| * | Merge branch 'mos-shuffle-tracked' into mos-bt | Mosharaf Chowdhury | 2011-04-27 | 3 | -0/+129 |
| |\ | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/Broadcast.scala | ||||
| | * | Merge branch 'master' into mos-shuffle-tracked | Mosharaf Chowdhury | 2011-04-27 | 3 | -0/+129 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: .gitignore core/src/main/scala/spark/LocalFileShuffle.scala src/scala/spark/BasicLocalFileShuffle.scala src/scala/spark/Broadcast.scala src/scala/spark/LocalFileShuffle.scala | ||||
| * | | Merged with master. Using sbt. | Mosharaf Chowdhury | 2011-02-09 | 1 | -0/+30 |
| | | | |||||
| * | | Merge branch 'master' into mos-bt | Mosharaf Chowdhury | 2011-02-09 | 1 | -7/+2 |
| |/ | |||||
* | | Replace deprecated fromFunction with either tabulate or fill. | Ismael Juma | 2011-05-26 | 4 | -6/+6 |
| | | | | | | | | tabulate used if indexed used by function and fill otherwise. | ||||
* | | Use math instead of Math as the latter is deprecated. | Ismael Juma | 2011-05-26 | 2 | -2/+2 |
| | | |||||
* | | Initial work towards new RDD design | Matei Zaharia | 2011-02-26 | 2 | -47/+0 |
|/ | |||||
* | Moved examples to spark.examples package | Matei Zaharia | 2011-02-02 | 13 | -0/+26 |
| | |||||
* | Made examples and core subprojects | Matei Zaharia | 2011-02-01 | 13 | -0/+621 |