aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* moved user scripts to bin foldershane-huang2013-09-2311-0/+0
| | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com>
* add admin scripts to sbinshane-huang2013-09-2314-47/+47
| | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com>
* added spark-class and spark-executor to sbinshane-huang2013-09-2314-22/+16
| | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com>
* Merge pull request #928 from jerryshao/fairscheduler-refactorReynold Xin2013-09-221-43/+56
|\ | | | | Refactor FairSchedulableBuilder
| * Change Exception to NoSuchElementException and minor style fixjerryshao2013-09-221-6/+7
| |
| * Remove infix style and othersjerryshao2013-09-221-10/+8
| |
| * Refactor FairSchedulableBuilder:jerryshao2013-09-221-39/+53
|/ | | | | 1. Configuration can be read from classpath if not set explicitly. 2. Add missing close handler.
* Merge pull request #937 from jerryshao/localProperties-fixReynold Xin2013-09-212-2/+50
|\ | | | | Fix PR926 local properties issues in Spark Streaming like scenarios
| * Add barrier for local properties unit test and fix some stylesjerryshao2013-09-222-3/+11
| |
| * Fix issue when local properties pass from parent to child threadjerryshao2013-09-182-2/+42
| |
* | Merge pull request #941 from ilikerps/masterReynold Xin2013-09-211-6/+6
|\ \ | | | | | | Add "org.apache." prefix to packages in spark-class
| * | Add "org.apache." prefix to packages in spark-classAaron Davidson2013-09-201-6/+6
| | | | | | | | | | | | Lacking this, the if/case statements never trigger on Spark 0.8.0+.
* | | Merge pull request #940 from ankurdave/clear-port-properties-after-testsReynold Xin2013-09-212-9/+7
|\ \ \ | |/ / |/| | After unit tests, clear port properties unconditionally
| * | After unit tests, clear port properties unconditionallyAnkur Dave2013-09-192-9/+7
|/ / | | | | | | | | | | | | | | | | | | | | | | In MapOutputTrackerSuite, the "remote fetch" test sets spark.driver.port and spark.hostPort, assuming that they will be cleared by LocalSparkContext. However, the test never sets sc, so it remains null, causing LocalSparkContext to skip clearing these properties. Subsequent tests therefore fail with java.net.BindException: "Address already in use". This commit makes LocalSparkContext clear the properties even if sc is null.
* | Merge pull request #938 from ilikerps/masterPatrick Wendell2013-09-191-4/+4
|\ \ | |/ |/| Fix issue with spark_ec2 seeing empty security groups
| * Fix issue with spark_ec2 seeing empty security groupsAaron Davidson2013-09-191-4/+4
|/ | | | | | | | | | Under unknown, but occasional, circumstances, reservation.groups is empty despite reservation.instances each having groups. This means that the spark_ec2 get_existing_clusters() method would fail to find any instances. To fix it, we simply use the instances' groups as the source of truth. Note that this is actually just a revival of PR #827, now that the issue has been reproduced.
* Merge pull request #933 from jey/yarn-typo-fixPatrick Wendell2013-09-151-2/+2
|\ | | | | Fix typo in Maven build docs
| * Fix typo in Maven build docsJey Kottalam2013-09-151-2/+2
|/
* Merge pull request #932 from pwendell/mesos-versionPatrick Wendell2013-09-153-3/+3
|\ | | | | Bumping Mesos version to 0.13.0
| * Bumping Mesos version to 0.13.0Patrick Wendell2013-09-153-3/+3
| |
* | Merge pull request #931 from pwendell/yarn-docsPatrick Wendell2013-09-151-3/+3
|\ \ | | | | | | Explain yarn.version in Maven build docs
| * | Explain yarn.version in Maven build docsPatrick Wendell2013-09-151-3/+3
| |/
* | Merge pull request #929 from pwendell/masterPatrick Wendell2013-09-132-5/+11
|\| | | | | Use different Hadoop version for YARN artifacts.
| * Use different Hadoop version for YARN artifacts.Patrick Wendell2013-09-132-5/+11
|/ | | | | This uses a seperate Hadoop version for YARN artifact. This means when people link against spark-yarn, things will resolve correctly.
* Add git scm url for publishingPatrick Wendell2013-09-121-0/+1
|
* Merge pull request #926 from kayousterhout/dynamicPatrick Wendell2013-09-111-9/+9
|\ | | | | Changed localProperties to use ThreadLocal (not DynamicVariable).
| * Changed localProperties to use ThreadLocal (not DynamicVariable).Kay Ousterhout2013-09-111-9/+9
| | | | | | | | | | | | The fact that DynamicVariable uses an InheritableThreadLocal can cause problems where the properties end up being shared across threads in certain circumstances.
* | Merge pull request #927 from benh/mesos-docsMatei Zaharia2013-09-111-17/+16
|\ \ | |/ |/| Updated Spark on Mesos documentation.
| * More updates to Spark on Mesos documentation.Benjamin Hindman2013-09-111-2/+2
| |
| * Updated Spark on Mesos documentation.Benjamin Hindman2013-09-111-17/+16
|/
* Merge pull request #919 from mateiz/jets3tPatrick Wendell2013-09-113-0/+11
|\ | | | | Add explicit jets3t dependency, which is excluded in hadoop-client
| * Add explicit jets3t dependency, which is excluded in hadoop-clientMatei Zaharia2013-09-103-0/+11
| |
* | Merge pull request #922 from pwendell/port-changePatrick Wendell2013-09-117-12/+11
|\ \ | | | | | | Change default port number from 3030 to 4030.
| * | Change port from 3030 to 4040Patrick Wendell2013-09-117-12/+11
| | |
* | | Merge pull request #925 from davidmccauley/masterReynold Xin2013-09-111-1/+3
|\ \ \ | | | | | | | | SPARK-894 - Not all WebUI fields delivered VIA JSON
| * | | SPARK-894 - Not all WebUI fields delivered VIA JSONDavid McCauley2013-09-111-1/+3
| | |/ | |/|
* | | Merge pull request #923 from haoyuan/masterMatei Zaharia2013-09-101-4/+4
|\ \ \ | | | | | | | | fix run-example script
| * | | better expressionHaoyuan Li2013-09-101-4/+4
| | | |
| * | | fix run-example scriptHaoyuan Li2013-09-101-4/+4
| | |/ | |/|
* | | Merge pull request #921 from pwendell/masterPatrick Wendell2013-09-102-0/+7
|\ \ \ | |/ / |/| | Fix HDFS access bug with assembly build.
| * | Fix HDFS access bug with assembly build.Patrick Wendell2013-09-102-0/+7
|/ / | | | | | | | | | | | | | | | | Due to this change in HDFS: https://issues.apache.org/jira/browse/HADOOP-7549 there is a bug when using the new assembly builds. The symptom is that any HDFS access results in an exception saying "No filesystem for scheme 'hdfs'". This adds a merge strategy in the assembly build which fixes the problem.
* / Update Python API featuresMatei Zaharia2013-09-101-1/+1
|/
* Merge pull request #917 from pwendell/mastershivaram2013-09-091-0/+7
|\ | | | | Document libgfortran dependency for MLBase
| * Document fortran dependency for MLBasePatrick Wendell2013-09-091-0/+7
|/
* Merge pull request #915 from ooyala/masterMatei Zaharia2013-09-091-1/+9
|\ | | | | Get rid of / improve ugly NPE when Utils.deleteRecursively() fails
| * Style fix: put body of if within curly bracesEvan Chan2013-09-091-1/+3
| |
| * Print out more friendly error if listFiles() failsEvan Chan2013-09-091-1/+7
| | | | | | | | listFiles() could return null if the I/O fails, and this currently results in an ugly NPE which is hard to diagnose.
* | Merge pull request #916 from mateiz/mkdist-fixMatei Zaharia2013-09-091-1/+1
|\ \ | | | | | | Fix copy issue in https://github.com/mesos/spark/pull/899
| * | Fix copy issue in https://github.com/mesos/spark/pull/899Matei Zaharia2013-09-091-1/+1
|/ /
* | Merge pull request #907 from stephenh/document_coalesce_shuffleMatei Zaharia2013-09-092-4/+27
|\ \ | | | | | | Add better docs for coalesce.
generated by cgit v1.2.3 (git 2.39.1) at 2024-07-09 23:31:43 +0000