| Commit message (Collapse) | Author | Age | Files | Lines |
|---|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
## What changes were proposed in this pull request?
Since Spark 2.1.0, Travis CI was supported by SPARK-15207 for automated PR verification (JDK7/JDK8 maven compilation and Java Linter) and contributors can see the additional result via their Travis CI dashboard (or PC).
This PR aims to make `.travis.yml` up-to-date by removing JDK7 which was removed via SPARK-19550.
## How was this patch tested?
See the result via Travis CI.
- https://travis-ci.org/dongjoon-hyun/spark/builds/207111713
Author: Dongjoon Hyun <dongjoon@apache.org>
Closes #17143 from dongjoon-hyun/SPARK-19801.
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
earlier
## What changes were proposed in this pull request?
- Remove support for Hadoop 2.5 and earlier
- Remove reflection and code constructs only needed to support multiple versions at once
- Update docs to reflect newer versions
- Remove older versions' builds and profiles.
## How was this patch tested?
Existing tests
Author: Sean Owen <sowen@cloudera.com>
Closes #16810 from srowen/SPARK-19464.
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
## What changes were proposed in this pull request?
Move Mesos code into a mvn module
## How was this patch tested?
unit tests
manually submitting a client mode and cluster mode job
spark/mesos integration test suite
Author: Michael Gummelt <mgummelt@mesosphere.io>
Closes #14637 from mgummelt/mesos-module.
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
## What changes were proposed in this pull request?
Currently, Java Linter is disabled in Jenkins tests.
https://github.com/apache/spark/blob/master/dev/run-tests.py#L554
However, as of today, Spark has 721 java files with 97362 code (without blank/comments). It's about 1/3 of Scala.
```
--------------------------------------------------------------------------------
Language files blank comment code
--------------------------------------------------------------------------------
Scala 2353 62819 124060 318747
Java 721 18617 23314 97362
```
This PR aims to take advantage of Travis CI to handle the following static analysis by adding a single file, `.travis.yml` without any additional burden on the existing servers.
- Java Linter
- JDK7/JDK8 maven compile
Note that this PR does not propose to remove some of the above work items from the Jenkins. It's possible, but we need to observe the Travis CI stability for a while. The main goal of this issue is to remove committer's overhead on linter-related PRs (the original PR and the fixation PR).
## How was this patch tested?
Pass the Travis CI tests. Please see the following link.
https://travis-ci.org/dongjoon-hyun/spark/builds/128595350
https://travis-ci.org/dongjoon-hyun/spark/builds/128708372
Author: Dongjoon Hyun <dongjoon@apache.org>
Closes #12980 from dongjoon-hyun/SPARK-15207.
|
| | |
|
| |
|
|
|
|
|
|
|
|
| |
This PR amortizes the cost of downloading all the jars and compiling core across more test cases. In one anecdotal run this change takes the cumulative time down from ~80 minutes to ~40 minutes.
Author: Michael Armbrust <michael@databricks.com>
Closes #255 from marmbrus/travis and squashes the following commits:
506b22d [Michael Armbrust] Cut down the granularity of travis tests so we can amortize the cost of compilation.
|
|
|
This is not intended to replace Jenkins immediately, and Jenkins will remain the CI of reference for merging pull requests in the near term. Long term, it is possible that Travis will give us better integration with github, so we are investigating its use.
Author: Michael Armbrust <michael@databricks.com>
Closes #230 from marmbrus/travis and squashes the following commits:
93f9a32 [Michael Armbrust] Add Apache license to .travis.yml
d7c0e78 [Michael Armbrust] Initial experimentation with Travis CI configuration
|
