diff options
| author | hyukjinkwon <gurwls223@gmail.com> | 2016-09-08 08:26:59 -0700 |
|---|---|---|
| committer | Shivaram Venkataraman <shivaram@cs.berkeley.edu> | 2016-09-08 08:26:59 -0700 |
| commit | 78d5d4dd5ce5a537ed04cd1bf242c9e9ea2c391a (patch) | |
| tree | 0713f74a384a96cbb42a74f74ce1c1e05b2338af /appveyor.yml | |
| parent | f0d21b7f90cdcce353ab6fc279b9cc376e46e536 (diff) | |
| download | spark-78d5d4dd5ce5a537ed04cd1bf242c9e9ea2c391a.tar.gz spark-78d5d4dd5ce5a537ed04cd1bf242c9e9ea2c391a.tar.bz2 spark-78d5d4dd5ce5a537ed04cd1bf242c9e9ea2c391a.zip | |
[SPARK-17200][PROJECT INFRA][BUILD][SPARKR] Automate building and testing on Windows (currently SparkR only)
## What changes were proposed in this pull request?
This PR adds the build automation on Windows with [AppVeyor](https://www.appveyor.com/) CI tool.
Currently, this only runs the tests for SparkR as we have been having some issues with testing Windows-specific PRs (e.g. https://github.com/apache/spark/pull/14743 and https://github.com/apache/spark/pull/13165) and hard time to verify this.
One concern is, this build is dependent on [steveloughran/winutils](https://github.com/steveloughran/winutils) for pre-built Hadoop bin package (who is a Hadoop PMC member).
## How was this patch tested?
Manually, https://ci.appveyor.com/project/HyukjinKwon/spark/build/88-SPARK-17200-build-profile
This takes roughly 40 mins.
Some tests are already being failed and this was found in https://github.com/apache/spark/pull/14743#issuecomment-241405287.
Author: hyukjinkwon <gurwls223@gmail.com>
Closes #14859 from HyukjinKwon/SPARK-17200-build.
Diffstat (limited to 'appveyor.yml')
| -rw-r--r-- | appveyor.yml | 56 |
1 files changed, 56 insertions, 0 deletions
diff --git a/appveyor.yml b/appveyor.yml new file mode 100644 index 0000000000..5e756835bc --- /dev/null +++ b/appveyor.yml @@ -0,0 +1,56 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOTICE file distributed with +# this work for additional information regarding copyright ownership. +# The ASF licenses this file to You under the Apache License, Version 2.0 +# (the "License"); you may not use this file except in compliance with +# the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +version: "{build}-{branch}" + +shallow_clone: true + +platform: x64 +configuration: Debug + +branches: + only: + - master + +only_commits: + files: + - R/ + +cache: + - C:\Users\appveyor\.m2 + +install: + # Install maven and dependencies + - ps: .\dev\appveyor-install-dependencies.ps1 + # Required package for R unit tests + - cmd: R -e "install.packages('testthat', repos='http://cran.us.r-project.org')" + - cmd: R -e "packageVersion('testthat')" + - cmd: R -e "install.packages('e1071', repos='http://cran.us.r-project.org')" + - cmd: R -e "packageVersion('e1071')" + - cmd: R -e "install.packages('survival', repos='http://cran.us.r-project.org')" + - cmd: R -e "packageVersion('survival')" + +build_script: + - cmd: mvn -DskipTests -Phadoop-2.6 -Psparkr -Phive -Phive-thriftserver package + +test_script: + - cmd: .\bin\spark-submit2.cmd --conf spark.hadoop.fs.default.name="file:///" R\pkg\tests\run-all.R + +notifications: + - provider: Email + on_build_success: false + on_build_failure: false + on_build_status_changed: false + |