diff options
| author | Josh Rosen <joshrosen@databricks.com> | 2015-09-17 11:40:24 -0700 |
|---|---|---|
| committer | Josh Rosen <joshrosen@databricks.com> | 2015-09-17 11:40:24 -0700 |
| commit | f1c911552cf5d0d60831c79c1881016293aec66c (patch) | |
| tree | 985304ab27c5d3e7f4eb3f903d48e1a47c2c6982 /dev | |
| parent | 64743870f23bffb8d96dcc8a0181c1452782a151 (diff) | |
| download | spark-f1c911552cf5d0d60831c79c1881016293aec66c.tar.gz spark-f1c911552cf5d0d60831c79c1881016293aec66c.tar.bz2 spark-f1c911552cf5d0d60831c79c1881016293aec66c.zip | |
[SPARK-10657] Remove SCP-based Jenkins log archiving
As of https://issues.apache.org/jira/browse/SPARK-7561, we no longer need to use our custom SCP-based mechanism for archiving Jenkins logs on the master machine; this has been superseded by the use of a Jenkins plugin which archives the logs and provides public links to view them.
Per shaneknapp, we should remove this log syncing mechanism if it is no longer necessary; removing the need to SCP from the Jenkins workers to the masters is a desired step as part of some larger Jenkins infra refactoring.
Author: Josh Rosen <joshrosen@databricks.com>
Closes #8793 from JoshRosen/remove-jenkins-ssh-to-master.
Diffstat (limited to 'dev')
| -rwxr-xr-x | dev/run-tests-jenkins | 35 |
1 files changed, 0 insertions, 35 deletions
diff --git a/dev/run-tests-jenkins b/dev/run-tests-jenkins index 3be78575e7..d3b05fa6df 100755 --- a/dev/run-tests-jenkins +++ b/dev/run-tests-jenkins @@ -116,39 +116,6 @@ function post_message () { fi } -function send_archived_logs () { - echo "Archiving unit tests logs..." - - local log_files=$( - find .\ - -name "unit-tests.log" -o\ - -path "./sql/hive/target/HiveCompatibilitySuite.failed" -o\ - -path "./sql/hive/target/HiveCompatibilitySuite.hiveFailed" -o\ - -path "./sql/hive/target/HiveCompatibilitySuite.wrong" - ) - - if [ -z "$log_files" ]; then - echo "> No log files found." >&2 - else - local log_archive="unit-tests-logs.tar.gz" - echo "$log_files" | xargs tar czf ${log_archive} - - local jenkins_build_dir=${JENKINS_HOME}/jobs/${JOB_NAME}/builds/${BUILD_NUMBER} - local scp_output=$(scp ${log_archive} amp-jenkins-master:${jenkins_build_dir}/${log_archive}) - local scp_status="$?" - - if [ "$scp_status" -ne 0 ]; then - echo "Failed to send archived unit tests logs to Jenkins master." >&2 - echo "> scp_status: ${scp_status}" >&2 - echo "> scp_output: ${scp_output}" >&2 - else - echo "> Send successful." - fi - - rm -f ${log_archive} - fi -} - # post start message { start_message="\ @@ -244,8 +211,6 @@ done test_result_note=" * This patch **fails $failing_test**." fi - - send_archived_logs } # post end message |