From 266b92faffb66af24d8ed2725beb80770a2d91f8 Mon Sep 17 00:00:00 2001 From: Michael Gummelt Date: Fri, 29 Jul 2016 05:50:47 -0700 Subject: [SPARK-16637] Unified containerizer ## What changes were proposed in this pull request? New config var: spark.mesos.docker.containerizer={"mesos","docker" (default)} This adds support for running docker containers via the Mesos unified containerizer: http://mesos.apache.org/documentation/latest/container-image/ The benefit is losing the dependency on `dockerd`, and all the costs which it incurs. I've also updated the supported Mesos version to 0.28.2 for support of the required protobufs. This is blocked on: https://github.com/apache/spark/pull/14167 ## How was this patch tested? - manually testing jobs submitted with both "mesos" and "docker" settings for the new config var. - spark/mesos integration test suite Author: Michael Gummelt Closes #14275 from mgummelt/unified-containerizer. --- dev/deps/spark-deps-hadoop-2.3 | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) (limited to 'dev/deps/spark-deps-hadoop-2.3') diff --git a/dev/deps/spark-deps-hadoop-2.3 b/dev/deps/spark-deps-hadoop-2.3 index 2e1a6a3dc6..ef97ffd9ab 100644 --- a/dev/deps/spark-deps-hadoop-2.3 +++ b/dev/deps/spark-deps-hadoop-2.3 @@ -122,7 +122,7 @@ libthrift-0.9.2.jar log4j-1.2.17.jar lz4-1.3.0.jar mail-1.4.7.jar -mesos-0.22.2-shaded-protobuf.jar +mesos-1.0.0-shaded-protobuf.jar metrics-core-3.1.2.jar metrics-graphite-3.1.2.jar metrics-json-3.1.2.jar -- cgit v1.2.3