From 5ffe752b59e468d55363f1f24b17a3677927ca8f Mon Sep 17 00:00:00 2001 From: Reynold Xin Date: Mon, 7 Sep 2015 10:42:30 -1000 Subject: [SPARK-9767] Remove ConnectionManager. We introduced the Netty network module for shuffle in Spark 1.2, and has turned it on by default for 3 releases. The old ConnectionManager is difficult to maintain. If we merge the patch now, by the time it is released, it would be 1 yr for which ConnectionManager is off by default. It's time to remove it. Author: Reynold Xin Closes #8161 from rxin/SPARK-9767. --- docs/configuration.md | 11 ----------- 1 file changed, 11 deletions(-) (limited to 'docs/configuration.md') diff --git a/docs/configuration.md b/docs/configuration.md index 29a36bd67f..a2cc7a37e2 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -382,17 +382,6 @@ Apart from these, the following properties are also available, and may be useful overhead per reduce task, so keep it small unless you have a large amount of memory. - - spark.shuffle.blockTransferService - netty - - Implementation to use for transferring shuffle and cached blocks between executors. There - are two implementations available: netty and nio. Netty-based - block transfer is intended to be simpler but equally efficient and is the default option - starting in 1.2, and nio block transfer is deprecated in Spark 1.5.0 and will - be removed in Spark 1.6.0. - - spark.shuffle.compress true -- cgit v1.2.3