aboutsummaryrefslogtreecommitdiff
path: root/network
Commit message (Collapse)AuthorAgeFilesLines
* Preparing Spark release v1.2.1-rc3v1.2.1Patrick Wendell2015-02-033-3/+3
|
* Revert "Preparing Spark release v1.2.1-rc2"Patrick Wendell2015-02-023-3/+3
| | | | This reverts commit b77f87673d1f9f03d4c83cf583158227c551359b.
* Revert "Preparing development version 1.2.2-SNAPSHOT"Patrick Wendell2015-02-023-3/+3
| | | | This reverts commit 0a16abadc59082b7d3a24d7f3625236658632813.
* Preparing development version 1.2.2-SNAPSHOTPatrick Wendell2015-01-283-3/+3
|
* Preparing Spark release v1.2.1-rc2Patrick Wendell2015-01-283-3/+3
|
* Revert "Preparing Spark release v1.2.1-rc1"Patrick Wendell2015-01-273-3/+3
| | | | This reverts commit 3e2d7d310b76c293b9ac787f204e6880f508f6ec.
* Revert "Preparing development version 1.2.2-SNAPSHOT"Patrick Wendell2015-01-273-3/+3
| | | | This reverts commit f53a4319ba5f0843c077e64ae5a41e2fac835a5b.
* Preparing development version 1.2.2-SNAPSHOTPatrick Wendell2015-01-273-3/+3
|
* Preparing Spark release v1.2.1-rc1Patrick Wendell2015-01-273-3/+3
|
* Revert "Preparing Spark release v1.2.1-rc1"Patrick Wendell2015-01-263-3/+3
| | | | This reverts commit e87eb2b42f137c22194cfbca2abf06fecdf943da.
* Revert "Preparing development version 1.2.2-SNAPSHOT"Patrick Wendell2015-01-263-3/+3
| | | | This reverts commit adfed7086f10fa8db4eeac7996c84cf98f625e9a.
* Preparing development version 1.2.2-SNAPSHOTUbuntu2015-01-273-3/+3
|
* Preparing Spark release v1.2.1-rc1Ubuntu2015-01-273-3/+3
|
* [SPARK-4864] Add documentation to Netty-based configsAaron Davidson2014-12-221-1/+1
| | | | | | | | | | | | Author: Aaron Davidson <aaron@databricks.com> Closes #3713 from aarondav/netty-configs and squashes the following commits: 8a8b373 [Aaron Davidson] Address Patrick's comments 3b1f84e [Aaron Davidson] [SPARK-4864] Add documentation to Netty-based configs (cherry picked from commit fbca6b6ce293b1997b40abeb9ab77b8a969a5fc9) Signed-off-by: Patrick Wendell <pwendell@gmail.com>
* [SPARK-4883][Shuffle] Add a name to the directoryCleaner threadzsxwing2014-12-221-3/+5
| | | | | | | | | | | | Author: zsxwing <zsxwing@gmail.com> Closes #3734 from zsxwing/SPARK-4883 and squashes the following commits: e6f2b61 [zsxwing] Fix the name cc74727 [zsxwing] Add a name to the directoryCleaner thread (cherry picked from commit 8773705fd4ab167bb06bee7f274b337560e3c293) Signed-off-by: Andrew Or <andrew@databricks.com>
* Preparing development version 1.2.1-SNAPSHOTPatrick Wendell2014-12-103-3/+3
|
* Preparing Spark release v1.2.0-rc2v1.2.0Patrick Wendell2014-12-103-3/+3
|
* Revert "Preparing Spark release v1.2.0-rc2"Patrick Wendell2014-12-103-3/+3
| | | | This reverts commit 2b72c569a674cccf79ebbe8d067b8dbaaf78007f.
* Revert "Preparing development version 1.2.1-SNAPSHOT"Patrick Wendell2014-12-103-3/+3
| | | | This reverts commit bc05df8a23ba7ad485f6844f28f96551b13ba461.
* Config updates for the new shuffle transport.Reynold Xin2014-12-093-6/+6
| | | | | | | | | | | Author: Reynold Xin <rxin@databricks.com> Closes #3657 from rxin/conf-update and squashes the following commits: 7370eab [Reynold Xin] Config updates for the new shuffle transport. (cherry picked from commit 9bd9334f588dbb44d01554f9f4ca68a153a48993) Signed-off-by: Aaron Davidson <aaron@databricks.com>
* [SPARK-4740] Create multiple concurrent connections between two peer nodes ↵Reynold Xin2014-12-093-46/+180
| | | | | | | | | | | | | | | | | | | | | in Netty. It's been reported that when the number of disks is large and the number of nodes is small, Netty network throughput is low compared with NIO. We suspect the problem is that only a small number of disks are utilized to serve shuffle files at any given point, due to connection reuse. This patch adds a new config parameter to specify the number of concurrent connections between two peer nodes, default to 2. Author: Reynold Xin <rxin@databricks.com> Closes #3625 from rxin/SPARK-4740 and squashes the following commits: ad4241a [Reynold Xin] Updated javadoc. f33c72b [Reynold Xin] Code review feedback. 0fefabb [Reynold Xin] Use double check in synchronization. 41dfcb2 [Reynold Xin] Added test case. 9076b4a [Reynold Xin] Fixed two NPEs. 3e1306c [Reynold Xin] Minor style fix. 4f21673 [Reynold Xin] [SPARK-4740] Create multiple concurrent connections between two peer nodes in Netty. (cherry picked from commit 2b9b72682e587909a84d3ace214c22cec830eeaf) Signed-off-by: Reynold Xin <rxin@databricks.com>
* SPARK-4805 [CORE] BlockTransferMessage.toByteArray() trips assertionSean Owen2014-12-091-1/+2
| | | | | | | | | | | | | Allocate enough room for type byte as well as message, to avoid tripping assertion about capacity of the buffer Author: Sean Owen <sowen@cloudera.com> Closes #3650 from srowen/SPARK-4805 and squashes the following commits: 9e1d502 [Sean Owen] Allocate enough room for type byte as well as message, to avoid tripping assertion about capacity of the buffer (cherry picked from commit d8f84f26e388055ca7459810e001d05ab60af15b) Signed-off-by: Aaron Davidson <aaron@databricks.com>
* Preparing development version 1.2.1-SNAPSHOTPatrick Wendell2014-12-043-3/+3
|
* Preparing Spark release v1.2.0-rc2Patrick Wendell2014-12-043-3/+3
|
* Revert "Preparing Spark release v1.2.0-rc1"Patrick Wendell2014-12-043-3/+3
| | | | This reverts commit 1056e9ec13203d0c51564265e94d77a054498fdb.
* Revert "Preparing development version 1.2.1-SNAPSHOT"Patrick Wendell2014-12-043-3/+3
| | | | This reverts commit 00316cc87983b844f6603f351a8f0b84fe1f6035.
* Preparing development version 1.2.1-SNAPSHOTPatrick Wendell2014-11-283-3/+3
|
* Preparing Spark release v1.2.0-rc1Patrick Wendell2014-11-283-3/+3
|
* Revert "Preparing Spark release v1.2.0-rc1"Patrick Wendell2014-11-283-3/+3
| | | | This reverts commit 39c7d1c1f9a7785285cf4c20dfbffd96f72d5634.
* Revert "Preparing development version 1.2.1-SNAPSHOT"Patrick Wendell2014-11-283-3/+3
| | | | This reverts commit fc7bff00ac731d2632213a98cd92dc5e84ce7dcd.
* Preparing development version 1.2.1-SNAPSHOTPatrick Wendell2014-11-283-3/+3
|
* Preparing Spark release v1.2.0-rc1Patrick Wendell2014-11-283-3/+3
|
* [SPARK-4193][BUILD] Disable doclint in Java 8 to prevent from build error.Takuya UESHIN2014-11-285-5/+5
| | | | | | | | | | | | | | | | | Author: Takuya UESHIN <ueshin@happy-camper.st> Closes #3058 from ueshin/issues/SPARK-4193 and squashes the following commits: e096bb1 [Takuya UESHIN] Add a plugin declaration to pluginManagement. 6762ec2 [Takuya UESHIN] Fix usage of -Xdoclint javadoc option. fdb280a [Takuya UESHIN] Fix Javadoc errors. 4745f3c [Takuya UESHIN] Merge branch 'master' into issues/SPARK-4193 923e2f0 [Takuya UESHIN] Use doclint option `-missing` instead of `none`. 30d6718 [Takuya UESHIN] Fix Javadoc errors. b548017 [Takuya UESHIN] Disable doclint in Java 8 to prevent from build error. (cherry picked from commit e464f0ac2d7210a4bf715478885fe7a8d397fe89) Signed-off-by: Patrick Wendell <pwendell@gmail.com>
* Revert "Preparing Spark release v1.2.0-rc1"Patrick Wendell2014-11-263-3/+3
| | | | This reverts commit cc2c05e4ee81d2f34873a2ebb9a5272867cb65c2.
* Revert "Preparing development version 1.2.1-SNAPSHOT"Patrick Wendell2014-11-263-3/+3
| | | | This reverts commit 380eba5f49eca1dbd4084e6c84e19866fffd4efa.
* [SPARK-4516] Avoid allocating Netty PooledByteBufAllocators unnecessarilyAaron Davidson2014-11-262-10/+8
| | | | | | | | | | | | | | | Turns out we are allocating an allocator pool for every TransportClient (which means that the number increases with the number of nodes in the cluster), when really we should just reuse one for all clients. This patch, as expected, greatly decreases off-heap memory allocation, and appears to make allocation only proportional to the number of cores. Author: Aaron Davidson <aaron@databricks.com> Closes #3465 from aarondav/fewer-pools and squashes the following commits: 36c49da [Aaron Davidson] [SPARK-4516] Avoid allocating unnecessarily Netty PooledByteBufAllocators (cherry picked from commit 346bc17a2ec8fc9e6eaff90733aa1e8b6b46883e) Signed-off-by: Patrick Wendell <pwendell@gmail.com>
* Preparing development version 1.2.1-SNAPSHOTPatrick Wendell2014-11-263-3/+3
|
* Preparing Spark release v1.2.0-rc1Patrick Wendell2014-11-263-3/+3
|
* Revert "Preparing Spark release v1.2.0-rc1"Patrick Wendell2014-11-263-3/+3
| | | | This reverts commit 5247dd859b95a440baa562b9827bdeb26aa6530e.
* Revert "Preparing development version 1.2.1-SNAPSHOT"Patrick Wendell2014-11-263-3/+3
| | | | This reverts commit 79df6b43ae762263a8120f423ddb4a0811dd4b6f.
* Preparing development version 1.2.1-SNAPSHOTPatrick Wendell2014-11-263-3/+3
|
* Preparing Spark release v1.2.0-rc1Patrick Wendell2014-11-263-3/+3
|
* Revert "Preparing Spark release v1.2.0-rc1"Patrick Wendell2014-11-263-3/+3
| | | | This reverts commit db7f4a898af22a02b36428507f8ef2b429d78dc1.
* Revert "Preparing development version 1.2.1-SNAPSHOT"Patrick Wendell2014-11-263-3/+3
| | | | This reverts commit d7b1ecb25676d228deb6fe05efdb4e2ab9c3e30b.
* Preparing development version 1.2.1-SNAPSHOTUbuntu2014-11-263-3/+3
|
* Preparing Spark release v1.2.0-rc1Ubuntu2014-11-263-3/+3
|
* Revert "Preparing Spark release v1.2.0-snapshot1"Patrick Wendell2014-11-263-3/+3
| | | | This reverts commit 38c1fbd9694430cefd962c90bc36b0d108c6124b.
* Revert "Preparing development version 1.2.1-SNAPSHOT"Patrick Wendell2014-11-263-3/+3
| | | | This reverts commit d7ac6013483e83caff8ea54c228f37aeca159db8.
* Preparing development version 1.2.1-SNAPSHOTUbuntu2014-11-173-3/+3
|
* Preparing Spark release v1.2.0-snapshot1Ubuntu2014-11-173-3/+3
|