diff options
| author | Josh Rosen <joshrosen@databricks.com> | 2016-02-16 12:06:30 -0800 |
|---|---|---|
| committer | Shixiong Zhu <shixiong@databricks.com> | 2016-02-16 12:06:30 -0800 |
| commit | 5f37aad48cb729a80c4cc25347460f12aafec9fb (patch) | |
| tree | 16dbd6eb1b8e5f1ccfafaf4755e785e4b3d72320 /streaming | |
| parent | c7d00a24da317c9601a9239ac1cf185fb6647352 (diff) | |
| download | spark-5f37aad48cb729a80c4cc25347460f12aafec9fb.tar.gz spark-5f37aad48cb729a80c4cc25347460f12aafec9fb.tar.bz2 spark-5f37aad48cb729a80c4cc25347460f12aafec9fb.zip | |
[SPARK-13308] ManagedBuffers passed to OneToOneStreamManager need to be freed in non-error cases
ManagedBuffers that are passed to `OneToOneStreamManager.registerStream` need to be freed by the manager once it's done using them. However, the current code only frees them in certain error-cases and not during typical operation. This isn't a major problem today, but it will cause memory leaks after we implement better locking / pinning in the BlockManager (see #10705).
This patch modifies the relevant network code so that the ManagedBuffers are freed as soon as the messages containing them are processed by the lower-level Netty message sending code.
/cc zsxwing for review.
Author: Josh Rosen <joshrosen@databricks.com>
Closes #11193 from JoshRosen/add-missing-release-calls-in-network-layer.
Diffstat (limited to 'streaming')
0 files changed, 0 insertions, 0 deletions