diff options
| author | shane-huang <shengsheng.huang@intel.com> | 2013-02-20 11:51:13 +0800 |
|---|---|---|
| committer | shane-huang <shengsheng.huang@intel.com> | 2013-04-07 14:37:12 +0800 |
| commit | df47b40b764e25cbd10ce49d7152e1d33f51a263 (patch) | |
| tree | 46b3efea5434f02a5ee87c0b31c3bb59c74b773c /streaming | |
| parent | dfe98ca798d84e6847330012f1332d9271156534 (diff) | |
| download | spark-df47b40b764e25cbd10ce49d7152e1d33f51a263.tar.gz spark-df47b40b764e25cbd10ce49d7152e1d33f51a263.tar.bz2 spark-df47b40b764e25cbd10ce49d7152e1d33f51a263.zip | |
Shuffle Performance fix: Use netty embeded OIO file server instead of ConnectionManager
Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages
change reference from io.Source to scala.io.Source to avoid looking into io.netty package
Signed-off-by: shane-huang <shengsheng.huang@intel.com>
Diffstat (limited to 'streaming')
| -rw-r--r-- | streaming/src/main/scala/spark/streaming/util/RawTextSender.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/streaming/src/main/scala/spark/streaming/util/RawTextSender.scala b/streaming/src/main/scala/spark/streaming/util/RawTextSender.scala index d8b987ec86..bd0b0e74c1 100644 --- a/streaming/src/main/scala/spark/streaming/util/RawTextSender.scala +++ b/streaming/src/main/scala/spark/streaming/util/RawTextSender.scala @@ -5,7 +5,7 @@ import spark.util.{RateLimitedOutputStream, IntParam} import java.net.ServerSocket import spark.{Logging, KryoSerializer} import it.unimi.dsi.fastutil.io.FastByteArrayOutputStream -import io.Source +import scala.io.Source import java.io.IOException /** |