diff options
author | jerryshao <sshao@hortonworks.com> | 2015-08-28 09:32:52 -0500 |
---|---|---|
committer | Imran Rashid <irashid@cloudera.com> | 2015-08-28 09:32:52 -0500 |
commit | 1502a0f6c5d2f85a331b29d3bf50002911ea393e (patch) | |
tree | b998df7966b0437edb46ea338d68a361ee76eeee /docs/ml-features.md | |
parent | 71a077f6c16c8816eae13341f645ba50d997f63d (diff) | |
download | spark-1502a0f6c5d2f85a331b29d3bf50002911ea393e.tar.gz spark-1502a0f6c5d2f85a331b29d3bf50002911ea393e.tar.bz2 spark-1502a0f6c5d2f85a331b29d3bf50002911ea393e.zip |
[YARN] [MINOR] Avoid hard code port number in YarnShuffleService test
Current port number is fixed as default (7337) in test, this will introduce port contention exception, better to change to a random number in unit test.
squito , seems you're author of this unit test, mind taking a look at this fix? Thanks a lot.
```
[info] - executor state kept across NM restart *** FAILED *** (597 milliseconds)
[info] org.apache.hadoop.service.ServiceStateException: java.net.BindException: Address already in use
[info] at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
[info] at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
[info] at org.apache.spark.network.yarn.YarnShuffleServiceSuite$$anonfun$1.apply$mcV$sp(YarnShuffleServiceSuite.scala:72)
[info] at org.apache.spark.network.yarn.YarnShuffleServiceSuite$$anonfun$1.apply(YarnShuffleServiceSuite.scala:70)
[info] at org.apache.spark.network.yarn.YarnShuffleServiceSuite$$anonfun$1.apply(YarnShuffleServiceSuite.scala:70)
[info] at org.scalatest.Transformer$$anonfun$apply$1.apply$mcV$sp(Transformer.scala:22)
[info] at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85)
[info] at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
[info] at org.scalatest.Transformer.apply(Transformer.scala:22)
[info] at org.scalatest.Transformer.apply(Transformer.scala:20)
[info] at org.scalatest.FunSuiteLike$$anon$1.apply(FunSuiteLike.scala:166)
[info] at org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:42)
...
```
Author: jerryshao <sshao@hortonworks.com>
Closes #8502 from jerryshao/avoid-hardcode-port.
Diffstat (limited to 'docs/ml-features.md')
0 files changed, 0 insertions, 0 deletions