diff options
| author | Tathagata Das <tathagata.das1565@gmail.com> | 2014-10-13 22:46:49 -0700 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2014-10-13 22:46:49 -0700 |
| commit | 4d26aca770f7dd50eee1ed7855e9eda68b5a7ffa (patch) | |
| tree | 6906b2a4071fc1ded7d90994cb17423ca19f0214 /NOTICE | |
| parent | 9eb49d4134e23a15142fb592d54d920e89bd8786 (diff) | |
| download | spark-4d26aca770f7dd50eee1ed7855e9eda68b5a7ffa.tar.gz spark-4d26aca770f7dd50eee1ed7855e9eda68b5a7ffa.tar.bz2 spark-4d26aca770f7dd50eee1ed7855e9eda68b5a7ffa.zip | |
[SPARK-3912][Streaming] Fixed flakyFlumeStreamSuite
@harishreedharan @pwendell
See JIRA for diagnosis of the problem
https://issues.apache.org/jira/browse/SPARK-3912
The solution was to reimplement it.
1. Find a free port (by binding and releasing a server-scoket), and then use that port
2. Remove thread.sleep()s, instead repeatedly try to create a sender and send data and check whether data was sent. Use eventually() to minimize waiting time.
3. Check whether all the data was received, without caring about batches.
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #2773 from tdas/flume-test-fix and squashes the following commits:
93cd7f6 [Tathagata Das] Reimplimented FlumeStreamSuite to be more robust.
Diffstat (limited to 'NOTICE')
0 files changed, 0 insertions, 0 deletions