diff options
| author | zsxwing <zsxwing@gmail.com> | 2015-09-29 11:53:28 -0700 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-09-29 11:53:28 -0700 |
| commit | dba95ea03216e6b8e623db4a36e1018c6ed95538 (patch) | |
| tree | a73afd6c4439b399f8ec13e07b94b183a3e8ec77 /python/docs | |
| parent | 9b9fe5f7bf55257269d8febcd64e95677075dfb6 (diff) | |
| download | spark-dba95ea03216e6b8e623db4a36e1018c6ed95538.tar.gz spark-dba95ea03216e6b8e623db4a36e1018c6ed95538.tar.bz2 spark-dba95ea03216e6b8e623db4a36e1018c6ed95538.zip | |
[SPARK-10825] [CORE] [TESTS] Fix race conditions in StandaloneDynamicAllocationSuite
Fix the following issues in StandaloneDynamicAllocationSuite:
1. It should not assume master and workers start in order
2. It should not assume master and workers get ready at once
3. It should not assume the application is already registered with master after creating SparkContext
4. It should not access Master.app and idToApp which are not thread safe
The changes includes:
* Use `eventually` to wait until master and workers are ready to fix 1 and 2
* Use `eventually` to wait until the application is registered with master to fix 3
* Use `askWithRetry[MasterStateResponse](RequestMasterState)` to get the application info to fix 4
Author: zsxwing <zsxwing@gmail.com>
Closes #8914 from zsxwing/fix-StandaloneDynamicAllocationSuite.
Diffstat (limited to 'python/docs')
0 files changed, 0 insertions, 0 deletions