diff options
| author | Josh Rosen <joshrosen@databricks.com> | 2015-11-11 14:30:38 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-11-11 14:30:38 -0800 |
| commit | 2d76e44b1a88e08047806972b2d241a89e499bab (patch) | |
| tree | 265e8e1e976d30a0c05fbadea7642f0e3048f012 /mllib | |
| parent | dd77e278b99e45c20fdefb1c795f3c5148d577db (diff) | |
| download | spark-2d76e44b1a88e08047806972b2d241a89e499bab.tar.gz spark-2d76e44b1a88e08047806972b2d241a89e499bab.tar.bz2 spark-2d76e44b1a88e08047806972b2d241a89e499bab.zip | |
[SPARK-11647] Attempt to reduce time/flakiness of Thriftserver CLI and SparkSubmit tests
This patch aims to reduce the test time and flakiness of HiveSparkSubmitSuite, SparkSubmitSuite, and CliSuite.
Key changes:
- Disable IO synchronization calls for Derby writes, since durability doesn't matter for tests. This was done for HiveCompatibilitySuite in #6651 and resulted in huge test speedups.
- Add a few missing `--conf`s to disable various Spark UIs. The CliSuite, in particular, never disabled these UIs, leaving it prone to port-contention-related flakiness.
- Fix two instances where tests defined `beforeAll()` methods which were never called because the appropriate traits were not mixed in. I updated these tests suites to extend `BeforeAndAfterEach` so that they play nicely with our `ResetSystemProperties` trait.
Author: Josh Rosen <joshrosen@databricks.com>
Closes #9623 from JoshRosen/SPARK-11647.
Diffstat (limited to 'mllib')
0 files changed, 0 insertions, 0 deletions