diff options
| author | Shixiong Zhu <shixiong@databricks.com> | 2016-05-19 18:31:05 -0700 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2016-05-19 18:31:05 -0700 |
| commit | 16ba71aba4e68bbb892d4ceb38d6d1d135d63fd3 (patch) | |
| tree | e73f4ae5cfe201cdc648da5dabd56468b6bd942c /examples | |
| parent | 664367781786df7ec52e39950dccd5a09681602c (diff) | |
| download | spark-16ba71aba4e68bbb892d4ceb38d6d1d135d63fd3.tar.gz spark-16ba71aba4e68bbb892d4ceb38d6d1d135d63fd3.tar.bz2 spark-16ba71aba4e68bbb892d4ceb38d6d1d135d63fd3.zip | |
[SPARK-15416][SQL] Display a better message for not finding classes removed in Spark 2.0
## What changes were proposed in this pull request?
If finding `NoClassDefFoundError` or `ClassNotFoundException`, check if the class name is removed in Spark 2.0. If so, the user must be using an incompatible library and we can provide a better message.
## How was this patch tested?
1. Run `bin/pyspark --packages com.databricks:spark-avro_2.10:2.0.1`
2. type `sqlContext.read.format("com.databricks.spark.avro").load("src/test/resources/episodes.avro")`.
It will show `java.lang.ClassNotFoundException: org.apache.spark.sql.sources.HadoopFsRelationProvider is removed in Spark 2.0. Please check if your library is compatible with Spark 2.0`
Author: Shixiong Zhu <shixiong@databricks.com>
Closes #13201 from zsxwing/better-message.
Diffstat (limited to 'examples')
0 files changed, 0 insertions, 0 deletions