public class HiveContext extends SQLContext
SQLContext.implicits$
Constructor and Description |
---|
HiveContext(SparkContext sc) |
Modifier and Type | Method and Description |
---|---|
void |
analyze(String tableName)
Analyzes the given table in the current database to generate statistics, which will be
used in query optimizations.
|
static String |
HIVE_METASTORE_JARS() |
static String |
HIVE_METASTORE_VERSION() |
static String |
hiveExecutionVersion()
The version of hive used internally by Spark SQL.
|
static scala.collection.immutable.Map<String,String> |
newTemporaryConfiguration()
Constructs a configuration for hive, where the metastore is located in a temp directory.
|
void |
refreshTable(String tableName)
Invalidate and refresh all the cached the metadata of the given table.
|
void |
setConf(String key,
String value)
Set the given Spark SQL configuration property.
|
applySchema, applySchema, applySchema, applySchema, baseRelationToDataFrame, cacheTable, clearCache, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createExternalTable, createExternalTable, createExternalTable, createExternalTable, createExternalTable, createExternalTable, dropTempTable, emptyDataFrame, experimental, getAllConfs, getConf, getConf, getOrCreate, implicits, isCached, jdbc, jdbc, jdbc, jsonFile, jsonFile, jsonFile, jsonRDD, jsonRDD, jsonRDD, jsonRDD, jsonRDD, jsonRDD, load, load, load, load, load, load, parquetFile, parquetFile, range, range, range, read, setConf, sparkContext, sql, table, tableNames, tableNames, tables, tables, udf, uncacheTable
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning
public HiveContext(SparkContext sc)
public static String hiveExecutionVersion()
public static String HIVE_METASTORE_VERSION()
public static String HIVE_METASTORE_JARS()
public static scala.collection.immutable.Map<String,String> newTemporaryConfiguration()
public void refreshTable(String tableName)
tableName
- (undocumented)public void analyze(String tableName)
Right now, it only supports Hive tables and it only updates the size of a Hive table in the Hive metastore.
tableName
- (undocumented)public void setConf(String key, String value)
SQLContext
setConf
in class SQLContext
key
- (undocumented)value
- (undocumented)