org.apache.hadoop.hive.ql.parse

Class ImportSemanticAnalyzer

java.lang.Object

org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer

public class ImportSemanticAnalyzer
extends BaseSemanticAnalyzer

ImportSemanticAnalyzer.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

BaseSemanticAnalyzer.AnalyzeRewriteContext, BaseSemanticAnalyzer.TableSpec

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

acidFileSinks, cacheUsage, cContext, columnAccessInfo, conf, console, ctx, db, fetchTask, HIVE_COLUMN_NULLS_FIRST, HIVE_COLUMN_NULLS_LAST, HIVE_COLUMN_ORDER_ASC, HIVE_COLUMN_ORDER_DESC, idToTableNameMap, inputs, linfo, LOG, outputs, queryProperties, queryState, rootTasks, STATIC_LOG, tableAccessInfo, transactionalInQuery, txnManager, updateColumnAccessInfo

Constructor Summary

Constructors

Constructor and Description
ImportSemanticAnalyzer(QueryState queryState)

Method Summary

Modifier and Type	Method and Description
void	analyzeInternal(ASTNode ast)
static void	checkTargetLocationEmpty(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path targetPath, ReplicationSpec replicationSpec, org.slf4j.Logger logger)
boolean	existsTable()
static boolean	isPartitioned(ImportTableDesc tblDesc)
static String	partSpecToString(Map<String,String> partSpec)
static boolean	prepareImport(boolean isImportCmd, boolean isLocationSet, boolean isExternalSet, boolean isPartSpecSet, boolean waitOnPrecursor, String parsedLocation, String parsedTableName, String overrideDBName, LinkedHashMap<String,String> parsedPartSpec, String fromLocn, EximUtil.SemanticAnalyzerWrapperContext x, UpdatedMetaDataTracker updatedMetadata, HiveTxnManager txnMgr) The same code is used from both the "repl load" as well as "import".
static Table	tableIfExists(ImportTableDesc tblDesc, Hive db) Utility method that returns a table if one corresponding to the destination tblDesc is found.

Methods inherited from class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

analyze, analyzeDDLSkewedValues, analyzeSkewedTablDDLColNames, analyzeStoredAdDirs, charSetString, constructListBucketingCtx, createFetchTask, createHiveDB, escapeSQLString, getAcidDdlDesc, getAcidFileSinks, getAllInputs, getAllOutputs, getAllRootTasks, getAutoCommitValue, getCacheUsage, getColumnAccessInfo, getColumnNames, getColumnNamesOrder, getColumns, getColumns, getColumns, getDatabase, getDatabase, getDb, getDbTableNamePair, getDotName, getFetchTask, getIdToTableNameMap, getInputs, getLineageInfo, getOutputs, getPartition, getPartitions, getQualifiedTableName, getQueryProperties, getQueryState, getResultSchema, getRootTasks, getSkewedValueFromASTNode, getSkewedValuesFromASTNode, getTable, getTable, getTable, getTable, getTable, getTableAccessInfo, getTxnMgr, getTypeStringFromAST, getUnescapedName, getUnescapedName, getUnescapedUnqualifiedTableName, getUpdateColumnAccessInfo, hasEnabledOrValidatedConstraints, hasTransactionalInQuery, init, initCtx, isValidPrefixSpec, processCheckConstraints, processDefaultConstraints, processForeignKeys, processNotNullConstraints, processPrimaryKeys, processPrimaryKeys, processUniqueConstraints, processUniqueConstraints, readProps, reset, setCacheUsage, setColumnAccessInfo, setFetchTask, setLineageInfo, setTableAccessInfo, setUpdateColumnAccessInfo, skipAuthorization, stripIdentifierQuotes, stripQuotes, toMessage, toReadEntity, toReadEntity, toReadEntity, toWriteEntity, toWriteEntity, toWriteEntity, tryQualifyPath, unescapeIdentifier, unescapeSQLString, validate, validateCheckConstraint, validatePartColumnType, validatePartSpec

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ImportSemanticAnalyzer

public ImportSemanticAnalyzer(QueryState queryState)
                       throws SemanticException

Throws:

SemanticException

Method Detail

existsTable

public boolean existsTable()

analyzeInternal

public void analyzeInternal(ASTNode ast)
                     throws SemanticException

Specified by:

analyzeInternal in class BaseSemanticAnalyzer

Throws:

SemanticException

prepareImport

public static boolean prepareImport(boolean isImportCmd,
                                    boolean isLocationSet,
                                    boolean isExternalSet,
                                    boolean isPartSpecSet,
                                    boolean waitOnPrecursor,
                                    String parsedLocation,
                                    String parsedTableName,
                                    String overrideDBName,
                                    LinkedHashMap<String,String> parsedPartSpec,
                                    String fromLocn,
                                    EximUtil.SemanticAnalyzerWrapperContext x,
                                    UpdatedMetaDataTracker updatedMetadata,
                                    HiveTxnManager txnMgr)
                             throws IOException,
                                    org.apache.hadoop.hive.metastore.api.MetaException,
                                    HiveException,
                                    URISyntaxException

The same code is used from both the "repl load" as well as "import". Given that "repl load" now supports two modes "repl load dbName [location]" and "repl load [location]" in which case the database name has to be taken from the table metadata by default and then over-ridden if something specified on the command line. hence for import to work correctly we have to pass in the sessionState default Db via the parsedDbName parameter

Throws:

IOException

org.apache.hadoop.hive.metastore.api.MetaException

HiveException

URISyntaxException

checkTargetLocationEmpty

public static void checkTargetLocationEmpty(org.apache.hadoop.fs.FileSystem fs,
                                            org.apache.hadoop.fs.Path targetPath,
                                            ReplicationSpec replicationSpec,
                                            org.slf4j.Logger logger)
                                     throws IOException,
                                            SemanticException

Throws:

IOException

SemanticException

partSpecToString

public static String partSpecToString(Map<String,String> partSpec)

isPartitioned

public static boolean isPartitioned(ImportTableDesc tblDesc)

tableIfExists

public static Table tableIfExists(ImportTableDesc tblDesc,
                                  Hive db)
                           throws HiveException

Utility method that returns a table if one corresponding to the destination tblDesc is found. Returns null if no such table is found.

Throws:

HiveException