org.apache.hive.hcatalog.mapreduce

Class SpecialCases

java.lang.Object

org.apache.hive.hcatalog.mapreduce.SpecialCases

public class SpecialCases
extends Object

This class is a place to put all the code associated with Special cases. If there is a corner case required to make a particular format work that is above and beyond the generic use, it belongs here, for example. Over time, the goal is to try to minimize usage of this, but it is a useful overflow class that allows us to still be as generic as possible in the main codeflow path, and call attention to the special cases here. Note : For all methods introduced here, please document why the special case is necessary, providing a jira number if possible.

Constructor Summary

Constructors

Constructor and Description
SpecialCases()

Method Summary

Modifier and Type	Method and Description
static void	addSpecialCasesParametersForHCatLoader(org.apache.hadoop.conf.Configuration conf, HCatTableInfo tableInfo) Method to do any storage-handler specific special casing while instantiating a HCatLoader
static void	addSpecialCasesParametersToOutputJobProperties(Map<String,String> jobProperties, OutputJobInfo jobInfo, Class<? extends org.apache.hadoop.mapred.OutputFormat> ofclass) Method to do any file-format specific special casing while instantiating a storage handler to write.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SpecialCases

public SpecialCases()

Method Detail

addSpecialCasesParametersToOutputJobProperties

public static void addSpecialCasesParametersToOutputJobProperties(Map<String,String> jobProperties,
                                                                  OutputJobInfo jobInfo,
                                                                  Class<? extends org.apache.hadoop.mapred.OutputFormat> ofclass)

Method to do any file-format specific special casing while instantiating a storage handler to write. We set any parameters we want to be visible to the job in jobProperties, and this will be available to the job via jobconf at run time. This is mostly intended to be used by StorageHandlers that wrap File-based OutputFormats such as FosterStorageHandler that wraps RCFile, ORC, etc.

Parameters:

jobProperties - : map to write to

jobInfo - : information about this output job to read from

ofclass - : the output format in use

addSpecialCasesParametersForHCatLoader

public static void addSpecialCasesParametersForHCatLoader(org.apache.hadoop.conf.Configuration conf,
                                                          HCatTableInfo tableInfo)

Method to do any storage-handler specific special casing while instantiating a HCatLoader

Parameters:

conf - : configuration to write to

tableInfo - : the table definition being used