org.apache.hadoop.hive.druid.io

Class DruidOutputFormat<K,V>

java.lang.Object

org.apache.hadoop.hive.druid.io.DruidOutputFormat<K,V>

All Implemented Interfaces:

HiveOutputFormat<K,DruidWritable>, org.apache.hadoop.mapred.OutputFormat<K,DruidWritable>

public class DruidOutputFormat<K,V>
extends Object
implements HiveOutputFormat<K,DruidWritable>

Field Summary

Fields

Modifier and Type	Field and Description
protected static org.slf4j.Logger	LOG

Constructor Summary

Constructors

Constructor and Description
DruidOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.fs.FileSystem ignored, org.apache.hadoop.mapred.JobConf job)
FileSinkOperator.RecordWriter	getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc, org.apache.hadoop.fs.Path finalOutPath, Class<? extends org.apache.hadoop.io.Writable> valueClass, boolean isCompressed, Properties tableProperties, org.apache.hadoop.util.Progressable progress) create the final out file and get some specific settings.
org.apache.hadoop.mapred.RecordWriter<K,DruidWritable>	getRecordWriter(org.apache.hadoop.fs.FileSystem ignored, org.apache.hadoop.mapred.JobConf job, String name, org.apache.hadoop.util.Progressable progress)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final org.slf4j.Logger LOG

Constructor Detail

DruidOutputFormat

public DruidOutputFormat()

Method Detail

getHiveRecordWriter

public FileSinkOperator.RecordWriter getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc,
                                                         org.apache.hadoop.fs.Path finalOutPath,
                                                         Class<? extends org.apache.hadoop.io.Writable> valueClass,
                                                         boolean isCompressed,
                                                         Properties tableProperties,
                                                         org.apache.hadoop.util.Progressable progress)
                                                  throws IOException

Description copied from interface: HiveOutputFormat

create the final out file and get some specific settings.

Specified by:

getHiveRecordWriter in interface HiveOutputFormat<K,DruidWritable>

Parameters:

jc - the job configuration file

finalOutPath - the final output file to be created

valueClass - the value class used for create

isCompressed - whether the content is compressed or not

tableProperties - the table properties of this file's corresponding table

progress - progress used for status report

Returns:

the RecordWriter for the output file

Throws:

IOException

getRecordWriter

public org.apache.hadoop.mapred.RecordWriter<K,DruidWritable> getRecordWriter(org.apache.hadoop.fs.FileSystem ignored,
                                                                              org.apache.hadoop.mapred.JobConf job,
                                                                              String name,
                                                                              org.apache.hadoop.util.Progressable progress)
                                                                       throws IOException

Specified by:

getRecordWriter in interface org.apache.hadoop.mapred.OutputFormat<K,DruidWritable>

Throws:

IOException

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.fs.FileSystem ignored,
                             org.apache.hadoop.mapred.JobConf job)
                      throws IOException

Specified by:

checkOutputSpecs in interface org.apache.hadoop.mapred.OutputFormat<K,DruidWritable>

Throws:

IOException