org.apache.hive.streaming

Class HiveStreamingConnection.Builder

java.lang.Object

org.apache.hive.streaming.HiveStreamingConnection.Builder

Enclosing class:

HiveStreamingConnection

public static class HiveStreamingConnection.Builder
extends Object

Constructor Summary

Constructors

Constructor and Description
Builder()

Method Summary

Modifier and Type	Method and Description
HiveStreamingConnection	connect() Returning a streaming connection to hive.
HiveStreamingConnection.Builder	withAgentInfo(String agentInfo) Specify agent info to use for streaming connection.
HiveStreamingConnection.Builder	withDatabase(String database) Specify database to use for streaming connection.
HiveStreamingConnection.Builder	withHiveConf(HiveConf hiveConf) Specify hive configuration object to use for streaming connection.
HiveStreamingConnection.Builder	withRecordWriter(RecordWriter recordWriter) Record writer to use for writing records to destination table.
HiveStreamingConnection.Builder	withStaticPartitionValues(List<String> staticPartitionValues) Specify the name of partition to use for streaming connection.
HiveStreamingConnection.Builder	withStreamingOptimizations(boolean enable) Whether to enable streaming optimizations.
HiveStreamingConnection.Builder	withTable(String table) Specify table to use for streaming connection.
HiveStreamingConnection.Builder	withTransactionBatchSize(int transactionBatchSize) Transaction batch size to use (default value is 10).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Builder

public Builder()

Method Detail

withDatabase

public HiveStreamingConnection.Builder withDatabase(String database)

Specify database to use for streaming connection.

Parameters:

database - - db name

Returns:

- builder

withTable

public HiveStreamingConnection.Builder withTable(String table)

Specify table to use for streaming connection.

Parameters:

table - - table name

Returns:

- builder

withStaticPartitionValues

public HiveStreamingConnection.Builder withStaticPartitionValues(List<String> staticPartitionValues)

Specify the name of partition to use for streaming connection.

Parameters:

staticPartitionValues - - static partition values

Returns:

- builder

withAgentInfo

public HiveStreamingConnection.Builder withAgentInfo(String agentInfo)

Specify agent info to use for streaming connection.

Parameters:

agentInfo - - agent info

Returns:

- builder

withHiveConf

public HiveStreamingConnection.Builder withHiveConf(HiveConf hiveConf)

Specify hive configuration object to use for streaming connection. Generate this object by point to already existing hive-site.xml or HIVE_CONF_DIR. Make sure if metastore URI has been set correctly else thrift://localhost:9083 will be used as default.

Parameters:

hiveConf - - hive conf object

Returns:

- builder

withTransactionBatchSize

@InterfaceStability.Evolving
public HiveStreamingConnection.Builder withTransactionBatchSize(int transactionBatchSize)

Transaction batch size to use (default value is 10). This is expert level configuration. For every transaction batch a delta directory will be created which will impact when compaction will trigger. NOTE: This is evolving API and is subject to change/might not be honored in future releases.

Parameters:

transactionBatchSize - - transaction batch size

Returns:

- builder

withStreamingOptimizations

public HiveStreamingConnection.Builder withStreamingOptimizations(boolean enable)

Whether to enable streaming optimizations. This is expert level configurations. Disabling streaming optimizations will have significant impact to performance and memory consumption.

Parameters:

enable - - flag to enable or not

Returns:

- builder

withRecordWriter

public HiveStreamingConnection.Builder withRecordWriter(RecordWriter recordWriter)

Record writer to use for writing records to destination table.

Parameters:

recordWriter - - record writer

Returns:

- builder

connect

public HiveStreamingConnection connect()
                                throws StreamingException

Returning a streaming connection to hive.

Returns:

- hive streaming connection

Throws:

StreamingException