org.apache.hadoop.mapred.lib

类 DelegatingInputFormat<K,V>

java.lang.Object

org.apache.hadoop.mapred.lib.DelegatingInputFormat<K,V>

所有已实现的接口:

InputFormat<K,V>

public class DelegatingInputFormat<K,V>
extends Object
implements InputFormat<K,V>

An InputFormat that delegates behaviour of paths to multiple other InputFormats.

另请参阅:

MultipleInputs.addInputPath(JobConf, Path, Class, Class)

构造器概要

构造器

构造器和说明
DelegatingInputFormat()

方法概要

方法

限定符和类型	方法和说明
RecordReader<K,V>	getRecordReader(InputSplit split, JobConf conf, Reporter reporter) Get the RecordReader for the given InputSplit.
InputSplit[]	getSplits(JobConf conf, int numSplits) Logically split the set of input files for the job.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

DelegatingInputFormat

public DelegatingInputFormat()

方法详细资料

getSplits

public InputSplit[] getSplits(JobConf conf,
                     int numSplits)
                       throws IOException

从接口复制的说明: InputFormat

Logically split the set of input files for the job.

Each InputSplit is then assigned to an individual Mapper for processing.

Note: The split is a logical split of the inputs and the input files are not physically split into chunks. For e.g. a split could be <input-file-path, start, offset> tuple.

指定者:

getSplits 在接口中 InputFormat<K,V>

参数:

conf - job configuration.

numSplits - the desired number of splits, a hint.

返回:

an array of InputSplits for the job.

抛出:

IOException

getRecordReader

public RecordReader<K,V> getRecordReader(InputSplit split,
                                JobConf conf,
                                Reporter reporter)
                                  throws IOException

从接口复制的说明: InputFormat

Get the RecordReader for the given InputSplit.

It is the responsibility of the RecordReader to respect record boundaries while processing the logical split to present a record-oriented view to the individual task.

指定者:

getRecordReader 在接口中 InputFormat<K,V>

参数:

split - the InputSplit

conf - the job that this split belongs to

返回:

a RecordReader

抛出:

IOException