CombineFileInputFormat instead@Deprecated public abstract class MultiFileInputFormat<K,V> extends FileInputFormat<K,V>
InputFormat that returns MultiFileSplit's
in getSplits(JobConf, int) method. Splits are constructed from
the files under the input paths. Each split returned contains nearly
equal content length. getRecordReader(InputSplit, JobConf, Reporter)
to construct RecordReader's for MultiFileSplit's.MultiFileSplitFileInputFormat.CounterLOG| 构造器和说明 |
|---|
MultiFileInputFormat()
已过时。
|
| 限定符和类型 | 方法和说明 |
|---|---|
abstract RecordReader<K,V> |
getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
已过时。
Get the
RecordReader for the given InputSplit. |
InputSplit[] |
getSplits(JobConf job,
int numSplits)
已过时。
Splits files returned by
FileInputFormat.listStatus(JobConf) when
they're too big. |
addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, isSplitable, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSizepublic InputSplit[] getSplits(JobConf job, int numSplits) throws IOException
FileInputFormatFileInputFormat.listStatus(JobConf) when
they're too big.getSplits 在接口中 InputFormat<K,V>getSplits 在类中 FileInputFormat<K,V>job - job configuration.numSplits - the desired number of splits, a hint.InputSplits for the job.IOExceptionpublic abstract RecordReader<K,V> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException
InputFormatRecordReader for the given InputSplit.
It is the responsibility of the RecordReader to respect
record boundaries while processing the logical split to present a
record-oriented view to the individual task.
getRecordReader 在接口中 InputFormat<K,V>getRecordReader 在类中 FileInputFormat<K,V>split - the InputSplitjob - the job that this split belongs toRecordReaderIOExceptionCopyright © 2009 The Apache Software Foundation