org.apache.nutch.fetcher
Class Fetcher2.InputFormat

java.lang.Object
  org.apache.hadoop.mapred.FileInputFormat<K,V>
      org.apache.hadoop.mapred.SequenceFileInputFormat<org.apache.hadoop.io.Text,CrawlDatum>
          org.apache.nutch.fetcher.Fetcher2.InputFormat

All Implemented Interfaces:

org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Enclosing class:

Fetcher2

public static class Fetcher2.InputFormat
extends org.apache.hadoop.mapred.SequenceFileInputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Field Summary

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

LOG

Constructor Summary

Fetcher2.InputFormat()

Method Summary

org.apache.hadoop.mapred.InputSplit[]

getSplits(org.apache.hadoop.mapred.JobConf job, int nSplits) Don't split inputs, to keep things polite.

Methods inherited from class org.apache.hadoop.mapred.SequenceFileInputFormat

getRecordReader, listPaths

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, isSplitable, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize, validateInput

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Fetcher2.InputFormat

public Fetcher2.InputFormat()

Method Detail

getSplits

public org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf job,
                                                       int nSplits)
                                                throws IOException

Don't split inputs, to keep things polite.

Specified by:

getSplits in interface org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Overrides:

getSplits in class org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Throws:

IOException