Package com.linkedin.venice.hadoop

Class VsonSequenceFileInputFormat

java.lang.Object
org.apache.hadoop.mapred.FileInputFormat<K,V>
org.apache.hadoop.mapred.SequenceFileInputFormat<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>
com.linkedin.venice.hadoop.VsonSequenceFileInputFormat
All Implemented Interfaces:
org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>
public class VsonSequenceFileInputFormat extends org.apache.hadoop.mapred.SequenceFileInputFormat<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>
This class was originally from Voldemort. https://github.com/voldemort/voldemort/blob/master/contrib/hadoop-store-builder/src/java/voldemort/store/readonly/mr/serialization/JsonSequenceFileInputFormat.java

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat

    org.apache.hadoop.mapred.FileInputFormat.Counter

  • Field Summary

    Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

    INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES

  • Constructor Summary

    Constructors
    Constructor
    Description
    VsonSequenceFileInputFormat()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    protected org.apache.hadoop.fs.FileStatus[]
    listStatus(org.apache.hadoop.mapred.JobConf job)
     

    Methods inherited from class org.apache.hadoop.mapred.SequenceFileInputFormat

    getRecordReader

    Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

    addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, isSplitable, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • VsonSequenceFileInputFormat

      public VsonSequenceFileInputFormat()

  • Method Details

    • listStatus

      protected org.apache.hadoop.fs.FileStatus[] listStatus(org.apache.hadoop.mapred.JobConf job) throws IOException
      Overrides:
      listStatus in class org.apache.hadoop.mapred.SequenceFileInputFormat<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>
      Throws:
      IOException