Class VeniceVsonRecordReader


  • public class VeniceVsonRecordReader
    extends AbstractVeniceRecordReader<org.apache.hadoop.io.BytesWritable,​org.apache.hadoop.io.BytesWritable>
    A record reader that reads records from VSON SequenceFile file input into Avro-serialized keys and values.
    • Constructor Summary

      Constructors 
      Constructor Description
      VeniceVsonRecordReader​(VeniceProperties props)  
      VeniceVsonRecordReader​(java.lang.String keySchemaString, java.lang.String valueSchemaString, java.lang.String keyField, java.lang.String valueField)  
      VeniceVsonRecordReader​(java.lang.String keyField, java.lang.String valueField, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path hdfsPath)  
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      java.lang.Object getAvroKey​(org.apache.hadoop.io.BytesWritable inputKey, org.apache.hadoop.io.BytesWritable inputValue)
      Return an Avro output key
      java.lang.Object getAvroValue​(org.apache.hadoop.io.BytesWritable inputKey, org.apache.hadoop.io.BytesWritable inputValue)
      return an Avro output value
      java.util.Map<java.lang.String,​java.lang.String> getMetadataMap()  
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Constructor Detail

      • VeniceVsonRecordReader

        public VeniceVsonRecordReader​(VeniceProperties props)
      • VeniceVsonRecordReader

        public VeniceVsonRecordReader​(java.lang.String keySchemaString,
                                      java.lang.String valueSchemaString,
                                      java.lang.String keyField,
                                      java.lang.String valueField)
      • VeniceVsonRecordReader

        public VeniceVsonRecordReader​(java.lang.String keyField,
                                      java.lang.String valueField,
                                      org.apache.hadoop.fs.FileSystem fs,
                                      org.apache.hadoop.fs.Path hdfsPath)
    • Method Detail

      • getAvroKey

        public java.lang.Object getAvroKey​(org.apache.hadoop.io.BytesWritable inputKey,
                                           org.apache.hadoop.io.BytesWritable inputValue)
        Description copied from class: AbstractVeniceRecordReader
        Return an Avro output key
        Specified by:
        getAvroKey in class AbstractVeniceRecordReader<org.apache.hadoop.io.BytesWritable,​org.apache.hadoop.io.BytesWritable>
      • getAvroValue

        public java.lang.Object getAvroValue​(org.apache.hadoop.io.BytesWritable inputKey,
                                             org.apache.hadoop.io.BytesWritable inputValue)
        Description copied from class: AbstractVeniceRecordReader
        return an Avro output value
        Specified by:
        getAvroValue in class AbstractVeniceRecordReader<org.apache.hadoop.io.BytesWritable,​org.apache.hadoop.io.BytesWritable>
      • getMetadataMap

        public java.util.Map<java.lang.String,​java.lang.String> getMetadataMap()