Package com.linkedin.venice.hadoop.input.recordreader.vson

Class VeniceVsonRecordReader

java.lang.Object

com.linkedin.venice.hadoop.input.recordreader.AbstractVeniceRecordReader<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

com.linkedin.venice.hadoop.input.recordreader.vson.VeniceVsonRecordReader

public class VeniceVsonRecordReader
extends AbstractVeniceRecordReader<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

A record reader that reads records from VSON SequenceFile file input into Avro-serialized keys and values.

Constructor Summary

Constructors

Constructor	Description
VeniceVsonRecordReader(VeniceProperties props)
VeniceVsonRecordReader(String keySchemaString, String valueSchemaString, String keyField, String valueField)
VeniceVsonRecordReader(String keyField, String valueField, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path hdfsPath)

Method Summary

Modifier and Type	Method	Description
Object	getAvroKey(org.apache.hadoop.io.BytesWritable inputKey, org.apache.hadoop.io.BytesWritable inputValue)	Return an Avro output key
Object	getAvroValue(org.apache.hadoop.io.BytesWritable inputKey, org.apache.hadoop.io.BytesWritable inputValue)	return an Avro output value
Map<String,String>	getMetadataMap()
Long	getRecordTimestamp(org.apache.hadoop.io.BytesWritable inputKey, org.apache.hadoop.io.BytesWritable inputValue)

Methods inherited from class com.linkedin.venice.hadoop.input.recordreader.AbstractVeniceRecordReader

configure, getKeyBytes, getKeySchema, getValueBytes, getValueSchema

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

VeniceVsonRecordReader

public VeniceVsonRecordReader(VeniceProperties props)

VeniceVsonRecordReader

public VeniceVsonRecordReader(String keySchemaString,
 String valueSchemaString,
 String keyField,
 String valueField)

VeniceVsonRecordReader

public VeniceVsonRecordReader(String keyField,
 String valueField,
 org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.fs.Path hdfsPath)

Method Details

getAvroKey

public Object getAvroKey(org.apache.hadoop.io.BytesWritable inputKey,
 org.apache.hadoop.io.BytesWritable inputValue)

Description copied from class: AbstractVeniceRecordReader

Return an Avro output key

Specified by:

getAvroKey in class AbstractVeniceRecordReader<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

getAvroValue

public Object getAvroValue(org.apache.hadoop.io.BytesWritable inputKey,
 org.apache.hadoop.io.BytesWritable inputValue)

Description copied from class: AbstractVeniceRecordReader

return an Avro output value

Specified by:

getAvroValue in class AbstractVeniceRecordReader<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

getRecordTimestamp

public Long getRecordTimestamp(org.apache.hadoop.io.BytesWritable inputKey,
 org.apache.hadoop.io.BytesWritable inputValue)

Specified by:

getRecordTimestamp in class AbstractVeniceRecordReader<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

getMetadataMap

public Map<String,String> getMetadataMap()