Package com.linkedin.venice.hadoop.mapreduce.datawriter.map

Class VeniceVsonMapper

java.lang.Object

com.linkedin.venice.hadoop.task.datawriter.AbstractDataWriterTask

com.linkedin.venice.hadoop.task.datawriter.AbstractInputRecordProcessor<INPUT_KEY,INPUT_VALUE>

com.linkedin.venice.hadoop.mapreduce.datawriter.map.AbstractVeniceMapper<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

com.linkedin.venice.hadoop.mapreduce.datawriter.map.VeniceVsonMapper

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.io.Closeable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

public class VeniceVsonMapper
extends AbstractVeniceMapper<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

Mapper that reads Vson input and deserializes it as Avro object and then Avro binary

Field Summary

Fields inherited from class com.linkedin.venice.hadoop.task.datawriter.AbstractInputRecordProcessor

veniceRecordReader

Fields inherited from class com.linkedin.venice.hadoop.task.datawriter.AbstractDataWriterTask

TASK_ID_NOT_SET

Constructor Summary

Constructors

Constructor	Description
VeniceVsonMapper()

Method Summary

Modifier and Type	Method	Description
AbstractVeniceRecordReader<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>	getRecordReader(VeniceProperties props)	A method for child classes to setup AbstractInputRecordProcessor.veniceRecordReader.

Methods inherited from class com.linkedin.venice.hadoop.mapreduce.datawriter.map.AbstractVeniceMapper

configure, map

Methods inherited from class com.linkedin.venice.hadoop.task.datawriter.AbstractInputRecordProcessor

close, configureTask, process, processRecord, readDictionaryFromKafka

Methods inherited from class com.linkedin.venice.hadoop.task.datawriter.AbstractDataWriterTask

configure, getEngineTaskConfigProvider, getPartitionCount, getTaskId, isChunkingEnabled, isRmdChunkingEnabled, setChunkingEnabled

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.io.Closeable

close

Constructor Details

VeniceVsonMapper

public VeniceVsonMapper()

Method Details

getRecordReader

public AbstractVeniceRecordReader<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable> getRecordReader(VeniceProperties props)

Description copied from class: AbstractInputRecordProcessor

A method for child classes to setup AbstractInputRecordProcessor.veniceRecordReader.

Specified by:

getRecordReader in class AbstractInputRecordProcessor<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>