Package com.linkedin.venice.hadoop.input.kafka

Class KafkaInputMRPartitioner

java.lang.Object

com.linkedin.venice.hadoop.mapreduce.datawriter.partition.VeniceMRPartitioner

com.linkedin.venice.hadoop.input.kafka.KafkaInputMRPartitioner

All Implemented Interfaces:

org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Partitioner<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

public class KafkaInputMRPartitioner
extends VeniceMRPartitioner

This class is used for KafkaInput Repush, and it only considers the key part of the composed key (ignoring the offset).

Field Summary

Fields inherited from class com.linkedin.venice.hadoop.mapreduce.datawriter.partition.VeniceMRPartitioner

EMPTY_KEY_LENGTH, venicePartitioner

Constructor Summary

Constructors

Constructor	Description
KafkaInputMRPartitioner()

Method Summary

Modifier and Type	Method	Description
protected int	getPartition(org.apache.hadoop.io.BytesWritable key, int numPartitions)

Methods inherited from class com.linkedin.venice.hadoop.mapreduce.datawriter.partition.VeniceMRPartitioner

configure, getPartition

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KafkaInputMRPartitioner

public KafkaInputMRPartitioner()

Method Detail

getPartition

protected int getPartition(org.apache.hadoop.io.BytesWritable key,
                           int numPartitions)

Overrides:

getPartition in class VeniceMRPartitioner