Class VeniceMRPartitioner

  • All Implemented Interfaces:
    org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Partitioner<,​>
    Direct Known Subclasses:

    public class VeniceMRPartitioner
    extends java.lang.Object
    implements org.apache.hadoop.mapred.Partitioner<,​>
    VeniceMRPartitioner will use the exact same partitioner as the one that will be used inside VeniceWriter (e.g. DefaultVenicePartitioner) to make sure the messages inside each partition belong to the same PubSub topic partition.
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      void configure​(org.apache.hadoop.mapred.JobConf job)  
      protected int getPartition​( key, int numPartitions)  
      int getPartition​( key, value, int numPartitions)  
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Constructor Detail

      • VeniceMRPartitioner

        public VeniceMRPartitioner()
    • Method Detail

      • getPartition

        public int getPartition​( key,
                                int numPartitions)
        Specified by:
        getPartition in interface org.apache.hadoop.mapred.Partitioner<,​>
      • getPartition

        protected int getPartition​( key,
                                   int numPartitions)
      • configure

        public void configure​(org.apache.hadoop.mapred.JobConf job)
        Specified by:
        configure in interface org.apache.hadoop.mapred.JobConfigurable