Package com.linkedin.venice.hadoop.input.kafka.avro

Class KafkaInputMapperValue

  • All Implemented Interfaces:
    java.io.Externalizable, java.io.Serializable, java.lang.Comparable<org.apache.avro.specific.SpecificRecord>, org.apache.avro.generic.GenericContainer, org.apache.avro.generic.GenericRecord, org.apache.avro.generic.IndexedRecord, org.apache.avro.specific.SpecificRecord
    public class KafkaInputMapperValue
extends org.apache.avro.specific.SpecificRecordBase
implements org.apache.avro.specific.SpecificRecord
    The data protocol between Mapper and Reducer for KafkaInputFormat
    See Also:
    Serialized Form

    • Field Summary

      Fields 
      Modifier and Type Field Description
      java.nio.ByteBuffer chunkedKeySuffix
      Serialized chunked key suffix and this field is not null only when this value is a chunk of a large value
      long offset
      The offset of the record in the original Kafka topic partition
      java.nio.ByteBuffer replicationMetadataPayload
      The serialized value of the replication metadata schema.
      int replicationMetadataVersionId
      The A/A replication metadata schema version ID that will be used to deserialize replicationMetadataPayload.
      static org.apache.avro.Schema SCHEMA$  
      int schemaId
      The schema id of the original record
      java.nio.ByteBuffer value
      The raw value bytes
      MapperValueType valueType
      The value type of the message

    • Constructor Summary

      Constructors 
      Constructor Description
      KafkaInputMapperValue()
      Default constructor.
      KafkaInputMapperValue​(MapperValueType valueType, java.nio.ByteBuffer value, java.lang.Long offset, java.lang.Integer schemaId, java.nio.ByteBuffer chunkedKeySuffix, java.lang.Integer replicationMetadataVersionId, java.nio.ByteBuffer replicationMetadataPayload)
      All-args constructor.

    • Method Summary

      All Methods Static Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      java.lang.Object get​(int field$)  
      java.nio.ByteBuffer getChunkedKeySuffix()
      Gets the value of the 'chunkedKeySuffix' field.
      static org.apache.avro.Schema getClassSchema()  
      long getOffset()
      Gets the value of the 'offset' field.
      java.nio.ByteBuffer getReplicationMetadataPayload()
      Gets the value of the 'replicationMetadataPayload' field.
      int getReplicationMetadataVersionId()
      Gets the value of the 'replicationMetadataVersionId' field.
      org.apache.avro.Schema getSchema()  
      int getSchemaId()
      Gets the value of the 'schemaId' field.
      org.apache.avro.specific.SpecificData getSpecificData()  
      java.nio.ByteBuffer getValue()
      Gets the value of the 'value' field.
      MapperValueType getValueType()
      Gets the value of the 'valueType' field.
      void put​(int field$, java.lang.Object value$)  
      void readExternal​(java.io.ObjectInput in)  
      void setChunkedKeySuffix​(java.nio.ByteBuffer value)
      Sets the value of the 'chunkedKeySuffix' field.
      void setOffset​(long value)
      Sets the value of the 'offset' field.
      void setReplicationMetadataPayload​(java.nio.ByteBuffer value)
      Sets the value of the 'replicationMetadataPayload' field.
      void setReplicationMetadataVersionId​(int value)
      Sets the value of the 'replicationMetadataVersionId' field.
      void setSchemaId​(int value)
      Sets the value of the 'schemaId' field.
      void setValue​(java.nio.ByteBuffer value)
      Sets the value of the 'value' field.
      void setValueType​(MapperValueType value)
      Sets the value of the 'valueType' field.
      void writeExternal​(java.io.ObjectOutput out)  

      • Methods inherited from class org.apache.avro.specific.SpecificRecordBase

        compareTo, customDecode, customEncode, equals, get, getConversion, getConversion, hasCustomCoders, hashCode, put, toString

      • Methods inherited from class java.lang.Object

        clone, finalize, getClass, notify, notifyAll, wait, wait, wait

      • Methods inherited from interface org.apache.avro.generic.GenericRecord

        hasField

    • Field Detail

      • SCHEMA$

        public static final org.apache.avro.Schema SCHEMA$

      • valueType

        public MapperValueType valueType
        The value type of the message

      • value

        public java.nio.ByteBuffer value
        The raw value bytes

      • offset

        public long offset
        The offset of the record in the original Kafka topic partition

      • schemaId

        public int schemaId
        The schema id of the original record

      • chunkedKeySuffix

        public java.nio.ByteBuffer chunkedKeySuffix
        Serialized chunked key suffix and this field is not null only when this value is a chunk of a large value

      • replicationMetadataVersionId

        public int replicationMetadataVersionId
        The A/A replication metadata schema version ID that will be used to deserialize replicationMetadataPayload.

      • replicationMetadataPayload

        public java.nio.ByteBuffer replicationMetadataPayload
        The serialized value of the replication metadata schema.

    • Constructor Detail

      • KafkaInputMapperValue

        public KafkaInputMapperValue()
        Default constructor. Note that this does not initialize fields to their default values from the schema. If that is desired then one should use newBuilder().

      • KafkaInputMapperValue

        public KafkaInputMapperValue​(MapperValueType valueType,
                             java.nio.ByteBuffer value,
                             java.lang.Long offset,
                             java.lang.Integer schemaId,
                             java.nio.ByteBuffer chunkedKeySuffix,
                             java.lang.Integer replicationMetadataVersionId,
                             java.nio.ByteBuffer replicationMetadataPayload)
        All-args constructor.
        Parameters:
        valueType - The value type of the message
        value - The raw value bytes
        offset - The offset of the record in the original Kafka topic partition
        schemaId - The schema id of the original record
        chunkedKeySuffix - Serialized chunked key suffix and this field is not null only when this value is a chunk of a large value
        replicationMetadataVersionId - The A/A replication metadata schema version ID that will be used to deserialize replicationMetadataPayload.
        replicationMetadataPayload - The serialized value of the replication metadata schema.

    • Method Detail

      • getClassSchema

        public static org.apache.avro.Schema getClassSchema()

      • getSpecificData

        public org.apache.avro.specific.SpecificData getSpecificData()
        Overrides:
        getSpecificData in class org.apache.avro.specific.SpecificRecordBase

      • getSchema

        public org.apache.avro.Schema getSchema()
        Specified by:
        getSchema in interface org.apache.avro.generic.GenericContainer
        Specified by:
        getSchema in class org.apache.avro.specific.SpecificRecordBase

      • get

        public java.lang.Object get​(int field$)
        Specified by:
        get in interface org.apache.avro.generic.IndexedRecord
        Specified by:
        get in class org.apache.avro.specific.SpecificRecordBase

      • put

        public void put​(int field$,
                java.lang.Object value$)
        Specified by:
        put in interface org.apache.avro.generic.IndexedRecord
        Specified by:
        put in class org.apache.avro.specific.SpecificRecordBase

      • getValueType

        public MapperValueType getValueType()
        Gets the value of the 'valueType' field.
        Returns:
        The value type of the message

      • setValueType

        public void setValueType​(MapperValueType value)
        Sets the value of the 'valueType' field. The value type of the message
        Parameters:
        value - the value to set.

      • getValue

        public java.nio.ByteBuffer getValue()
        Gets the value of the 'value' field.
        Returns:
        The raw value bytes

      • setValue

        public void setValue​(java.nio.ByteBuffer value)
        Sets the value of the 'value' field. The raw value bytes
        Parameters:
        value - the value to set.

      • getOffset

        public long getOffset()
        Gets the value of the 'offset' field.
        Returns:
        The offset of the record in the original Kafka topic partition

      • setOffset

        public void setOffset​(long value)
        Sets the value of the 'offset' field. The offset of the record in the original Kafka topic partition
        Parameters:
        value - the value to set.

      • getSchemaId

        public int getSchemaId()
        Gets the value of the 'schemaId' field.
        Returns:
        The schema id of the original record

      • setSchemaId

        public void setSchemaId​(int value)
        Sets the value of the 'schemaId' field. The schema id of the original record
        Parameters:
        value - the value to set.

      • getChunkedKeySuffix

        public java.nio.ByteBuffer getChunkedKeySuffix()
        Gets the value of the 'chunkedKeySuffix' field.
        Returns:
        Serialized chunked key suffix and this field is not null only when this value is a chunk of a large value

      • setChunkedKeySuffix

        public void setChunkedKeySuffix​(java.nio.ByteBuffer value)
        Sets the value of the 'chunkedKeySuffix' field. Serialized chunked key suffix and this field is not null only when this value is a chunk of a large value
        Parameters:
        value - the value to set.

      • getReplicationMetadataVersionId

        public int getReplicationMetadataVersionId()
        Gets the value of the 'replicationMetadataVersionId' field.
        Returns:
        The A/A replication metadata schema version ID that will be used to deserialize replicationMetadataPayload.

      • setReplicationMetadataVersionId

        public void setReplicationMetadataVersionId​(int value)
        Sets the value of the 'replicationMetadataVersionId' field. The A/A replication metadata schema version ID that will be used to deserialize replicationMetadataPayload.
        Parameters:
        value - the value to set.

      • getReplicationMetadataPayload

        public java.nio.ByteBuffer getReplicationMetadataPayload()
        Gets the value of the 'replicationMetadataPayload' field.
        Returns:
        The serialized value of the replication metadata schema.

      • setReplicationMetadataPayload

        public void setReplicationMetadataPayload​(java.nio.ByteBuffer value)
        Sets the value of the 'replicationMetadataPayload' field. The serialized value of the replication metadata schema.
        Parameters:
        value - the value to set.

      • writeExternal

        public void writeExternal​(java.io.ObjectOutput out)
                   throws java.io.IOException
        Specified by:
        writeExternal in interface java.io.Externalizable
        Overrides:
        writeExternal in class org.apache.avro.specific.SpecificRecordBase
        Throws:
        java.io.IOException

      • readExternal

        public void readExternal​(java.io.ObjectInput in)
                  throws java.io.IOException
        Specified by:
        readExternal in interface java.io.Externalizable
        Overrides:
        readExternal in class org.apache.avro.specific.SpecificRecordBase
        Throws:
        java.io.IOException