Package com.linkedin.venice.hadoop.output.avro

Class ValidateSchemaAndBuildDictMapperOutput

  • All Implemented Interfaces:
    java.io.Externalizable, java.io.Serializable, java.lang.Comparable<org.apache.avro.specific.SpecificRecord>, org.apache.avro.generic.GenericContainer, org.apache.avro.generic.GenericRecord, org.apache.avro.generic.IndexedRecord, org.apache.avro.specific.SpecificRecord
    public class ValidateSchemaAndBuildDictMapperOutput
extends org.apache.avro.specific.SpecificRecordBase
implements org.apache.avro.specific.SpecificRecord
    The data protocol between ValidateSchemaAndBuildDictMapper and VenicePushJob
    See Also:
    Serialized Form

    • Field Summary

      Fields 
      Modifier and Type Field Description
      long inputFileDataSize
      Total input Data size in all files
      static org.apache.avro.Schema SCHEMA$  
      java.nio.ByteBuffer zstdDictionary
      Zstd compression dictionary

    • Method Summary

      All Methods Static Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      java.lang.Object get​(int field$)  
      static org.apache.avro.Schema getClassSchema()  
      long getInputFileDataSize()
      Gets the value of the 'inputFileDataSize' field.
      org.apache.avro.Schema getSchema()  
      org.apache.avro.specific.SpecificData getSpecificData()  
      java.nio.ByteBuffer getZstdDictionary()
      Gets the value of the 'zstdDictionary' field.
      void put​(int field$, java.lang.Object value$)  
      void readExternal​(java.io.ObjectInput in)  
      void setInputFileDataSize​(long value)
      Sets the value of the 'inputFileDataSize' field.
      void setZstdDictionary​(java.nio.ByteBuffer value)
      Sets the value of the 'zstdDictionary' field.
      void writeExternal​(java.io.ObjectOutput out)  

      • Methods inherited from class org.apache.avro.specific.SpecificRecordBase

        compareTo, customDecode, customEncode, equals, get, getConversion, getConversion, hasCustomCoders, hashCode, put, toString

      • Methods inherited from class java.lang.Object

        clone, finalize, getClass, notify, notifyAll, wait, wait, wait

      • Methods inherited from interface org.apache.avro.generic.GenericRecord

        hasField

    • Field Detail

      • SCHEMA$

        public static final org.apache.avro.Schema SCHEMA$

      • inputFileDataSize

        public long inputFileDataSize
        Total input Data size in all files

      • zstdDictionary

        public java.nio.ByteBuffer zstdDictionary
        Zstd compression dictionary

    • Constructor Detail

      • ValidateSchemaAndBuildDictMapperOutput

        public ValidateSchemaAndBuildDictMapperOutput()
        Default constructor. Note that this does not initialize fields to their default values from the schema. If that is desired then one should use newBuilder().

      • ValidateSchemaAndBuildDictMapperOutput

        public ValidateSchemaAndBuildDictMapperOutput​(java.lang.Long inputFileDataSize,
                                              java.nio.ByteBuffer zstdDictionary)
        All-args constructor.
        Parameters:
        inputFileDataSize - Total input Data size in all files
        zstdDictionary - Zstd compression dictionary

    • Method Detail

      • getClassSchema

        public static org.apache.avro.Schema getClassSchema()

      • getSpecificData

        public org.apache.avro.specific.SpecificData getSpecificData()
        Overrides:
        getSpecificData in class org.apache.avro.specific.SpecificRecordBase

      • getSchema

        public org.apache.avro.Schema getSchema()
        Specified by:
        getSchema in interface org.apache.avro.generic.GenericContainer
        Specified by:
        getSchema in class org.apache.avro.specific.SpecificRecordBase

      • get

        public java.lang.Object get​(int field$)
        Specified by:
        get in interface org.apache.avro.generic.IndexedRecord
        Specified by:
        get in class org.apache.avro.specific.SpecificRecordBase

      • put

        public void put​(int field$,
                java.lang.Object value$)
        Specified by:
        put in interface org.apache.avro.generic.IndexedRecord
        Specified by:
        put in class org.apache.avro.specific.SpecificRecordBase

      • getInputFileDataSize

        public long getInputFileDataSize()
        Gets the value of the 'inputFileDataSize' field.
        Returns:
        Total input Data size in all files

      • setInputFileDataSize

        public void setInputFileDataSize​(long value)
        Sets the value of the 'inputFileDataSize' field. Total input Data size in all files
        Parameters:
        value - the value to set.

      • getZstdDictionary

        public java.nio.ByteBuffer getZstdDictionary()
        Gets the value of the 'zstdDictionary' field.
        Returns:
        Zstd compression dictionary

      • setZstdDictionary

        public void setZstdDictionary​(java.nio.ByteBuffer value)
        Sets the value of the 'zstdDictionary' field. Zstd compression dictionary
        Parameters:
        value - the value to set.

      • writeExternal

        public void writeExternal​(java.io.ObjectOutput out)
                   throws java.io.IOException
        Specified by:
        writeExternal in interface java.io.Externalizable
        Overrides:
        writeExternal in class org.apache.avro.specific.SpecificRecordBase
        Throws:
        java.io.IOException

      • readExternal

        public void readExternal​(java.io.ObjectInput in)
                  throws java.io.IOException
        Specified by:
        readExternal in interface java.io.Externalizable
        Overrides:
        readExternal in class org.apache.avro.specific.SpecificRecordBase
        Throws:
        java.io.IOException