Package com.linkedin.venice.hadoop.task.datawriter

Class AbstractDataWriterTask

java.lang.Object
com.linkedin.venice.hadoop.task.datawriter.AbstractDataWriterTask
Direct Known Subclasses:
AbstractInputRecordProcessor, AbstractPartitionWriter, KafkaInputFormatCombiner, ValidateSchemaAndBuildDictMapper
public abstract class AbstractDataWriterTask extends Object
Class for commonalities between AbstractInputRecordProcessor, AbstractPartitionWriter, KafkaInputFormatCombiner and ValidateSchemaAndBuildDictMapper.

  • Field Details

  • Constructor Details

    • AbstractDataWriterTask

      public AbstractDataWriterTask()

  • Method Details

    • getPartitionCount

      protected int getPartitionCount()
      Returns:
      The number of partitions for the pubsub topic where data will be written.

    • getTaskId

      protected int getTaskId()
      Returns:
      The ID of the current task. This ID number is 0-based.

    • setChunkingEnabled

      protected void setChunkingEnabled(boolean isChunkingEnabled)

    • isChunkingEnabled

      protected boolean isChunkingEnabled()

    • isRmdChunkingEnabled

      protected boolean isRmdChunkingEnabled()

    • getEngineTaskConfigProvider

      protected EngineTaskConfigProvider getEngineTaskConfigProvider()

    • configureTask

      protected abstract void configureTask(VeniceProperties props)
      Allow implementations of this class to configure task-specific stuff.
      Parameters:
      props - the job props that the task was configured with.

    • configure

      protected final void configure(EngineTaskConfigProvider engineTaskConfigProvider)
      Configures the task with the given EngineTaskConfigProvider.
      Parameters:
      engineTaskConfigProvider -