Class AbstractDataWriterTask
- java.lang.Object
-
- com.linkedin.venice.hadoop.task.datawriter.AbstractDataWriterTask
-
- Direct Known Subclasses:
AbstractInputRecordProcessor
,AbstractPartitionWriter
,KafkaInputFormatCombiner
,ValidateSchemaAndBuildDictMapper
public abstract class AbstractDataWriterTask extends java.lang.Object
Class for commonalities betweenAbstractInputRecordProcessor
,AbstractPartitionWriter
,KafkaInputFormatCombiner
andValidateSchemaAndBuildDictMapper
.
-
-
Field Summary
Fields Modifier and Type Field Description protected static int
TASK_ID_NOT_SET
-
Constructor Summary
Constructors Constructor Description AbstractDataWriterTask()
-
Method Summary
All Methods Instance Methods Abstract Methods Concrete Methods Modifier and Type Method Description protected void
configure(EngineTaskConfigProvider engineTaskConfigProvider)
Configures the task with the givenEngineTaskConfigProvider
.protected abstract void
configureTask(VeniceProperties props)
Allow implementations of this class to configure task-specific stuff.protected EngineTaskConfigProvider
getEngineTaskConfigProvider()
protected int
getPartitionCount()
protected int
getTaskId()
protected boolean
isChunkingEnabled()
protected boolean
isRmdChunkingEnabled()
protected void
setChunkingEnabled(boolean isChunkingEnabled)
-
-
-
Field Detail
-
TASK_ID_NOT_SET
protected static final int TASK_ID_NOT_SET
- See Also:
- Constant Field Values
-
-
Method Detail
-
getPartitionCount
protected int getPartitionCount()
- Returns:
- The number of partitions for the pubsub topic where data will be written.
-
getTaskId
protected int getTaskId()
- Returns:
- The ID of the current task. This ID number is 0-based.
-
setChunkingEnabled
protected void setChunkingEnabled(boolean isChunkingEnabled)
-
isChunkingEnabled
protected boolean isChunkingEnabled()
-
isRmdChunkingEnabled
protected boolean isRmdChunkingEnabled()
-
getEngineTaskConfigProvider
protected EngineTaskConfigProvider getEngineTaskConfigProvider()
-
configureTask
protected abstract void configureTask(VeniceProperties props)
Allow implementations of this class to configure task-specific stuff.- Parameters:
props
- the job props that the task was configured with.
-
configure
protected final void configure(EngineTaskConfigProvider engineTaskConfigProvider)
Configures the task with the givenEngineTaskConfigProvider
.- Parameters:
engineTaskConfigProvider
-
-
-