Package com.linkedin.venice.hadoop.input.kafka.ttl

Class VeniceChunkedPayloadTTLFilter

java.lang.Object

com.linkedin.venice.hadoop.AbstractVeniceFilter<INPUT_VALUE>

com.linkedin.venice.hadoop.input.kafka.ttl.VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

com.linkedin.venice.hadoop.input.kafka.ttl.VeniceChunkedPayloadTTLFilter

All Implemented Interfaces:

Closeable, AutoCloseable

public class VeniceChunkedPayloadTTLFilter
extends VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

This class is responsible to filter records based on the RMD information and the ttl config by taking chunked records ChunkAssembler.ValueBytesAndSchemaId.

Field Summary

Fields inherited from class com.linkedin.venice.hadoop.input.kafka.ttl.VeniceRmdTTLFilter

rmdSchemaMap, valueSchemaMap

Constructor Summary

Constructors

Constructor	Description
VeniceChunkedPayloadTTLFilter(VeniceProperties props)

Method Summary

Modifier and Type	Method	Description
protected ByteBuffer	getRmdPayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)
protected int	getRmdProtocolId(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)
protected int	getSchemaId(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)
protected ByteBuffer	getValuePayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)
protected void	updateRmdPayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId, ByteBuffer payload)
protected void	updateValuePayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId, byte[] payload)

Methods inherited from class com.linkedin.venice.hadoop.input.kafka.ttl.VeniceRmdTTLFilter

checkAndMaybeFilterValue, close, skipRmdRecord

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

VeniceChunkedPayloadTTLFilter

public VeniceChunkedPayloadTTLFilter(VeniceProperties props)
                              throws IOException

Throws:

IOException

Method Details

getSchemaId

protected int getSchemaId(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)

Specified by:

getSchemaId in class VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

getRmdProtocolId

protected int getRmdProtocolId(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)

Specified by:

getRmdProtocolId in class VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

getRmdPayload

protected ByteBuffer getRmdPayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)

Specified by:

getRmdPayload in class VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

getValuePayload

protected ByteBuffer getValuePayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)

Specified by:

getValuePayload in class VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

updateRmdPayload

protected void updateRmdPayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId,
 ByteBuffer payload)

Specified by:

updateRmdPayload in class VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

updateValuePayload

protected void updateValuePayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId,
 byte[] payload)

Specified by:

updateValuePayload in class VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>