Package com.linkedin.venice.hadoop.input.kafka.ttl

Class VeniceChunkedPayloadTTLFilter

java.lang.Object

com.linkedin.venice.hadoop.AbstractVeniceFilter<INPUT_VALUE>

com.linkedin.venice.hadoop.input.kafka.ttl.VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

com.linkedin.venice.hadoop.input.kafka.ttl.VeniceChunkedPayloadTTLFilter

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class VeniceChunkedPayloadTTLFilter
extends VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

This class is responsible to filter records based on the RMD information and the ttl config by taking chunked records ChunkAssembler.ValueBytesAndSchemaId.

Field Summary

Fields inherited from class com.linkedin.venice.hadoop.input.kafka.ttl.VeniceRmdTTLFilter

rmdSchemaMap, valueSchemaMap

Constructor Summary

Constructors

Constructor	Description
VeniceChunkedPayloadTTLFilter(VeniceProperties props)

Method Summary

Modifier and Type	Method	Description
protected java.nio.ByteBuffer	getRmdPayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)
protected int	getRmdProtocolId(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)
protected int	getSchemaId(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)
protected java.nio.ByteBuffer	getValuePayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)
protected void	updateRmdPayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId, java.nio.ByteBuffer payload)
protected void	updateValuePayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId, byte[] payload)

Methods inherited from class com.linkedin.venice.hadoop.input.kafka.ttl.VeniceRmdTTLFilter

checkAndMaybeFilterValue, close, skipRmdRecord

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

VeniceChunkedPayloadTTLFilter

public VeniceChunkedPayloadTTLFilter(VeniceProperties props)
                              throws java.io.IOException

Throws:

java.io.IOException

Method Detail

getSchemaId

protected int getSchemaId(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)

Specified by:

getSchemaId in class VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

getRmdProtocolId

protected int getRmdProtocolId(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)

Specified by:

getRmdProtocolId in class VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

getRmdPayload

protected java.nio.ByteBuffer getRmdPayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)

Specified by:

getRmdPayload in class VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

getValuePayload

protected java.nio.ByteBuffer getValuePayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId)

Specified by:

getValuePayload in class VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

updateRmdPayload

protected void updateRmdPayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId,
                                java.nio.ByteBuffer payload)

Specified by:

updateRmdPayload in class VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>

updateValuePayload

protected void updateValuePayload(ChunkAssembler.ValueBytesAndSchemaId valueBytesAndSchemaId,
                                  byte[] payload)

Specified by:

updateValuePayload in class VeniceRmdTTLFilter<ChunkAssembler.ValueBytesAndSchemaId>