Class VeniceKafkaInputTTLFilter
- java.lang.Object
-
- com.linkedin.venice.hadoop.AbstractVeniceFilter<INPUT_VALUE>
-
- com.linkedin.venice.hadoop.input.kafka.ttl.VeniceRmdTTLFilter<KafkaInputMapperValue>
-
- com.linkedin.venice.hadoop.input.kafka.ttl.VeniceKafkaInputTTLFilter
-
- All Implemented Interfaces:
java.io.Closeable
,java.lang.AutoCloseable
public class VeniceKafkaInputTTLFilter extends VeniceRmdTTLFilter<KafkaInputMapperValue>
This class is responsible to filter records based on the RMD information and the ttl config by taking KIF inputKafkaInputMapperValue
.
-
-
Field Summary
-
Fields inherited from class com.linkedin.venice.hadoop.input.kafka.ttl.VeniceRmdTTLFilter
rmdSchemaMap, valueSchemaMap
-
-
Constructor Summary
Constructors Constructor Description VeniceKafkaInputTTLFilter(VeniceProperties props)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description protected java.nio.ByteBuffer
getRmdPayload(KafkaInputMapperValue kafkaInputMapperValue)
protected int
getRmdProtocolId(KafkaInputMapperValue kafkaInputMapperValue)
protected int
getSchemaId(KafkaInputMapperValue kafkaInputMapperValue)
protected java.nio.ByteBuffer
getValuePayload(KafkaInputMapperValue kafkaInputMapperValue)
protected boolean
skipRmdRecord(KafkaInputMapperValue input)
When schemeId is negative, it indicates a chunked record.protected void
updateRmdPayload(KafkaInputMapperValue kafkaInputMapperValue, java.nio.ByteBuffer payload)
protected void
updateValuePayload(KafkaInputMapperValue kafkaInputMapperValue, byte[] payload)
-
Methods inherited from class com.linkedin.venice.hadoop.input.kafka.ttl.VeniceRmdTTLFilter
checkAndMaybeFilterValue, close
-
-
-
-
Constructor Detail
-
VeniceKafkaInputTTLFilter
public VeniceKafkaInputTTLFilter(VeniceProperties props) throws java.io.IOException
- Throws:
java.io.IOException
-
-
Method Detail
-
getSchemaId
protected int getSchemaId(KafkaInputMapperValue kafkaInputMapperValue)
- Specified by:
getSchemaId
in classVeniceRmdTTLFilter<KafkaInputMapperValue>
-
getRmdProtocolId
protected int getRmdProtocolId(KafkaInputMapperValue kafkaInputMapperValue)
- Specified by:
getRmdProtocolId
in classVeniceRmdTTLFilter<KafkaInputMapperValue>
-
getRmdPayload
protected java.nio.ByteBuffer getRmdPayload(KafkaInputMapperValue kafkaInputMapperValue)
- Specified by:
getRmdPayload
in classVeniceRmdTTLFilter<KafkaInputMapperValue>
-
getValuePayload
protected java.nio.ByteBuffer getValuePayload(KafkaInputMapperValue kafkaInputMapperValue)
- Specified by:
getValuePayload
in classVeniceRmdTTLFilter<KafkaInputMapperValue>
-
updateRmdPayload
protected void updateRmdPayload(KafkaInputMapperValue kafkaInputMapperValue, java.nio.ByteBuffer payload)
- Specified by:
updateRmdPayload
in classVeniceRmdTTLFilter<KafkaInputMapperValue>
-
updateValuePayload
protected void updateValuePayload(KafkaInputMapperValue kafkaInputMapperValue, byte[] payload)
- Specified by:
updateValuePayload
in classVeniceRmdTTLFilter<KafkaInputMapperValue>
-
skipRmdRecord
protected boolean skipRmdRecord(KafkaInputMapperValue input)
When schemeId is negative, it indicates a chunked record. Skip it and pass it to Reducer as chunk will only be re-assembled at Reducer.- Overrides:
skipRmdRecord
in classVeniceRmdTTLFilter<KafkaInputMapperValue>
- Parameters:
input
-- Returns:
-
-