Package com.linkedin.davinci.utils

Class ChunkAssembler

java.lang.Object

com.linkedin.davinci.utils.ChunkAssembler

public class ChunkAssembler
extends Object

Field Summary

Fields

Modifier and Type	Field	Description
protected final InMemoryStorageEngine	inMemoryStorageEngine
protected final String	storeName

Constructor Summary

Constructors

Constructor	Description
ChunkAssembler(String storeName)

Method Summary

Modifier and Type	Method	Description
ByteBuffer	bufferAndAssembleRecord(PubSubTopicPartition pubSubTopicPartition, int schemaId, byte[] keyBytes, ByteBuffer valueBytes, long recordOffset, int readerSchemaId, VeniceCompressor compressor)	Buffers and assembles chunks of a record.
<T> T	bufferAndAssembleRecord(PubSubTopicPartition pubSubTopicPartition, int schemaId, byte[] keyBytes, ByteBuffer valueBytes, long recordOffset, Lazy<RecordDeserializer<T>> recordDeserializer, int readerSchemaId, VeniceCompressor compressor)	Buffers and assembles chunks of a record.
void	clearInMemoryDB()
protected <T> T	decompressAndDeserialize(RecordDeserializer<T> deserializer, VeniceCompressor compressor, ByteBuffer value)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

storeName

protected final String storeName

inMemoryStorageEngine

protected final InMemoryStorageEngine inMemoryStorageEngine

Constructor Details

ChunkAssembler

public ChunkAssembler(String storeName)

Method Details

bufferAndAssembleRecord

public <T> T bufferAndAssembleRecord(PubSubTopicPartition pubSubTopicPartition,
 int schemaId,
 byte[] keyBytes,
 ByteBuffer valueBytes,
 long recordOffset,
 Lazy<RecordDeserializer<T>> recordDeserializer,
 int readerSchemaId,
 VeniceCompressor compressor)

Buffers and assembles chunks of a record. If the record is chunked, it stores the chunks and returns null. Once all chunks of a record are received, it assembles, decompresses, and deserializes the record.

bufferAndAssembleRecord

public ByteBuffer bufferAndAssembleRecord(PubSubTopicPartition pubSubTopicPartition,
 int schemaId,
 byte[] keyBytes,
 ByteBuffer valueBytes,
 long recordOffset,
 int readerSchemaId,
 VeniceCompressor compressor)

Buffers and assembles chunks of a record. If the record is chunked, it stores the chunks and returns null. Once all chunks of a record are received, it returns the compressed and serialized assembled record.

decompressAndDeserialize

protected <T> T decompressAndDeserialize(RecordDeserializer<T> deserializer,
 VeniceCompressor compressor,
 ByteBuffer value)
                                  throws IOException

Throws:

IOException

clearInMemoryDB

public void clearInMemoryDB()