Package com.linkedin.davinci.storage.chunking
package com.linkedin.davinci.storage.chunking
-
ClassDescriptionRead compute and write compute chunking adapterBatch get chunking adapterThis
InputStream
implementation allows us to pass a value made up of many chunks into the Avro decoder without stitching it up into a single big byte array.ChunkingAdapter<CHUNKS_CONTAINER,VALUE> This interface allows each code path which needs to interact with chunked values to optimize the way the re-assembly is handled so that the final form in which the is consumed is generated as efficiently as possible, via the use of a temporaryChunkingAdapter
.This class and the rest of this package encapsulate the complexity of assembling chunked values from the storage engine.GenericChunkingAdapter<V extends org.apache.avro.generic.GenericRecord>Read compute and write compute chunking adapterJust for the sake of casting the generic type toGenericRecord
...A ChunkingAdapter to be used when we want to read the value from storage engine as raw bytes.Single get chunking adapterSpecificRecordChunkingAdapter<V extends org.apache.avro.specific.SpecificRecord>