Package com.linkedin.venice.compression

Class VeniceCompressor

java.lang.Object

com.linkedin.venice.compression.VeniceCompressor

All Implemented Interfaces:

Closeable, AutoCloseable

Direct Known Subclasses:

GzipCompressor, NoopCompressor, ZstdWithDictCompressor

public abstract class VeniceCompressor
extends Object
implements Closeable

Field Summary

Fields

Modifier and Type	Field	Description
protected static final int	SCHEMA_HEADER_LENGTH

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	VeniceCompressor(CompressionStrategy compressionStrategy)

Method Summary

Modifier and Type	Method	Description
void	close()
protected abstract void	closeInternal()
byte[]	compress(byte[] data)
ByteBuffer	compress(ByteBuffer src, int startPositionOfOutput)
protected abstract byte[]	compressInternal(byte[] data)
protected abstract ByteBuffer	compressInternal(ByteBuffer src, int startPositionOfOutput)
ByteBuffer	decompress(byte[] data, int offset, int length)
InputStream	decompress(InputStream inputStream)
ByteBuffer	decompress(ByteBuffer data)
ByteBuffer	decompressAndPrependSchemaHeader(byte[] data, int offset, int length, int schemaHeader)	This method tries to decompress data and maybe prepend the schema header.
protected abstract ByteBuffer	decompressAndPrependSchemaHeaderInternal(byte[] data, int offset, int length, int schemaHeader)
protected abstract ByteBuffer	decompressInternal(byte[] data, int offset, int length)
protected abstract InputStream	decompressInternal(InputStream inputStream)
protected abstract ByteBuffer	decompressInternal(ByteBuffer data)
CompressionStrategy	getCompressionStrategy()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

SCHEMA_HEADER_LENGTH

protected static final int SCHEMA_HEADER_LENGTH

See Also:

• Constant Field Values

Constructor Details

VeniceCompressor

protected VeniceCompressor(CompressionStrategy compressionStrategy)

Method Details

compress

public byte[] compress(byte[] data)
                throws IOException

Throws:

IOException

compressInternal

protected abstract byte[] compressInternal(byte[] data)
                                    throws IOException

Throws:

IOException

compress

public ByteBuffer compress(ByteBuffer src,
 int startPositionOfOutput)
                    throws IOException

Throws:

IOException

compressInternal

protected abstract ByteBuffer compressInternal(ByteBuffer src,
 int startPositionOfOutput)
                                        throws IOException

Throws:

IOException

decompress

public ByteBuffer decompress(ByteBuffer data)
                      throws IOException

Throws:

IOException

decompressInternal

protected abstract ByteBuffer decompressInternal(ByteBuffer data)
                                          throws IOException

Throws:

IOException

decompress

public ByteBuffer decompress(byte[] data,
 int offset,
 int length)
                      throws IOException

Throws:

IOException

decompressInternal

protected abstract ByteBuffer decompressInternal(byte[] data,
 int offset,
 int length)
                                          throws IOException

Throws:

IOException

decompressAndPrependSchemaHeader

public ByteBuffer decompressAndPrependSchemaHeader(byte[] data,
 int offset,
 int length,
 int schemaHeader)
                                            throws IOException

This method tries to decompress data and maybe prepend the schema header. The returned ByteBuffer will be backed by byte array that starts with schema header, followed by the decompressed data. The ByteBuffer will be positioned at the beginning of the decompressed data and the remaining of the ByteBuffer will be the length of the decompressed data.

Throws:

IOException

decompressAndPrependSchemaHeaderInternal

protected abstract ByteBuffer decompressAndPrependSchemaHeaderInternal(byte[] data,
 int offset,
 int length,
 int schemaHeader)
                                                                throws IOException

Throws:

IOException

getCompressionStrategy

public CompressionStrategy getCompressionStrategy()

decompress

public InputStream decompress(InputStream inputStream)
                       throws IOException

Throws:

IOException

decompressInternal

protected abstract InputStream decompressInternal(InputStream inputStream)
                                           throws IOException

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Throws:

IOException

closeInternal

protected abstract void closeInternal()
                               throws IOException

Throws:

IOException