Package com.linkedin.venice.spark.datawriter.compression

Class SparkCompressionReEncoder

java.lang.Object

com.linkedin.venice.spark.datawriter.compression.SparkCompressionReEncoder

All Implemented Interfaces:

Serializable

public class SparkCompressionReEncoder
extends Object
implements Serializable

Spark compression re-encoder for repush jobs.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
SparkCompressionReEncoder(CompressionStrategy sourceStrategy, CompressionStrategy destStrategy, byte[] sourceDict, byte[] destDict, org.apache.spark.sql.types.StructType schema, int valueColumnIndex, boolean compressionMetricCollectionEnabled, DataWriterAccumulators accumulators)

Method Summary

Modifier and Type	Method	Description
void	close()
org.apache.spark.sql.Row	reEncode(org.apache.spark.sql.Row row)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SparkCompressionReEncoder

public SparkCompressionReEncoder(CompressionStrategy sourceStrategy,
 CompressionStrategy destStrategy,
 byte[] sourceDict,
 byte[] destDict,
 org.apache.spark.sql.types.StructType schema,
 int valueColumnIndex,
 boolean compressionMetricCollectionEnabled,
 DataWriterAccumulators accumulators)

Method Details

reEncode

public org.apache.spark.sql.Row reEncode(org.apache.spark.sql.Row row)
                                  throws IOException

Throws:

IOException

close

public void close()