Class KafkaInputDictTrainer
java.lang.Object
com.linkedin.venice.hadoop.input.kafka.KafkaInputDictTrainer
Zstd dict trainer for Kafka Repush.
This class will try to read a few records from every partition as samples of dict trainer.
-
Nested Class Summary
Modifier and TypeClassDescriptionstatic class
static class
-
Constructor Summary
ModifierConstructorDescriptionprotected
KafkaInputDictTrainer
(KafkaInputFormat inputFormat, Optional<com.github.luben.zstd.ZstdDictTrainer> trainerSupplier, KafkaInputDictTrainer.Param param, com.linkedin.venice.hadoop.input.kafka.KafkaInputDictTrainer.CompressorBuilder compressorBuilder) -
Method Summary
-
Constructor Details
-
KafkaInputDictTrainer
-
KafkaInputDictTrainer
protected KafkaInputDictTrainer(KafkaInputFormat inputFormat, Optional<com.github.luben.zstd.ZstdDictTrainer> trainerSupplier, KafkaInputDictTrainer.Param param, com.linkedin.venice.hadoop.input.kafka.KafkaInputDictTrainer.CompressorBuilder compressorBuilder)
-
-
Method Details
-
trainDict
public byte[] trainDict()
-