Package com.linkedin.davinci.kafka.consumer

Class KafkaClusterBasedRecordThrottler

java.lang.Object

com.linkedin.davinci.kafka.consumer.KafkaClusterBasedRecordThrottler

public class KafkaClusterBasedRecordThrottler
extends java.lang.Object

This class is used to throttle records consumed per Kafka cluster

Field Summary

Fields

Modifier and Type	Field	Description
protected java.util.Map<java.lang.String,java.util.Map<PubSubTopicPartition,java.util.List<PubSubMessage<KafkaKey,KafkaMessageEnvelope,java.lang.Long>>>>	kafkaUrlToThrottledRecords

Constructor Summary

Constructors

Constructor	Description
KafkaClusterBasedRecordThrottler(java.util.Map<java.lang.String,EventThrottler> kafkaUrlToRecordsThrottler)

Method Summary

Modifier and Type	Method	Description
java.util.Map<PubSubTopicPartition,java.util.List<PubSubMessage<KafkaKey,KafkaMessageEnvelope,java.lang.Long>>>	poll(PubSubConsumerAdapter consumer, java.lang.String kafkaUrl, long pollTimeoutMs)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

kafkaUrlToThrottledRecords

protected java.util.Map<java.lang.String,java.util.Map<PubSubTopicPartition,java.util.List<PubSubMessage<KafkaKey,KafkaMessageEnvelope,java.lang.Long>>>> kafkaUrlToThrottledRecords

Constructor Detail

KafkaClusterBasedRecordThrottler

public KafkaClusterBasedRecordThrottler(java.util.Map<java.lang.String,EventThrottler> kafkaUrlToRecordsThrottler)

Method Detail

poll

public java.util.Map<PubSubTopicPartition,java.util.List<PubSubMessage<KafkaKey,KafkaMessageEnvelope,java.lang.Long>>> poll(PubSubConsumerAdapter consumer,
                                                                                                                                              java.lang.String kafkaUrl,
                                                                                                                                              long pollTimeoutMs)