Package com.linkedin.davinci.kafka.consumer

Class KafkaClusterBasedRecordThrottler

java.lang.Object

com.linkedin.davinci.kafka.consumer.KafkaClusterBasedRecordThrottler

public class KafkaClusterBasedRecordThrottler
extends Object

This class is used to throttle records consumed per Kafka cluster

Field Summary

Fields

Modifier and Type	Field	Description
protected Map<String,Map<PubSubTopicPartition,List<PubSubMessage<KafkaKey,KafkaMessageEnvelope,Long>>>>	kafkaUrlToThrottledRecords

Constructor Summary

Constructors

Constructor	Description
KafkaClusterBasedRecordThrottler(Map<String,EventThrottler> kafkaUrlToRecordsThrottler)

Method Summary

Modifier and Type	Method	Description
Map<PubSubTopicPartition,List<PubSubMessage<KafkaKey,KafkaMessageEnvelope,Long>>>	poll(PubSubConsumerAdapter consumer, String kafkaUrl, long pollTimeoutMs)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

kafkaUrlToThrottledRecords

protected Map<String,Map<PubSubTopicPartition,List<PubSubMessage<KafkaKey,KafkaMessageEnvelope,Long>>>> kafkaUrlToThrottledRecords

Constructor Details

KafkaClusterBasedRecordThrottler

public KafkaClusterBasedRecordThrottler(Map<String,EventThrottler> kafkaUrlToRecordsThrottler)

Method Details

poll

public Map<PubSubTopicPartition,List<PubSubMessage<KafkaKey,KafkaMessageEnvelope,Long>>> poll(PubSubConsumerAdapter consumer,
 String kafkaUrl,
 long pollTimeoutMs)