AbstractKafkaConsumerService |
|
AbstractStoreBufferService |
Abstract class capturing the responsibilities of drainers threads doing store ingestion.
|
ActiveActiveProducerCallback |
|
ActiveActiveStoreIngestionTask |
This class contains logic that SNs must perform if a store-version is running in Active/Active mode.
|
AggKafkaConsumerService |
|
AmplificationFactorAdapter |
This class hides and handles amplification factor concept for each user partition.
|
ConsumerAction |
|
ConsumerSubscriptionCleaner |
Encapsulates the logic for deciding if a given topic-partition should be unsubscribed and, in that case, executing
the unsubscription.
|
KafkaClusterBasedRecordThrottler |
This class is used to throttle records consumed per Kafka cluster
|
KafkaConsumerService |
KafkaConsumerService is used to manage a pool of consumption-related resources connected to a specific Kafka
cluster.
|
KafkaConsumerServiceDelegator |
This delegator impl is used to distribute different partition requests into different consumer service.
|
KafkaStoreIngestionService |
Assumes: One to One mapping between a Venice Store and Kafka Topic.
|
KeyLevelLocksManager |
A helper class to return the same lock for the same raw key bytes.
|
LeaderFollowerStoreIngestionTask |
This class contains the state transition work between leader and follower; both leader and follower
will keep track of information like which topic leader is consuming from and the corresponding offset
as well as the latest successfully consumed or produced offset in the version topic (VT).
|
LeaderProducedRecordContext |
This class holds all the necessary context information which is passed from
kafka consumer thread -> kafka producer callback thread -> drainer thread.
|
LeaderProducerCallback |
|
MemoryBoundBlockingQueue<T extends Measurable> |
This class is a generic implementation of a memory bound blocking queue.
|
MetadataRepoBasedTopicExistingCheckerImpl |
|
ParticipantStoreConsumptionTask |
|
PartitionConsumptionState |
This class is used to maintain internal state for consumption of each partition.
|
PartitionConsumptionState.TransientRecord |
This immutable class holds a association between a key and value and the source offset of the consumed message.
|
PartitionWiseKafkaConsumerService |
|
RemoteIngestionRepairService |
Singleton class meant to keep track of subscription failures for ingestion tasks where the ingestion
task needs to keep running despite cluster failures.
|
SeparatedStoreBufferService |
This store buffer services maintains two separate drainer queues for store ingestions.
|
StatusReportAdapter |
This class forwards status report requests to IngestionNotificationDispatcher at USER partition level.
|
StorageUtilizationManager |
This class has the following responsibilities:
1.
|
StoreBufferService |
This class is serving as a PubSubMessage buffer with an accompanying pool of drainer threads.
|
StoreIngestionTask |
A runnable Kafka Consumer consuming messages from all the partition assigned to current node for a Kafka Topic.
|
StoreIngestionTaskFactory |
|
StoreIngestionTaskFactory.Builder |
Builder class for StoreIngestionTaskFactory ; once the build() function is invoked,
no modification is allowed on any parameters.
|
StorePartitionDataReceiver |
|
StoreWriteComputeProcessor |
This class handles Write Compute operations related to a specific store.
|
TopicPartitionIngestionInfo |
|
TopicSwitchWrapper |
This class precomputes the conversion from Avro's CharSequence to String, and also hangs on to the
correct instance of PubSubTopic , so that the lookup need not be performed in many locations.
|
TopicWiseKafkaConsumerService |
|