| AbstractKafkaConsumerService |
|
| AbstractStoreBufferService |
Abstract class capturing the responsibilities of drainers threads doing store ingestion.
|
| ActiveActiveProducerCallback |
|
| ActiveActiveStoreIngestionTask |
This class contains logic that SNs must perform if a store-version is running in Active/Active mode.
|
| AggKafkaConsumerService |
|
| ConsumerAction |
|
| ConsumerSubscriptionCleaner |
Encapsulates the logic for deciding if a given topic-partition should be unsubscribed and, in that case, executing
the unsubscription.
|
| IngestionBatchProcessor |
This class is used to process the AA/WC messages in parallel to address the long-tail partition lagging issues.
|
| IngestionThrottler |
This throttler has the following functionality:
1.
|
| KafkaClusterBasedRecordThrottler |
This class is used to throttle records consumed per Kafka cluster
|
| KafkaConsumerService |
KafkaConsumerService is used to manage a pool of consumption-related resources connected to a specific Kafka
cluster. |
| KafkaConsumerServiceDelegator |
This delegator impl is used to distribute different partition requests into different consumer service.
|
| KafkaStoreIngestionService |
Assumes: One to One mapping between a Venice Store and Kafka Topic.
|
| KeyLevelLocksManager |
A helper class to return the same lock for the same raw key bytes.
|
| LeaderFollowerStoreIngestionTask |
This class contains the state transition work between leader and follower; both leader and follower
will keep track of information like which topic leader is consuming from and the corresponding offset
as well as the latest successfully consumed or produced offset in the version topic (VT).
|
| LeaderProducedRecordContext |
This class holds all the necessary context information which is passed from
kafka consumer thread -> kafka producer callback thread -> drainer thread.
|
| LeaderProducerCallback |
|
| MergeConflictResultWrapper |
This wrapper is used to keep the context after handling Active/Active messages.
|
| MetadataRepoBasedTopicExistingCheckerImpl |
|
| ParticipantStoreConsumptionTask |
|
| PartitionConsumptionState |
This class is used to maintain internal state for consumption of each partition.
|
| PartitionConsumptionState.TransientRecord |
This immutable class holds a association between a key and value and the source offset of the consumed message.
|
| PartitionReplicaIngestionContext |
This class is for wrapping the information about the role of the partition replica on that host to
AggKafkaConsumerService to achieve finer granularity of consumer assignment. |
| PartitionWiseKafkaConsumerService |
|
| PubSubMessageProcessedResult |
|
| PubSubMessageProcessedResultWrapper<K,V,OFFSET> |
|
| RegionNameUtil |
|
| RemoteIngestionRepairService |
Singleton class meant to keep track of subscription failures for ingestion tasks where the ingestion
task needs to keep running despite cluster failures.
|
| ReplicaHeartbeatInfo |
|
| SeparatedStoreBufferService |
This store buffer services maintains two separate drainer queues for store ingestions.
|
| StorageUtilizationManager |
This class has the following responsibilities:
1.
|
| StoreAwarePartitionWiseKafkaConsumerService |
|
| StoreBufferService |
This class is serving as a PubSubMessage buffer with an accompanying pool of drainer threads. |
| StoreIngestionTask |
A runnable Kafka Consumer consuming messages from all the partition assigned to current node for a Kafka Topic.
|
| StoreIngestionTaskFactory |
|
| StoreIngestionTaskFactory.Builder |
Builder class for StoreIngestionTaskFactory; once the build() function is invoked,
no modification is allowed on any parameters. |
| StorePartitionDataReceiver |
|
| StoreWriteComputeProcessor |
This class handles Write Compute operations related to a specific store.
|
| TopicPartitionForIngestion |
This class is a wrapper of pair of .
|
| TopicPartitionIngestionInfo |
|
| TopicSwitchWrapper |
This class precomputes the conversion from Avro's CharSequence to String, and also hangs on to the
correct instance of PubSubTopic, so that the lookup need not be performed in many locations. |
| TopicWiseKafkaConsumerService |
|
| WriteComputeResultWrapper |
This result wrapper is for non-Active-Active stores.
|