Package com.linkedin.davinci.ingestion

Interface IngestionBackendBase

All Superinterfaces:

java.lang.AutoCloseable, java.io.Closeable

All Known Subinterfaces:

DaVinciIngestionBackend, VeniceIngestionBackend

All Known Implementing Classes:

DefaultIngestionBackend, IsolatedIngestionBackend

public interface IngestionBackendBase
extends java.io.Closeable

Method Summary

Modifier and Type	Method	Description
void	addIngestionNotifier(VeniceNotifier ingestionListener)
default void	dropStoragePartitionGracefully(VeniceStoreVersionConfig storeConfig, int partition, int timeoutInSeconds)	This method stops to subscribe the specified topic partition and delete partition data from storage and it will always drop empty storage engine.
void	dropStoragePartitionGracefully(VeniceStoreVersionConfig storeConfig, int partition, int timeoutInSeconds, boolean removeEmptyStorageEngine)	This method stops to subscribe the specified topic partition and delete partition data from storage.
java.util.Map<java.lang.String,java.util.Set<java.lang.Integer>>	getLoadedStoreUserPartitionsMapping()	Get currently loaded store partition mappings.
KafkaStoreIngestionService	getStoreIngestionService()
void	killConsumptionTask(java.lang.String topicName)
void	shutdownIngestionTask(java.lang.String topicName)
default void	startConsumption(VeniceStoreVersionConfig storeConfig, int partition)
void	startConsumption(VeniceStoreVersionConfig storeConfig, int partition, java.util.Optional<LeaderFollowerStateType> leaderState)
java.util.concurrent.CompletableFuture<java.lang.Void>	stopConsumption(VeniceStoreVersionConfig storeConfig, int partition)

Methods inherited from interface java.io.Closeable

close

Method Detail

startConsumption

default void startConsumption(VeniceStoreVersionConfig storeConfig,
                              int partition)

startConsumption

void startConsumption(VeniceStoreVersionConfig storeConfig,
                      int partition,
                      java.util.Optional<LeaderFollowerStateType> leaderState)

stopConsumption

java.util.concurrent.CompletableFuture<java.lang.Void> stopConsumption(VeniceStoreVersionConfig storeConfig,
                                                                       int partition)

killConsumptionTask

void killConsumptionTask(java.lang.String topicName)

shutdownIngestionTask

void shutdownIngestionTask(java.lang.String topicName)

addIngestionNotifier

void addIngestionNotifier(VeniceNotifier ingestionListener)

dropStoragePartitionGracefully

default void dropStoragePartitionGracefully(VeniceStoreVersionConfig storeConfig,
                                            int partition,
                                            int timeoutInSeconds)

This method stops to subscribe the specified topic partition and delete partition data from storage and it will always drop empty storage engine.

Parameters:

storeConfig - Store version config

partition - Partition number to be dropped in the store version.

timeoutInSeconds - Number of seconds to wait before timeout.

dropStoragePartitionGracefully

void dropStoragePartitionGracefully(VeniceStoreVersionConfig storeConfig,
                                    int partition,
                                    int timeoutInSeconds,
                                    boolean removeEmptyStorageEngine)

This method stops to subscribe the specified topic partition and delete partition data from storage.

Parameters:

storeConfig - Store version config

partition - Partition number to be dropped in the store version.

timeoutInSeconds - Number of seconds to wait before timeout.

removeEmptyStorageEngine - Whether to drop storage engine when dropping the last partition.

getStoreIngestionService

KafkaStoreIngestionService getStoreIngestionService()

getLoadedStoreUserPartitionsMapping

java.util.Map<java.lang.String,java.util.Set<java.lang.Integer>> getLoadedStoreUserPartitionsMapping()

Get currently loaded store partition mappings.