Package com.linkedin.davinci.ingestion

Interface IngestionBackend

All Superinterfaces:

java.lang.AutoCloseable, java.io.Closeable

All Known Implementing Classes:

DefaultIngestionBackend, IsolatedIngestionBackend

public interface IngestionBackend
extends java.io.Closeable

Method Summary

Modifier and Type	Method	Description
void	addIngestionNotifier(VeniceNotifier ingestionListener)
default void	dropStoragePartitionGracefully(VeniceStoreVersionConfig storeConfig, int partition, int timeoutInSeconds)	This method stops to subscribe the specified topic partition and delete partition data from storage and it will always drop empty storage engine.
void	dropStoragePartitionGracefully(VeniceStoreVersionConfig storeConfig, int partition, int timeoutInSeconds, boolean removeEmptyStorageEngine)	This method stops to subscribe the specified topic partition and delete partition data from storage.
KafkaStoreIngestionService	getStoreIngestionService()
void	killConsumptionTask(java.lang.String topicName)
void	removeStorageEngine(java.lang.String topicName)
void	setStorageEngineReference(java.lang.String topicName, java.util.concurrent.atomic.AtomicReference<AbstractStorageEngine> storageEngineReference)
void	shutdownIngestionTask(java.lang.String topicName)
void	startConsumption(VeniceStoreVersionConfig storeConfig, int partition)
java.util.concurrent.CompletableFuture<java.lang.Void>	stopConsumption(VeniceStoreVersionConfig storeConfig, int partition)

Methods inherited from interface java.io.Closeable

close

Method Detail

startConsumption

void startConsumption(VeniceStoreVersionConfig storeConfig,
                      int partition)

stopConsumption

java.util.concurrent.CompletableFuture<java.lang.Void> stopConsumption(VeniceStoreVersionConfig storeConfig,
                                                                       int partition)

killConsumptionTask

void killConsumptionTask(java.lang.String topicName)

shutdownIngestionTask

void shutdownIngestionTask(java.lang.String topicName)

addIngestionNotifier

void addIngestionNotifier(VeniceNotifier ingestionListener)

dropStoragePartitionGracefully

default void dropStoragePartitionGracefully(VeniceStoreVersionConfig storeConfig,
                                            int partition,
                                            int timeoutInSeconds)

This method stops to subscribe the specified topic partition and delete partition data from storage and it will always drop empty storage engine.

Parameters:

storeConfig - Store version config

partition - Partition number to be dropped in the store version.

timeoutInSeconds - Number of seconds to wait before timeout.

dropStoragePartitionGracefully

void dropStoragePartitionGracefully(VeniceStoreVersionConfig storeConfig,
                                    int partition,
                                    int timeoutInSeconds,
                                    boolean removeEmptyStorageEngine)

This method stops to subscribe the specified topic partition and delete partition data from storage.

Parameters:

storeConfig - Store version config

partition - Partition number to be dropped in the store version.

timeoutInSeconds - Number of seconds to wait before timeout.

removeEmptyStorageEngine - Whether to drop storage engine when dropping the last partition.

getStoreIngestionService

KafkaStoreIngestionService getStoreIngestionService()

removeStorageEngine

void removeStorageEngine(java.lang.String topicName)

setStorageEngineReference

void setStorageEngineReference(java.lang.String topicName,
                               java.util.concurrent.atomic.AtomicReference<AbstractStorageEngine> storageEngineReference)