Package com.linkedin.davinci.ingestion

Interface IngestionBackend

All Superinterfaces:
AutoCloseable, Closeable
All Known Implementing Classes:
DefaultIngestionBackend, IsolatedIngestionBackend
public interface IngestionBackend extends Closeable

  • Method Details

    • startConsumption

      void startConsumption(VeniceStoreVersionConfig storeConfig, int partition, Optional<PubSubPosition> pubSubPosition)

    • stopConsumption

      CompletableFuture<Void> stopConsumption(VeniceStoreVersionConfig storeConfig, int partition)

    • killConsumptionTask

      void killConsumptionTask(String topicName)

    • shutdownIngestionTask

      void shutdownIngestionTask(String topicName)

    • addIngestionNotifier

      void addIngestionNotifier(VeniceNotifier ingestionListener)

    • dropStoragePartitionGracefully

      default CompletableFuture<Void> dropStoragePartitionGracefully(VeniceStoreVersionConfig storeConfig, int partition, int timeoutInSeconds)
      This method stops to subscribe the specified topic partition and delete partition data from storage and it will always drop empty storage engine.
      Parameters:
      storeConfig - Store version config
      partition - Partition number to be dropped in the store version.
      timeoutInSeconds - Number of seconds to wait before timeout.
      Returns:
      a future for the drop partition action.

    • dropStoragePartitionGracefully

      CompletableFuture<Void> dropStoragePartitionGracefully(VeniceStoreVersionConfig storeConfig, int partition, int timeoutInSeconds, boolean removeEmptyStorageEngine)
      This method stops to subscribe the specified topic partition and delete partition data from storage.
      Parameters:
      storeConfig - Store version config
      partition - Partition number to be dropped in the store version.
      timeoutInSeconds - Number of seconds to wait before timeout.
      removeEmptyStorageEngine - Whether to drop storage engine when dropping the last partition.
      Returns:
      a future for the drop partition action.

    • getStoreIngestionService

      KafkaStoreIngestionService getStoreIngestionService()

    • removeStorageEngine

      void removeStorageEngine(String topicName)

    • setStorageEngineReference

      void setStorageEngineReference(String topicName, AtomicReference<StorageEngine> storageEngineReference)

    • hasCurrentVersionBootstrapping

      boolean hasCurrentVersionBootstrapping()
      Check whether there are any current version bootstrapping or not.