Package com.linkedin.davinci

Class DaVinciBackend

java.lang.Object

com.linkedin.davinci.DaVinciBackend

All Implemented Interfaces:

Closeable, AutoCloseable

public class DaVinciBackend
extends Object
implements Closeable

Core backend service that powers all DaVinciClient client instances with shared infrastructure for storage, ingestion, and metadata management. This backend is designed as a shared resource managed through a ReferenceCounted pattern in AvroGenericDaVinciClient. Multiple DaVinci clients share the same ingestion services and metadata repositories for resource efficiency. DaVinciBackend tracks different client types (regular vs version-specific) to prevent collisions due to the shared behavior of this class. Regular clients participate in version swaps while version-specific clients subscribe to a fixed version and ignore version swap events.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static enum	DaVinciBackend.ClientType

Constructor Summary

Constructors

Constructor	Description
DaVinciBackend(ClientConfig clientConfig, VeniceConfigLoader configLoader, Optional<Set<String>> managedClients, ICProvider icProvider, Optional<ObjectCacheConfig> cacheConfig)

Method Summary

Modifier and Type	Method	Description
void	addStoreBackend(String storeName, StoreBackend storeBackend)
void	close()
protected void	deleteStore(String storeName)
StorageEngineBackedCompressorFactory	getCompressorFactory()
final IngestionBackend	getIngestionBackend()
InternalDaVinciRecordTransformerConfig	getInternalRecordTransformerConfig(String storeName)
ObjectCacheBackend	getObjectCache()
ReadOnlySchemaRepository	getSchemaRepository()
DaVinciBackend.ClientType	getStoreClientType(String storeName)
StoreBackend	getStoreOrThrow(String storeName)
SubscriptionBasedReadOnlyStoreRepository	getStoreRepository()
Integer	getVersionSpecificStoreVersion(String storeName)
protected void	handleStoreChanged(StoreBackend storeBackend)
boolean	hasCurrentVersionBootstrapping()
protected final boolean	isIsolatedIngestion()
void	registerRecordTransformerConfig(String storeName, DaVinciRecordTransformerConfig recordTransformerConfig)
void	registerStoreClient(String storeName, Integer storeVersion)	Registers a store client and enforces client type exclusivity per store.
protected void	reportPushStatus(String kafkaTopic, int partition, ExecutionStatus status)
protected void	reportPushStatus(String kafkaTopic, int partition, ExecutionStatus status, Optional<String> incrementalPushVersion)
void	setConfigLoader(VeniceConfigLoader configLoader)
void	setStorageService(StorageService storageService)
void	setStoreRepository(SubscriptionBasedReadOnlyStoreRepository storeRepository)
void	unregisterStoreClient(String storeName, Integer storeVersion)
void	verifyCacheConfigEquality(ObjectCacheConfig newObjectCacheConfig, String storeName)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

DaVinciBackend

public DaVinciBackend(ClientConfig clientConfig,
 VeniceConfigLoader configLoader,
 Optional<Set<String>> managedClients,
 ICProvider icProvider,
 Optional<ObjectCacheConfig> cacheConfig)

Method Details

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

getStoreOrThrow

public StoreBackend getStoreOrThrow(String storeName)

getStoreRepository

public SubscriptionBasedReadOnlyStoreRepository getStoreRepository()

getObjectCache

public ObjectCacheBackend getObjectCache()

getSchemaRepository

public ReadOnlySchemaRepository getSchemaRepository()

getIngestionBackend

public final IngestionBackend getIngestionBackend()

verifyCacheConfigEquality

public void verifyCacheConfigEquality(@Nullable
 ObjectCacheConfig newObjectCacheConfig,
 String storeName)

getCompressorFactory

public StorageEngineBackedCompressorFactory getCompressorFactory()

reportPushStatus

protected void reportPushStatus(String kafkaTopic,
 int partition,
 ExecutionStatus status)

reportPushStatus

protected void reportPushStatus(String kafkaTopic,
 int partition,
 ExecutionStatus status,
 Optional<String> incrementalPushVersion)

deleteStore

protected void deleteStore(String storeName)

isIsolatedIngestion

protected final boolean isIsolatedIngestion()

handleStoreChanged

protected void handleStoreChanged(StoreBackend storeBackend)

registerStoreClient

public void registerStoreClient(String storeName,
 Integer storeVersion)

Registers a store client and enforces client type exclusivity per store. Prevents mixing regular and version-specific clients for the same store.

Parameters:

storeName - the name of the store to register a client for

storeVersion - the target version for version-specific clients, or null for regular clients

Throws:

VeniceClientException - if there is a client type conflict or multiple version-specific clients target different versions of the same store

unregisterStoreClient

public void unregisterStoreClient(String storeName,
 Integer storeVersion)

getStoreClientType

public DaVinciBackend.ClientType getStoreClientType(String storeName)

getVersionSpecificStoreVersion

public Integer getVersionSpecificStoreVersion(String storeName)

setStoreRepository

public void setStoreRepository(SubscriptionBasedReadOnlyStoreRepository storeRepository)

setStorageService

public void setStorageService(StorageService storageService)

setConfigLoader

public void setConfigLoader(VeniceConfigLoader configLoader)

addStoreBackend

public void addStoreBackend(String storeName,
 StoreBackend storeBackend)

hasCurrentVersionBootstrapping

public boolean hasCurrentVersionBootstrapping()

registerRecordTransformerConfig

public void registerRecordTransformerConfig(String storeName,
 DaVinciRecordTransformerConfig recordTransformerConfig)

getInternalRecordTransformerConfig

public InternalDaVinciRecordTransformerConfig getInternalRecordTransformerConfig(String storeName)