Package com.linkedin.venice.helix

Class HelixReadWriteSchemaRepositoryAdapter

java.lang.Object

com.linkedin.venice.helix.HelixReadWriteSchemaRepositoryAdapter

All Implemented Interfaces:

ReadOnlySchemaRepository, ReadWriteSchemaRepository, VeniceResource

public class HelixReadWriteSchemaRepositoryAdapter
extends Object
implements ReadWriteSchemaRepository

This repository supports the following operations: 1. For the regular stores, read/write operations are supported as HelixReadWriteSchemaRepository. 2. For system stores, only read operations are supported via HelixReadOnlyZKSharedSchemaRepository, and if you want to update the schemas for system stores, you will need to update the corresponding zk shared store instead.

Constructor Summary

Constructors

Constructor	Description
HelixReadWriteSchemaRepositoryAdapter(HelixReadOnlyZKSharedSchemaRepository readOnlyZKSharedSchemaRepository, ReadWriteSchemaRepository readWriteRegularStoreSchemaRepository)

Method Summary

Modifier and Type	Method	Description
DerivedSchemaEntry	addDerivedSchema(String storeName, String schemaStr, int valueSchemaId)	Add a new derived schema for the given store and value schema id
DerivedSchemaEntry	addDerivedSchema(String storeName, String schemaStr, int valueSchemaId, int derivedSchemaId)	Add a new derived schema for the given store by specifying derived schema id.
RmdSchemaEntry	addReplicationMetadataSchema(String storeName, int valueSchemaId, String replicationMetadataSchemaStr, int replicationMetadataVersionId)
SchemaEntry	addValueSchema(String storeName, String schemaStr, int schemaId)	Add a new value schema for the given store by specifying schema id.
SchemaEntry	addValueSchema(String storeName, String schemaStr, DirectionalSchemaCompatibilityType expectedCompatibilityType)	Add a new value schema for the given store
void	clear()
DerivedSchemaEntry	getDerivedSchema(String storeName, int valueSchemaId, int derivedSchemaId)
GeneratedSchemaID	getDerivedSchemaId(String storeName, String derivedSchemaStr)	Look up derived schema id and its corresponding value schema id by given store name and derived schema.
Collection<DerivedSchemaEntry>	getDerivedSchemas(String storeName)
SchemaEntry	getKeySchema(String storeName)	Get key schema for the given store.
DerivedSchemaEntry	getLatestDerivedSchema(String storeName, int valueSchemaId)	Get the most recent derived schema added to the given store and value schema id
ReadWriteSchemaRepository	getReadWriteRegularStoreSchemaRepository()
RmdSchemaEntry	getReplicationMetadataSchema(String storeName, int valueSchemaId, int replicationMetadataVersionId)
Collection<RmdSchemaEntry>	getReplicationMetadataSchemas(String storeName)
SchemaEntry	getSupersetOrLatestValueSchema(String storeName)	Get the most recent value schema or superset value schema if one exists.
SchemaEntry	getSupersetSchema(String storeName)	Get the superset value schema for a given store.
SchemaEntry	getValueSchema(String storeName, int id)	Get value schema for the given store and value schema id.
int	getValueSchemaId(String storeName, String valueSchemaStr)	Return the schema ID of any schema that has the same parsing canonical form as the schema provided.
Collection<SchemaEntry>	getValueSchemas(String storeName)	Get all the value schemas for the given store.
boolean	hasValueSchema(String storeName, int id)	Check whether the specified schema id is valid or not
SchemaEntry	initKeySchema(String storeName, String schemaStr)	Set up key schema for the given store
int	preCheckDerivedSchemaAndGetNextAvailableId(String storeName, int valueSchemaId, String derivedSchemaStr)
int	preCheckValueSchemaAndGetNextAvailableId(String storeName, String valueSchemaStr, DirectionalSchemaCompatibilityType expectedCompatibilityType)
void	refresh()
DerivedSchemaEntry	removeDerivedSchema(String storeName, int valueSchemaId, int derivedSchemaId)	Remove an existing derived schema
void	removeValueSchema(String storeName, int schemaID)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.linkedin.venice.meta.ReadOnlySchemaRepository

getLatestDerivedSchema

Methods inherited from interface com.linkedin.venice.meta.ReadWriteSchemaRepository

addValueSchema

Constructor Details

HelixReadWriteSchemaRepositoryAdapter

public HelixReadWriteSchemaRepositoryAdapter(HelixReadOnlyZKSharedSchemaRepository readOnlyZKSharedSchemaRepository,
 ReadWriteSchemaRepository readWriteRegularStoreSchemaRepository)

Method Details

initKeySchema

public SchemaEntry initKeySchema(String storeName,
 String schemaStr)

Description copied from interface: ReadWriteSchemaRepository

Set up key schema for the given store

Specified by:

initKeySchema in interface ReadWriteSchemaRepository

addValueSchema

public SchemaEntry addValueSchema(String storeName,
 String schemaStr,
 DirectionalSchemaCompatibilityType expectedCompatibilityType)

Description copied from interface: ReadWriteSchemaRepository

Add a new value schema for the given store

Specified by:

addValueSchema in interface ReadWriteSchemaRepository

addValueSchema

public SchemaEntry addValueSchema(String storeName,
 String schemaStr,
 int schemaId)

Description copied from interface: ReadWriteSchemaRepository

Add a new value schema for the given store by specifying schema id. This API is mostly intended to be used in cross-colo mode. When there are multiple colos, we'd like to have consistent value id across colos, so that deserializer can work properly while reading records. Caller should figure out the schema id number by themselves. TODO: Might want to remove it from the interface and make it invisible from the outside

Specified by:

addValueSchema in interface ReadWriteSchemaRepository

addDerivedSchema

public DerivedSchemaEntry addDerivedSchema(String storeName,
 String schemaStr,
 int valueSchemaId)

Description copied from interface: ReadWriteSchemaRepository

Add a new derived schema for the given store and value schema id

Specified by:

addDerivedSchema in interface ReadWriteSchemaRepository

addDerivedSchema

public DerivedSchemaEntry addDerivedSchema(String storeName,
 String schemaStr,
 int valueSchemaId,
 int derivedSchemaId)

Description copied from interface: ReadWriteSchemaRepository

Add a new derived schema for the given store by specifying derived schema id. Mostly used in cross-colo mode.

Specified by:

addDerivedSchema in interface ReadWriteSchemaRepository

removeDerivedSchema

public DerivedSchemaEntry removeDerivedSchema(String storeName,
 int valueSchemaId,
 int derivedSchemaId)

Description copied from interface: ReadWriteSchemaRepository

Remove an existing derived schema

Specified by:

removeDerivedSchema in interface ReadWriteSchemaRepository

Returns:

the derived schema that is deleted or null if the schema doesn't exist

preCheckValueSchemaAndGetNextAvailableId

public int preCheckValueSchemaAndGetNextAvailableId(String storeName,
 String valueSchemaStr,
 DirectionalSchemaCompatibilityType expectedCompatibilityType)

Specified by:

preCheckValueSchemaAndGetNextAvailableId in interface ReadWriteSchemaRepository

preCheckDerivedSchemaAndGetNextAvailableId

public int preCheckDerivedSchemaAndGetNextAvailableId(String storeName,
 int valueSchemaId,
 String derivedSchemaStr)

Specified by:

preCheckDerivedSchemaAndGetNextAvailableId in interface ReadWriteSchemaRepository

getKeySchema

public SchemaEntry getKeySchema(String storeName)

Description copied from interface: ReadOnlySchemaRepository

Get key schema for the given store.

Specified by:

getKeySchema in interface ReadOnlySchemaRepository

getValueSchema

public SchemaEntry getValueSchema(String storeName,
 int id)

Description copied from interface: ReadOnlySchemaRepository

Get value schema for the given store and value schema id.

Specified by:

getValueSchema in interface ReadOnlySchemaRepository

hasValueSchema

public boolean hasValueSchema(String storeName,
 int id)

Description copied from interface: ReadOnlySchemaRepository

Check whether the specified schema id is valid or not

Specified by:

hasValueSchema in interface ReadOnlySchemaRepository

getValueSchemaId

public int getValueSchemaId(String storeName,
 String valueSchemaStr)

Description copied from interface: ReadOnlySchemaRepository

Return the schema ID of any schema that has the same parsing canonical form as the schema provided. If multiple schemas have the same parsing canonical form, return the one with the largest ID.

Specified by:

getValueSchemaId in interface ReadOnlySchemaRepository

getValueSchemas

public Collection<SchemaEntry> getValueSchemas(String storeName)

Description copied from interface: ReadOnlySchemaRepository

Get all the value schemas for the given store.

Specified by:

getValueSchemas in interface ReadOnlySchemaRepository

removeValueSchema

public void removeValueSchema(String storeName,
 int schemaID)

Specified by:

removeValueSchema in interface ReadWriteSchemaRepository

getSupersetOrLatestValueSchema

public SchemaEntry getSupersetOrLatestValueSchema(String storeName)

Description copied from interface: ReadOnlySchemaRepository

Get the most recent value schema or superset value schema if one exists.

Specified by:

getSupersetOrLatestValueSchema in interface ReadOnlySchemaRepository

getSupersetSchema

public SchemaEntry getSupersetSchema(String storeName)

Description copied from interface: ReadOnlySchemaRepository

Get the superset value schema for a given store. Each store has at most one active superset schema. Specifically a store must have some features enabled (e.g. read compute, write compute) to have a superset value schema which evolves as new value schemas are added.

Specified by:

getSupersetSchema in interface ReadOnlySchemaRepository

Returns:

Superset value schema or null if store does not have any superset value schema.

getDerivedSchemaId

public GeneratedSchemaID getDerivedSchemaId(String storeName,
 String derivedSchemaStr)

Description copied from interface: ReadOnlySchemaRepository

Look up derived schema id and its corresponding value schema id by given store name and derived schema. This is likely used by clients that write to Venice

Specified by:

getDerivedSchemaId in interface ReadOnlySchemaRepository

Returns:

a pair where the first value is value schema id and the second value is derived schema id

getDerivedSchema

public DerivedSchemaEntry getDerivedSchema(String storeName,
 int valueSchemaId,
 int derivedSchemaId)

Specified by:

getDerivedSchema in interface ReadOnlySchemaRepository

getDerivedSchemas

public Collection<DerivedSchemaEntry> getDerivedSchemas(String storeName)

Specified by:

getDerivedSchemas in interface ReadOnlySchemaRepository

getLatestDerivedSchema

public DerivedSchemaEntry getLatestDerivedSchema(String storeName,
 int valueSchemaId)

Description copied from interface: ReadOnlySchemaRepository

Get the most recent derived schema added to the given store and value schema id

Specified by:

getLatestDerivedSchema in interface ReadOnlySchemaRepository

addReplicationMetadataSchema

public RmdSchemaEntry addReplicationMetadataSchema(String storeName,
 int valueSchemaId,
 String replicationMetadataSchemaStr,
 int replicationMetadataVersionId)

Specified by:

addReplicationMetadataSchema in interface ReadWriteSchemaRepository

getReplicationMetadataSchema

public RmdSchemaEntry getReplicationMetadataSchema(String storeName,
 int valueSchemaId,
 int replicationMetadataVersionId)

Specified by:

getReplicationMetadataSchema in interface ReadOnlySchemaRepository

getReplicationMetadataSchemas

public Collection<RmdSchemaEntry> getReplicationMetadataSchemas(String storeName)

Specified by:

getReplicationMetadataSchemas in interface ReadOnlySchemaRepository

refresh

public void refresh()

Specified by:

refresh in interface VeniceResource

clear

public void clear()

Specified by:

clear in interface VeniceResource

getReadWriteRegularStoreSchemaRepository

public ReadWriteSchemaRepository getReadWriteRegularStoreSchemaRepository()