Package com.linkedin.davinci.consumer

Class BootstrappingVeniceChangelogConsumerDaVinciRecordTransformerImpl<K,V>

java.lang.Object

com.linkedin.davinci.consumer.BootstrappingVeniceChangelogConsumerDaVinciRecordTransformerImpl<K,V>

All Implemented Interfaces:

BootstrappingVeniceChangelogConsumer<K,V>

@Experimental
public class BootstrappingVeniceChangelogConsumerDaVinciRecordTransformerImpl<K,V>
extends Object
implements BootstrappingVeniceChangelogConsumer<K,V>

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
class	BootstrappingVeniceChangelogConsumerDaVinciRecordTransformerImpl.DaVinciRecordTransformerBootstrappingChangelogConsumer

Constructor Summary

Constructors

Constructor	Description
BootstrappingVeniceChangelogConsumerDaVinciRecordTransformerImpl(ChangelogClientConfig changelogClientConfig)

Method Summary

Modifier and Type	Method	Description
DaVinciRecordTransformerConfig	getRecordTransformerConfig()
Collection<PubSubMessage<K,ChangeEvent<V>,VeniceChangeCoordinate>>	poll(long timeoutInMs)	polls for the next batch of change events.
CompletableFuture<Void>	start()
CompletableFuture<Void>	start(Set<Integer> partitions)	Start performs both a topic subscription and catch up.
void	stop()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

BootstrappingVeniceChangelogConsumerDaVinciRecordTransformerImpl

public BootstrappingVeniceChangelogConsumerDaVinciRecordTransformerImpl(ChangelogClientConfig changelogClientConfig)

Method Details

start

public CompletableFuture<Void> start(Set<Integer> partitions)

Description copied from interface: BootstrappingVeniceChangelogConsumer

Start performs both a topic subscription and catch up. The client will look at the latest offset in the server and sync bootstrap data up to that point in changes. Once that is done for all partitions, the future will complete. NOTE: This future may take some time to complete depending on how much data needs to be ingested in order to catch up with the time that this client started.

Specified by:

start in interface BootstrappingVeniceChangelogConsumer<K,V>

Parameters:

partitions - which partition id's to catch up with

Returns:

a future that completes once catch up is complete for all passed in partitions.

start

public CompletableFuture<Void> start()

Specified by:

start in interface BootstrappingVeniceChangelogConsumer<K,V>

stop

public void stop()
          throws Exception

Specified by:

stop in interface BootstrappingVeniceChangelogConsumer<K,V>

Throws:

Exception

poll

public Collection<PubSubMessage<K,ChangeEvent<V>,VeniceChangeCoordinate>> poll(long timeoutInMs)

Description copied from interface: BootstrappingVeniceChangelogConsumer

polls for the next batch of change events. The first records returned following calling 'start()' will be from the bootstrap state. Once this state is consumed, subsequent calls to poll will be based off of recent updates to the Venice store.

Specified by:

poll in interface BootstrappingVeniceChangelogConsumer<K,V>

Returns:

getRecordTransformerConfig

public DaVinciRecordTransformerConfig getRecordTransformerConfig()