Package com.linkedin.venice.beam.consumer

Class VeniceChangelogConsumerIO.Read<K,V>

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<PubSubMessage<K,ChangeEvent<V>,VeniceChangeCoordinate>>>

com.linkedin.venice.beam.consumer.VeniceChangelogConsumerIO.Read<K,V>

All Implemented Interfaces:

Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

Enclosing class:

VeniceChangelogConsumerIO

public static class VeniceChangelogConsumerIO.Read<K,V>
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<PubSubMessage<K,ChangeEvent<V>,VeniceChangeCoordinate>>>

See Also:

• Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static enum	VeniceChangelogConsumerIO.Read.SeekWhence

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

annotations, displayData, name, resourceHints

Constructor Summary

Constructors

Constructor	Description
Read()
Read(VeniceChangelogConsumerIO.Read read)

Method Summary

Modifier and Type	Method	Description
org.apache.beam.sdk.values.PCollection<PubSubMessage<K,ChangeEvent<V>,VeniceChangeCoordinate>>	expand(org.apache.beam.sdk.values.PBegin input)
String	getConsumerIdSuffix()
LocalVeniceChangelogConsumerProvider	getLocalVeniceChangelogConsumerProvider()
Set<Integer>	getPartitions()
org.joda.time.Duration	getPollTimeout()
long	getSeekTimestamp()
VeniceChangelogConsumerIO.Read.SeekWhence	getSeekWhence()
String	getStore()
org.joda.time.Duration	getTerminationTimeout()
VeniceChangelogConsumerIO.Read<K,V>	setConsumerIdSuffix(String consumerIdSuffix)
VeniceChangelogConsumerIO.Read<K,V>	setLocalVeniceChangelogConsumerProvider(LocalVeniceChangelogConsumerProvider localVeniceChangelogConsumerProvider)
VeniceChangelogConsumerIO.Read<K,V>	setPartitions(Set<Integer> partitions)
VeniceChangelogConsumerIO.Read<K,V>	setPollTimeout(org.joda.time.Duration timeout)
VeniceChangelogConsumerIO.Read<K,V>	setSeekTimestamp(long seekTimestamp)
VeniceChangelogConsumerIO.Read<K,V>	setSeekWhence(VeniceChangelogConsumerIO.Read.SeekWhence seekWhence)
VeniceChangelogConsumerIO.Read<K,V>	setStore(String store)
VeniceChangelogConsumerIO.Read<K,V>	setTerminationTimeout(org.joda.time.Duration timeout)
VeniceChangelogConsumerIO.Read<K,V>.com.linkedin.venice.beam.consumer.VeniceChangelogConsumerIO.Read.CurrentValueTransform	withOnlyCurrentValue(org.apache.beam.sdk.coders.Coder returnTypeCoder)
VeniceChangelogConsumerIO.Read<K,V>.com.linkedin.venice.beam.consumer.VeniceChangelogConsumerIO.Read.RemoveMetadata	withoutMetadata()

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setDisplayData, setResourceHints, toString, validate, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Details

Read

public Read()

Read

public Read(VeniceChangelogConsumerIO.Read read)

Method Details

expand

public org.apache.beam.sdk.values.PCollection<PubSubMessage<K,ChangeEvent<V>,VeniceChangeCoordinate>> expand(org.apache.beam.sdk.values.PBegin input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<PubSubMessage<K,ChangeEvent<V>,VeniceChangeCoordinate>>>

getPollTimeout

public org.joda.time.Duration getPollTimeout()

setPollTimeout

public VeniceChangelogConsumerIO.Read<K,V> setPollTimeout(org.joda.time.Duration timeout)

getSeekWhence

public VeniceChangelogConsumerIO.Read.SeekWhence getSeekWhence()

setSeekWhence

public VeniceChangelogConsumerIO.Read<K,V> setSeekWhence(VeniceChangelogConsumerIO.Read.SeekWhence seekWhence)

getStore

public String getStore()

setStore

public VeniceChangelogConsumerIO.Read<K,V> setStore(String store)

getTerminationTimeout

public org.joda.time.Duration getTerminationTimeout()

setTerminationTimeout

public VeniceChangelogConsumerIO.Read<K,V> setTerminationTimeout(org.joda.time.Duration timeout)

getSeekTimestamp

public long getSeekTimestamp()

setSeekTimestamp

public VeniceChangelogConsumerIO.Read<K,V> setSeekTimestamp(long seekTimestamp)

getPartitions

public Set<Integer> getPartitions()

setPartitions

public VeniceChangelogConsumerIO.Read<K,V> setPartitions(Set<Integer> partitions)

getLocalVeniceChangelogConsumerProvider

public LocalVeniceChangelogConsumerProvider getLocalVeniceChangelogConsumerProvider()

setLocalVeniceChangelogConsumerProvider

public VeniceChangelogConsumerIO.Read<K,V> setLocalVeniceChangelogConsumerProvider(LocalVeniceChangelogConsumerProvider localVeniceChangelogConsumerProvider)

getConsumerIdSuffix

public String getConsumerIdSuffix()

setConsumerIdSuffix

public VeniceChangelogConsumerIO.Read<K,V> setConsumerIdSuffix(String consumerIdSuffix)

withoutMetadata

public VeniceChangelogConsumerIO.Read<K,V>.com.linkedin.venice.beam.consumer.VeniceChangelogConsumerIO.Read.RemoveMetadata withoutMetadata()

withOnlyCurrentValue

public VeniceChangelogConsumerIO.Read<K,V>.com.linkedin.venice.beam.consumer.VeniceChangelogConsumerIO.Read.CurrentValueTransform withOnlyCurrentValue(org.apache.beam.sdk.coders.Coder returnTypeCoder)