Package com.linkedin.venice.pulsar.sink

Class VenicePulsarSink

java.lang.Object

com.linkedin.venice.pulsar.sink.VenicePulsarSink

All Implemented Interfaces:

AutoCloseable, org.apache.pulsar.io.core.Sink<org.apache.pulsar.client.api.schema.GenericObject>

public class VenicePulsarSink
extends Object
implements org.apache.pulsar.io.core.Sink<org.apache.pulsar.client.api.schema.GenericObject>

A Pulsar Sink that sends messages to Venice. Please refer to Apache Pulsar's documentation for more information on Pulsar connectors: https://pulsar.apache.org/docs/2.10.x/io-use/ Available configuration parameters: see VeniceSinkConfig class.

Constructor Summary

Constructors

Constructor	Description
VenicePulsarSink()

Method Summary

Modifier and Type	Method	Description
void	close()
static Map<String,String>	getConfig(VenicePulsarSinkConfig veniceCfg, String systemName)
void	open(VenicePulsarSinkConfig config, VeniceSystemProducer startedProducer, org.apache.pulsar.io.core.SinkContext sinkContext)	to simplify unit testing
void	open(Map<String,Object> cfg, org.apache.pulsar.io.core.SinkContext sinkContext)
protected void	throttle()
void	write(org.apache.pulsar.functions.api.Record<org.apache.pulsar.client.api.schema.GenericObject> record)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

VenicePulsarSink

public VenicePulsarSink()

Method Details

open

public void open(Map<String,Object> cfg,
 org.apache.pulsar.io.core.SinkContext sinkContext)
          throws Exception

Specified by:

open in interface org.apache.pulsar.io.core.Sink<org.apache.pulsar.client.api.schema.GenericObject>

Throws:

Exception

open

public void open(VenicePulsarSinkConfig config,
 VeniceSystemProducer startedProducer,
 org.apache.pulsar.io.core.SinkContext sinkContext)
          throws Exception

to simplify unit testing

Throws:

Exception

write

public void write(org.apache.pulsar.functions.api.Record<org.apache.pulsar.client.api.schema.GenericObject> record)
           throws Exception

Specified by:

write in interface org.apache.pulsar.io.core.Sink<org.apache.pulsar.client.api.schema.GenericObject>

Throws:

Exception

throttle

protected void throttle()
                 throws InterruptedException

Throws:

InterruptedException

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Throws:

Exception

getConfig

public static Map<String,String> getConfig(VenicePulsarSinkConfig veniceCfg,
 String systemName)