Package com.linkedin.venice.pubsub.adapter.kafka.producer

Class ApacheKafkaProducerConfig

java.lang.Object
com.linkedin.venice.pubsub.adapter.kafka.producer.ApacheKafkaProducerConfig
public class ApacheKafkaProducerConfig extends Object
This class holds all properties used to construct ApacheKafkaProducerAdapter (This class could be refactored to hold consumer properties as well). Tune and adjust the configs in this class to control the behavior of Apache Kafka producer.

  • Field Details

    • KAFKA_CONFIG_PREFIX

      public static final String KAFKA_CONFIG_PREFIX
      Legacy Kafka configs are using only kafka prefix. But now we are using pubsub.kafka prefix for all Kafka configs.
      See Also:

    • PUBSUB_KAFKA_CLIENT_CONFIG_PREFIX

      public static final String PUBSUB_KAFKA_CLIENT_CONFIG_PREFIX
      See Also:

    • KAFKA_PRODUCER_CONFIG_PREFIXES

      public static final Set<String> KAFKA_PRODUCER_CONFIG_PREFIXES

    • KAFKA_BOOTSTRAP_SERVERS

      public static final String KAFKA_BOOTSTRAP_SERVERS
      See Also:

    • KAFKA_PRODUCER_RETRIES_CONFIG

      public static final String KAFKA_PRODUCER_RETRIES_CONFIG
      See Also:

    • KAFKA_LINGER_MS

      public static final String KAFKA_LINGER_MS
      See Also:

    • KAFKA_BUFFER_MEMORY

      public static final String KAFKA_BUFFER_MEMORY
      See Also:

    • KAFKA_CLIENT_ID

      public static final String KAFKA_CLIENT_ID
      See Also:

    • KAFKA_PRODUCER_DELIVERY_TIMEOUT_MS

      public static final String KAFKA_PRODUCER_DELIVERY_TIMEOUT_MS
      See Also:

    • KAFKA_PRODUCER_REQUEST_TIMEOUT_MS

      public static final String KAFKA_PRODUCER_REQUEST_TIMEOUT_MS
      See Also:

    • SSL_KAFKA_BOOTSTRAP_SERVERS

      public static final String SSL_KAFKA_BOOTSTRAP_SERVERS
      See Also:

    • KAFKA_POSITION_FACTORY_CLASS_NAME

      protected static final String KAFKA_POSITION_FACTORY_CLASS_NAME

    • SSL_TO_KAFKA_LEGACY

      @Deprecated public static final String SSL_TO_KAFKA_LEGACY
      Deprecated.
      Use KAFKA_OVER_SSL instead
      N.B. do not attempt to change spelling, "kakfa", without carefully replacing all instances in use and some of them may be external to this repo
      See Also:

    • KAFKA_OVER_SSL

      public static final String KAFKA_OVER_SSL
      See Also:

    • DEFAULT_KAFKA_BATCH_SIZE

      public static final String DEFAULT_KAFKA_BATCH_SIZE
      Default Kafka batch size and linger time for better producer performance during ingestion.
      See Also:

    • DEFAULT_KAFKA_LINGER_MS

      public static final String DEFAULT_KAFKA_LINGER_MS
      See Also:

  • Constructor Details

  • Method Details

    • getProducerProperties

      protected Properties getProducerProperties()

    • getBrokerAddress

      protected String getBrokerAddress()

    • getPubSubMessageSerializer

      public PubSubMessageSerializer getPubSubMessageSerializer()