Package com.linkedin.davinci.stats.ingestion.heartbeat

Class HeartbeatMonitoringService

java.lang.Object

com.linkedin.venice.service.AbstractVeniceService

com.linkedin.davinci.stats.ingestion.heartbeat.HeartbeatMonitoringService

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class HeartbeatMonitoringService
extends AbstractVeniceService

This service monitors heartbeats. Heartbeats are only monitored if lagMonitors are added for leader or follower partitions. Once a lagMonitor is added, the service will being emitting a metric which grows linearly with time, only resetting to the timestamp of the last reported heartbeat for a given partition. Heartbeats are only monitored for stores which have a hybrid config. All other registrations for lag monitoring are ignored. Max and Average are reported per version of resource across partitions. If a heartbeat is invoked for a partition that we're NOT monitoring lag for, it is ignored. This class will monitor lag for a partition as a leader or follower, but never both. Whether we're reporting leader or follower depends on which monitor was set last. Lag will stop being reported for partitions which have the monitor removed. Each region gets a different lag monitor

Nested Class Summary

Nested classes/interfaces inherited from class com.linkedin.venice.service.AbstractVeniceService

AbstractVeniceService.ServiceState

Field Summary

Fields

Modifier and Type	Field	Description
static int	DEFAULT_REPORTER_THREAD_SLEEP_INTERVAL_SECONDS

Fields inherited from class com.linkedin.venice.service.AbstractVeniceService

logger, serviceState

Constructor Summary

Constructors

Constructor	Description
HeartbeatMonitoringService(io.tehuti.metrics.MetricsRepository metricsRepository, ReadOnlyStoreRepository metadataRepository, java.util.Set<java.lang.String> regionNames, java.lang.String localRegionName)

Method Summary

Modifier and Type	Method	Description
void	addFollowerLagMonitor(Version version, int partition)	Adds monitoring for a follower partition of a given version.
void	addLeaderLagMonitor(Version version, int partition)	Adds monitoring for a leader partition of a given version.
protected java.util.Map<java.lang.String,java.util.Map<java.lang.Integer,java.util.Map<java.lang.Integer,java.util.Map<java.lang.String,java.lang.Long>>>>	getFollowerHeartbeatTimeStamps()
protected java.util.Map<java.lang.String,java.util.Map<java.lang.Integer,java.util.Map<java.lang.Integer,java.util.Map<java.lang.String,java.lang.Long>>>>	getLeaderHeartbeatTimeStamps()
protected void	record()
void	recordFollowerHeartbeat(java.lang.String store, int version, int partition, java.lang.String region, java.lang.Long timestamp)	Record a follower heartbeat timestamp for a given partition of a store version from a specific region.
protected void	recordLags(java.util.Map<java.lang.String,java.util.Map<java.lang.Integer,java.util.Map<java.lang.Integer,java.util.Map<java.lang.String,java.lang.Long>>>> heartbeatTimestamps, com.linkedin.davinci.stats.ingestion.heartbeat.HeartbeatMonitoringService.ReportLagFunction lagFunction)
void	recordLeaderHeartbeat(java.lang.String store, int version, int partition, java.lang.String region, java.lang.Long timestamp)	Record a leader heartbeat timestamp for a given partition of a store version from a specific region.
void	removeLagMonitor(Version version, int partition)	Removes monitoring for a partition of a given version.
boolean	startInner()
void	stopInner()

Methods inherited from class com.linkedin.venice.service.AbstractVeniceService

close, getName, isRunning, start, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_REPORTER_THREAD_SLEEP_INTERVAL_SECONDS

public static final int DEFAULT_REPORTER_THREAD_SLEEP_INTERVAL_SECONDS

See Also:

Constant Field Values

Constructor Detail

HeartbeatMonitoringService

public HeartbeatMonitoringService(io.tehuti.metrics.MetricsRepository metricsRepository,
                                  ReadOnlyStoreRepository metadataRepository,
                                  java.util.Set<java.lang.String> regionNames,
                                  java.lang.String localRegionName)

Method Detail

addFollowerLagMonitor

public void addFollowerLagMonitor(Version version,
                                  int partition)

Adds monitoring for a follower partition of a given version. This request is ignored if the version isn't hybrid.

Parameters:

version - the version to monitor lag for

partition - the partition to monitor lag for

addLeaderLagMonitor

public void addLeaderLagMonitor(Version version,
                                int partition)

Adds monitoring for a leader partition of a given version. This request is ignored if the version isn't hybrid.

Parameters:

version - the version to monitor lag for

partition - the partition to monitor lag for

removeLagMonitor

public void removeLagMonitor(Version version,
                             int partition)

Removes monitoring for a partition of a given version.

Parameters:

version - the version to remove monitoring for

partition - the partition to remove monitoring for

startInner

public boolean startInner()
                   throws java.lang.Exception

Specified by:

startInner in class AbstractVeniceService

Returns:

true if the service is completely started, false if it is still starting asynchronously (in this case, it is the implementer's responsibility to set AbstractVeniceService.serviceState to AbstractVeniceService.ServiceState.STARTED upon completion of the async work).

Throws:

java.lang.Exception

stopInner

public void stopInner()
               throws java.lang.Exception

Specified by:

stopInner in class AbstractVeniceService

Throws:

java.lang.Exception

recordLeaderHeartbeat

public void recordLeaderHeartbeat(java.lang.String store,
                                  int version,
                                  int partition,
                                  java.lang.String region,
                                  java.lang.Long timestamp)

Record a leader heartbeat timestamp for a given partition of a store version from a specific region.

Parameters:

store - the store this heartbeat is for

version - the version this heartbeat is for

partition - the partition this heartbeat is for

region - the region this heartbeat is from

timestamp - the time of this heartbeat

recordFollowerHeartbeat

public void recordFollowerHeartbeat(java.lang.String store,
                                    int version,
                                    int partition,
                                    java.lang.String region,
                                    java.lang.Long timestamp)

Record a follower heartbeat timestamp for a given partition of a store version from a specific region.

Parameters:

store - the store this heartbeat is for

version - the version this heartbeat is for

partition - the partition this heartbeat is for

region - the region this heartbeat is from

timestamp - the time of this heartbeat

getLeaderHeartbeatTimeStamps

protected java.util.Map<java.lang.String,java.util.Map<java.lang.Integer,java.util.Map<java.lang.Integer,java.util.Map<java.lang.String,java.lang.Long>>>> getLeaderHeartbeatTimeStamps()

getFollowerHeartbeatTimeStamps

protected java.util.Map<java.lang.String,java.util.Map<java.lang.Integer,java.util.Map<java.lang.Integer,java.util.Map<java.lang.String,java.lang.Long>>>> getFollowerHeartbeatTimeStamps()

recordLags

protected void recordLags(java.util.Map<java.lang.String,java.util.Map<java.lang.Integer,java.util.Map<java.lang.Integer,java.util.Map<java.lang.String,java.lang.Long>>>> heartbeatTimestamps,
                          com.linkedin.davinci.stats.ingestion.heartbeat.HeartbeatMonitoringService.ReportLagFunction lagFunction)

record

protected void record()