Package com.linkedin.venice.pushmonitor
package com.linkedin.venice.pushmonitor
-
ClassDescriptionAbstractPushMonitor is a high level abstraction that manages
OfflinePushStatus
.The callback method to disable leader replicas whenever they are in ERROR state so that helix can elect a new leader.Status of executing off-line push.An implementation ofAbstractPushMonitor
that listens to Helix Customized View to determine the push statusLeakedPushStatusCleanUpService will wake up regularly (interval is determined by controller configConfigKeys.LEAKED_PUSH_STATUS_CLEAN_UP_SERVICE_SLEEP_INTERVAL_MS
), get all existing push status ZNodes on Zookeeper that belong to the specified cluster, without scanning through the replica statuses, find all leaked push status and delete them on Zookeeper.Accessor to execute the CURD operations for offline push and its replicas statuses.Class stores all the statuses and history of one offline push.Class stores the status of one partition including all the replicas statuses in this partition.An implementation ofAbstractPushMonitor
that listens to ZKPartitionStatus
to determine the push status.Listener used to listen the data change of partition status.In Venice, Push is a task that asynchronously writes data to Venice.This class maintains the mapping of Kafka topic to eachPushMonitor
instance and delegates calls to the correct instance.This enum controls the behavior of howPushMonitorDelegator
chooses proper PushMonitor for resources.This class contains some common util methods for push monitoring purpose.This class serves as a collector of offline push status for both Venice Server and Da Vinci clients.Decide the offline push status by checking all replicas statuses under different offline push strategies.Class stores replica status and history.This push monitor is able to query hybrid store quota status from routersThis push monitor is able to query push job status from routers; it only works for stores running in Leader/Follower mode and it will be built for STREAM_REPROCESSING job.The snapshot of status change.Wait all strategy stands for Venice do not allow one replica to be failed.Wait N-1 strategy stands for Venice could tolerate one of replica to be failed for each partition.