Class PubSubSplitPlanner
java.lang.Object
com.linkedin.venice.vpj.pubsub.input.PubSubSplitPlanner
Utility class for planning
PubSubPartitionSplit
s
for both MapReduce and Spark ingestion jobs.
This class encapsulates the common logic for:
- Building a
TopicManager
from job configuration. - Reading split parameters (split type, max records per split, max splits per partition, time window, etc.).
- Determining the number of partitions for a topic and generating splits using the appropriate
PubSubTopicPartitionSplitStrategy
.
-
Constructor Summary
Constructors -
Method Summary
-
Constructor Details
-
PubSubSplitPlanner
public PubSubSplitPlanner()
-
-
Method Details
-
plan
-