Package com.linkedin.venice.spark.input.pubsub

Class SparkPubSubPartitionReaderFactory

java.lang.Object

com.linkedin.venice.spark.input.pubsub.SparkPubSubPartitionReaderFactory

All Implemented Interfaces:

Serializable, org.apache.spark.sql.connector.read.PartitionReaderFactory

public class SparkPubSubPartitionReaderFactory
extends Object
implements org.apache.spark.sql.connector.read.PartitionReaderFactory

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
SparkPubSubPartitionReaderFactory(VeniceProperties jobConfig)

Method Summary

Modifier and Type	Method	Description
org.apache.spark.sql.connector.read.PartitionReader<org.apache.spark.sql.catalyst.InternalRow>	createReader(org.apache.spark.sql.connector.read.InputPartition genericInputPartition)
boolean	supportColumnarReads(org.apache.spark.sql.connector.read.InputPartition partition)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.connector.read.PartitionReaderFactory

createColumnarReader

Constructor Details

SparkPubSubPartitionReaderFactory

public SparkPubSubPartitionReaderFactory(VeniceProperties jobConfig)

Method Details

createReader

public org.apache.spark.sql.connector.read.PartitionReader<org.apache.spark.sql.catalyst.InternalRow> createReader(org.apache.spark.sql.connector.read.InputPartition genericInputPartition)

Specified by:

createReader in interface org.apache.spark.sql.connector.read.PartitionReaderFactory

supportColumnarReads

public boolean supportColumnarReads(org.apache.spark.sql.connector.read.InputPartition partition)

Specified by:

supportColumnarReads in interface org.apache.spark.sql.connector.read.PartitionReaderFactory