Package com.linkedin.venice.spark.input.pubsub.raw

Class VeniceRawPubsubInputPartitionReaderFactory

java.lang.Object

com.linkedin.venice.spark.input.pubsub.raw.VeniceRawPubsubInputPartitionReaderFactory

All Implemented Interfaces:

Serializable, org.apache.spark.sql.connector.read.PartitionReaderFactory

public class VeniceRawPubsubInputPartitionReaderFactory
extends Object
implements org.apache.spark.sql.connector.read.PartitionReaderFactory

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
VeniceRawPubsubInputPartitionReaderFactory(VeniceProperties jobConfig)

Method Summary

Modifier and Type	Method	Description
org.apache.spark.sql.connector.read.PartitionReader<org.apache.spark.sql.catalyst.InternalRow>	createReader(org.apache.spark.sql.connector.read.InputPartition genericInputPartition)
boolean	supportColumnarReads(org.apache.spark.sql.connector.read.InputPartition partition)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.connector.read.PartitionReaderFactory

createColumnarReader

Constructor Details

VeniceRawPubsubInputPartitionReaderFactory

public VeniceRawPubsubInputPartitionReaderFactory(VeniceProperties jobConfig)

Method Details

createReader

public org.apache.spark.sql.connector.read.PartitionReader<org.apache.spark.sql.catalyst.InternalRow> createReader(org.apache.spark.sql.connector.read.InputPartition genericInputPartition)

Specified by:

createReader in interface org.apache.spark.sql.connector.read.PartitionReaderFactory

supportColumnarReads

public boolean supportColumnarReads(org.apache.spark.sql.connector.read.InputPartition partition)

Specified by:

supportColumnarReads in interface org.apache.spark.sql.connector.read.PartitionReaderFactory