Package com.linkedin.venice.spark.input.pubsub.raw

Class VeniceRawPubsubInputScan

java.lang.Object

com.linkedin.venice.spark.input.pubsub.raw.VeniceRawPubsubInputScan

All Implemented Interfaces:

org.apache.spark.sql.connector.read.Batch, org.apache.spark.sql.connector.read.Scan

public class VeniceRawPubsubInputScan
extends Object
implements org.apache.spark.sql.connector.read.Scan, org.apache.spark.sql.connector.read.Batch

Constructor Summary

Constructors

Constructor	Description
VeniceRawPubsubInputScan(VeniceProperties jobConfig)

Method Summary

Modifier and Type	Method	Description
org.apache.spark.sql.connector.read.PartitionReaderFactory	createReaderFactory()
org.apache.spark.sql.connector.read.InputPartition[]	planInputPartitions()
org.apache.spark.sql.types.StructType	readSchema()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.connector.read.Scan

description, supportedCustomMetrics, toBatch, toContinuousStream, toMicroBatchStream

Constructor Details

VeniceRawPubsubInputScan

public VeniceRawPubsubInputScan(VeniceProperties jobConfig)

Method Details

planInputPartitions

public org.apache.spark.sql.connector.read.InputPartition[] planInputPartitions()

Specified by:

planInputPartitions in interface org.apache.spark.sql.connector.read.Batch

createReaderFactory

public org.apache.spark.sql.connector.read.PartitionReaderFactory createReaderFactory()

Specified by:

createReaderFactory in interface org.apache.spark.sql.connector.read.Batch

readSchema

public org.apache.spark.sql.types.StructType readSchema()

Specified by:

readSchema in interface org.apache.spark.sql.connector.read.Scan