Package com.linkedin.venice.spark.input.hdfs

Class VeniceHdfsInputPartitionReader

java.lang.Object

com.linkedin.venice.spark.input.VeniceAbstractPartitionReader

com.linkedin.venice.spark.input.hdfs.VeniceHdfsInputPartitionReader

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.spark.sql.connector.read.PartitionReader<org.apache.spark.sql.catalyst.InternalRow>

public class VeniceHdfsInputPartitionReader
extends VeniceAbstractPartitionReader

Constructor Summary

Constructors

Constructor	Description
VeniceHdfsInputPartitionReader(VeniceProperties jobConfig, VeniceHdfsInputPartition partition)

Method Summary

Modifier and Type	Method	Description
protected VeniceRecordIterator	createRecordIterator(VeniceProperties jobConfig, org.apache.spark.sql.connector.read.InputPartition partition)

Methods inherited from class com.linkedin.venice.spark.input.VeniceAbstractPartitionReader

close, get, next

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.connector.read.PartitionReader

currentMetricsValues

Constructor Details

VeniceHdfsInputPartitionReader

public VeniceHdfsInputPartitionReader(VeniceProperties jobConfig,
 VeniceHdfsInputPartition partition)

Method Details

createRecordIterator

protected VeniceRecordIterator createRecordIterator(VeniceProperties jobConfig,
 org.apache.spark.sql.connector.read.InputPartition partition)

Specified by:

createRecordIterator in class VeniceAbstractPartitionReader