Package com.linkedin.venice.spark.datawriter.task

Class TimedIterator

java.lang.Object

com.linkedin.venice.spark.datawriter.task.TimedIterator

All Implemented Interfaces:

Iterator<org.apache.spark.sql.Row>

public class TimedIterator
extends Object
implements Iterator<org.apache.spark.sql.Row>

Wraps an Iterator<Row> and records wall-clock timing when the iterator is exhausted. Timing is recorded once, on the first call to hasNext() that returns false.

Constructor Summary

Constructors

Constructor	Description
TimedIterator(Iterator<org.apache.spark.sql.Row> delegate, org.apache.spark.util.LongAccumulator timeNsAccumulator)

Method Summary

Modifier and Type	Method	Description
boolean	hasNext()
org.apache.spark.sql.Row	next()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining, remove

Constructor Details

TimedIterator

public TimedIterator(Iterator<org.apache.spark.sql.Row> delegate,
 org.apache.spark.util.LongAccumulator timeNsAccumulator)

Method Details

hasNext

public boolean hasNext()

Specified by:

hasNext in interface Iterator<org.apache.spark.sql.Row>

next

public org.apache.spark.sql.Row next()

Specified by:

next in interface Iterator<org.apache.spark.sql.Row>