Package com.linkedin.venice.spark.datawriter.recordprocessor

Class SparkLogicalTimestampProcessor

java.lang.Object

com.linkedin.venice.spark.datawriter.recordprocessor.SparkLogicalTimestampProcessor

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.MapFunction<org.apache.spark.sql.Row,org.apache.spark.sql.Row>

public class SparkLogicalTimestampProcessor
extends Object
implements org.apache.spark.api.java.function.MapFunction<org.apache.spark.sql.Row,org.apache.spark.sql.Row>

A Spark MapFunction that processes input Row and converts the logical timestamp in the RMD field to the actual RMD byte array if necessary. It acts as pass through for non-long RMD types.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
SparkLogicalTimestampProcessor(boolean containsLogicalTimestamp, String rmdSchemaString)

Method Summary

Modifier and Type	Method	Description
org.apache.spark.sql.Row	call(org.apache.spark.sql.Row record)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SparkLogicalTimestampProcessor

public SparkLogicalTimestampProcessor(boolean containsLogicalTimestamp,
 String rmdSchemaString)

Method Details

call

public org.apache.spark.sql.Row call(org.apache.spark.sql.Row record)
                              throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.MapFunction<org.apache.spark.sql.Row,org.apache.spark.sql.Row>

Throws:

Exception