Package com.linkedin.venice.hadoop.spark.datawriter.writer

Class SparkPartitionWriterFactory

  • All Implemented Interfaces:
    java.io.Serializable, org.apache.spark.api.java.function.MapPartitionsFunction<org.apache.spark.sql.Row,​org.apache.spark.sql.Row>
    public class SparkPartitionWriterFactory
extends java.lang.Object
implements org.apache.spark.api.java.function.MapPartitionsFunction<org.apache.spark.sql.Row,​org.apache.spark.sql.Row>
    See Also:
    Serialized Form

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      java.util.Iterator<org.apache.spark.sql.Row> call​(java.util.Iterator<org.apache.spark.sql.Row> rows)  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • SparkPartitionWriterFactory

        public SparkPartitionWriterFactory​(org.apache.spark.broadcast.Broadcast<java.util.Properties> jobProps,
                                   DataWriterAccumulators accumulators)

    • Method Detail

      • call

        public java.util.Iterator<org.apache.spark.sql.Row> call​(java.util.Iterator<org.apache.spark.sql.Row> rows)
                                                  throws java.lang.Exception
        Specified by:
        call in interface org.apache.spark.api.java.function.MapPartitionsFunction<org.apache.spark.sql.Row,​org.apache.spark.sql.Row>
        Throws:
        java.lang.Exception