DataWriterSparkJob (venice API)

java.lang.Object
- com.linkedin.venice.hadoop.jobs.DataWriterComputeJob
- - com.linkedin.venice.hadoop.spark.datawriter.jobs.AbstractDataWriterSparkJob
  - - com.linkedin.venice.hadoop.spark.datawriter.jobs.DataWriterSparkJob

All Implemented Interfaces:

ComputeJob, java.io.Closeable, java.lang.AutoCloseable
```
public class DataWriterSparkJob
extends AbstractDataWriterSparkJob
```
The default implementation of AbstractDataWriterSparkJob for Avro and Vson file input formats.

Nested Class Summary
- Nested classes/interfaces inherited from interface com.linkedin.venice.hadoop.jobs.ComputeJob
  ComputeJob.Status

Field Summary
- Fields inherited from class com.linkedin.venice.hadoop.jobs.DataWriterComputeJob
  PASS_THROUGH_CONFIG_PREFIXES

Constructor Summary

Constructors
Constructor Description

DataWriterSparkJob()

Method Summary

All Methods Instance Methods Concrete Methods
Modifier and Type	Method	Description
`protected org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>`	`getUserInputDataFrame()`	Get the data frame based on the user's input data.

Methods inherited from class com.linkedin.venice.hadoop.spark.datawriter.jobs.AbstractDataWriterSparkJob
close, configure, getJobProperties, getPushJobSetting, getSparkSession, getTaskTracker, kill, runComputeJob, setInputConf

Methods inherited from class com.linkedin.venice.hadoop.jobs.DataWriterComputeJob
configure, getFailureReason, getStatus, runJob, validateJob

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Constructor Detail
  - DataWriterSparkJob
```
public DataWriterSparkJob()
```
- Method Detail
  - getUserInputDataFrame
```
protected org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> getUserInputDataFrame()
```
    Description copied from class: AbstractDataWriterSparkJob
    Get the data frame based on the user's input data. The schema of the Row has the following constraints:
    
    Must contain a field "key" with the schema: DataTypes.BinaryType. This is the key of the record represented in serialized Avro.
    
    Must contain a field "value" with the schema: DataTypes.BinaryType. This is the value of the record represented in serialized Avro.
    
    Must not contain fields with names beginning with "_". These are reserved for internal use.
    
    Can contain fields that do not violate the above constraints
    Specified by:
    
    getUserInputDataFrame in class AbstractDataWriterSparkJob
    
    Returns:
    
    The data frame based on the user's input data