Description

Writes Avro records to Avro data files on Hadoop file systems.

Usage

  1. writer.builder.class=org.apache.gobblin.writer.AvroDataWriterBuilder
  2. writer.destination.type=HDFS

For more info, see AvroHdfsDataWriter

Configuration

Key Type Description Default Value
writer.codec.type One of null,deflate,snappy,bzip2,xz,zstandard Type of the compression codec deflate
writer.deflate.level 1-9 The compression level for the “deflate” codec 9