When I dug into the code a little more, I saw that both
AvroPathPerKeyOutputFormat and AvroParquetPathPerKeyOutputFormat use "part"
as a default when creating the basePath when there is not a value for
"mapreduce.output.basename".  My guess is that when running via a
SparkPipeline that value is not set.  I changed my local copy to use out0
as the defaultValue instead of part, and the job was able to write output


On Fri, May 25, 2018 at 2:20 PM David Ortiz <[EMAIL PROTECTED]> wrote: