Questions tagged [avroio]

Running a java job to read Avro files and have been getting errors. Looking for help on this - Here is the code - // Get Avro Schema String schemaJson = getSchema(options.getAvroSchema()); Schema schema = new Schema.Parser().parse(schemaJson); //…

Problem: I am writing an Apache Beam pipeline to convert Avro file to Parquet file (with Spark runner). Everything works well until I start to convert large size Avro file (15G). The code used to read Avro file to create PColletion: …