1

How do I make giraph read data from multiple input paths. I am using this in gora.properties

gora.datastore.default = org.apache.gora.avro.store.Avrostore gora.avrostore.input.path=file:///path/to/file1.avro,file:///path/to/file2.avro

But it gives this error Input path does not exist: file:/path/to/file1.avro,file:/path/to/file2.avro

  • It seems like the FileInputFormat is unable to split the input path at commas(It is reading it as "\,"),then how do I give the input? – rohith kumar Dec 21 '16 at 09:59

1 Answers1

0

Short answer: sorry, but seems not possible.

Long answer:

I don't use Giraph, but I know that Gora does not support multiple paths in AvroStore.

For that necessity, Giraph should be the one implementing that feature creating 2 DataStore connections (one per each file), but I guess it does not do that (or does it?).

The other approach would be to improve AvroStore to support several files in the configuration, but as far as I know, you are the first to think about it. Maybe you would want to make that improvement... :)

Alfonso Nishikawa
  • 1,876
  • 1
  • 17
  • 33