0

I exported a faster_rcnn_resnet101 model with custom classes for serving predictions and deployed it on Cloud ML platform so that I can use Cloud ML prediction engine. Online prediction works but the results fail when I try batch prediction. It appears that the official documentation is outdated and needs an update.

I tried formatting my data in both ways mentioned here. In addition I also tried the request format mentioned here.

I also tried the steps mentioned in the google cloud blog.

Local prediction and online prediction work but the batch prediction fails. Any help will be much appreciated.

Error Log:

('Exception during running the graph: assertion failed: [Unable to decode bytes as JPEG, PNG, GIF, or BMP]\n\t [[node map/while/decode_image/cond_jpeg/cond_png/cond_gif/Assert_1/Assert (defined at /usr/local/lib/python2.7/dist-packages/google/cloud/ml/prediction/frameworks/tf_prediction_lib.py:210) = Assert[T=[DT_STRING], summarize=3, _device="/job:localhost/replica:0/task:0/device:CPU:0"](map/while/decode_image/cond_jpeg/cond_png/cond_gif/is_bmp, map/while/decode_image/cond_jpeg/cond_png/cond_gif/Assert_1/Assert/data_0)]]', 1)

Vishal
  • 231
  • 2
  • 6

1 Answers1

0

Our apologies, but batch prediction is not currently supported for custom models.

rhaertel80
  • 8,254
  • 1
  • 31
  • 47