26

How can I use multiple tensorflow models? I use docker container.

model_config_list: {

  config: {
    name: "model1",
    base_path: "/tmp/model",
    model_platform: "tensorflow"
  },
  config: {
     name: "model2",
     base_path: "/tmp/model2",
     model_platform: "tensorflow"
  }
}
Machavity
  • 30,841
  • 27
  • 92
  • 100
onuryartasi
  • 587
  • 2
  • 6
  • 13

1 Answers1

24

Built a docker image from official tensorflow serving docker file

Then inside docker image.

/usr/local/bin/tensorflow_model_server --port=9000 --model_config_file=/serving/models.conf

here /serving/models.conf is a similar file as yours.

Sumsuddin Shojib
  • 3,583
  • 3
  • 26
  • 45
  • 3
    I think the model_name is not needed in the command line, since it's specified in the config file for each model? – Mike Apr 12 '18 at 03:14
  • 2
    Yes, you are right. (If `model_config_file` is used, --model_name, --model_base_path are ignored.). Edited now – Sumsuddin Shojib Apr 12 '18 at 04:39