How to get a specific machine type for ML Engine online prediction?

Question

Is there an option to request a faster node for online prediction in ML Engine?

For example, when training I can configure any of these machines for my job:

standard, large_model, complex_model_s, complex_model_m, complex_model_l, standard_gpu, complex_model_m_gpu, complex_model_l_gpu, standard_p100, complex_model_m_p100

See description of available clusters and machines for training here and here

I am struggling to find if it is possible to control what kind of machine runs my online prediction.

Could you post the content of the link, so it is understandable from your question without link? — , Oct 17 '17 at 15:43

score 0 · Answer 1 · answered Oct 18 '17 at 00:13

0

We are currently adding that capability and will let you know when it's publicly available.

answered Oct 18 '17 at 00:13

rhaertel80

8,254
1
31
47

score 0 · Answer 2 · answered May 21 '18 at 23:30

ML Engine offers 4-core instance type in addition to the default serving instance type for online prediction. However the feature is still at alpha stage and it will only be available to a selected list of accounts who opted in as "Trusted Testers". Please contact cloudml-feedback@google.com if you need help to setup prediction service with faster node.

How to get a specific machine type for ML Engine online prediction?

2 Answers2