0

Can somebody suggest to me how can I do load balancing in a Rasa Chatbot? There is not much documentation or tutorials available.

Gandharv pathak
  • 7
  • 7

1 Answers1

0

If you deploy your Rasa bot via Rasa X, you can do so in Kubernetes or Openshift. Both of these cluster environments provide native load balancing and the availability to scale pods when you have more traffic. https://rasa.com/docs/rasa-x/installation-and-setup/openshift-kubernetes/

Ella Rohm-Ensing
  • 346
  • 2
  • 5
  • I have deployed the rasa bot using docker. Does docker provide load balancing? @ella – Gandharv pathak May 16 '20 at 17:14
  • That's sort of what docker swarm is for, but there's no official Rasa support for docker swarm. I'd definitely recommend a cluster env for load balancing. These tools are built on top of docker for that exact use case -- rebuilding it in docker itself is sort of reinventing the wheel. – Ella Rohm-Ensing May 18 '20 at 09:52