Multiple instance in single LAN of different servers

Support
1

I tried to find the doc for deploying multiple instances of weaviate in different machine inside single LAN environment to make a cluster. The example I find is on ONE machine docker compose for three instance. Any chance you could point me to the right doc for multiple servers? I would like to test deploy to our Google Cloud.

Description

Server Setup Information

  • Weaviate Server Version:
  • Deployment Method:
  • Multi Node? Number of Running Nodes:
  • Client Language and Version:

Any additional Information

2

Hi Lawrence!

Considering the latest 1.25 version, that introduced RAFT consensus as a way to choose a lider in the Cluster, you will need to define some of those variables:

the main variable being: RAFT_JOIN

With those set, as long as each node can communicate with the other nodes from that cluster, it should work.

Thanks!

3

Cool… will do the test very soon and see how it goes.

4

Checked it. And yes, RAFT_JOIN is one of the key to set in dockerfile. The only thing left is how to set the IP address (or DNS name) of weaviate-1 (as cluster master) in weaviate-2 or weaviate-3’s docker file. I know the environment variable could set the port and others.

5

you can set those at /etc/hosts with corresponding ips for each machine.