Weaviate scalability

Support
1

Hello,

I have weaviate deployment on K8s (Production environment), and now i need to scale it to 3 replicas.

when i tried that, i found only one container is working at a time and the other ones disconnects

is there any missing configuration i need to add to make it work?

Appreciate your help!

2

Hi @lina_7amed ! Welcome to our community :slight_smile:

Can you provide us with some logs and reproducible steps for that?

when you increase the replica number in the helm chart, it should work as expected.

3

Hello, Thanks for your reply

Actually i’m not using the helm chart

This is my environment variables used in the deployment:

QUERY_DEFAULTS_LIMIT: ‘25’
AUTHENTICATION_ANONYMOUS_ACCESS_ENABLED: ‘false’
PERSISTENCE_DATA_PATH: /var/lib/weaviate
DEFAULT_VECTORIZER_MODULE: none
CLUSTER_HOSTNAME: node1
AUTHENTICATION_APIKEY_ENABLED: ‘true’
AUTHENTICATION_APIKEY_ALLOWED_KEYS:
AUTHENTICATION_APIKEY_USERS:
AUTHORIZATION_ADMINLIST_ENABLED: ‘true’
AUTHORIZATION_ADMINLIST_USERS:

and this is the image i’m using “semitechnologies/weaviate:1.18.4”

do i miss any configuration here?

Thanks

4

Hi!

What is the verison of your helm chart?

you can find it running:

helm show chart weaviate/weaviate

Also, any reason for using 1.18.4 version and not a more recent one?

5

again i’m not using helm chart
which version do you recommend to be compatible with scalability feature

6

Oh! Sorry, missed that part.

We strongely suggest using helm as it has everything necessary to deploy it in multi node scenario.

Or, you can use it as reference to do your own deployment.

There is this thread where you can use as base to deploy two nodes using docker-compose, and use the env vars for reference: