# Weaviate Self host pods are not stable in Production, local index not found and shard errors

**URL:** <https://forum.weaviate.io/t/weaviate-self-host-pods-are-not-stable-in-production-local-index-not-found-and-shard-errors/21180>\
**Category:** Support\
**Created:** [May 26, 2025, 2:01pm UTC](https://forum.weaviate.io/t/weaviate-self-host-pods-are-not-stable-in-production-local-index-not-found-and-shard-errors/21180 "2025-05-26T14:01:59Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Surya\_Sandeep\_Boda](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/surya_sandeep_boda/32/3275_2.png) [@Surya\_Sandeep\_Boda](https://forum.weaviate.io/u/Surya_Sandeep_Boda)\
**Post date:** [May 26, 2025, 2:01pm UTC](https://forum.weaviate.io/t/weaviate-self-host-pods-are-not-stable-in-production-local-index-not-found-and-shard-errors/21180/1 "2025-05-26T14:01:59Z")

</div>

Hello Weaviate,

I have a Weaviate Self host cluster with 7 nodes inside it. Attached the Docker compose file here.

**Docker-compose file**

version: ‘3.8’

services:  
weaviate-node-1:  
init: true  
command: [–host, 0.0.0.0, --port, ‘8080’, --scheme, http]  
image: [cr.weaviate.io/semitechnologies/weaviate:1.30.3](http://cr.weaviate.io/semitechnologies/weaviate:1.30.3)  
ports:  
- 8080:8080  
- 6050:6060  
- 50051:50051  
restart: on-failure:0  
volumes:  
- weaviate-node-1-data:/var/lib/weaviate  
environment:  
ENABLE\_BATCHING: “true”  
BATCH\_MAX\_SIZE: “100”  
BATCH\_MAX\_DELAY: “50ms”  
LOG\_LEVEL: ‘info’  
ASYNC\_INDEXING: ‘true’  
BATCH\_ENABLED: ‘true’  
BATCH\_QUEUE\_TIMEOUT\_REPLACE\_EXISTING\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_DELETE\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_OBJECT\_MS: 2000  
BATCH\_TOKENS\_PER\_SECOND: 40000  
BATCH\_MAX\_PARALLEL\_BATCHES: 32  
ASYNC\_INDEXING\_QUEUE\_SIZE: 100000  
QUERY\_DEFAULTS\_LIMIT: 1000  
QUERY\_MAXIMUM\_RESULTS: 100000  
AUTHENTICATION\_ANONYMOUS\_ACCESS\_ENABLED: ‘true’  
PERSISTENCE\_DATA\_PATH: ‘/var/lib/weaviate’  
ENABLE\_API\_BASED\_MODULES: ‘false’  
ENABLE\_MODULES: ‘’  
DISABLE\_MODULES: ‘text2vec-contextionary,text2vec-transformers,text2vec-openai,text2vec-huggingface’  
CLUSTER\_HOSTNAME: ‘node1’  
CLUSTER\_GOSSIP\_BIND\_PORT: ‘7100’  
CLUSTER\_DATA\_BIND\_PORT: ‘7101’  
RAFT\_JOIN: ‘node1,node2,node3,node4,node5,node6,node7’  
RAFT\_BOOTSTRAP\_EXPECT: 7  
deploy:  
resources:  
limits:  
cpus: ‘3.0’  
memory: ‘6G’  
networks:  
- weaviate-net

weaviate-node-2:  
init: true  
command: [–host, 0.0.0.0, --port, ‘8080’, --scheme, http]  
image: [cr.weaviate.io/semitechnologies/weaviate:1.30.3](http://cr.weaviate.io/semitechnologies/weaviate:1.30.3)  
ports:  
- 8081:8080  
- 6051:6060  
- 50052:50051  
restart: on-failure:0  
volumes:  
- weaviate-node-2-data:/var/lib/weaviate  
environment:  
ENABLE\_BATCHING: “true”  
BATCH\_MAX\_SIZE: “100”  
BATCH\_MAX\_DELAY: “50ms”  
LOG\_LEVEL: ‘info’  
ASYNC\_INDEXING: ‘true’  
BATCH\_ENABLED: ‘true’  
BATCH\_QUEUE\_TIMEOUT\_REPLACE\_EXISTING\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_DELETE\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_OBJECT\_MS: 2000  
BATCH\_TOKENS\_PER\_SECOND: 40000  
BATCH\_MAX\_PARALLEL\_BATCHES: 32  
ASYNC\_INDEXING\_QUEUE\_SIZE: 100000  
QUERY\_DEFAULTS\_LIMIT: 1000  
QUERY\_MAXIMUM\_RESULTS: 100000  
AUTHENTICATION\_ANONYMOUS\_ACCESS\_ENABLED: ‘true’  
PERSISTENCE\_DATA\_PATH: ‘/var/lib/weaviate’  
ENABLE\_API\_BASED\_MODULES: ‘false’  
ENABLE\_MODULES: ‘’  
DISABLE\_MODULES: ‘text2vec-contextionary,text2vec-transformers,text2vec-openai,text2vec-huggingface’  
CLUSTER\_HOSTNAME: ‘node2’  
CLUSTER\_GOSSIP\_BIND\_PORT: ‘7102’  
CLUSTER\_DATA\_BIND\_PORT: ‘7103’  
CLUSTER\_JOIN: ‘weaviate-node-1:7100’  
RAFT\_JOIN: ‘node1,node2,node3,node4,node5,node6,node7’  
RAFT\_BOOTSTRAP\_EXPECT: 7  
deploy:  
resources:  
limits:  
cpus: ‘3.0’  
memory: ‘6G’  
networks:  
- weaviate-net

weaviate-node-3:  
init: true  
command: [–host, 0.0.0.0, --port, ‘8080’, --scheme, http]  
image: [cr.weaviate.io/semitechnologies/weaviate:1.30.3](http://cr.weaviate.io/semitechnologies/weaviate:1.30.3)  
ports:  
- 8082:8080  
- 6052:6060  
- 50053:50051  
restart: on-failure:0  
volumes:  
- weaviate-node-3-data:/var/lib/weaviate  
environment:  
LOG\_LEVEL: ‘info’  
ENABLE\_BATCHING: “true”  
BATCH\_MAX\_SIZE: “100”  
BATCH\_MAX\_DELAY: “50ms”  
ASYNC\_INDEXING: ‘true’  
BATCH\_ENABLED: ‘true’  
BATCH\_QUEUE\_TIMEOUT\_REPLACE\_EXISTING\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_DELETE\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_OBJECT\_MS: 2000  
BATCH\_TOKENS\_PER\_SECOND: 40000  
BATCH\_MAX\_PARALLEL\_BATCHES: 32  
ASYNC\_INDEXING\_QUEUE\_SIZE: 100000  
QUERY\_DEFAULTS\_LIMIT: 1000  
QUERY\_MAXIMUM\_RESULTS: 100000  
AUTHENTICATION\_ANONYMOUS\_ACCESS\_ENABLED: ‘true’  
PERSISTENCE\_DATA\_PATH: ‘/var/lib/weaviate’  
ENABLE\_API\_BASED\_MODULES: ‘false’  
ENABLE\_MODULES: ‘’  
DISABLE\_MODULES: ‘text2vec-contextionary,text2vec-transformers,text2vec-openai,text2vec-huggingface’  
CLUSTER\_HOSTNAME: ‘node3’  
CLUSTER\_GOSSIP\_BIND\_PORT: ‘7104’  
CLUSTER\_DATA\_BIND\_PORT: ‘7105’  
CLUSTER\_JOIN: ‘weaviate-node-1:7100’  
RAFT\_JOIN: ‘node1,node2,node3,node4,node5,node6,node7’  
RAFT\_BOOTSTRAP\_EXPECT: 7  
deploy:  
resources:  
limits:  
cpus: ‘3.0’  
memory: ‘6G’  
networks:  
- weaviate-net

weaviate-node-4:  
init: true  
command: [–host, 0.0.0.0, --port, ‘8080’, --scheme, http]  
image: [cr.weaviate.io/semitechnologies/weaviate:1.30.3](http://cr.weaviate.io/semitechnologies/weaviate:1.30.3)  
ports:  
- 8083:8080  
- 6053:6060  
- 50054:50051  
restart: on-failure:0  
volumes:  
- weaviate-node-4-data:/var/lib/weaviate  
environment:  
LOG\_LEVEL: ‘info’  
ENABLE\_BATCHING: “true”  
BATCH\_MAX\_SIZE: “100”  
BATCH\_MAX\_DELAY: “50ms”  
ASYNC\_INDEXING: ‘true’  
BATCH\_ENABLED: ‘true’  
BATCH\_QUEUE\_TIMEOUT\_REPLACE\_EXISTING\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_DELETE\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_OBJECT\_MS: 2000  
BATCH\_TOKENS\_PER\_SECOND: 40000  
BATCH\_MAX\_PARALLEL\_BATCHES: 32  
ASYNC\_INDEXING\_QUEUE\_SIZE: 100000  
QUERY\_DEFAULTS\_LIMIT: 1000  
QUERY\_MAXIMUM\_RESULTS: 100000  
AUTHENTICATION\_ANONYMOUS\_ACCESS\_ENABLED: ‘true’  
PERSISTENCE\_DATA\_PATH: ‘/var/lib/weaviate’  
ENABLE\_API\_BASED\_MODULES: ‘false’  
ENABLE\_MODULES: ‘’  
DISABLE\_MODULES: ‘text2vec-contextionary,text2vec-transformers,text2vec-openai,text2vec-huggingface’  
CLUSTER\_HOSTNAME: ‘node4’  
CLUSTER\_GOSSIP\_BIND\_PORT: ‘7106’  
CLUSTER\_DATA\_BIND\_PORT: ‘7107’  
CLUSTER\_JOIN: ‘weaviate-node-1:7100’  
RAFT\_JOIN: ‘node1,node2,node3,node4,node5,node6,node7’  
RAFT\_BOOTSTRAP\_EXPECT: 7  
deploy:  
resources:  
limits:  
cpus: ‘3.0’  
memory: ‘6G’  
networks:  
- weaviate-net

weaviate-node-5:  
init: true  
command: [–host, 0.0.0.0, --port, ‘8080’, --scheme, http]  
image: [cr.weaviate.io/semitechnologies/weaviate:1.30.3](http://cr.weaviate.io/semitechnologies/weaviate:1.30.3)  
ports:  
- 8084:8080  
- 6054:6060  
- 50055:50051  
restart: on-failure:0  
volumes:  
- weaviate-node-5-data:/var/lib/weaviate  
environment:  
LOG\_LEVEL: ‘info’  
ENABLE\_BATCHING: “true”  
BATCH\_MAX\_SIZE: “100”  
BATCH\_MAX\_DELAY: “50ms”  
ASYNC\_INDEXING: ‘true’  
BATCH\_ENABLED: ‘true’  
BATCH\_QUEUE\_TIMEOUT\_REPLACE\_EXISTING\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_DELETE\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_OBJECT\_MS: 2000  
BATCH\_TOKENS\_PER\_SECOND: 40000  
BATCH\_MAX\_PARALLEL\_BATCHES: 32  
ASYNC\_INDEXING\_QUEUE\_SIZE: 100000  
QUERY\_DEFAULTS\_LIMIT: 1000  
QUERY\_MAXIMUM\_RESULTS: 100000  
AUTHENTICATION\_ANONYMOUS\_ACCESS\_ENABLED: ‘true’  
PERSISTENCE\_DATA\_PATH: ‘/var/lib/weaviate’  
ENABLE\_API\_BASED\_MODULES: ‘false’  
ENABLE\_MODULES: ‘’  
DISABLE\_MODULES: ‘text2vec-contextionary,text2vec-transformers,text2vec-openai,text2vec-huggingface’  
CLUSTER\_HOSTNAME: ‘node5’  
CLUSTER\_GOSSIP\_BIND\_PORT: ‘7108’  
CLUSTER\_DATA\_BIND\_PORT: ‘7109’  
CLUSTER\_JOIN: ‘weaviate-node-1:7100’  
RAFT\_JOIN: ‘node1,node2,node3,node4,node5,node6,node7’  
RAFT\_BOOTSTRAP\_EXPECT: 7  
deploy:  
resources:  
limits:  
cpus: ‘3.0’  
memory: ‘6G’  
networks:  
- weaviate-net

weaviate-node-6:  
init: true  
command: [–host, 0.0.0.0, --port, ‘8080’, --scheme, http]  
image: [cr.weaviate.io/semitechnologies/weaviate:1.30.3](http://cr.weaviate.io/semitechnologies/weaviate:1.30.3)  
ports:  
- 8085:8080  
- 6055:6060  
- 50056:50051  
restart: on-failure:0  
volumes:  
- weaviate-node-6-data:/var/lib/weaviate  
environment:  
LOG\_LEVEL: ‘info’  
ENABLE\_BATCHING: “true”  
BATCH\_MAX\_SIZE: “100”  
BATCH\_MAX\_DELAY: “50ms”  
ASYNC\_INDEXING: ‘true’  
BATCH\_ENABLED: ‘true’  
BATCH\_QUEUE\_TIMEOUT\_REPLACE\_EXISTING\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_DELETE\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_OBJECT\_MS: 2000  
BATCH\_TOKENS\_PER\_SECOND: 40000  
BATCH\_MAX\_PARALLEL\_BATCHES: 32  
ASYNC\_INDEXING\_QUEUE\_SIZE: 100000  
QUERY\_DEFAULTS\_LIMIT: 1000  
QUERY\_MAXIMUM\_RESULTS: 100000  
AUTHENTICATION\_ANONYMOUS\_ACCESS\_ENABLED: ‘true’  
PERSISTENCE\_DATA\_PATH: ‘/var/lib/weaviate’  
ENABLE\_API\_BASED\_MODULES: ‘false’  
ENABLE\_MODULES: ‘’  
DISABLE\_MODULES: ‘text2vec-contextionary,text2vec-transformers,text2vec-openai,text2vec-huggingface’  
CLUSTER\_HOSTNAME: ‘node6’  
CLUSTER\_GOSSIP\_BIND\_PORT: ‘7110’  
CLUSTER\_DATA\_BIND\_PORT: ‘7111’  
CLUSTER\_JOIN: ‘weaviate-node-1:7100’  
RAFT\_JOIN: ‘node1,node2,node3,node4,node5,node6,node7’  
RAFT\_BOOTSTRAP\_EXPECT: 7  
deploy:  
resources:  
limits:  
cpus: ‘3.0’  
memory: ‘6G’  
networks:  
- weaviate-net

weaviate-node-7:  
init: true  
command: [–host, 0.0.0.0, --port, ‘8080’, --scheme, http]  
image: [cr.weaviate.io/semitechnologies/weaviate:1.30.3](http://cr.weaviate.io/semitechnologies/weaviate:1.30.3)  
ports:  
- 8086:8080  
- 6056:6060  
- 50057:50051  
restart: on-failure:0  
volumes:  
- weaviate-node-7-data:/var/lib/weaviate  
environment:  
LOG\_LEVEL: ‘info’  
ENABLE\_BATCHING: “true”  
BATCH\_MAX\_SIZE: “100”  
BATCH\_MAX\_DELAY: “50ms”  
ASYNC\_INDEXING: ‘true’  
BATCH\_ENABLED: ‘true’  
BATCH\_QUEUE\_TIMEOUT\_REPLACE\_EXISTING\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_DELETE\_MS: 2000  
BATCH\_QUEUE\_TIMEOUT\_OBJECT\_MS: 2000  
BATCH\_TOKENS\_PER\_SECOND: 40000  
BATCH\_MAX\_PARALLEL\_BATCHES: 32  
ASYNC\_INDEXING\_QUEUE\_SIZE: 100000  
QUERY\_DEFAULTS\_LIMIT: 1000  
QUERY\_MAXIMUM\_RESULTS: 100000  
AUTHENTICATION\_ANONYMOUS\_ACCESS\_ENABLED: ‘true’  
PERSISTENCE\_DATA\_PATH: ‘/var/lib/weaviate’  
ENABLE\_API\_BASED\_MODULES: ‘false’  
ENABLE\_MODULES: ‘’  
DISABLE\_MODULES: ‘text2vec-contextionary,text2vec-transformers,text2vec-openai,text2vec-huggingface’  
CLUSTER\_HOSTNAME: ‘node7’  
CLUSTER\_GOSSIP\_BIND\_PORT: ‘7112’  
CLUSTER\_DATA\_BIND\_PORT: ‘7113’  
CLUSTER\_JOIN: ‘weaviate-node-1:7100’  
RAFT\_JOIN: ‘node1,node2,node3,node4,node5,node6,node7’  
RAFT\_BOOTSTRAP\_EXPECT: 7  
deploy:  
resources:  
limits:  
cpus: ‘3.0’  
memory: ‘6G’  
networks:  
- weaviate-net

volumes:  
weaviate-node-1-data:  
driver: local  
driver\_opts:  
type: none  
device: /mnt/weaviate/pod1  
o: bind  
weaviate-node-2-data:  
driver: local  
driver\_opts:  
type: none  
device: /mnt/weaviate/pod2  
o: bind  
weaviate-node-3-data:  
driver: local  
driver\_opts:  
type: none  
device: /mnt/weaviate/pod3  
o: bind  
weaviate-node-4-data:  
driver: local  
driver\_opts:  
type: none  
device: /mnt/weaviate/pod4  
o: bind  
weaviate-node-5-data:  
driver: local  
driver\_opts:  
type: none  
device: /mnt/weaviate/pod5  
o: bind  
weaviate-node-6-data:  
driver: local  
driver\_opts:  
type: none  
device: /mnt/weaviate/pod6  
o: bind  
weaviate-node-7-data:  
driver: local  
driver\_opts:  
type: none  
device: /mnt/weaviate/pod7  
o: bind

networks:  
weaviate-net:  
driver: bridge

**Errors we face are:-**

1. curl -X POST [http://localhost:8080/v1/graphql](http://localhost:8080/v1/graphql) -H “Content-Type: application/json” -d “{"query":"{ Aggregate { Sitemanager\_c\_kafka\_crm\_deal { meta { count } } } }"}”

{“data”:{“Aggregate”:{“Sitemanager\_c\_kafka\_crm\_deal”:null}},“errors”:[{“locations”:[{“column”:15,“line”:1}],“message”:“shard j42oexiqtoCg: status code: 422, error: local index "Sitemanager\_c\_kafka\_crm\_deal" not found\n”,“path”:[“Aggregate”,“Sitemanager\_c\_kafka\_crm\_deal”]}]}

1. Just after doing a “docker-compose down” and “docker-compose up” , the cluster starts working. These errors are quite frequent and makes us do the docker-compose down too frequently.
2. Attached a snapshot of another error pattern we frequently  
 ![image (3)](https://canada1.discourse-cdn.com/flex027/uploads/weaviate/original/2X/a/ae989f85b8123e1d0bc27c672a7c4d807a1e84e6.png)

---

<div class="post-metadata">

**Author:** ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)\
**Post date:** [May 26, 2025, 3:27pm UTC](https://forum.weaviate.io/t/weaviate-self-host-pods-are-not-stable-in-production-local-index-not-found-and-shard-errors/21180/2 "2025-05-26T15:27:46Z")

</div>

Hi! For multi node deployments, [we suggest kubernetes](https://weaviate.io/developers/weaviate/installation/kubernetes).

I will close this thread in favor of: [Shard assignment to Nodes not happening](https://forum.weaviate.io/t/shard-assignment-to-nodes-not-happening/21181)

THanks!

---

<div class="post-metadata">

**Author:** ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)\
**Post date:** [May 26, 2025, 3:27pm UTC](https://forum.weaviate.io/t/weaviate-self-host-pods-are-not-stable-in-production-local-index-not-found-and-shard-errors/21180/3 "2025-05-26T15:27:50Z")

</div>