Disable some weaviate services (e.g. reranker) after indexing?

Support
1

Description

I used the docker compose configurator to make a docker-compose file that has a DPR query embedder, DPR passage embedder, and a generative reranker.

To save GPU memory, at inference time I would like to disable the DPR passage embedder (which is not needed assuming I don’t need to add new documents when just querying the vector db) and disable the reranker. I decided after the fact that I don’t want to use the reranker (or at least, I don’t want it right now).

Is it possible to disable these? I tried commenting some stuff out of the docker-compose, but it wasn’t successful.

Server Setup Information

  • Weaviate Server Version: 1.24.2
  • Deployment Method: docker
  • Multi Node? Number of Running Nodes: 1
  • Client Language and Version: python, 4.5.3

Any additional Information

2

Hi! I believe you will get some errors.

Because the collection defines the module to be used, however, the server, after you comment out that module, will not have the module.

Can you share the logs or reproduce steps?

Maybe this can be a good enough use case that we can create a feature request.

Thanks!