Can we use my own LLM for generative search?

General
1

Is it possible to use our own LLM to do generative search? If we can, how can we set it up?

2

Hi!

Check this module for that:

:slight_smile:

Let me know if this helps :slight_smile:

3

@DudaNogueira Am I missing something? This module is using transformer? I would like to use my LLM to do a generative search.

4

Hi @rhuang !

You can adapt this docker container:

to your own, and use it with your model, reusing all the apis that are exposed in Weaviate to consume that service.