I have a custom reranker model that I am self hosting. I’d like to enable this in weaviate by replacing parts of the reranker-transformers module. I see the example in the docs of required endpoints for customizing text2vec-transformers, but I can’t seem to find the same for reranker-transformers. Can someone please help me identify what I need to implement/what the incoming requests will look like for rerankers?
I ended up just pulling the semitechnologies/reranker-transformers container and searching around inside. I found the following input class:
which looks like what I need! Also- it looks like the same endpoints as the text2vec-transformers except instead of /vectors we have /rerank:
bonus for those of you who care- I’m running both text2vec-transformers custom model and the custom reranker-transformers at the same url, so all I had to do was add /rerank and update the weaviate config!