Using sentence_transformers together with Weaviate

[DudaNogueira]

hi @Bevani !!

Welcome to our community

There is a new approach I have just discovered the other day.

You can use tools like https://lmstudio.ai/, that will run different models both for LLM and embedding and emulate open ai interface.

With that you can point the text2vec_openai to that endpoint and it should use your custom models.

Check this thread:

How to use weaviate with LM Studio?

Yes that is very helpful! It’s confusing because the docs pages for the text2vec_openai module (text2vec-openai | Weaviate - Vector Database) refer to it in camel case like “baseURL” However now I’m getting this error: Failed to import 1 objects e.g. Failed to import object with error: WeaviateInsertManyAllFailedError(‘Every object failed during insertion. Here is the set of all errors: send POST request: Post “http://host.docker.internal:1234/v1/embeddings”: context deadline exceeded (Clien…