Where to specify the Azure OpenAI api version / model?

Description

Hello,

I would like to specify the api version that Weaviate uses to query the Azure OpenAI endpoint.
From what I read in the discussions here I am not sure where I can specify the api_version - when creating the Collection or as an environment parameter.

If it is an environment parameter for the docker container, what value would it be? Is it

  • AZURE_OPENAI_API_VERSION
  • OPENAI_API_VERSION
  • something else?

Additionally I have the issue that I want to use a “text-embedding-3-large” - which is deployed on azure - with 1536 dimensions. Anyhow, after creating the collection, the “model” parameter of the collection lists the “model” parameter as “text-embedding-3-large”. As far as I found out the model can only be specified in the OpenAI class directly, not in Azure OpenAI. Can I just ignore the wrong “model” parameter of the created collection or will this be an issue?

THANKS

Server Setup Information

  • Weaviate Server Version:
  • Deployment Method:
  • Multi Node? No
  • Client Language and Version: 1.28
  • Multitenancy?: No

Hey @franz_hals

Please have a look at:

Let me know if that reflects what you are reporting and feel free to add a comment there in the Github issue if needed.

Regards,
Mohamed Shahin,
Support Engineer

1 Like

Hi Mohamed, thanks for creating the issue - it reflects my experience except that I did not try for bigger vector dimensions than 1536.

1 Like