I logged a bug about this a few days ago (link) but wanted to post here as well to raise awareness. It is my understanding that if action isn’t taken soon Azure customers will no longer be able to use the generative-openai module.
Description
How to reproduce this bug?
The generative-openai module is using a deprecated API version for chat completions. Azure has notified its customers that the 2023-03-15-preview version is deprecated and will be fully retired (aka no longer accept API requests) on 2 April 2024. Azure is advising to migrate to 2023-12-01-preview.
The 2023-03-15-preview version is referenced in https://github.com/weaviate/weaviate/blob/192abf0c71d9a2d1a39b233ba374167343014d59/modules/generative-openai/clients/openai.go#L42
My recommendation is to upgrade to the new API version before the end of February in order to allow Azure users at least one month (March) to upgrade their Weaviate instances.
What is the expected behavior?
Utilize 2023-12-01-preview API version and avoid service disruptions for users leveraging Azure.
What is the actual behavior?
The generative-openai module uses the 2023-03-15-preview version and will cease to function for Azure customers on 2 April 2024.
Supporting information
For context, here is the email Azure sent to its customers:
Update your code to use the latest Azure OpenAI Service preview API by 2 April 2024
You’re receiving this email because you’ve used an older Azure OpenAI Service preview API in the last 30 days.
We recently made Azure OpenAI API version 2023-12-01-preview available. You’ll need to update any code that uses the following older versions before they’re retired on 2 April 2024:
• 2023-03-15-preview
• 2023-06-01-preview
• 2023-07-01-preview
• 2023-08-01-preview
• 2023-09-15-preview
The 2023-12-01 preview version includes improvements such as support for DALL-E 3.0 and enhanced content filtering.
Required action
To avoid potential service disruptions, update your code that uses any of the retiring Azure OpenAI API versions to use version 2023-12-01 by 2 April 2024.
Server Version
1.23.7