Verba: Changing OpenAI Embeddings & Chunk Size

Mike_Hudson · February 7, 2024, 6:46pm

Is it possible to easily change the Verba code so we can try using the new OpenAI “text-embedding-3-large” model? We’re curious to see if that improves retrieval for unusual words.

And is it possible to play with changing chunk size?

DudaNogueira · February 7, 2024, 7:27pm

Hi!

Verba has now a modularized structure that easily allows new embedding components.

This is the one that controls the current OpenAi embedding:

github.com

weaviate/Verba/blob/main/goldenverba/components/embedding/ADAEmbedder.py

from weaviate import Client

from goldenverba.components.embedding.interface import Embedder
from goldenverba.components.reader.document import Document


class ADAEmbedder(Embedder):
    """
    ADAEmbedder for Verba.
    """

    def __init__(self):
        super().__init__()
        self.name = "ADAEmbedder"
        self.requires_env = ["OPENAI_API_KEY"]
        self.requires_library = ["openai"]
        self.description = "Embeds and retrieves objects using OpenAI's ADA model"
        self.vectorizer = "text2vec-openai"

    def embed(

This file has been truncated. show original

We should have some contents around this new model soon.

You can probably experiment with it by adapting this recipe:

github.com

weaviate/recipes/blob/main/generative-search/generative_search_openai.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "rJD9aP9eVcsT"
      },
      "source": [
        "## Dependencies"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "ReE5TWeXSDTe"
      },
      "outputs": [],
      "source": [
        "!pip install weaviate-client"

This file has been truncated. show original

Let me know if this helps.

Thanks!

Mike_Hudson · February 7, 2024, 7:45pm

Thanks. I think that means that for now there isn’t an easy way to use the 3072 dimension “text-embedding-3-large” embedder with Verba. https://openai.com/blog/new-embedding-models-and-api-updates

DudaNogueira · February 7, 2024, 7:51pm

Not without changing the code.

But hopefully we get it soon.

It would be interesting to point this out as an issue:

Mike_Hudson · February 8, 2024, 8:50am

Done – issue created. Thanks Duda.

Topic		Replies	Views
Can you update Verba to use the new embedding models from OpenAI? General bug , integration , developer-experience	1	166	May 28, 2024
Anybody Using text-embedding-3-large? General developer-experience	2	362	March 4, 2024
New OpenAI Embedding Models Support	20	2500	February 21, 2024
Verba stuck with older informations General	4	130	May 22, 2024
Additional Chunkers for Verba General	2	218	June 4, 2024

Verba: Changing OpenAI Embeddings & Chunk Size

Related topics