Confused by the example of generative query

rjalex · February 9, 2024, 3:50pm

I am using my own computed vectors for the item I am searching and am happy with the examples of nearvector, nearoobject and hybrid searches.

what I’m not quite getting is where do I define my generative module, be it an OpenAI API-key based or my own generative on prem modulue.

Can anyone suggest a full example for this?

DudaNogueira · February 9, 2024, 11:03pm

Hi @rjalex !!

First, you need to enable that module in Weviate:

If you are using WCS, it is enabled by default.

So for example, let’s say you want this module:

Now, with that module installed, you need to create your collection and specify that module on it’s configuration.

Here we have a python v3 version recipe (py v4 should come soon):

github.com

weaviate/recipes/blob/main/generative-search/generative_search_openai.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "rJD9aP9eVcsT"
      },
      "source": [
        "## Dependencies"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "ReE5TWeXSDTe"
      },
      "outputs": [],
      "source": [
        "!pip install weaviate-client"

This file has been truncated. show original

Now, for the OpenAI APIKEY, you can set those both on your environment variable, or during query time.

Let me know if this helps

rjalex · February 10, 2024, 11:35am

Looks like the original page has serious formatting issues

DudaNogueira · February 10, 2024, 2:52pm

What formatting? I don’t see it.

rjalex · February 10, 2024, 7:26pm

on https://github.com/weaviate/recipes/blob/main/generative-search/generative_search_openai.ipynb the notebook cells seem jumbled:

Topic		Replies	Views
Generative search / RAG guide preview - feedback thread Resources	6	1583	October 16, 2023
Change OpenAI Generative Model for Existing Classes Support	3	394	December 10, 2024
Use of generative-openai moduleConfig Support neartext	5	266	April 8, 2024
Can we use my own LLM for generative search? General	3	151	April 16, 2024
RAG with image search General	1	64	August 3, 2024

Confused by the example of generative query

Related topics