Storing JSON data inside weaviate vector db

chrono2 · January 30, 2024, 3:55am

Hello everyone,

I was able to write a python script to add json data from a API feed. This stores data on the latest Hockey scores and matches.

After completing this, how would I get my openai APP to connect to weaviate, read the json data, and then be able to answer questions from this data?

For example, when is the next Penguins game? Did the Penguins lose last night?

Is this even possible? Would openai be able to take user queries (questions) and be able to read the json data and make sense of it all?

I thought it would but the questions are not being answered Just responds normal gpt responses. Since the JSON data does have hockey scheduling and game info, I figured it would be able to answer these questions, but it seems like there is a bigger part to this.

Anyone can suggest what I am missing? Or which route to go? Do I need to store this JSON data inside a SQL db and then maybe use Text to SQL features? That means…I won’t have any need for weaviate?

Thanks

DudaNogueira · January 30, 2024, 5:35pm

Hi!

Weaviate will connect to OpenAi for vectorizing the data and generating the answer, not the other way around.

Here we have a recipe that will show you exactly how to accomplish that:

github.com

weaviate/recipes/blob/main/generative-search/generative_search_openai.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "rJD9aP9eVcsT"
      },
      "source": [
        "## Dependencies"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "ReE5TWeXSDTe"
      },
      "outputs": [],
      "source": [
        "!pip install weaviate-client"

This file has been truncated. show original

Let me know if that helps!

chrono2 · February 1, 2024, 1:14pm

Thank you. I will go ahead and take a look at this.

Topic		Replies	Views
Should I choose Weaviate for my first project? Support	2	294	December 19, 2023
Can Weaviate read JSON data? Support python , technical	4	102	December 3, 2024
How do I store Stripe's OpenAPI JSON file (Which is highly unstructured JSON file) on weaviate? General	18	920	July 6, 2023
Weaviate and ChatGPT Retrieval Plugin Query No Results Support	1	420	November 20, 2023
OpenAI API Key Leaked Support	3	465	February 16, 2025

Storing JSON data inside weaviate vector db

Related topics