ImageBind failed to load an audio file while creating embedding

Support
, ,
1

Description

The following error shows up when i tries to insert an audio and using the ImageBind to create a embedding for it

Object was not added! Unexpected status code: 500, with response body: {'error': [{'message': 'vectorize target vector audio_vector: update vector: fail with status 500: Failed to load audio from 2025_07_07-03_48_09_233837_AM_4789'}]}.

Server Setup Information

  • Weaviate Server Version: 1.31.3
  • Deployment Method: docker
  • Multi Node? Number of Running Nodes: 1
  • Client Language and Version: python
  • Multitenancy?: no

Any additional Information

My code python code:

import weaviate
from weaviate.classes.config import Configure, DataType, Property, Multi2VecField
from datetime import datetime, timezone
import shutil
import base64

from module import chunker, asr

# Connect to Weaviate
client = weaviate.connect_to_local(
    host="192.168.31.140",
    port=8099,
)

if client.collections.exists("AudioCollection"):
    client.collections.delete("AudioCollection")

client.collections.create(
    "AudioCollection",
    properties=[
        Property(name="title", data_type=DataType.TEXT),
        Property(name="audio", data_type=DataType.BLOB),
    ],
    vectorizer_config=[
        Configure.NamedVectors.multi2vec_bind(
            name="audio_vector",
            audio_fields=[Multi2VecField(name="audio", weight=1.0)],
            text_fields=[Multi2VecField(name="title", weight=0.0)],
        )
    ],
)


def file_to_base64(path):
    with open(path, "rb") as f:
        return base64.b64encode(f.read()).decode("utf-8")


collection = client.collections.get("AudioCollection")

audio_b64 = file_to_base64("/Users/tomy999/Downloads/test1.mp3")

obj = {
    "title": "Sample audio",
    "audio": audio_b64,
}

collection.data.insert(obj)
4

hi @Tomywang999 !!

Welcome to our community :hugs:

Do you see any error on ImageBind’s server logs? WHat about Weaviate server logs?

Also, can you send out the mp3 file directly to image bind?

This error message indicates that Weaviate got a 500 error while trying to vectorize this object.

Let me know if this helps!

Thanks!