Lost classes in schema

Support
1

I have created 2 classes in my weaviate instance and populated them with data
I can see them in the /var/lib/weaviate directory in my docker container
But after a restart of the weaviate container, suddenly a call to
curl http://localhost:8080/v1/schema
returns

{"classes":[]}

How is it possible? any idea ?

Thanks

Olivier

2

did you mount /var/lib/weaviate to somewhere on your local storage?

3

Yes, I’m using a docker volume mounted via docker compose

4

The content of the directory “survives” after a container restart, I can see perfectly the index files with the name of my classes, but apparently the schema is empty

5

can you share your docker-compose.yml?

6

A fragment:

version: '3.4'
services:
############################################################################################
# WEAVIATE
    sherpa-weaviate:
        container_name: "sherpa-weaviate"
        image: semitechnologies/weaviate:1.19.5
        runtime: nvidia
        environment:
            - TRANSFORMERS_INFERENCE_API=http://localhost:18082
            - QUERY_DEFAULTS_LIMIT=25
            - AUTHENTICATION_ANONYMOUS_ACCESS_ENABLED=true
            - PERSISTENCE_DATA_PATH=/var/lib/weaviate
            #- DEFAULT_VECTORIZER_MODULE=text2vec-openai
            - DEFAULT_VECTORIZER_MODULE=text2vec-transformers
            - ENABLE_MODULES=backup-filesystem,text2vec-transformers,generative-openai,text2vec-openai,text2vec-huggingface
            - CLUSTER_HOSTNAME=node1
            - BACKUP_FILESYSTEM_PATH=/var/lib/weaviate_backup
        volumes:
            - wadata:/var/lib/weaviate
            - wabackup:/var/lib/weaviate_backup
        network_mode: host
        hostname: localhost
        command:
            - --host
            - 0.0.0.0
            - --port
            - '18081'
            - --scheme
            - http
        restart: always
############################################################################################
# T2V-TRANSFORMERS
    sherpa-t2v-transformers:
        container_name: "sherpa-t2v-transformers"
        #image: semitechnologies/transformers-inference:sentence-transformers-all-MiniLM-L12-v2
        #image: semitechnologies/transformers-inference:sentence-transformers-paraphrase-multilingual-mpnet-base-v2
        #image: kairntech/transformers-inference:sentence-camembert-base
        image: kairntech/transformers-inference:flaubert-base-uncased-xnli-sts
        runtime: nvidia
        environment:
            - ENABLE_CUDA=1
            - NVIDIA_VISIBLE_DEVICES=all
            - T2V_TRANSFORMERS_DIRECT_TOKENIZE=1
        network_mode: host
        hostname: localhost
        working_dir: /app
        entrypoint: uvicorn
        command: [ "app:app",  "--host",  "0.0.0.0",  "--port",  "18082" ]
############################################################################################
volumes:
    wadata:
      driver: local
      name: sherpa_wadata
    wabackup:
      driver: local
      name: sherpa_wabackup
7

It works perfectly well and resist to restart
But once I had this problem: schema empty unless the classes are still present in the /var/lib/weaviate dir

8

Could you clarify what you mean? Are you saying the problem has disappeared?

9

I’m just saying that most of the time it works like a charm but I had the problem once without any explanation that’s why I was asking if it is a known problem ? or is there a way to restore the schema when the index files of the classes are still present on the disk?

10

no, it is not a known problem. Could you please file a bug report so our engineers can look into this?

11

2 posts were split to a new topic: Adding backup module – don’t want to lose my data