# Storing the data to weaviate

**URL:** <https://forum.weaviate.io/t/storing-the-data-to-weaviate/1950>\
**Category:** Support\
**Created:** [April 8, 2024, 12:29pm UTC](https://forum.weaviate.io/t/storing-the-data-to-weaviate/1950 "2024-04-08T12:29:02Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![garcia.e](https://avatars.discourse-cdn.com/v4/letter/g/848f3c/32.png) [@garcia.e](https://forum.weaviate.io/u/garcia.e)\
**Post date:** [April 8, 2024, 12:29pm UTC](https://forum.weaviate.io/t/storing-the-data-to-weaviate/1950/1 "2024-04-08T12:29:03Z")

</div>

Hello,  
I have a question about storing data into the weaviate (inside a docker in a virtual machine).  
When i push some data into weaviate, it needs to connect to openIA, but, all the data stays in local? Because its a confidential data that we’re storing in to the docker and i need to be sure that all the data stays always in Local.

Thanks!

---

<div class="post-metadata">

**Author:** ![rjalex](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/rjalex/32/807_2.png) [@rjalex](https://forum.weaviate.io/u/rjalex)\
**Post date:** [April 8, 2024, 4:43pm UTC](https://forum.weaviate.io/t/storing-the-data-to-weaviate/1950/2 "2024-04-08T16:43:10Z")

</div>

Hi, if you use OpenAI as your vectorizer your data will be sent to them, vectorized and the vector returned and inserted along with your object. No way around this.

If your need is to never send data, then you must look into vectorising with a self-hosted model, either manually, meaning that you will not let Weaviate vectorize automatically and manually compute the vector and add it to the object data, or use the text2vector-transformer module and package your model in a container which you will use as the default vectorizer module. Hope this helps a little.

Ciao from Roma !

---

<div class="post-metadata">

**Author:** ![garcia.e](https://avatars.discourse-cdn.com/v4/letter/g/848f3c/32.png) [@garcia.e](https://forum.weaviate.io/u/garcia.e)\
**Post date:** [April 11, 2024, 10:22am UTC](https://forum.weaviate.io/t/storing-the-data-to-weaviate/1950/3 "2024-04-11T10:22:35Z")

</div>

Thanks!

Now I’m trying to incorporate a local vectorize model, but i think i’m doing something wrong. What i’m doing is using the parameter “vector” in the add\_data\_object function, and using de en\_core\_web\_lg model from spaCY to create the vector.

How can I make weaviate to not vectorize automatically?

---

<div class="post-metadata">

**Author:** ![rjalex](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/rjalex/32/807_2.png) [@rjalex](https://forum.weaviate.io/u/rjalex)\
**Post date:** [April 11, 2024, 5:14pm UTC](https://forum.weaviate.io/t/storing-the-data-to-weaviate/1950/4 "2024-04-11T17:14:01Z")

</div>

This magic happens in three places 🙂

In the weaviate docker-compose.yml file you do not declare any modules:

```auto
services:
  weaviate:
    volumes:
      - weaviate_data:/var/lib/weaviate
    image: semitechnologies/weaviate:1.24.21
    ports:
      - 8077:8080
      - 50051:50051
    restart: on-failure:0
    environment:
      QUERY_DEFAULTS_LIMIT: 25
      AUTHENTICATION_ANONYMOUS_ACCESS_ENABLED: "true"
      PERSISTENCE_DATA_PATH: "/var/lib/weaviate"
      DEFAULT_VECTORIZER_MODULE: "none"
      CLUSTER_HOSTNAME: "node1"

volumes:
  weaviate_data:

```

as you can see there’s a **DEFAULT\_VECTORIZER\_MODULE: “none”**

the second is where you define your collection:

```auto
 client.collections.create(
        schema_name,
        description="A class to store articles with a semantic kicker and searchable author.",
        vectorizer_config=None,
        inverted_index_config=wvcc.Configure.inverted_index(
            index_property_length=True,
            stopwords_preset=None,
            stopwords_additions=isagog_stopwords,
        ),
        vector_index_config=wvcc.Configure.VectorIndex.hnsw(
            distance_metric=wvcc.VectorDistances.COSINE
        ),
        properties=[
            # default tokenization is tokenization=wvcc.Tokenization.WORD
            wvcc.Property(name="app_id", data_type=wvcc.DataType.TEXT, tokenization=wvcc.Tokenization.FIELD), # app generated publicationDay-slug   
            wvcc.Property(name="author", data_type=wvcc.DataType.TEXT), # search/filter
            wvcc.Property(name="category", data_type=wvcc.DataType.TEXT), # search/filter
            wvcc.Property(name="excerpt", data_type=wvcc.DataType.TEXT), # search/filter
            wvcc.Property(name="kicker", data_type=wvcc.DataType.TEXT), # to be vectorized
            wvcc.Property(name="locmentions", data_type=wvcc.DataType.TEXT), # search/filter
            wvcc.Property(name="orgmentions", data_type=wvcc.DataType.TEXT), # search/filter
            wvcc.Property(name="permentions", data_type=wvcc.DataType.TEXT), # search/filter
            wvcc.Property(name="publicationDay", data_type=wvcc.DataType.TEXT, tokenization=wvcc.Tokenization.FIELD), # search/filter
            wvcc.Property(name="tag", data_type=wvcc.DataType.TEXT, tokenization=wvcc.Tokenization.FIELD), # search/filter
            wvcc.Property(name="title", data_type=wvcc.DataType.TEXT), # to be vectorized
            wvcc.Property(name="topic", data_type=wvcc.DataType.TEXT, tokenization=wvcc.Tokenization.FIELD), # search/filter
        ]
    )

```

and again you can see a **vectorizer\_config=None**

Then when you insert your object you must insert both the data and ist manually derived vector. Something along the following lines:

```auto
try:
        with client.batch.dynamic() as batch:
            for item in data:   
                vector = item.pop('vector') # This removes and returns the vector
                properties = item # The rest of the data is now in 'properties'         
                batch.add_object(properties=properties, collection=schema_name, vector=vector)

```

hope this helps. Hasta la victoria !!! 🙂

---

<div class="post-metadata">

**Author:** ![garcia.e](https://avatars.discourse-cdn.com/v4/letter/g/848f3c/32.png) [@garcia.e](https://forum.weaviate.io/u/garcia.e)\
**Post date:** [April 12, 2024, 10:08am UTC](https://forum.weaviate.io/t/storing-the-data-to-weaviate/1950/5 "2024-04-12T10:08:15Z")

</div>

Thanks!  
It will help for sure!
