Hello everyone. I need some help regarding the following issue
I have a weaviate instance that doesn’t support gRPC (i cannot use weaviate client version 4 on it). I have an S3 bucket that acts as a backup for the mentioned weaviate instance. Now I have created a weaviate cluster that has 3 weaviate instances on openstack. The idea is to use them as shards and shard based on id
My question is - Is there a way to load / import data from S3 into the weaviate instance? If so, is there a way to import the data into weaviate shards from S3?
Any help or resource is appreciated, or a link to relevant part of documentation!
Thank you so much in advance! 
hi @AnnTade !!
Great question. If I understood it correctly, you want to now use a multi node cluster, and have your data in a single node cluster.
In those cases, you cannot use the backup/restore functions. That’s because, upon restoring at target
, the collection in the new cluster will still have the very same configurations you had in souce
.
There is a feature in our roadmap that will make it possible using dynamic scaling.
But for now, you will need to create the target
collection, define the replication factor accordingly, and migrate your data to this new cluster.
We have a fairly simple migration guide available here:
Let me know if this helps!
Thanks!