[Question] Syncing embedded Weaviate with Cloud?

Support
1

I couldn’t find much information on how to set up syncing between the two so that the data gets replicated with cloud. Trying to create a local-first but cloud sync also solution

2

Good morning @Tejas_Sharma,

I hope you having a lovely week!

I understand that you are trying to replicate data to Weaviate Cloud Cluster from a Local Cluster, Am I correct?

You can use a migration script in our documentation where you can move collection (s) from local instance to could instance.

3

Hi Mohamed,

Thanks for getting back.

Actually, I’m not trying to migrate but keep both since the user would want a local-first too in case their internet is not available. I was wondering if there was a recommended way to keep both in sync or on each operation, I would have to modify both instances (and in case of being offline, I guess would have to store the operations for when the internet connects)

4

Hi @Tejas_Sharma,

What you’re trying to achieve sounds like a fantastic idea and a valuable feature to implement. Currently, there isn’t a straightforward way to establish such synchronous behavior between two instances. However, I believe this could be a very beneficial feature.

I suggest opening a feature request here

When a feature gets enough votes from our users, it draws attention from our engineers, and we can add it to the roadmap.

I mentioned migration as a method to replicate data from a source to a destination, ensuring you have a replicated instance. However, I agree with you that for now, tracking and storing operations locally and then queuing and batching them once online to match the instances might be the best approach.

5

Thanks Mohamed, submitting it there

1 Like