Read all objects

Support
1 
collection = client.collections.get("WineReview").with_consistency_level(ConsistencyLevel.ALL)
for item in collection.iterator():
    print(print(item.uuid, item.properties))

Hi team , does the above retrieves all the objects present in the collection and read on repair happens parallely , regardless of no limit and after params given ?

2

Hi @Dharanish !

It should. AFAIK, it will fix those eventual inconsistencies on read.

Also, keep an eye for our roadmap.

Hopefully we’ll have async repair in 1.25:

Ps: Don’t forget to leave your thumbs up on this issue :wink:
Ps: And, for course, our :star: in our Github repo :wink:

Thanks!

1 Like
3

Hey, just following up to this since I also would like this feature.

I want to run a process on each node in a collection and save if the process has been completed as a DoneProcessing boolean property in each node. Since I will be running on all nodes I should naturally be using your iterator class, but if my script fails and I need to start again I’d prefer not to read nodes that have already been processed. I know I can run queries with the boolean filter in a while loop, but it feels like an antipattern if you have an iterator class.

Great work with Weaviate btw, it’s an amazing tool!!

4

@clpurcell Please see Consistency | Weaviate

5

Hi Mohamed,

Thank you for the quick reply!

I’m not sure how your link helps. I’m not running with any replication, just a single-node local deployment.

In case what I described wasn’t clear here is some more background information. The process I’m running takes a node and calculates other nodes that may match it. If matches are found, I save them as references for that node. To track which nodes I’ve already run this matching process on I’ve created a boolean field called DoneProcessing and set all nodes to False. As my script iterates over all nodes and runs this matching process I update DoneProcessing to True.

Again, thanks for the help and your great work!

6

Hey @clpurcell

Thank you for your confirmation, I may misread that.

Would you please open a new topic and put all details there including your snippet of code?

I will try to replicate and we have a dedicated thread in the forum for that in case we rule out any bugs.

I appreciate it.