Batch insert progress bar updates rarely in logs view. Buffer flush?

Support
1

Description

When viewing logs of a batch upsert jobs, I have to wait several minutes between progress bar printouts. I ran the process with python3 -u but it did not help. Does the progress bar in weaviate need to specifically run with some internal print buffer flushing arguments? Can weaviate be updated with this feature?

Server Setup Information

  • Weaviate Server Version: docker image version 1.24.2
  • Deployment Method: k8s
  • Multi Node? Number of Running Nodes: 1
  • Client Language and Version: python, weaviate-client==4.5.3
  • Multitenancy?: no

Any additional Information

2

hi @moruga123 !!

I believe you are talking about the tqdm lib, right?

If that’s the case, this is not a builtin feature in Weaviate cliente, but just a wrapper used around the insert.

Here is more info on tqm:

Let me know if this is the case here.

thanks!