Where does weaviate backup store logs

Description

Where does weaviate backup store logs, backup failing with write object error to S3, started happening after cohere use.

Server Setup Information

  • Weaviate Server Version:
  • Deployment Method: k8s helm 1.24.3
  • Multi Node? Number of Running Nodes:
  • Client Language and Version: English

Any additional Information

Where are the logs?

hi @djjeffr !

It will be outputted at the stdout of the running container.

on k8s case, you can get the with:

kubectl get logs pod/weaviate-0

Let me know if this helps :slight_smile:

Thanks, still looking into issue, appears a k8s network or cpu throttling config may be effecting minio.

The problem appears to be in the weaviate backup code, it is deciding to call s3.abortMultipartUpload after get 499 http error. This causes the broken pipe which ends backup with fail.

HUmm…

Can you open an issue in our GH at Issues · weaviate/weaviate · GitHub?

If possible, providing a reproducible code. That helps a lot!

Thanks!

See https://github.com/weaviate/weaviate/issues/4743

~WRD0000.jpg

1 Like