# Backup Issue Weaviate

**URL:** https://forum.weaviate.io/t/backup-issue-weaviate/4341
**Category:** Support
**Tags:** integration
**Created:** [September 26, 2024, 1:05pm UTC](https://forum.weaviate.io/t/backup-issue-weaviate/4341 "2024-09-26T13:05:54Z")
**Posts on this page:** 10
**Page:** 1

<div class="post-metadata">

### Author: ![sanjeev1678](https://avatars.discourse-cdn.com/v4/letter/s/91b2a8/32.png) [@sanjeev1678](https://forum.weaviate.io/u/sanjeev1678)
#### Post date: [September 26, 2024, 1:05pm UTC](https://forum.weaviate.io/t/backup-issue-weaviate/4341/1 "2024-09-26T13:05:54Z")

</div>

Hello Team

I am getting this error, when I am running weaviate backup(.create) method.

The block list may not contain more than 50,000 blocks.\nERROR CODE: BlockListTooLong\n--------------------------------------------------------------------------------\n\ufeff\<?xml version="1.0" encoding="utf-8"?\>`BlockListTooLong`The block list may not contain more than 50,000 blocks.

I’ve been experimenting with the `chunk_size` and `compressionLevel` parameters in the backup configuration to address this issue.  
Please find my code.

```auto
result = client.backup.create(
backup_id="weaviate-backup_20240902600000_3",
backend='azure',
wait_for_completion=False,
config=BackupConfigCreate(chunk_size="256"),
include_collections = ['demotesting']
)

```

Given the size of the dataset, I suspect that the error is related to the number of data blocks generated during the backup process. To reduce the total number of blocks, I increase the chunk size, but still giving the same error.  
Please let me know how I can fix this issue

- Weaviate Server Version:
- Deployment Method: Kubernetes
- Number of Running Nodes: One node
- Weaviate Version: 1.25.0
- **backup-azure**
- weaviate python client: 4.6.5

---

<div class="post-metadata">

### Author: ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)
#### Post date: [September 30, 2024, 2:59pm UTC](https://forum.weaviate.io/t/backup-issue-weaviate/4341/2 "2024-09-30T14:59:22Z")

</div>

Hi @sanjeev1678 !!

I believe this is a bug 🤔

Have you tried a different module, for example, backup-s3?

I will create an issue on this after I get some word from our team.

Thanks!

---

<div class="post-metadata">

### Author: ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)
#### Post date: [September 30, 2024, 3:13pm UTC](https://forum.weaviate.io/t/backup-issue-weaviate/4341/3 "2024-09-30T15:13:26Z")

</div>

@sanjeev1678 !!

Also, can you try that with the latest version?

We had some changes on modules that have bumped some dependencies and may have fixed this.

THanks!

---

<div class="post-metadata">

### Author: ![sanjeev1678](https://avatars.discourse-cdn.com/v4/letter/s/91b2a8/32.png) [@sanjeev1678](https://forum.weaviate.io/u/sanjeev1678)
#### Post date: [October 1, 2024, 7:21am UTC](https://forum.weaviate.io/t/backup-issue-weaviate/4341/4 "2024-10-01T07:21:27Z")

</div>

Hello @DudaNogueira

In the meantime, I encountered multiple issue with the backup in Azure.

Error message:

**“upload stream "weaviate-backup/weaviate-0/doc/chunk-1": Put "\weaviate-backup\_20240902600000%2Fweaviate-0%2Fdoc%2Fchunk-1?blockid=5oN5xDQLTMVIhoP8%2F5nf8gAALL0AAAAAAAAAAAAA%3D%3D\u0026comp=block": dial tcp 20.60.128.132:443: connect: connection refused”**

Additionally, there’s another issue:

**“backup class industryintel descriptor: cannot create new backup, backup ‘weaviate-backup\_20240902600000’ is not yet released, this means its contents have not yet been fully copied to its destination, try again later”**

I was expecting these to be resolved in newer versions of Weaviate.

---

<div class="post-metadata">

### Author: ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)
#### Post date: [October 1, 2024, 8:08am UTC](https://forum.weaviate.io/t/backup-issue-weaviate/4341/5 "2024-10-01T08:08:27Z")

</div>

hi, sorry, are those logs from the latest version?

It was not clear if that you have updated it after the 1.25.0 version

---

<div class="post-metadata">

### Author: ![sanjeev1678](https://avatars.discourse-cdn.com/v4/letter/s/91b2a8/32.png) [@sanjeev1678](https://forum.weaviate.io/u/sanjeev1678)
#### Post date: [October 1, 2024, 8:20am UTC](https://forum.weaviate.io/t/backup-issue-weaviate/4341/6 "2024-10-01T08:20:20Z")

</div>

Hello @DudaNogueira

Yes, this is the logs from the latest version after updated to 1.25.0 version.

---

<div class="post-metadata">

### Author: ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)
#### Post date: [October 1, 2024, 8:29am UTC](https://forum.weaviate.io/t/backup-issue-weaviate/4341/7 "2024-10-01T08:29:59Z")

</div>

Oh, the latest version is 1.26.5, not 1.25 🤔

The changes I mentioned landed in latest 1.26.X version (not sure exactly which, so 1.26.5 is the best option)

---

<div class="post-metadata">

### Author: ![sanjeev1678](https://avatars.discourse-cdn.com/v4/letter/s/91b2a8/32.png) [@sanjeev1678](https://forum.weaviate.io/u/sanjeev1678)
#### Post date: [October 1, 2024, 8:45am UTC](https://forum.weaviate.io/t/backup-issue-weaviate/4341/8 "2024-10-01T08:45:25Z")

</div>

I understand, but will the issue with “backup not released yet” be resolved in the latest release?

A recurring issue we’re facing is that whenever a previous backup fails for any reason, this **“backup release not yet”** error appears for all subsequent backups.

This is a significant problem because once this issue occurs, entire backup pipeline stops functioning. It’s strange, and we should have some form of exception-handling mechanism to address and resolve this issue.

The error message we receive is:  
**“cannot create new backup, backup ‘weaviate-backup\_20240902600000’ is not yet released.”**

---

<div class="post-metadata">

### Author: ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)
#### Post date: [October 1, 2024, 9:24am UTC](https://forum.weaviate.io/t/backup-issue-weaviate/4341/9 "2024-10-01T09:24:02Z")

</div>

Hi @sanjeev1678 !

The new [1.26.5 version](https://github.com/weaviate/weaviate/releases/tag/v1.26.5) implements a new cancel backup endpoint:

> <https://github.com/weaviate/weaviate/pull/5765>
>
> \### What's being changed:
> this PR backports backup cancel endpoint PRs
> - http…s://github.com/weaviate/weaviate/pull/5639
> \- https://github.com/weaviate/weaviate/pull/5736
> 
> \### Review checklist
> 
> \- \[\] Documentation has been updated, if necessary. Link to changed documentation:
> \- \[x\] Chaos pipeline run or not necessary. Link to pipeline: https://github.com/weaviate/weaviate-chaos-engineering/actions/runs/10798058707
> \- \[\] All new code is covered by tests where it is reasonable.
> \- \[\] Performance tests have been run or not necessary.

Previously you could solve this by restarting Weaviate server, that will reset all backup processes.

This is not yet implemented on new client version, but you call this API directly.

here is the part of the openapi spec for that:

> <https://github.com/weaviate/weaviate/blob/faf123a410d73b7408a5b3a601609f3646c78bee/openapi-specs/schema.json#L4956>

You need to do a DELETE call to this endpoint:

> GET/backups/_{backend}_/_{id}_

Let me know if this helps!

---

<div class="post-metadata">

### Author: ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)
#### Post date: [October 1, 2024, 9:46am UTC](https://forum.weaviate.io/t/backup-issue-weaviate/4341/10 "2024-10-01T09:46:39Z")

</div>

Hi! By the way the legend @jphwang 🦸‍♂️ just updated our docs with that:

> **[Weaviate](https://weaviate.io/developers/weaviate/api/rest#tag/backups/DELETE/backups/%7Bbackend%7D/%7Bid%7D)**
