Resource limit values

Support
1

Hi Team.

When configuring a Weaviate cluster for performance improvement, it is believed that the appropriate shard should be expanded.
In this case, I’d like to know if there are any limitations on setting limits per pod?
I would like to know the maximum or appropriate limit values that one Pod can use for the next items.

  • CPU
  • Memory
  • PV size

Thank you.

2

Hi!

This will depend on the machine you have available.

As long as it supports more memory and more CPU, Weaviate will use it.

So the limit here is more on the machine/hardware side, not on Weaviate.

1 Like
3

Hi @DudaNogueira

As you suggested, I will not set the CPU and memory limits when creating Weaviate with Helm Chart. In the case of PV, the default is set to 32Gi, which is appropriate in most cases? If the initially planned space is insufficient, how should it be expanded?

  1. Create additional replicas
  2. Expand PV space

Which method would you recommend more?

Thank you.

4

hi @Rio !

You can just increase the PV for that cluster. If using our oficial helm, just changing the corresponding parameter in values.yaml

Let me know if this help!

1 Like
5

Hello. @DudaNogueira

As you told me, I modified the corresponding part of the values.yaml file and executed the helm upgrade command, and the following error occurs.

[values.yaml]
storage:
size: 40Gi
storageClassName: “”

[Error Message]
Error: UPGRADE FAILED: cannot patch “weaviate” with kind StatefulSet: StatefulSet.apps “weaviate” is invalid: spec: Forbidden: updates to statefulset spec for fields other than ‘replicas’, ‘ordinals’, ‘template’, ‘updateStrategy’, ‘persistentVolumeClaimRetentionPolicy’ and ‘minReadySeconds’ are forbidden

My helm chart version is ‘weaviate-16.8.0’
What’s the problem?

6

Hi!

I believe this can be something you will need to check with the k8s provider. :thinking:

You probably will get a similar issue for other apps.

This is where that value from the helm is used:

Let me know if this helps.

Thanks!

1 Like
7

ok. I will check it.

thank you.

1 Like