Weaviate startup time has increased with 1.25 onwards

Description

We have upgraded from 1.24.23 to 1.26.4. Earlier weaviate was able to start up within a second, however after upgrading, it takes 2-10 seconds to come up for small dataset. As per documentation, that it takes time to migration the schema due to RAFT, however this is not only taking time once during upgrade instead it takes whenever it restarts after the upgrade.

Server Setup Information

  • Weaviate Server Version: 1.26.4
  • Deployment Method: k8s
  • Multi Node? Number of Running Nodes: 1
  • Client Language and Version: python and v3
  • Multitenancy?: No

Any additional Information

Hi!

How small is this dataset?

Can you try testing it on a second cluster that doesn’t do migration?

Also, do you see any outstanding logs during the startup?

I think the RAFT startup takes longer than the old startup-code. I also noticed that

yes, it takes similar time with a new index without any documents.