Hi @Tibin_Lukose,
This error is related to an old panic from back in the day, but the bug has already been resolved besides many other improvements:
“error”: “could not load or initialize schema: sync schema with other nodes in the cluster: read schema: open transaction: broadcast open transaction.”
Please be aware that you’re running a very outdated version of Weaviate, even before the RAFT mechanism was implemented for multi-node clusters.
You must upgrade to v1.25.32 post-RAFT, despite the fact that 1.25 is still considered outdated. The latest version of Weaviate is 1.29, so I highly recommend planning an upgrade soon - there are way too many features and great improvements that have been implemented.
Additionally, I see that you have only 2 nodes in your cluster. I’d highly recommend reading up on the concept of multi-node clusters. It is generally better to have 3 nodes (an odd number) for replication in Weaviate, rather than 2 nodes (an even number). Here’s why:
Raft-based cluster like Weaviate, a quorum is needed for the cluster to function properly. With 3 nodes, the quorum is 2, which means the cluster can continue to operate even if one node fails. In contrast, a 2-node cluster requires both nodes to be available to form a quorum, making it less fault-tolerant.
Consensus resolution: An odd number of nodes makes it easier to resolve conflicts and reach consensus. In a 3-node setup, a quorum can be reached with 2 nodes, providing better fault tolerance. A replication factor of 3 or 5 is commonly used as it provides a good balance between performance and fault tolerance.
I hope this helps!
Regards,
Mohamed Shahin
Weaviate Support Engineer