Weaviate Batch writes throwing errors

When I do batch writes using weaviate spark connector version 1.3.2, after a certain number of records are written, the batch write fails with the error:

io.weaviate.spark.WeaviateResultError: error getting result and no more retries left. Error from Weaviate: [WeaviateErrorMessage(message=error waiting for local schema to catch up to version 257: deadline exceeded for waiting for update: version got=87 want=257, throwable=null)

Hey @Arindom_Bora,

Welcome to the community! :partying_face: It’s great to have you with us :hugs:

This looks like a simple timeout issue, likely due to some temporary network latency.

Just increase the timeout in your Weaviate connection configuration. Additionally, you can reduce batch a bit in case and it’s always good to have a retry logic.

Let me know if that helps!

Best regards,

Mohamed Shahin
Weaviate Support Engineer
(Ireland, UTC±00:00/+01:00)

Actually, the disc was full in one of the pods, because of which raft wasn’t working properly, had to manually clear it

1 Like