Keyword Scores missing

Description

Keyword Score in explain_score returns no value, namely NaN, for chunks that explicitly contain the searched keyword. This happens when the amount of chunks in the environment exceeds like 12-15 chunks. So, e.g. we have a chunk:

“lorem ipsum lorem ipsum lorem ipsum POTATO+Premium lorem ipsum lorem ipsum lorem ipsum etc” (around 300 tokens)”

and we have it 5 times in the database, we receive the keyword score for the search input POTATO+Premium. But as soon as the chunks is 12 times in the database, no keyword score is returned for the same chunk (or for any at all) for the same search input POTATO+Premium.

What could be the possible problem here?

Server Setup Information

  • Weaviate Server Version: 1.25.13
  • Deployment Method: Kubernetes
  • Multi Node? Number of Running Nodes: 1
  • Client Language and Version: Python 4.16.10
  • Multitenancy?: No

Any additional Information

Hi @A_S

You’re currently running a very old version, and the NaN issue you’re seeing, I remember saw before which was actually a bug in earlier releases.

We’re now at version 1.33, so I strongly recommend you:

  1. Upgrade your Weaviate DB to the latest version.

  2. Upgrade your client library to the latest release as well (because you will run into compatibility issues if not).

Best regards,

Mohamed Shahin
Weaviate Support Engineer
(Ireland, UTC±00:00/+01:00)