Description
Keyword Score in explain_score returns no value, namely NaN, for chunks that explicitly contain the searched keyword. This happens when the amount of chunks in the environment exceeds like 12-15 chunks. So, e.g. we have a chunk:
“lorem ipsum lorem ipsum lorem ipsum POTATO+Premium lorem ipsum lorem ipsum lorem ipsum etc” (around 300 tokens)”
and we have it 5 times in the database, we receive the keyword score for the search input POTATO+Premium. But as soon as the chunks is 12 times in the database, no keyword score is returned for the same chunk (or for any at all) for the same search input POTATO+Premium.
What could be the possible problem here?
Server Setup Information
- Weaviate Server Version: 1.25.13
- Deployment Method: Kubernetes
- Multi Node? Number of Running Nodes: 1
- Client Language and Version: Python 4.16.10
- Multitenancy?: No