Adjusting the query.nearText parameter: Retrieving comments on LinkedIn

Hello, I have a question.

I am using Weaviate to retrieve comments created by users to posts on LinkedIn.

I save the content of the linkedin post and the comment posted in weaviate. And from another post content, I want to retrieve nearby posts so that the AI can be inspired by the user’s way of answering.

I’m in the process of refining the distance (query.nearText).

At the moment, it’s 0.3. What do you recommend?

I want to retrieve comments similar to posts that have already been answered.

hi @Mattk !!

Welcome to our community :hugs:

Limiting the results by a fixed threshold of distance (or score) can be tricky, as those can change depending on the indexed content and query.

One suggestion is to use the auto cut feature:

That will group your results by distance jump between them, and can filter out the results that are groups away from your query.

Let me know if this helps!

Thanks!