Hi,
What is the best way to change the message that is returned if the query being asked could not be found in the context of the added documents? I would just like to customise it a little.
Regards,
Hi!
The way to accomplish this is to be explicit on the prompt. As you are using Verba, it doesn’t seem to have this feature for now.
One way would be changing this part here (I believe):
yield {
"message": "",
"finish_reason": chunk["choices"][0]["finish_reason"],
}
except StopAsyncIteration:
pass
except Exception:
raise
def prepare_messages(
self, queries: list[str], context: list[str], conversation: dict[str, str]
) -> dict[str, str]:
"""
Prepares a list of messages formatted for a Retrieval Augmented Generation chatbot system, including system instructions, previous conversation, and a new user query with context.
@parameter queries: A list of strings representing the user queries to be answered.
@parameter context: A list of strings representing the context information provided for the queries.
@parameter conversation: A list of previous conversation messages that include the role and content.
@returns A list of message dictionaries formatted for the chatbot. This includes an initial system message, the previous conversation messages, and the new user query encapsulated with the provided context.
Let me know if this helps.
THanks!
Awesome! Thank you, that was exactly it. I can tell it in the content how to reply to certain messages.
1 Like
