How can I specify the max length of a RAG response?

Support
1

I’m using the Generative Search - OpenAI module and the query responses for grouped_task are huge. How can I limit the size of these? The docs don’t have much detail for this. The maxTokensProperty in the moduleConfig with the schema doesn’t appear to change this size either.

2

Hi @Hannah_Grossman ! Welcome to our comnmunity :hugs:

Have you tried passing it as an instruction whithin the prompt itself?