GSE Tokenizer on WCD

Although it is stated that GSE tokenizer is available from WCD v1.24, it seems that it is still unavailable (When I try to use it, the error message suggests I have to set environmental variable ENABLE_TOKENIZER_GSE to be true but I cannot do that on WCD), the reference is here.

I really need to use hybrid search with decent tokenizer for my
Japanese client and it will be great if I could use GSE somehow on
WCD.

Thanks.

hi @dnot23 !

Sorry for the delay here. Missed this one.

We are working on allowing changing more configurations in our WCD serverless offering.

Right now we enable this configuration for Bring your Own Cloud offering.

While I do not have an ETA for this feature, I know this is a prio in our roadmap.

Thanks!

1 Like