# Additional Chunkers for Verba

**URL:** <https://forum.weaviate.io/t/additional-chunkers-for-verba/2612>\
**Category:** General\
**Created:** [June 3, 2024, 9:25pm UTC](https://forum.weaviate.io/t/additional-chunkers-for-verba/2612 "2024-06-03T21:25:08Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![mmike87](https://avatars.discourse-cdn.com/v4/letter/m/e19adc/32.png) [@mmike87](https://forum.weaviate.io/u/mmike87)\
**Post date:** [June 3, 2024, 9:25pm UTC](https://forum.weaviate.io/t/additional-chunkers-for-verba/2612/1 "2024-06-03T21:25:08Z")

</div>

Hi, I am new to Verba and LLMs in general, however I have spent a lot of time over the last couple weeks getting up to speed. Verba seemed like a great way to POC some of the ideas I’m trying to sell to my company’s product management team.

I noticed that there is only the one basic “chunker” available. Is there a location where other chunkers can be found? Many of the videos seem to show other chunkers, but the project only has the Token Chunker.

I’m having trouble getting the results I am looking for, and wanted to play with other chunking strategies. I could certainly write some, but for POC work I’d rather not have to write a chunker just to try it, so I thought I’d look to see if anyone knows of any repos that have chunkers for Verba or that could easily be adapted.

Thanks in advance for any suggestions. So far, I am having a good time with Verba!

---

<div class="post-metadata">

**Author:** ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)\
**Post date:** [June 3, 2024, 11:07pm UTC](https://forum.weaviate.io/t/additional-chunkers-for-verba/2612/2 "2024-06-03T23:07:36Z")

</div>

hi @mmike87 !

There is a folder where the chunking components live:

> **[Verba/goldenverba/components/chunking at main · weaviate/Verba](https://github.com/weaviate/Verba/tree/main/goldenverba/components/chunking)**
>
> Retrieval Augmented Generation (RAG) chatbot powered by Weaviate - weaviate/Verba

Indeed there is only one there ☹

If you want to play more with chunks, I first suggest you this doc:

> **[A brief introduction to chunking | Weaviate - Vector Database](https://weaviate.io/developers/academy/py/standalone/chunking/introduction)**
>
> \<!-- import imageUrl from '../../tmpimages/academyplaceholder.jpg';

Then I also suggest you this recipe, using langchain:  
[GitHub - weaviate/recipes: This repository shares end-to-end notebooks on how to use various features and integrations with Weaviate at the core!](https://github.com/weaviate/recipes) (check integrations / llm-frameworks / langchain)

There you can see how to use langchain’s chunking libs. And now the third suggestion, are suggestion, langchain’s chunk libs:

> **[Text Splitters | 🦜️🔗 LangChain](https://python.langchain.com/v0.1/docs/modules/data_connection/document_transformers/)**
>
> Once you've loaded documents, you'll often want to transform them to better suit your application. The simplest example

Of course, that will drive you apart from Verba a little bit, but will get you a good set of tools to tune and experiment more.

For now, Verba, understandably, is only supporting a limited number of splitters/chunkers, models, etc.

Please, feel free to voice your feature request at our github:

> **[GitHub - weaviate/Verba: Retrieval Augmented Generation (RAG) chatbot powered...](https://github.com/weaviate/Verba/)**
>
> Retrieval Augmented Generation (RAG) chatbot powered by Weaviate - weaviate/Verba

Let me know if this helps 🙂

Thanks!

---

<div class="post-metadata">

**Author:** ![mmike87](https://avatars.discourse-cdn.com/v4/letter/m/e19adc/32.png) [@mmike87](https://forum.weaviate.io/u/mmike87)\
**Post date:** [June 4, 2024, 2:48am UTC](https://forum.weaviate.io/t/additional-chunkers-for-verba/2612/3 "2024-06-04T02:48:46Z")

</div>

Thanks! That is indeed helpful. I haven’t played with LangChain yet, but no better time than the present. Thanks again.