# Best way to multiprocess

**URL:** https://forum.weaviate.io/t/best-way-to-multiprocess/7377
**Category:** Support
**Created:** [November 1, 2024, 4:13pm UTC](https://forum.weaviate.io/t/best-way-to-multiprocess/7377 "2024-11-01T16:13:47Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![teapotboy](https://avatars.discourse-cdn.com/v4/letter/t/6de8d8/32.png) [@teapotboy](https://forum.weaviate.io/u/teapotboy)
#### Post date: [November 1, 2024, 4:13pm UTC](https://forum.weaviate.io/t/best-way-to-multiprocess/7377/1 "2024-11-01T16:13:47Z")

</div>

### Description

I’m trying to multiprocess my RAG with around 4 million queries. The queries are over one cluster but with different metadata filters. I have used ThreadPoolExecutor but there seems to be no improvement. I thought that each query can be paralleled on one cpu. Any idea how I should speed up the whole process? Thank you!

### Server Setup Information

- Weaviate Server Version:
- Deployment Method: 
- Multi Node? Number of Running Nodes:
- Client Language and Version:
- Multitenancy?:

### Any additional Information

---

<div class="post-metadata">

### Author: ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)
#### Post date: [November 4, 2024, 2:19pm UTC](https://forum.weaviate.io/t/best-way-to-multiprocess/7377/2 "2024-11-04T14:19:33Z")

</div>

Hi @teapotboy

Can you provide the version of both server and client you are using?

Are you running a multinode environment?

Thanks!

> [@teapotboy](#):
>
> - Weaviate Server Version:
> - Deployment Method:
> - Multi Node? Number of Running Nodes:
> - Client Language and Version:
> - Multitenancy?:

---

<div class="post-metadata">

### Author: ![Dirk](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dirk/32/46_2.png) [@Dirk](https://forum.weaviate.io/u/Dirk)
#### Post date: [November 4, 2024, 2:51pm UTC](https://forum.weaviate.io/t/best-way-to-multiprocess/7377/3 "2024-11-04T14:51:39Z")

</div>

You could try the async API: [Async API | Weaviate](https://weaviate.io/developers/weaviate/client-libraries/python/async)
