# Data model feasibility with extensive array filtering

**URL:** <https://forum.weaviate.io/t/data-model-feasibility-with-extensive-array-filtering/21830>\
**Category:** General\
**Tags:** technical\
**Created:** [August 13, 2025, 2:42pm UTC](https://forum.weaviate.io/t/data-model-feasibility-with-extensive-array-filtering/21830 "2025-08-13T14:42:40Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Fogapod](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/fogapod/32/7562_2.png) [@Fogapod](https://forum.weaviate.io/u/Fogapod)\
**Post date:** [August 13, 2025, 2:42pm UTC](https://forum.weaviate.io/t/data-model-feasibility-with-extensive-array-filtering/21830/1 "2025-08-13T14:42:40Z")

</div>

Hello, im currently in the process of selecting vector db for my use case:

tens of millions of dense + sparse vectors for hybrid search with extensive metadata filtering.

I expect to have primary int array field with ~300 numbers on average and a few other indexed scalar fields which would be used together.

I tried qdrant and it took more than a week on 32 core machine to index the data. Is this something weaviate could potentially do better? Is there any way to estimate the indexing/recall perf and memory usage?

---

<div class="post-metadata">

**Author:** ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)\
**Post date:** [August 13, 2025, 8:59pm UTC](https://forum.weaviate.io/t/data-model-feasibility-with-extensive-array-filtering/21830/2 "2025-08-13T20:59:36Z")

</div>

hi @Fogapod !!

Welcome to our community 🤗

We do have some calculations on how much of memory your vectors will be using:

[https://docs.weaviate.io/weaviate/concepts/resources](https://docs.weaviate.io/weaviate/concepts/resources#an-example-calculation)

However, for indexing, it will depend on the data type, replication and sharding, so I believe it would be better to do a test before 🤔

So I believe that some experimentation is necessary in order to map out the possible changes you can do in order to improve performance.

Let me know if this helps!