# Aggregate text slow on 50k plus objects

**URL:** <https://forum.weaviate.io/t/aggregate-text-slow-on-50k-plus-objects/2911>\
**Category:** Support\
**Tags:** python\
**Created:** [July 2, 2024, 7:08pm UTC](https://forum.weaviate.io/t/aggregate-text-slow-on-50k-plus-objects/2911 "2024-07-02T19:08:49Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![ublrama](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/ublrama/32/1869_2.png) [@ublrama](https://forum.weaviate.io/u/ublrama)\
**Post date:** [July 2, 2024, 7:08pm UTC](https://forum.weaviate.io/t/aggregate-text-slow-on-50k-plus-objects/2911/1 "2024-07-02T19:08:49Z")

</div>

Hi, I have a collection with approximately 55K objects. I am using the multi2vec-clip as vectorizer. Each object contains a property named “collection” which refers to the image collection the object belongs to. Now I want get the total count of each collection. When I do a count for all objects, I get a response instantly. But when I i do a count for each collection it takes a very long time. To reproduce you can use the following GraphQL

```auto
{
      Aggregate {
        Schema_name{
            collection{
                count
                type
                topOccurrences{
                    value
                    occurs
                }
                
            }   
        }
        
      }
    }

```

This is my schema

```auto
 schemaConfig = {
        'class': schema, # class name for schema config in Weaviate (change it with a custom name for your images)
        'vectorizer': 'multi2vec-clip',
        'vectorIndexType': 'hnsw',
        "moduleConfig": {
            "multi2vec-clip": {
                "imageFields": [
                    "image"
                ],
                "textFields": [
                    "metadata",
                    "metadata_string",
                    "title",
                    "url",
                    "collection"
                ],

            },
            "generative-openai": {
                "model": "gpt-3.5-turbo"
            },
        },
        'properties': [
            {
                'name': 'image_id',
                'dataType': ['text']
            },
            {
                'name': 'image',
                'dataType': ['blob']
            },
            {
                'name': 'metadata',
                'dataType': ['text[]']
            },
            {
                'name': 'metadata_string',
                'dataType': ['text']
            },
            {
                'name': 'title',
                'dataType': ['text']
            },
            {
                'name': 'url',
                'dataType': ['text']
            },
            {
                'name': 'handle',
                'dataType': ['text']
            },
            {
                'name': 'collection',
                'dataType': ['text']
            }
        ]
    }

```

Can someone shed some light why the performance is slow when trying to aggregate?

Thank you very much

---

<div class="post-metadata">

**Author:** ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)\
**Post date:** [July 3, 2024, 6:58pm UTC](https://forum.weaviate.io/t/aggregate-text-slow-on-50k-plus-objects/2911/2 "2024-07-03T18:58:00Z")

</div>

Hi @ublrama !!

Welcome to our community 🤗

Aggregate, AFAIK, is a CPU and DISK bound operations.

Do you have any metrics on this cluster?

Also, please, fill in the requested infos so we can understand better your scenario:

- Weaviate Server Version:
- Deployment Method: 
- Multi Node? Number of Running Nodes:
- Client Language and Version:
- Multitenancy?:  
Thanks!

---

<div class="post-metadata">

**Author:** ![ublrama](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/ublrama/32/1869_2.png) [@ublrama](https://forum.weaviate.io/u/ublrama)\
**Post date:** [July 5, 2024, 6:34am UTC](https://forum.weaviate.io/t/aggregate-text-slow-on-50k-plus-objects/2911/3 "2024-07-05T06:34:38Z")

</div>

Thanks for your reply. Here is the additional information:

- Weaviate Server Version: 1.25.3
- Deployment Method: Docker
- Multi Node? Number of Running Nodes: 1
- Client Language and Version: Python 3.11 with Weaviate 4.6.3
- Multitenancy?: No

---

<div class="post-metadata">

**Author:** ![DudaNogueira](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dudanogueira/32/7846_2.png) [@DudaNogueira](https://forum.weaviate.io/u/DudaNogueira)\
**Post date:** [July 5, 2024, 7:49pm UTC](https://forum.weaviate.io/t/aggregate-text-slow-on-50k-plus-objects/2911/4 "2024-07-05T19:49:53Z")

</div>

Ok, do you only have those 50K objects?

Do you have any reading on memory/cpu usage?

Do you think we could come up with some dataset to replicate this?