Multi-Tenant support for Unstructured ETL Pipelines!

I was trying to get Make ETL pipelines from aws-S3 to Weaviate for multiple users, But couldn’t find a way to utilize Weaviate’s Multi-Tenancy via Unstructured.

Now, I’m creating separate Collection for Each User !

Is there any alternative for this?

Hey @Satyam_Namdev,

Welcome to the community!

I get the challenge you’re facing, and honestly, I’d highly recommend Multi-Tenancy for your use case—it’s much better for schema operations and overall performance.

Are you saying that with Unstructured, you can’t configure a collection with Multi-Tenancy enabled and then ingest from S3 directly into a tenant instead of the collection?

Would love to understand more about your setup! and code as well if possible.