# At the end i get no files to process after Embedder ,Will youplease help me sort this issue

**URL:** <https://forum.weaviate.io/t/at-the-end-i-get-no-files-to-process-after-embedder-will-youplease-help-me-sort-this-issue/9976>\
**Category:** General\
**Created:** [January 31, 2025, 12:32pm UTC](https://forum.weaviate.io/t/at-the-end-i-get-no-files-to-process-after-embedder-will-youplease-help-me-sort-this-issue/9976 "2025-01-31T12:32:55Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![DhanushKumar\_R](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dhanushkumar_r/32/3310_2.png) [@DhanushKumar\_R](https://forum.weaviate.io/u/DhanushKumar_R)\
**Post date:** [January 31, 2025, 12:32pm UTC](https://forum.weaviate.io/t/at-the-end-i-get-no-files-to-process-after-embedder-will-youplease-help-me-sort-this-issue/9976/1 "2025-01-31T12:32:55Z")

</div>

2025-01-31 17:59:10,059 MainProcess DEBUG updating download directory to: [C:\Users\dhanu.cache\unstructured\ingest\s3\62e5a70d24](file:///C:/Users/dhanu/.cache/unstructured/ingest/s3/62e5a70d24) 2025-01-31 17:59:10,061 MainProcess INFO running pipeline: DocFactory → Reader → Partitioner → Chunker → Embedder → Writer → Copier with config: {“reprocess”: true, “verbose”: true, “work\_dir”: “C:\Users\dhanu\.cache\unstructured\ingest\pipeline”, “output\_dir”: “s3://genairag/creditcard”, “num\_processes”: 40, “raise\_on\_error”: false} 2025-01-31 17:59:10,212 MainProcess INFO Running doc factory to generate ingest docs. Source connector: {“processor\_config”: {“reprocess”: true, “verbose”: true, “work\_dir”: “C:\Users\dhanu\.cache\unstructured\ingest\pipeline”, “output\_dir”: “s3://genairag/creditcard”, “num\_processes”: 40, “raise\_on\_error”: false}, “read\_config”: {“download\_dir”: “C:\Users\dhanu\.cache\unstructured\ingest\s3\62e5a70d24”, “re\_download”: false, “preserve\_downloads”: false, “download\_only”: false, “max\_docs”: null}, “connector\_config”: {“remote\_url”: “s3://genairag/”, “uncompress”: false, “recursive”: false, “file\_glob”: null, “access\_config”: {“anonymous”: false, “endpoint\_url”: null, “key”: null, “secret”: null, “token”: null}, “protocol”: “s3”, “path\_without\_protocol”: “genairag/”, “dir\_path”: “genairag”, “file\_path”: “”}} 2025-01-31 17:59:10,229 MainProcess INFO processing 4 docs via 40 processes 2025-01-31 17:59:10,233 MainProcess INFO calling Reader with 4 docs 2025-01-31 17:59:10,236 MainProcess INFO Running source node to download data associated with ingest docs 2025-01-31 17:59:18,125 MainProcess INFO calling Partitioner with 4 docs 2025-01-31 17:59:18,127 MainProcess INFO Running partition node to extract content from json files. Config: {“pdf\_infer\_table\_structure”: false, “strategy”: “auto”, “ocr\_languages”: null, “encoding”: null, “additional\_partition\_args”: {}, “skip\_infer\_table\_types”: null, “fields\_include”: [“element\_id”, “text”, “type”, “metadata”, “embeddings”], “flatten\_metadata”: false, “metadata\_exclude”: , “metadata\_include”: , “partition\_endpoint”: “[https://api.unstructuredapp.io](https://api.unstructuredapp.io/)”, “partition\_by\_api”: true, “api\_key”: “_**", “hi\_res\_model\_name”: null}, partition kwargs: {}] 2025-01-31 17:59:18,130 MainProcess INFO creating [C:\Users\dhanu.cache\unstructured\ingest\pipeline\partitioned](file:///C:/Users/dhanu/.cache/unstructured/ingest/pipeline/partitioned) 2025-01-31 17:59:38,178 MainProcess INFO calling Chunker with 4 docs 2025-01-31 17:59:38,178 MainProcess INFO Running chunking node. Chunking config: {“chunking\_strategy”: “by\_title”, “combine\_text\_under\_n\_chars”: 1000, “include\_orig\_elements”: null, “max\_characters”: 8192, “multipage\_sections”: null, “new\_after\_n\_chars”: null, “overlap”: null, “overlap\_all”: null}] 2025-01-31 17:59:38,180 MainProcess INFO creating [C:\Users\dhanu.cache\unstructured\ingest\pipeline\chunked](file:///C:/Users/dhanu/.cache/unstructured/ingest/pipeline/chunked) 2025-01-31 17:59:47,338 MainProcess INFO calling Embedder with 4 docs 2025-01-31 17:59:47,340 MainProcess INFO Running embedding node. Embedding config: {“provider”: “azure-openai”, “api\_key”: "**_”, “model\_name”: “text-embedding-ada-002”, “aws\_access\_key\_id”: null, “aws\_secret\_access\_key”: null, “aws\_region”: null}] 2025-01-31 17:59:47,343 MainProcess INFO creating [C:\Users\dhanu.cache\unstructured\ingest\pipeline\embedded.py](file:///C:/Users/dhanu/.cache/unstructured/ingest/pipeline/embedded.py) 2025-01-31 17:59:49,345 MainProcess INFO no files to process after Embedder

---

<div class="post-metadata">

**Author:** ![Shahin](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/shahin/32/7944_2.png) [@Shahin](https://forum.weaviate.io/u/Shahin)\
**Post date:** [January 31, 2025, 2:43pm UTC](https://forum.weaviate.io/t/at-the-end-i-get-no-files-to-process-after-embedder-will-youplease-help-me-sort-this-issue/9976/2 "2025-01-31T14:43:07Z")

</div>

Refer to: [No files to process after Embedder ,Here are my code and issue , i need an guidance to sort this issue,please help me out](https://forum.weaviate.io/t/no-files-to-process-after-embedder-here-are-my-code-and-issue-i-need-an-guidance-to-sort-this-issue-please-help-me-out/9977)

---

<div class="post-metadata">

**Author:** ![DhanushKumar\_R](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.weaviate.io/dhanushkumar_r/32/3310_2.png) [@DhanushKumar\_R](https://forum.weaviate.io/u/DhanushKumar_R)\
**Post date:** [January 31, 2025, 4:25pm UTC](https://forum.weaviate.io/t/at-the-end-i-get-no-files-to-process-after-embedder-will-youplease-help-me-sort-this-issue/9976/3 "2025-01-31T16:25:23Z")

</div>

Thank you so much for the help
