I am trying to upload 4 million 384d vectors.
1 million requires ~3Gb of Ram as per documentation.
I have 4Gb of Ram (30Gb ssd) on a low end server. The documentation in one spot makes it sound like a hard cap for vector size. But another spot implies that data is offloaded to the hard drive and is slower, but what is the cap, hd space?
What are the hard limits?
Also qdrant allows memmaps to have a 70% reduction in ram for harddrive tradeoff. I see weaviate has memmaps, is this possible in weaviate as well? They can have 4million (384) in 3Gb of Ram (reportedly).