Running vector search on the edge is something we’ve been working towards here at Qdrant.
The main problem is that vector search is resource-hungry, starting with the embedding step: EmbeddingGemma-2, a small modern model, takes up 310MB of memory when quantiz...