quantization

Several Retrievers, One Small Machine

How to run keyword, dense, fusion and reranking together on modest hardware: where the memory actually goes, and which famous constants are folklore.

Retrieval and RAG06