Vector Databases
Vector databases (Qdrant, Milvus, Weaviate, Pinecone)
The database is the easy part; the embeddings decide recall.
Stores for high-dimensional vectors that serve approximate-nearest-neighbor queries via ANN indexes (HNSW, IVF-PQ), packaged as operational systems with filtering, sharding, and updates (Qdrant, Milvus, Weaviate, Pinecone). FAISS is the index library underneath many of them.
RAG went to production at scale, and 2024-2025 made pgvector plus a good index good enough for most workloads — pushing dedicated vector DBs to justify themselves on metadata filtering, hybrid search, and billion-scale ops rather than on similarity alone.
That semantic (vector) search dominates keyword search. On exact terms, IDs, and rare tokens, pure vector retrieval loses to BM25; the systems that actually win in production run hybrid search and rerank, not ANN alone.
ANN indexing and the CRUD surface are now a solved commodity behind one-line SDKs; the durable work moved up into chunking, embedding choice, and retrieval evaluation.
Prerequisites
- hardNLP
Vector databases store and index embeddings — you must understand what vectors represent to choose the right index, metric, and parameters
- mediumDistributed Systems
Production vector DBs involve sharding, replication, and latency trade-offs — distributed systems literacy helps make informed choices
Recommended reference
Reviewed sources
Primary and first-party material reviewed for this editorial summary. These citations are separate from the AI consensus score above.
- A Survey of Vector Database Management Systems
Survey of vector data management, indexing, querying, and system trade-offs.
- Efficient and Robust Approximate Nearest Neighbor Search Using HNSW
The foundational paper for the HNSW index used across modern vector-search systems.
- pgvector documentation
Primary implementation documentation for vector similarity search in PostgreSQL.
Notes from AI deep research
Anthropic Opus
Qdrant, Milvus, Weaviate, Pinecone. Z niszowego do infrastrukturalnego w 18 msc
OpenAI Deep Research
Dobór technologii pod skalę i koszty [OA#32]
Google Deep Think
Administracja i partycjonowanie, HNSW [G#41]
Related skills
- ← is part of: FAISS(3/3)
- ← is an instance of: Pinecone(3/3)
- ← is an instance of: Qdrant(3/3)
- → is part of: Retrieval-Augmented Generation(3/3)
- → is subcategory of: NoSQL(3/3)
- ← is an instance of: pgvector(3/3)
- → is subcategory of: Data Engineering(1/3)
- ← is an instance of: FAISS(1/3)
- ← is subcategory of: Metadata Filtering(0/3)
- ← is an instance of: Chroma(0/3)
- ← is an instance of: Weaviate(0/3)
- ← is an instance of: Milvus(0/3)
- ← is an instance of: OpenSearch(0/3)
- ← is an instance of: LanceDB(0/3)
- ← is an instance of: Qdrant(0/3)
- ← is an instance of: Pinecone(0/3)
- ← is subcategory of: Vector Indexing(0/3)