Vector DB learning path
A sequenced curriculum covering every topic on this site — 25 lessons grouped into 8 stages, from first embedding to production RAG.
1. Foundations
Understand what a vector database is and run your first query.
2. Core concepts
Learn the math and data structures that power vector search.
- Step 1Embeddings20 min
How models map text/images into a dense vector space.
- Step 2Similarity search15 min
Cosine vs. dot vs. L2 — when each distance metric is correct.
- Step 3Indexing (HNSW, IVF)30 min
ANN structures that make billion-scale search fast.
- Step 4Hybrid search20 min
Combine BM25 keyword and dense vectors with score fusion.
3. Pick a database
Survey the ecosystem and choose the right engine for your workload.
- Step 1Pinecone15 min
Managed serverless — fastest path to production.
- Step 2Weaviate15 min
Schema-first with built-in modules for vectorization.
- Step 3Qdrant15 min
Rust-based, strong filtering and payload indexing.
- Step 4Chroma10 min
Embedded DB ideal for prototyping LLM apps locally.
- Step 5Milvus20 min
Distributed, GPU-accelerated, designed for tens of billions of vectors.
- Step 6pgvector15 min
Keep vectors next to relational data inside Postgres.
- Step 7FAISS20 min
The reference library — every other engine borrows from it.
4. Internals & scale
Understand how production systems compress, distribute, and filter.
5. Build RAG
Wire embeddings + retrieval + an LLM into a working RAG app.
6. Advanced retrieval
Move beyond naive RAG with reranking, query rewriting, and agents.
- Step 1Advanced RAG (HyDE, RRF)25 min
Hypothetical document embeddings and Reciprocal Rank Fusion.
- Step 2Reranking25 min
Cross-encoders, ColBERT late interaction, MMR diversity.
- Step 3Agentic RAG30 min
CRAG and Self-RAG — let the model decide when to retrieve.
- Step 4Multimodal RAG25 min
CLIP shared spaces and ColPali for OCR-free PDF retrieval.
7. Production
Measure quality, optimize cost, and run reliably at scale.
8. Bonus — how LLMs work
Open the black box so you understand what RAG is feeding.
What you'll be able to build
- Semantic search over your own documents, code, or images.
- A production-grade RAG chatbot with reranking and evaluation.
- Hybrid search combining BM25 keyword + dense vectors.
- Multimodal retrieval over PDFs, screenshots, and figures.
- An agentic system that decides when to retrieve and when to answer.