Document Utilities
Vector Databases & Embeddings
Retrieval-Augmented Generation (RAG) depends on one central trick: convert language into numerical vectors that preserve semantic similarity, then search those vectors quickly at query time. Vector databases are specialized engines built for this nearest-neighbor retrieval problem.
From Text to Numeric Meaning
An embedding model transforms each text chunk into a high-dimensional coordinate. Similar meanings end up near each other in vector space, even when exact words differ. For example, "rate limit exceeded" and "too many requests" can map to nearby regions despite surface-level phrasing differences.
- Input: sentence, paragraph, or document chunk.
- Encoder: embedding model outputs dense numeric array.
- Storage: vector + metadata saved in a vector index.
- Retrieval: similarity search returns top-k relevant chunks.
Embedding Flowchart
Why Vector DBs Instead of SQL LIKE Queries?
Traditional keyword matching is lexical: it checks exact or partial word overlap. Semantic retrieval compares meaning using distance metrics such as cosine similarity or inner product. This enables robust matching across synonyms, paraphrases, and multilingual variations.
RAG Retrieval Loop (High Level)
# Conceptual RAG retrieval pipeline
1) Embed user query
2) Search vector index for top-k nearest chunks
3) Re-rank or filter by metadata confidence
4) Inject selected chunks into model prompt
5) Generate grounded response