Build a retrieval-augmented generation (RAG) pipeline end to end. Chunk a fictional company handbook the model has never seen, embed it with MiniLM (mean pooling + L2 normalisation, no sentence-transformers needed), explore the embedding space, and measure retrieval recall@k. Then ground Qwen2.5-1.5B-Instruct's answers in the retrieved passages and show that retrieval turns hallucinated guesses into correct answers. The first run downloads about 3 GB of models.
Corpus & Embeddings
Exploring the Embedding Space
Retrieval
Grounded Generation
Premium Project
This guided, GPU-powered project is available to Premium members. Upgrade to train models end-to-end in an interactive notebook.