Notes

Paper notes & summaries

Summaries of papers I'm reading — mostly ML, retrieval, and systems. Written to be re-read, cross-linked as a second brain, and refined over time. Follow the [[links]] between notes.

ReadingJuly 2026

Retrieval-Augmented Generation for Knowledge-Intensive NLP

Lewis, Perez, Piktus, et al. · NeurIPS 2020

Pairs a parametric seq2seq model with a non-parametric retriever so knowledge lives in an index you can edit, not just in the weights.

#rag#retrieval#llms#nlp

Read note

SummarizedJuly 2026

Attention Is All You Need

Vaswani, Shazeer, Parmar, et al. · NeurIPS 2017

The paper that replaced recurrence with pure attention and became the backbone of modern LLMs.

#transformers#attention#deep-learning#nlp

Read note