MICROGPT

An interactive visualization of Andrej Karpathy's microGPT — a complete GPT transformer built from scratch in ~150 lines of Python, with zero dependencies. Click any highlighted code section to read an annotation explaining what it does and why.

Original code by Andrej Karpathy. JavaScript port runs live in your browser.