#Karpathy’s influential "Software 2.0" essay from 02017
on 02026-06-01#Dwarkesh #Karpathy #interview on #AI and #neural-networks is pretty thought-provoking. Karpathy endorses Feynman’s definition of learning: “It’s the only way to build. If I can’t build it, I don’t understand it. That’s a Feynman quote, I believe. I 100% have always believed this very strongly, because there are all these micro things that are just not properly arranged and you don’t really have the knowledge. You just think you have the knowledge. So don’t write blog posts, don’t do slides, don’t do any of that. Build the code, arrange it, get it to work. It’s the only way to go. Otherwise, you’re missing knowledge.” #toread since I’m only up to about 2 hours.
on 02025-10-18The definition of "vibe coding" from #Karpathy. #neural-networks
on 02025-06-20#video by Andrej #Karpathy on how he uses #LLM #AI two years ago
on 02025-03-16Andrej #Karpathy reports Jiayi Pan (@jiayi_pirate) has replicated the #DeepSeek #neural-networks training approach through RL finetuning of a base model, showing an example of “the CountDown game”
on 02025-01-29mildly amusing semi-fiction about self-aware #neural-networks by #Karpathy
on 02024-09-27“The simplest, fastest repository for training/finetuning medium-sized GPTs. It is a rewrite of minGPT that prioritizes teeth over education. Still under active development, but currently the file train.py reproduces GPT-2 (124M) on OpenWebText, running on a single 8XA100 40GB node in about 4 days of training. The code itself is plain and readable: train.py is a ~300-line boilerplate training loop and model.py a ~300-line GPT model definition, which can optionally load the GPT-2 weights from OpenAI. That's it.” #Karpathy #neural-networks #small-is-beautiful (but it still relies on PyTorch)
on 02024-03-01an update on the state of the art of #reinforcement-learning by #Karpathy. #AI #deep-learning #machine-learning #toread
on 02016-06-21Lecture notes for a Stanford class on #neural-networks and #deep-learning, written by Andrej #Karpathy, the author of #unreasonable-RNNs.
on 02016-04-25