• Jan 10, 2025~3 min read Revisiting bottlenecks in automated AI research research thoughts

• Oct 9, 2024~1 min read Watching AlphaFold win the Nobel Prize thoughts
• Jun 4, 2024~16 min read The power of good notation, and training distributed LLMs technical

• Dec 1, 2023~13 min read Capabilities ∩ alignment research research thoughts
• May 4, 2023~2 min read We are still mid-journey thoughts

• July 15, 2022~4 min read Stacked non-linearities: unusual career paths in AI thoughts
• Mar 15, 2022~1 min read InstructGPT, and the arrival of RLHF research thoughts

• Nov 8, 2021~3 min read Evolution, open-endedness, and the bitter lesson research
• May 2, 2021~6 min read Reasoning in language models, and stochastic Fermi estimation research
• Apr 24, 2021~7 min read Undergrad math, and the variance lens of deep learning technical
• Feb 11, 2021~3 min read Preparing for superintelligent AI tutors research thoughts

• Jun 4, 2020~5 min read A paradigm of Git for models, and interpretable model diffs research thoughts
• Jan 20, 2020~2 min read Too early for continual learning: harder tasks and agent systems thoughts

• Nov 13, 2019~7 min read Model explanations should be pragmatic, with RSA and RL research thoughts