(I’ve been working on …)
Machine Learning
- Modded NanoGPT - an LLM speedrunning competition where I have set several records 1. I’ve written a corresponding blogpost on muon.
- Prime Environments - creating Reinforcement Learning envs to test and train agents, including SWE Bench
- Spotify MCP Server - get your LLM to control spotify (>500 github stars!)
- Semantic Finder - vector search in your browser (>300 github stars!)
Graphics
- Theory of Human Tetrachromacy - Best Paper Honorable Mention at Siggraph ‘24
- Various experiments/simulations in C++: Raytracing I, II, 3D Mesh Engine
Footnotes
-
At the time of writing this, 5 records: incorporating Flash Attention 3, adding a better matrix sign function, speeding up Muon, improving weight decay, and adding batch size scheduling. ^