Semantic Phonons: Lattice Vibrations in AI Internals I apply the mathematics of phonon modes to study semantic representations in language models. I show theoretical predictions and verify them in GloVe and Gemma 2B. Diffusion Geometry for LLM internals I use diffusion geometry to study the residual stream of LLMs. Lattice Gas, Hopfield Networks and Transformer Attention I study a lattice gas in the grand canonical ensemble, a project from my PhD, and show how it connects to transformer models through Hopfield networks. Dendrite Networks A cellular automaton model simulating dendritic growth with parallelized diffusion. Brownian Stocks A fun weekend project where I modeled stock prices using Langevin Dynamics.
