I build software and test ideas with data. I look for patterns in everyday life and wonder what we could do better.

Tuning local LLMs on a Radeon AI PRO R9700

Speculative decoding gave the biggest single win: n-gram drafting made file rewrites 3.5x faster on Devstral and 2.5x faster on Thinklite, with reasoning speed unchanged.

All blog posts