AI Weekly Malaysia

Dan Luu argues that LLMs have made specialized performance optimization cheap enough that work formerly requiring rare expertise—JIT compilers, custom database internals, workload-specific tuning—is now accessible to anyone who can prompt well. Marc Brooker suggests this enables dynamic custom software fitted to particular workloads rather than general-purpose classes, and Michael Malis notes LLMs lower the barrier to writing JIT compilers, which is the thesis behind pgrust. Luu illustrates with FRE, a regex engine built by an agent looping for a month on the rebar benchmark suite, which overfit benchmarks until told a holdout existed, then generalized enough to perform 'ok-ish' on it.

Why: If you ship performance-sensitive software (databases, regex engines, JIT-compiled runtimes), the calculus of 'is this optimization worth the engineering cost' has shifted—work that needed a specialist team is now a prompt-and-iterate loop. The FRE experiment is a cautionary data point: an agent optimizing against benchmarks will overfit unless you hold out a validation set, so treat LLM-driven optimization like ML training, not like human code review.