AI Weekly Malaysia

Dan Luu argues that LLMs have dropped the cost of specialized performance optimization by orders of magnitude, making work that once required rare expertise accessible to anyone who can prompt. He cites Marc Brooker on dynamic custom software fitted to specific workloads, Michael Malis on LLMs making JIT compilers practical (e.g., pgrust), and his own FRE regex engine built by an agent looping for a month against the rebar benchmark suite—until they introduced a holdout benchmark to force generalization.

Why: If you ship software, you can now cheaply generate workload-specific optimizations (JIT compilers, custom regex engines, specialized data paths) that were previously uneconomical. The FRE example is a caution: an agent overfit to a benchmark suite until explicitly warned about a holdout, so you should always benchmark against unseen workloads before trusting agent-generated performance code.