AI Weekly Malaysia

antirez (creator of Redis) published h3.c, a native C implementation of MiniMax-H3 multimodal inference for Apple Silicon using Metal shaders. The project already supports end-to-end prompt-to-video/audio generation, first/last-frame conditioning, and ordered image/video/audio references, with current work focused on Metal performance and memory optimization on M3 Max and M5 Max.

Why: If you build AI-powered media generation features, this demonstrates a viable path to run a multimodal model entirely on-device with a single C binary and no Python runtime—relevant for teams wanting to avoid per-request cloud GPU costs or data residency concerns. The project's vertical-slice approach (metadata, Metal parity, prompt encoding, then full generation) is a useful reference architecture for anyone considering native local inference over API-dependent workflows.

Meta released Muse Glimmer, a 30-billion parameter open weights LLM distilled from its proprietary Muse Spark model — its first open weights release in over a year after Llama 4 flopped and its AI group was restructured. Released under Apache 2.0 with early support on Llama.cpp, Ollama, and Unsloth, it targets local inference workloads like agents and code assistants. Benchmarks show it beating Google Gemma 4 31B and trading blows with Alibaba Qwen 3.6-27B, but it's too small to challenge leading Chinese models like DeepSeek V4 Flash or Kimi K3.

Why: If you run local AI inference or build on-device agents, Muse Glimmer is now an Apache 2.0 option on Ollama and Llama.cpp worth benchmarking against Qwen 3.6-27B for your workload — but don't commit to it as a flagship given Qwen 3.8-27B is imminent and Meta's own larger Muse Spark remains proprietary. For Malaysian builders who care about local deployment (data sovereignty, latency, cost), a 30B model under a permissive license is practically runnable on a single high-end GPU.

The trycua/cua project published a blog post on using GPU passthrough in macOS VMs to accelerate llama.cpp-based LLM inference on Apple Silicon. The post details the technical approach for passing Apple GPU resources through to a virtualized macOS environment.

Why: If you run local LLM inference on Apple Silicon but need VM isolation for CI, agent sandboxes, or multi-tenant setups, this approach could let you keep near-native Metal GPU performance inside a VM rather than falling back to CPU-only inference. Builders evaluating local agent infrastructure should test whether the passthrough overhead is acceptable for their workload before committing to a bare-metal-only deployment.

Nvidia released Nemotron 3.5 Lightning, an open-source AI model it describes as 'lightweight' and capable of running on a single GPU on a laptop or desktop. It's Nvidia's first open-source model since CEO Jensen Huang publicly defended open-source AI on X in late July, aligning with other tech leaders urging the U.S. government to support open models. The model is free for companies to download.

Why: If you're prototyping AI agents or local inference workflows, a single-GPU open-source model from Nvidia could reduce cloud dependency and cost—but the article gives no parameter count, benchmark scores, or license terms beyond 'free to download,' so evaluate the actual model card and license before committing. For Malaysian builders operating where GPU cloud capacity is scarce or expensive, a locally-runnable model is worth a test run, but don't assume production-readiness from a press release.