AI Weekly Malaysia

Meta released Muse Glimmer, a 30-billion parameter open-weight model under Apache 2.0 designed to run AI agents locally on a single consumer GPU (Mac or PC). It supports text and images, was trained across 100+ languages, and handles multi-step agentic tasks like tool calling, code writing/debugging, and file/screenshot manipulation, working offline as an 'always-on' personal agent.

Why: A 30B parameter agentic model that runs on a single consumer GPU under Apache 2.0 is directly downloadable and deployable today — builders can prototype local AI agents without cloud API costs or data leaving the device. For Malaysian developers and startups, this matters because local execution sidesteps cloud latency and data residency concerns, and the 100+ language training may include Malay or other regional languages worth testing. Evaluate whether Glimmer's agentic capabilities (tool calling, code debugging, file handling) are good enough to replace or complement your current cloud-based agent stack.

Needle 2 is a 45M-parameter agentic LLM compressed to a 14MB binary that runs in 28MB of RAM, designed for tool calling, device control, and structured extraction on sub-$200 hardware. It hits 500 tokens/sec decode on a Raspberry Pi 5, 300–700 on budget Samsung A-Series phones, and even runs on ESP32-S3 microcontrollers. It trades benchmark wins with models 5×–70× larger (FunctionGemma 270M, LFM2.5 230M, Apple FM) on mobile device-use tasks, and is released under Apache 2.0 with weights on Hugging Face.

Why: If you are building IoT, smart home, wearable, or robotics products targeting the Malaysian or broader SEA market where most phones ship under $200, Needle 2 lets you run on-device function calling without a GPU, NPU, or cloud dependency. The 28MB RAM footprint means you can prototype agent-based device control on hardware you already have—Raspberry Pi, ESP32-S3, or budget Android phones—today, with the repo and sandbox available to test immediately.

LiquidAI released LFM2.5-VL-3B, a 3.1B parameter vision-language model designed for on-device/edge use, pairing a SigLIP2 400M vision encoder with their LFM2.5-2.6B text backbone. It was pre-trained on ~34T tokens with 4x more vision data than prior versions, supports 128K vocabulary for non-Latin scripts, and adds screen/UI understanding, object grounding, multi-image input, and function calling. Benchmarks show it leading its size class on real-world image tasks (RealWorldQA 73.1, MMStar 63.3) against comparably-sized models from Qwen, InternVL, and Gemma.

Why: If you are building on-device apps that need document/screen understanding or vision-grounded function calling without cloud API latency or cost, this is a concrete 3B model worth benchmarking against Qwen3.5-2B or InternVL 3.5 2B for your use case. The function-calling capability in vision-text contexts is the differentiator to test, since most small VLMs struggle there.

Ukraine claims to have found an Nvidia Jetson edge-AI chip inside a Russian S-71 'Monochrome' cruise missile, suggesting the weapon may use AI for targeting or navigation. The Jetson line is designed for embedded and edge inference workloads, making its presence in a munition notable as an indicator of AI-enabled autonomous weapons systems.

Why: If confirmed, this is a concrete data point that edge-AI inference hardware (the same Jetson modules developers use for robotics and vision projects) is being deployed in autonomous weapons — relevant to anyone building with Jetson who should be aware of export-control and dual-use scrutiny that may tighten around these chips.