AI Weekly Malaysia

Needle 2 is a 45M-parameter agentic LLM compressed to a 14MB binary that runs in 28MB of RAM, designed for tool calling, device control, and structured extraction on sub-$200 hardware. It hits 500 tokens/sec decode on a Raspberry Pi 5, 300–700 on budget Samsung A-Series phones, and even runs on ESP32-S3 microcontrollers. It trades benchmark wins with models 5×–70× larger (FunctionGemma 270M, LFM2.5 230M, Apple FM) on mobile device-use tasks, and is released under Apache 2.0 with weights on Hugging Face.

Why: If you are building IoT, smart home, wearable, or robotics products targeting the Malaysian or broader SEA market where most phones ship under $200, Needle 2 lets you run on-device function calling without a GPU, NPU, or cloud dependency. The 28MB RAM footprint means you can prototype agent-based device control on hardware you already have—Raspberry Pi, ESP32-S3, or budget Android phones—today, with the repo and sandbox available to test immediately.

Meta CEO Mark Zuckerberg announced the company will open the weights for Muse Spark 1.2, its latest AI model, making it downloadable and usable by the public. He also said Meta will release a new family of open-source models called Muse Glimmer, specifically designed to run on laptops, as Meta positions itself against OpenAI and Anthropic.

Why: If Muse Glimmer models genuinely run on consumer laptops, builders can prototype and ship AI features without API costs or cloud GPU dependencies—a significant cost advantage for Malaysian startups and indie developers. Watch the actual model sizes and licensing terms when released; 'open weight' does not always mean commercially unrestricted.

Meta AI Research open-sourced Muse Glimmer, a 30B-parameter model under Apache 2.0 designed for always-on local agent workflows on a single consumer GPU. It targets function calling, local coding, and LLM-as-a-judge evaluation, trained via logit distillation from a larger teacher model (Muse Spark) followed by agent-heavy mid-training and RL post-training. Integrations for llama.cpp, MLX, and ExecuTorch are promised in the coming days but not yet available.

Why: If you build agents and want to cut cloud API costs or run offline, a 30B model that fits a single consumer GPU with permissive Apache 2.0 weights is worth evaluating once the llama.cpp/MLX/ExecuTorch integrations land. For Malaysian builders facing API cost barriers or data-locality requirements, this could enable self-hosted agent prototypes without recurring cloud spend — but wait for the runtime integrations before committing time.

LiquidAI released LFM2.5-VL-3B, a 3.1B parameter vision-language model designed for on-device/edge use, pairing a SigLIP2 400M vision encoder with their LFM2.5-2.6B text backbone. It was pre-trained on ~34T tokens with 4x more vision data than prior versions, supports 128K vocabulary for non-Latin scripts, and adds screen/UI understanding, object grounding, multi-image input, and function calling. Benchmarks show it leading its size class on real-world image tasks (RealWorldQA 73.1, MMStar 63.3) against comparably-sized models from Qwen, InternVL, and Gemma.

Why: If you are building on-device apps that need document/screen understanding or vision-grounded function calling without cloud API latency or cost, this is a concrete 3B model worth benchmarking against Qwen3.5-2B or InternVL 3.5 2B for your use case. The function-calling capability in vision-text contexts is the differentiator to test, since most small VLMs struggle there.

Google unveiled the Pixel 11 lineup (Pixel 11, Pro, Pro XL, Pro Fold) with Gemini Intelligence, an agentic AI layer that works inside the OS to connect data across messages, calendars, maps, and other Google services and carry out multi-step actions like checking availability or starting reservations. Rick Osterloh said Gemini could eventually become the primary interface for phones and laptops, and noted memory shortages are pushing consumer electronics prices higher.

Why: For AI agent builders, the notable shift is Google pushing agentic AI into the OS layer rather than a standalone chatbot — if this pattern succeeds, it signals that consumer-facing agents will increasingly be embedded in platform ecosystems rather than shipped as independent apps. The memory shortage price pressure is a reminder that hardware costs for on-device AI inference may stay elevated.