AI Weekly Malaysia

Needle 2 is a 45M-parameter agentic LLM compressed to a 14MB binary that runs in 28MB of RAM, designed for tool calling, device control, and structured extraction on sub-$200 hardware. It hits 500 tokens/sec decode on a Raspberry Pi 5, 300–700 on budget Samsung A-Series phones, and even runs on ESP32-S3 microcontrollers. It trades benchmark wins with models 5×–70× larger (FunctionGemma 270M, LFM2.5 230M, Apple FM) on mobile device-use tasks, and is released under Apache 2.0 with weights on Hugging Face.

Why: If you are building IoT, smart home, wearable, or robotics products targeting the Malaysian or broader SEA market where most phones ship under $200, Needle 2 lets you run on-device function calling without a GPU, NPU, or cloud dependency. The 28MB RAM footprint means you can prototype agent-based device control on hardware you already have—Raspberry Pi, ESP32-S3, or budget Android phones—today, with the repo and sandbox available to test immediately.

Mistral AI was granted US patent 12,670,045 for a method where an LLM generates a code block encapsulating tool calls, executes it in a sandbox, pauses to send pending tool calls to a client for execution, receives results, and resumes execution. The patent was filed March 4, 2026 and lists Gabriel Vergnaud as inventor, assigned to Mistral AI (Paris). It covers 20 claims around this pause-resume code-execution tool-call pattern.

Why: This patent covers a pattern — LLM generates executable code that orchestrates tool calls with sandbox pause/resume — that is increasingly common in agent frameworks and vibe-coding tools. Builders shipping agents that use code-as-tool-call execution should be aware this patent exists, since it could affect open-source frameworks or cloud providers that implement the same flow. No action needed today, but worth tracking whether Mistral enforces it or offers it freely.