Hot Chips 2026: Samsung makes LPDDR5X smart with logic unit in memory — LPDDR5X-PIM is 3.01x faster than LPDDR5X in AI inference with 8x the bandwidth
- ID
- 17772
- Status
- summarized
- Published
- 26 Aug 2026, 2:31 AM
- Fetched
- 26 Aug 2026, 2:57 AM
- Provider
- Tom's Hardware
- Category
- technology
- Original URL
- https://www.tomshardware.com/pc-components/dram/hot-chips-2026-samsung-makes-lpddr5x-smart-with-logic-unit-in-memory-lpddr5x-pim-is-3-01x-faster-than-lpddr5x-in-ai-inference-with-8x-the-bandwidth
- Source URL
- https://www.tomshardware.com/feeds/all
Summary
- Score
- 5.5
- Created
- 26 Aug 2026, 2:57 AM
- Tags
- Audience
- ai-ml-learnersdeveloperssaas-founders
What happened
Samsung introduced LPDDR5X-PIM, adding in-memory processing logic to LPDDR5X memory, claiming 3.01x faster AI inference and 8x the bandwidth versus standard LPDDR5X. The motivation is explicit: HBM is too expensive and wafer demand is worsening, so Samsung is pushing PIM into cheaper low-power memory to accelerate inference without HBM.
Why it matters
If you're building on-device or edge AI inference workloads, LPDDR5X-PIM could eventually deliver HBM-adjacent inference speedups in mobile and edge form factors at lower cost. For now this is a Hot Chips presentation, not a shipping product you can buy — no pricing, no availability date, no SDK. Track it as a signal that inference hardware is bifurcating: HBM for datacenter, PIM-augmented LPDDR for edge, with the cost gap driving the split.
Discussion angle
Will PIM in LPDDR5X actually reach edge devices builders can deploy, or will it stay locked inside Samsung's own Exynos and accelerator silicon like HBM-PIM did with AMD?