Nature

‘RAMmageddon’ hits labs: AI-driven memory shortage is impacting science

The soaring cost and limited supply of computer memory is slowing some projects — and spurring creative approaches.
IEEE

Efficient KV Cache Spillover Management on Memory-Constrained GPU for LLM Inference

Abstract: The rapid growth of model parameters presents a significant challenge when deploying large generative models on GPU. Existing LLM runtime memory management solutions tend to maximize batch ...
IEEE

Hyla-SLAM: Toward Maximally Scalable 3D LiDAR-Based SLAM Using Dynamic Memory Management and Behavior Trees

Most robotics applications depend on an accurate environment representation that encodes task-relevant information. When such representations are not available a priori, they must be generated online.
Reuters

AI's memory chip champion has a value problem

LONDON, Feb 20 (Reuters Breakingviews) - Not long ago, memory chip makers were in crisis. A post-pandemic supply glut in 2023 pushed prices into freefall, wiping out operating profits across the ...
TechCrunch

Reload wants to give your AI agents a shared memory

There came a point when Newton Asare realized AI agents weren’t just tools anymore. “They were operating more like teammates,” he told TechCrunch. The realization crystallized when Asare and Kiran Das ...