'Observational memory' cuts AI agent costs 10x and outscores RAG on long-context benchmarks

As AI agents move into production, teams are rethinking memory. Mastra’s open-source observational memory shows how stable ...
InfoWorld

AI memory is really a database problem

If we want to avoid making AI agents a huge new attack surface, we’ve got to treat agent memory the way we treat databases: with firewalls, audits, and access privileges. The pace at which large ...
Computerworld

New procedural memory framework promises cheaper, more resilient AI agents

A research team from Zhejiang University and Alibaba Group has introduced Memp, a framework that gives large language model (LLM) agents a form of procedural memory designed to make them more ...
Dark Reading

AI Agents May Have a Memory Problem

Memory-enabled artificial intelligence agents that can store and recall user data for more intelligent and personalized decision-making are vulnerable to memory injection attacks that can manipulate ...
VentureBeat

New LLM optimization technique slashes memory costs up to 75%

Researchers at the Tokyo-based startup Sakana AI have developed a new technique that enables language models to use memory more efficiently, helping enterprises cut the costs of building applications ...
Security Boulevard

The Promptware Kill Chain

Attacks against modern generative artificial intelligence (AI) large language models (LLMs) pose a real threat. Yet discussions around these attacks and their potential defenses are dangerously myopic ...
Semiconductor Engineering

Pooling CPU Memory for LLM Inference With Lower Latency and Higher Throughput (UC Berkeley)

“The rapid growth of LLMs has revolutionized natural language processing and AI analysis, but their increasing size and memory demands present significant challenges. A common solution is to spill ...
InfoWorld

Unlocking LLM superpowers: How PagedAttention helps the memory maze

Large language models (LLMs) like GPT and PaLM are transforming how we work and interact, powering everything from programming assistants to universal chatbots. But here’s the catch: running these ...