DEV-TOOLSApril 16, 20261 min read9 views

Show HN: Agent-cache – Multi-tier LLM/tool/session caching for Valkey and Redis

Agent-cache is a multi-tier exact-match caching solution for AI agents that handles LLM responses, tool results, and session states through a single connection, supporting Redis and Valkey.

Multi-tier exact-match cache for AI agents backed by Valkey or Redis. LLM responses, tool results, and session state behind one connection. Framework adapters for LangChain, LangGraph, and Vercel AI SDK. OpenTelemetry and Prometheus built in. No modules required - works on vanilla Valkey 7+ and Redis 6.2+.

Shipped v0.1.0 yesterday, v0.2.0 today with cluster mode. Streaming support coming next.

Existing options locked you into one tier (LangChain = LLM only, LangGraph = state only) or one framework. This solves both.

npm: https://www.npmjs.com/package/@betterdb/agent-cache Docs: https://docs.betterdb.com/packages/agent-cache.html Examples: https://valkeyforai.com/cookbooks/betterdb/ GitHub: https://github.com/BetterDB-inc/monitor/tree/master/packages...

Happy to answer questions.

Source: Hacker News

More in this category

dev-tools

Linux kernel will support $ORIGIN, sort of

Farid Zakaria shares his journey of proposing a patch to the Linux kernel to support relocatable binaries in Nix, which evolved into a powerful eBPF-based solution for binfmt_misc.

dev-tools

Five US tech giants' hidden debts soar to $1.65T on opaque AI funding

A Nikkei study reveals that off-balance-sheet debts at five major US tech companies have surged eightfold to $1.65 trillion, driven by massive AI investments like data center leases and GPU contracts.

dev-tools

Running Doom on Our Custom CPU and Going Viral

Two developers successfully built a custom CPU from scratch at the logic gate level, deployed it on an FPGA, and optimized its memory architecture to run the classic game DOOM.

dev-tools

Incremental – A library for incremental computations

Incremental is a library designed for building complex computations that update efficiently when inputs change. Inspired by self-adjusting computation research, it is highly useful for large-scale calculations, GUI views, and data synchronization.

dev-tools

Flock Credibility Lost as It Repeatedly Lies to City Councils, Police, & Public

Flock Safety, a prominent provider of automatic license plate readers (ALPR), is facing a severe credibility crisis after being caught repeatedly misleading city councils, police departments, and the public about its surveillance capabilities and data practices.

dev-tools

Human mathematicians are being outcounterexampled

In just a few weeks, advanced AI models like ChatGPT Sol and Claude Fable have disproved long-standing mathematical conjectures by finding precise counterexamples and auto-formalizing them in Lean.