Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Fast little local memory retriever for Hermes

Via r/LocalLlama
Tuesday, May 26, 2026 · 8:10PM
Summary

As title says. Looking for suggestions of a good memory retriever (for use with hindsight/hermes) ideally that can run on a strix halo NPU. GPT OSS 20B would be good based on their outdated rankings but it’s slow on the NPU for this type of task — needs very high throughput to be pulling memories. A

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories