Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

What if your HNSW index stored 3-bit embeddings instead of float32? [R]

Via r/MachineLearning
Saturday, Apr 11, 2026 · 12:35AM
Summary

I've been experimenting with an approach to vector indexing where the HNSW graph nodes store quantized embeddings (~388 bytes each at dim=1024) instead of float32 vectors (~4,096 bytes). The key insight: if you quantize embeddings using Lloyd-Max scalar quantization after a random orthogonal rotatio

Continue reading the full article
Read at r/MachineLearning
www.reddit.com
Back to all stories