Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

has anyone tried local VLMs for desktop GUI automation?

Via r/LocalLlama
Wednesday, May 13, 2026 ยท 7:43AM
Summary

Trying to use a quantized VLM on Apple Silicon to do desktop GUI automation from screenshots. Works ok for basic stuff but small icons and dense UIs are rough. Also the visual token count per screenshot is way higher than I expected which kills prefill speed. Anyone else working on this locally? Cur

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories