Been running local models for a while, currently a 3090 box for the daily driver stuff and a second machine with a pair of older cards I use for batch jobs. Nothing exotic by this sub's standards. Standard reasons: cost at volume, not sending data to an API, and honestly just liking that it's mine.
