Hey! We heard the feedback on making the model more portable and accessible. So in light of that we have 2 updates to share. First, you can pull a new 4-bit quant straight from Hugging Face, so it’s now small enough to run on a Mac or whatever local hardware you’ve got. It needs about 20 gigs so if
