I recently posted about using Apple's on-device 3B model to build a shell assistant and benchmarking accuracy. I used the bare model and dynamic retrieval. As a next step, I wanted to explore training a LoRA adapter for the model, partly to see if it improves accuracy, but mostly to understand what
