I fine-tuned Gemma 3 4B on a psychotherapy dataset using DPO as part of an experiment to make a local chatbot that can act as a companion (yes, this is absolutely not intendended to give medical advice or be a therapist). I must thank whoever invented QLoRa and PeFT - I was able to run the finetunin
