Wrote this as I built the infra at my org. Let me know what you all think... https://gd03.me/writings/inference-infra
