Why does LoRA work? Because every matrix in existence is just: rotate, stretch, rotate. Keep the big stretches, drop the rest. https://t.co/FS54AK3pTY #LLM #GPU # ...