Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Please help me understand figure on subspace similarity in LoRA paper. [D]

Via r/MachineLearning
Friday, Jul 10, 2026 ยท 1:46PM
Summary

I am studying the LoRA paper and have trouble understanding this figure. The function essentially measures how much of the subspace spanned by the top i vectors is contained in the subspace spanned by the top j vectors in the higher rank matrix. Therefore, j can not be lower than i. So when they say

Continue reading the full article
Read at r/MachineLearning
www.reddit.com
Back to all stories