Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Why not just have one less feature before softmax? [D]

Via r/MachineLearning
Tuesday, Sep 29, 2026 · 5:26AM
Summary

Softmax has N inputs and N outputs but it's output only has N-1 degrees of freedom because of the condition that the sum of outputs must be equal to one. Based on this we can figure out that actually we can make due with only N-1 inputs by making an assumption that logits before softmax must sum up

Continue reading the full article
Read at r/MachineLearning
www.reddit.com
Back to all stories