Sapient Intelligence (the HRM/hierarchical reasoning folks) dropped HRM-Text 1B today. Posting because the benchmark chart is interesting enough to be worth a look even if you're skeptical of the marketing. The training numbers: 1B params, trained from scratch on 16 GPUs in 1.9 days 40B unique token
