![[R] Tiny transformers (<100 params) can add two 10-digit numbers to 100% accuracy](https://www.digitado.com.br/wp-content/uploads/2026/02/1BS1qsBBGaHBC3k_LH8kbvv273r9Z2KmBbnWD9Z76FU-84qfYq-978x400.png "[R] Tiny transformers (<100 params) can add two 10-digit numbers to 100% accuracy")
[R] Tiny transformers (
![[R] Tiny transformers (<100 params) can add two 10-digit numbers to 100% accuracy](https://external-preview.redd.it/1BS1qsBBGaHBC3k_LH8kbvv273r9Z2KmBbnWD9Z76FU.png?width=640&crop=smart&auto=webp&s=e7a7b3a2fa48c609a15696873151a038b3944576 "[R] Tiny transformers (<100 params) can add two 10-digit numbers to 100% accuracy") |
Really interesting project. Crazy you can get such good performance. A key component is that they are digit tokens. Floating math will be way tricker. submitted by /u/LetsTacoooo |
Like
0
Liked
Liked
