Why Smarter Models Make Worse Keyboards
Neural models get the hype. But that lightning-fast word suggestion as you type? That’s not a neural model. It’s a lookup table. And it’s beating transformers on the metric that matters. I’ve spent a lot of time thinking about prediction under pressure. When I was working on Indian-language typing for early Kindle devices, we had a problem that no amount of ML enthusiasm could solve: the hardware simply didn’t care about our ambitions. We had roughly 512 MB […]