[R] Designing AI Chip Software and Hardware

This is a detailed document on how to design an AI chip, both software and hardware.

I used to work at Google on TPUs and at Nvidia on GPUs, so I have some idea about this, though the design I suggest is not the same as TPUs or GPUs.

I also included many anecdotes from my career in Silicon Valley.

Background This doc came to be because I was considering making an AI hw startup and this was to be my plan. I decided against it for personal reasons. So if you’re running an AI hardware company, here’s what a competitor that you now won’t have would have planned to do. Usually such plans would be all hush-hush, but since I never started the company, you can get to know about it.