[D] Interview experience for LLM inference systems position

Hi I am preparing for a interview at an AI Lab for LLM inference team with a systems role, not MLE. I have been told I will have an LLM inference related coding round, a design round and an inference optimization related discussion. I have been extensively preparing for these. My Prep for coding is learning to code from scratch the following: SelfAttention, Transformer block, BPE tokenizer, Sampling methods, LV Cache, Bean Search. For other two interviews, I am just studying all the inference design and bottlenecks and old/new work done to eliminate them. I would love to hear if anyone has had similar interview and can share experiences.

submitted by /u/dividebyzero74
[link] [comments]

Liked Liked