[P] Interactive 2D and 3D Visualization of GPT-2

[P] Interactive 2D and 3D Visualization of GPT-2

Hi everyone, I’ve built an interactive web visualization of GPT-2 (124M). You can check it out at

llm-visualized.com

It depicts real attention scores and activations extracted from GPT-2 during a forward pass. It’s mean to be an education resource that illustrates Transformer basics and concepts such as kv-caching!

I built the 3d component with Three.js and the 2d component with plain HTML/CSS/JS. Would love to hear your thoughts/feedback!

submitted by /u/Greedy-Argument-4699
[link] [comments]

Liked Liked