Gemma Scope: helping the safety community shed light on the inner workings of language models
Announcing a comprehensive, open suite of sparse autoencoders for language model interpretability.
Announcing a comprehensive, open suite of sparse autoencoders for language model interpretability.
Breakthrough models AlphaProof and AlphaGeometry 2 solve advanced reasoning problems in mathematics
Humans excel at processing vast arrays of visual information, a skill that is crucial for achieving artificial general intelligence (AGI). Over the decades, AI researchers have developed Visual Question Answering (VQA) systems to interpret scenes within single images and answer related questions. While recent advancements in foundation models have significantly closed the gap between human and machine visual processing, conventional VQA has been restricted to reason about only single images at a time rather than whole collections of […]
Exploring AGI, the challenges of scaling and the future of multimodal generative AI
When working in AI, especially when doing an empirical PhD, the engineering required for effective experimentation is incredibly important. I procrastinated on writing this article for a while now, but it is getting more and more apparent these days when a large portion of research shifted to working with large foundation models. But even ~7 years ago, when I started my PhD, I quickly realized that running experiments effectively will be crucial. This is because effective experimentation means […]