engblogs

Building a general-purpose architecture, Perceiver IO, that can handle diverse inputs and produce a wide variety of outputs, enabling the processing of various types of data.

Exploring a general and versatile architecture that can handle different types of data to solve complex problems in AI systems.

Exploring the evolution of service architecture at SoundCloud with a focus on backends for frontends.

Explore the latest in open-source GPU programming for neural networks with Triton.

Generally capable agents are trained to play a variety of games and tasks without human interaction data, marking an important step toward more adaptive AI agents.

Exploring the development of AI agents with general and adaptive behavior, capable of learning and reacting to new conditions and playing a variety of games and tasks.

Exploring the advancements in machine learning for high-accuracy protein structure prediction on a large scale

Sharing high-quality protein structure predictions for all human proteins and 20 other organisms using AlphaFold 2 system.

Sharing knowledge among web engineers at SoundCloud and being part of the 'Web Collective'

Introducing Melting Pot: a scalable evaluation suite for multi-agent reinforcement learning, designed to test generalisation to novel social situations and assess a broad range of social interactions with 21 MARL substrates and over 85 unique test scenarios.

Exploring the efficacy of large language models trained on code

Reflecting on the inaugural year of EleutherAI.