Understanding the capabilities, limitations, and societal impact of large language models
Exploring the impact of large language models on society and their capabilities and limitations
Tests Under the Magnifying Lens
The importance of testing in engineering practices at SoundCloud and building well-balanced test pyramids within code repositories.
Data, Architecture, or Losses: What Contributes Most to Multimodal Transformer Success?
Examining the importance of multimodal attention in the success of multimodal transformers for pretraining.
Scaling Kubernetes to 7,500 nodes
Efficient strategies for scaling Kubernetes deployments to 7,500 nodes
CLIP: Connecting text and images
Exploring the integration of text and images through CLIP technology
DALL·E: Creating images from text
Exploring how DALL·E generates images based on textual descriptions
Organizational update from OpenAI
Exploring the latest organizational developments at OpenAI
MuZero: Mastering Go, chess, shogi and Atari without rules
MuZero is a general-purpose algorithm that can master Go, chess, shogi, and Atari without being given the rules, using its ability to plan winning strategies in unknown environments.
Imitating Interactive Intelligence
Creating a simulated environment (Playroom) for virtual robots to engage in interactive intelligence, studying joint intentionality, cooperation, and communication of private knowledge.
Using JAX to accelerate our research
Using JAX to accelerate research on AI systems by evaluating new machine learning libraries and frameworks
Growing the Hardcaml toolset
Announcement of new Hardcaml libraries in the toolset
AlphaFold: a solution to a 50-year-old grand challenge in biology
The blog post discusses AlphaFold, an AI system that has solved the challenging protein-folding problem, showcasing the potential of AI in scientific discovery and its impact on accelerating progress in fundamental fields of biology.