engblogs

Exploring RETRO: Augmenting transformers with retrieval to improve language models

Exploring language modelling at scale, including the use of Gopher and ethical considerations, for understanding and communication in artificial agents and humans.

A blogpost summarizing the papers and talks presented by Stanford AI Lab at NeurIPS 2021, including topics like improving compositionality of neural networks, reverse engineering recurrent neural networks, compositional transformers for scene generation, and more.

AI-assisted research in pure mathematics uncovers new insights in topology and representation theory, demonstrating the potential of machine learning in the field.

On the Expressivity of Markov Reward: A systematic study of the reward hypothesis and its limitations in conveying tasks to RL agents.

This blogpost explores various changes in how Chrome is built to achieve a 25.8% higher score on Speedometer and a 22.0% increase in browser responsiveness, by leveraging compiler optimizations, profiling, and call graph sorting.

Demonstrating limitations of Markov reward functions and providing algorithms for constructing optimal reward functions for various types of tasks

Discovering patterns in numbers through intuitive and spiritual insights, as exemplified by Srinivasa Ramanujan's extraordinary ability in pure mathematics.

Exploring the impact of the OpenAI Residency program on the future of AI development.

Addressing the challenges of rich-text collaboration by constructing a CRDT for efficient modeling and synchronization.

Instant Access to OpenAI's API Eliminates Waitlist

This technical blogpost describes the new features and changes in Chrome 97, including the addition of WebTransport, new array static methods, and various deprecations and removals.