The Nvidia Patterns

The Nvidia Patterns

Artificial Intelligence Papers

GDM's Robotics Papers of January 2024

January Papers by Google DeepMind in Robotics.

Michael Spencer's avatar
Michael Spencer
Jan 08, 2024
∙ Paid
4
Share

Hey Everyone,

I hope you had a nice break and some festivities. This going to be a rather short post.

Google DeepMind, launched three new papers for advanced robotics that show how we can help robots make faster decisions, and better understand and navigate their environments.

  • The first, AutoRT, brings together large vision and language models with robotic control models in a single system, which could help create robots that understand practical human goals in much more natural ways. The resulting system safely orchestrated as many as 20 robots simultaneously, gathering a diverse dataset across 6,650 unique tasks.

  • The other two papers present a new system for scaling up the efficiency and speed of Robotic Transformers (SARA-RT), and a system for improving the generalization of learning robotic motions by sketching trajectories over top training videos (RT-Trajectory).

More details can be found on GDM’s blog.

Read the AutoRT Paper


Read the SARA-RT Paper


Read the RT-Trajectory Papers


Google wrote a ‘Robot Constitution’

Join My Reddit

Keep reading with a 7-day free trial

Subscribe to The Nvidia Patterns to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Michael Spencer
Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture