IROS 2026 Tutorial

Learning-to-Optimize for Control in Robotics

A hands-on tutorial on learning-to-optimize methods for real-time MPC, sampling-based control, and adaptive robotic control.

Overview

This tutorial introduces learning-to-optimize (L2O) as a practical framework for accelerating and improving optimization-based control in robotic applications.

The tutorial focuses on real-time model predictive control, efficient sampling-based control, and learning-to-adapt methods for controllers operating under changing dynamics and uncertain environments. The hands-on examples will use the Ctrl-L2O toolbox to demonstrate these ideas across robotic systems such as autonomous vehicles, quadrupedal robots, and bipedal robots, with interfaces compatible with platforms such as MuJoCo.

Tentative Schedule

Time Speaker Talks
1:30-1:45 Rahul Mangharam Openings
1:45-2:45 Viet-Anh Le Learning-to-Optimize and Its Applications in Control
2:45-3:00 — Coffee Break
3:00-4:00 Yorie Nakahira Learning Safe and Adaptive Autonomy: Uncertainty, Language, and Human-AI Alignment
4:00-4:30 — Coffee Break
4:30-5:30 Ahmad Amine Learning-to-Sample for Model Predictive Control

Tutorial Contents

Viet-Anh Le

Learning-to-Optimize and Its Applications in Control

Viet-Anh Le (Postdoctoral Researcher, University of Pennsylvania)

Abstract

This tutorial introduces learning-to-optimize (L2O) through the lens of parametric optimization for control and robotics. We begin with model predictive control (MPC) and trajectory optimization as motivating examples, highlighting the computational challenges that arise when optimization problems must be solved repeatedly in real time. In the first part of the tutorial, we introduce the fundamental concepts of L2O and their integration with traditional optimization methods. We then present core L2O concepts, including learning parametric solution maps through supervised learning and self-supervised learning, neural warm starts, algorithm unrolling, and differentiable optimization layers. Particular emphasis is placed on how learning can be integrated with, rather than replace, optimization algorithms to improve computational efficiency while retaining model structure and constraints. The tutorial will discuss L2O approaches for continuous and mixed-integer optimization, as well as learning sampling distributions and solver parameters for sampling-based control. Through representative examples in robotic navigation, trajectory optimization, contact-rich manipulation, and locomotion, we illustrate how L2O can accelerate optimization and enable real-time control of complex dynamical systems. The tutorial concludes with emerging directions in differentiable control, scientific machine learning, and generalizable optimization policies.

Biography

Viet-Anh Le is a postdoctoral researcher at the Department of Electrical and Systems Engineering, University of Pennsylvania, PA, USA. He received the PhD degree in Mechanical Engineering from the University of Delaware in 2025, the MSc degree in Informatics from Northern Arizona University in 2021, and the BSc degree in Automation and Control Engineering (talented program) from Hanoi University of Science and Technology, Vietnam in 2019, respectively. From September 2023 to August 2025, he was a visiting graduate scholar in System Engineering at Cornell University, and from June to August 2023, he was a research intern at Honda Research Institute USA. His current research interests include Learning for Control and Optimization, Model Predictive Control, Distributed Optimization, and Multi-agent Systems.

Yorie Nakahira

Learning Safe and Adaptive Autonomy: Uncertainty, Language, and Human-AI Alignment

Yorie Nakahira (Associate Professor, Carnegie Mellon University)

Abstract

This seminar introduces our recent work in stochastic safe control, uncertainty and risk quantification, language-guided control, and multi-agent interaction. First, we consider safe control for systems with latent risks, where hidden variables can make the dynamics partially unidentifiable and induce spurious distribution shifts between offline and online statistics. To address these challenges, we develop data-driven techniques for quantifying risk and providing safety guarantees despite latent uncertainty and distribution shifts. Our framework establishes the first bridge between safe control and causal inference. Second, we present our work on uncertainty quantification and neural network fine tuning. At the core of our approach are analytic solutions for the moments of random variables passed through nonlinear activation functions. These solutions enable sample-free uncertainty quantification and one-pass fine-tuning without iterative gradient computation. Finally, we introduce our work on language-guided planning, control, and safety certificates. These results show how natural language can specify and execute robot tasks, guide diffusion planners with probabilistic guarantees, and adapt safety certificates to humans’ perceived risks. These interactions reveal an underexplored opportunity to proactively shape desirable opponent adaptations to improve lifelong performance, safety, and human-AI alignment.

Biography

Yorie Nakahira is an Associate Professor in the Department of Electrical and Computer Engineering at Carnegie Mellon University. She received a B.E. in Control and Systems Engineering from Tokyo Institute of Technology and a Ph.D. in Control and Dynamical Systems from California Institute of Technology. Her research goal is to develop control and learning techniques that enhance the capabilities of autonomous systems. On the algorithm side, her group studies robust and safe control, uncertainty and risk quantification, adaptation algorithms, and language-guided control. On the application side, her group explores diverse topics, ranging from autonomous control systems to human sensorimotor control to poverty alleviation policy design. She has received four young investigator awards, including NSF CAREER, and holds a part-time position at the Research and Development Center for Large Language Models.

Ahmad Amine

Learning-to-Sample for Model Predictive Control

Ahmad Amine (PhD Student, University of Pennsylvania)

Abstract

This tutorial examines learning-to-optimize methods for sampling-based model predictive control (MPC), with a focus on model predictive path integral (MPPI) control. Building on neural warm starts and differentiable optimization layers, we study three ways to incorporate learning into MPPI. First, we learn the mean of a Gaussian sampling distribution over control sequences while retaining a fixed covariance and online optimization over the prediction horizon. Second, we use normalizing flows to learn distributions over control sequences and update the latent sampling distribution online. Third, we examine Step-MPPI, which learns a state-conditioned action mean and covariance through long-horizon closed-loop training and uses single-step lookahead during deployment. Hands-on examples extend the navigation and control problems introduced earlier in the tutorial, connecting learned initializations and differentiable control layers to their sampling-based counterparts. Through these examples, we examine the trade-offs among sampling budget, prediction horizon, computational cost, and closed-loop performance.

Biography

Ahmad Amine is a fourth-year PhD student in Electrical and Systems Engineering at the University of Pennsylvania, advised by Professor Rahul Mangharam. He received his MSE in Robotics from the University of Pennsylvania and his BE in Electrical and Computer Engineering from the American University of Beirut. His research focuses on safe, learning-based control, with an emphasis on model predictive control, online system identification, and data-driven invariant-set learning. He develops methods that use successful trajectories and failed executions to improve controller performance while ensuring safety, with applications in autonomous driving and robotics.

Materials

Slides, software toolboxes, and notebooks for the talks:

Organizers

Rahul Mangharam

Rahul Mangharam

Professor, University of Pennsylvania

Viet-Anh Le

Viet-Anh Le

Postdoctoral Researcher, University of Pennsylvania

Yorie Nakahira

Yorie Nakahira

Associate Professor, Carnegie Mellon University

Ahmad Amine

Ahmad Amine

PhD Student, University of Pennsylvania

Acknowledgments

We gratefully acknowledge the sponsorship of the IEEE RAS Technical Committee on Robot Control.