Profile Photo

Dongsu Lee

Hello! I am a PhD student at the University of Texas at Austin, where I’m supervised by Prof. Amy Zhang in the MIDI Lab. Previous affiliation. I collaborated with Prof. Ding Zhao in the Safe AI Lab, Carnegie Mellon University (CMU); with Prof. Minhae Kwon in the BMIL; and Prof. Sangsoo Kim in the Post-genome Informatics Lab at Soongsil University in Seoul, South Korea.

I’m interested in realistic RL problems, e.g, partial observability, coordination with unseen partners, and human-robot collaboration. Then, I aim to make an RL algorithm applicable in via both self-play and data-driven techniques.

I am always happy to talk about research, so feel free to reach out if you want to chat!

Selected Publications

Multi-agent Coordination via Flow Matching
Dongsu Lee, Daehee Lee, Amy Zhang
ICLR 2026
Unifying Agent Interaction and World Information for Multi-agent Coordination
Dongsu Lee, Daehee Lee, Yaru Niu, Honguk Woo, Amy Zhang, Ding Zhao
NeurIPS 2025 ARLET Workshop (Oral)
Policy Compatible Skill Incremental Learning via Lazy Learning Interface
Daehee Lee, Dongsu Lee, TaeYoon Kwack, Wonje Choi, Honguk Woo
NeurIPS 2025 (Spotlight)

All Publications & Patents

Paper Multi-agent Coordination via Flow Matching
Dongsu Lee, Daehee Lee, Amy Zhang
ICLR 2026
Paper Unifying Agent Interaction and World Information for Multi-agent Coordination
Dongsu Lee, Daehee Lee, Yaru Niu, Honguk Woo, Amy Zhang, Ding Zhao
NeurIPS 2025 ARLET Workshop (Oral)
Paper Policy Compatible Skill Incremental Learning via Lazy Learning Interface
Daehee Lee, Dongsu Lee, TaeYoon Kwack, Wonje Choi, Honguk Woo
NeurIPS 2025 (Spotlight)
Paper Scenario-free Autonomous Driving with Multi-task Offline-to-online Reinforcement Learning
Dongsu Lee, Minhae Kwon
IEEE Transactions on Intelligent Transportation Systems

Patents

Patent Method and Apparatus for Inferring Stochastic Driving Characteristic of a Vehicle
Dongsu Lee, Minhae Kwon
Application no. US 18/139602 (Apr 26, 2023), pending
Patent Apparatus and Method for Inferring Driving Characteristics of Vehicle
Dongsu Lee, Minhae Kwon
Patent no. US 12,391,261 (Issued Aug 19, 2025)
Patent Method for Combating Stop-and-Go Wave Problem Using Deep Reinforcement Learning based Autonomous Vehicles
Dongsu Lee, Minhae Kwon
Patent no. US 12,091,025 (Sep 2024)

Write-ups

Blog A lazy, borrowed recipe
Mar 2026 • Discourse: right direction of the offline MARL community.
Blog Fast and expressive multi-agent coordination
Oct 2025 • Capturing complex joint behavior while keeping inference fast.
Blog Research statement: Towards generalizable MARL
Aug 2025 • Bottlenecks and a roadmap for generalizable MARL.