Dongsu Lee

Hello! I'm Dongsu. I will start as a PhD student in the 2025 Fall, United States. Previously, I worked at Brain and Machine Intelligence Lab (BMIL) (Prof. Minhae Kwon) and Post-genome Informatics Lab (Prof. Sangsoo Kim) at the Soongsil University in Seoul, South Korea.

I am interested in reinforcement learning, representation learning, and robotics. Recently, I explore the way to enhance the scalability of RL for robotics and multi-agent system.

Speak truth, amid echoing scorn.
Embrace adventure, born of conviction.
Take responsibility, without retreat.

Email / CV / Scholar / X / Github

Selected Publications

Temporal Distance-aware Transition Augmentation for Offline Model-based Reinforcement Learning

Dongsu Lee, Minhae Kwon
ICML 2025
paper | project page

Episodic Future Thinking With Offline Reinforcement Learning for Autonomous Driving

Dongsu Lee, Minhae Kwon
IEEE IoTJ 2025; IEEE ITSC 2023
paper (short) | project page | talk (10min)

Episodic Future Thinking Mechanism for Multi-agent Reinforcement Learning

Dongsu Lee, Minhae Kwon
NeurIPS 2024
paper | project page | talk (5min)

AD4RL: Autonomous Driving Benchmarks for Offline Reinforcement Learning with Value-based Dataset

Dongsu Lee, Chanin Eom, Minhae Kwon
ICRA 2024
paper | project page | talk (5min) | media

Instant Inverse Modeling of Stochastic Driving Behavior with Deep Reinforcement Learning

Dongsu Lee, Minhae Kwon
IEEE T-CE 2024
paper

Stability Analysis in Mixed-autonomous Traffic with Deep Reinforcement Learning

Dongsu Lee, Minhae Kwon
IEEE T-VT 2023; NeurIPS DeepRL Workshop 2022
paper | slides | invited talk (korean) | media

ADAS-RL: Safety Learning Approach for Stable Autonomous Driving

Dongsu Lee, Minhae Kwon
ICT Express 2022
paper

Patents

Method for Combating Stop-and-Go Wave Problem Using Deep Reinforcement Learning based Autonomous Vehicles, Recording medium and device for performing this the method

Dongsu Lee, Minhae Kwon, Patent no. US 12,091,025 (Sep 2024)

Honors and Awards

Scholarships

AI Intensive Program at Carnegie Mellon University (Aug 2024 - Feb 2025)

IITP & Sogang University (USD 41K)

Future Industrial Talent Scholarship (Aug 2023 - Feb 2025)

CMK Hyundai Group (Full tuition + KRW 3,600K / year)

Awards

Global Excellence Scholarship (Prize: KRW 3,000K), CMK Hyundai Group (Mar, Dec, Dec 2024)

ICT Challenge IITP President’s Award (Prize: KRW 5,000K), IITP (Sep 2023)

Services

Reviews

Journals: Nature Communication (2025), IEEE T-ITS (2025), IEEE T-CE (2025), IEEE T-VT (2023), IEEE IoT-J (2023)

Conferences: NeurIPS (2025), CoRL (2025), IRoS (2025), ICRA (2025), ICML (2022)

Workshops: ICML Theory of Mind Workshop (2023; Program committee), NeurIPS ML4AD (2022)

Template