Gwanghyun (Bradley) Kim

Welcome!

I am a Research Scientist at NVIDIA GEAR, working on world models and foundation models for robotics. I received my Ph.D. in electrical and computer engineering (ECE) from Seoul National University (SNU), advised by Prof. Se Young Chun. I completed my M.S. in Bio and Brain Engineering (BBE) at Korea Advanced Institute of Science and Technology (KAIST), advised by Prof. Jong Chul Ye. I earned my B.S degree in electrical and electronic engineering (EEE) from Yonsei University.

Experience

NVIDIA Research, Research Scientist
Apr. 2026 - Present, Santa Clara, CA (remote)
NVIDIA Research, Research Scientist Intern
Mentors: Jim Fan, Yuke Zhu, and Joel Jang
Jan. 2026 - Apr. 2026, Santa Clara, CA (remote)
NVIDIA Research, Research Scientist Intern
Mentors: Umar Iqbal, Xueting Li, Ye Yuan, Koki Nagano, and Tianye Li
Jan. 2024 - Feb. 2025, Santa Clara, CA (remote)
Google Research, Student Researcher
Hosts: Alonso Martinez, Krishna Somandepalli, and Yu-Chuan Su
Sep. 2023 - Jan. 2024, New York, NY
Fast Campus, Lecturer in AI
Letcure title: Mastering GANs through Model Implementation
Nov. 2022 - Oct. 2023, Seoul, Korea

Research Interests

My research focuses on building world models and foundation models for robotics, unifying perception, prediction, and action for real-world embodied agents. This builds on my work in multimodal generative modeling for understanding and synthesizing the physical world — spanning 2D/3D scene generation, temporally consistent video modeling, and environments with physical interactions.

News

[Apr. 2026] I joined NVIDIA GEAR as a Research Scientist!
[Feb. 2026] HUG-3D is accepted to CVPR 2026 as a Highlight.
[Sep. 2025] We won the 2nd place award in REG 2025.
[Jun. 2025] GeoMan, done at NVIDIA, and PersonaCraft are accepted to ICCV 2025.
[Oct. 2024] I won the Google Conference Scholarship.
[Sep. 2024] AVDiT & MoNL, done at Google, is accepted to NeurIPS 2024.
[Jul. 2024] BeyondScene is accepted to ECCV 2024.
[Jan. 2024] I joined NVIDIA as a Research Intern.
[Nov. 2023] I won the Qualcomm Innovation Fellowship South Korea 2023.
[Sep. 2023] I joined Google as a Student Researcher.

Show older news

[Aug. 2023] I am selected as a recipient of Yulchon AI Star Scholarships.
[Jul. 2023] PODIA-3D is accepted to ICCV 2023.
[Apr. 2023] Ditto-NeRF is available on arXiv.
[Feb. 2023] DATID-3D is accepted to CVPR 2023.
[Nov. 2022] I start a new position as Lecturer in AI at Fast Campus.
[Aug. 2022] DiffusionCLIP is invited to oral session at KCCV 2022.
[Jun. 2022] DISTL is accepted to Nature Communications.
[Mar. 2022] DiffusionCLIP is accepted to CVPR 2022.
[Dec. 2021] I won the Best Master Student for the Year Award at BISPL, KAIST.
[Dec. 2021] Our AI-based COVID-19 diagnosis solution passed exploratory clinical trial.
[Nov. 2021] MT-ViT for COVID-19 is accepted to Medical Image Analysis.
[Sep. 2021] FeSTA is accepted to NeurIPS 2021.
[Dec. 2020] We won the 2nd place award in NVIDIA AI Healthcare Hackathon.

Research

World Action Models are Zero-Shot Policies

S. Ye^†, Y. Ge*, K. Zheng*, S. Gao*, S. Yu*, ..., Gwanghyun Kim, ..., Y. Chebotar, S. Reed, J. Kautz, Y. Zhu^†, J. Fan^†, J. Jang^† (*core, ^†leads)

arXiv 2026, NVIDIA

PDF Project page Code
CVPR Highlight

Human Interaction-Aware 3D Reconstruction from a Single Image

Gwanghyun Kim*, J. J. Kim*, S. Y. Jeon*, J. Park, S. Y. Chun (*co-first authors)

CVPR 2026 (Highlight)

PDF Project page
ICCV

GeoMan: Temporally Consistent Human Geometry Estimation using Image-to-Video Diffusion

Gwanghyun Kim, X. Li, Y. Yuan, K. Nagano, T. Li, J. Kautz, S. Y. Chun, U. Iqbal

ICCV 2025, NVIDIA

PDF Project page
ICCV

PersonaCraft: Personalized and Controllable Full-Body Multi-Human Scene Generation Using Occlusion-Aware 3D-Conditioned Diffusion

Gwanghyun Kim*, S. Y. Jeon*, S. Lee, S. Y. Chun (*co-first)

ICCV 2025

PDF Project page Code
NeurIPS

A Versatile Diffusion Transformer with Mixture of Noise Levels for Audiovisual Generation

Gwanghyun Kim*, A. Martinez, Y. Su, B. Jou, J. Lezama, A. Gupta, L. Yu, L. Jiang, A. Jansen, J. Walker, K. Somandepalli* (*co-first)

NeurIPS 2024, Google

PDF Project page
ECCV

BeyondScene: Higher-Resolution Human-Centric Scene Generation With Pretrained Diffusion

Gwanghyun Kim*, H. Kim*, H. Seo*, D U Kang*, S. Y. Chun (*co-first)

ECCV 2024

PDF Project page Code
ICCV

PODIA-3D: Domain Adaptation of 3D Generative Model Across Large Domain Gap Using Pose-Preserved Text-to-Image Diffusion

Gwanghyun Kim, J. H. Jang, S. Y. Chun

ICCV 2023

PDF Project page Code
DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Model

H. Seo*, H. Kim*, Gwanghyun Kim*, S. Y. Chun (*co-first)

arxiv 2023

PDF Project page Code
CVPR

DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Model

Gwanghyun Kim, S. Y. Chun

CVPR 2023

PDF Project page Code Demo Colab GitHub Stars
Nat. Commun.

AI can evolve without labels: self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation

S. Park, Gwanghyun Kim, Y. Oh, J. B. Seo, S. M. Lee, J. H. Kim, S. Moon, J. K. Lim, C. M. Park, J. C. Ye

Nature Communications, 2022

PDF
CVPR

DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation

Gwanghyun Kim, T. Kwon, J. C. Ye

CVPR 2022, KCCV 2022 (Oral)

PDF Code Demo Colab Video Poster GitHub Stars
NeurIPS

Federated Split Vision Transformer for COVID-19 CXR Diagnosis using Task-Agnostic Training

S. Park*, Gwanghyun Kim*, J. Kim, B. Kim, J. C. Ye (*co-first)

NeurIPS 2021

PDF
Med. Image Anal.

Multi-task Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantification

S. Park*, Gwanghyun Kim*, Y. Oh, J. B. Seo, S. M. Lee, J. H. Kim, S. Moon, J. K. Lim, J. C. Ye (*co-first)

Medical Image Analysis, 2021

PDF
Severity Quantification and Lesion Localization of COVID-19 on CXR using Vision Transformer

Gwanghyun Kim, S. Park, Y. Oh, J. B. Seo, S. M. Lee, J. H. Kim, S. Moon, J. K. Lim, J. C. Ye

arxiv 2021

PDF
Vision Transformer for COVID-19 CXR Diagnosis using Chest X-ray Feature Corpus

S. Park, Gwanghyun Kim, Y. Oh, J. B. Seo, S. M. Lee, J. H. Kim, S. Moon, J. K. Lim, J. C. Ye

arxiv 2021

PDF

Patents

Full-Body Multi-Person Image Generation Reflecting Individual Facial, Body, and Pose Characteristics with Distortion Prevention
Gwanghyun Kim, D. Ban, S.Lee, S. Y. Jeon, S. Y. Chun
Korean Patent, Filed, No. 10-2026-0059245, 2026
Higher-Resolution Human-Centric Scene Generation With Pretrained Diffusion
S. Y. Chun, Gwanghyun Kim, H. Kim, H. Seo, D U Kang
U.S. Patent, Filed, No. 19,019,060, 2025
Korean Patent, Filed, No. 10-2024-0115484, 2024
Multi-Modal Diffusion with Mixture of Timesteps
K. Somandepalli, Gwanghyun Kim, A. Martinez, Y. Su, B. Jou, J. Lezama, A. Gupta, L. Yu, L. Jiang, A. Jansen, J. Walker
U.S. Patent, Filed, No. 63,548,776, 2024
Domain Adaptation of 3D Generative Model Across Large Domain Gap Using Pose-Preserved Text-to-Image Diffusion
S. Y. Chun, Gwanghyun Kim
U.S. Patent, Filed, No. 18,933,335, 2024
Korean Patent, Granted, No. 10-2944713, 2026
Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Model
S. Y. Chun, Gwanghyun Kim
U.S. Patent, Filed, No. 18,534,243, 2023
Korean Patent, Granted, No. 10-2903508, 2025
Severity quantification and lesion localization method of infectious disease on cxr using vision transformer and apparatus therefor
J. C. Ye, S. Park, Gwanghyun Kim
U.S. Patent, Granted, No. 12,169,933, 2024
Korean Patent, Granted, No. 10-2558096, 2023
Method of classifying lesion of chest x-ray radiograph based on data normalization and local patch and apparatus thereof
J. C. Ye, S. Park, Y. Oh, Gwanghyun Kim
U.S. Patent, Granted, No. 12,056,880, 2024
Korean Patent, Granted, No. 10-2021-0039509, 2023

Awards and Honors

2nd Place Award in REG 2025 Challenge (€400), MICCAI, 2025
Google Conference Scholarship ($3,000), Google, 2024
Qualcomm Innovation Fellowship South Korea 2023 ($4,000), Qualcomm, 2023
Yulchon AI Star Scholarships ($8,000), Youlchon Foundation & SNU AI Institute, 2023
Brain Korea 21 Scholarships, Korea Research Foundation, 2022 - 2023
Best Master Student for the Year Award ($2,000), BISPL, KAIST, 2021
2nd Place Award in NVIDIA AI Healthcare Hackathon ($8,500), NVIDIA & GIAI, 2020
KAIST Scholarship, KAIST, 2020 - 2021
Honors Scholarship, Yonsei University, Spring 2018, Fall 2018

Invited Talks

BeyondScene: Higher-Resolution Human-Scene Generation With Pretrained Diffusion
Samsung MX Research Collaboration Seminar, SNU IPAI, 2024
BeyondScene: Higher-Resolution Human-Scene Generation With Pretrained Diffusion
Cohere For AI, Cohere (Remote), 2024
Tutorial on Denoising Diffusion Models
Bioimaging Winter School, IEIE, 2024
Audio-Video Latent Diffusion Models
Google Research, Google, 2024
Text-driven Control of 2D/3D Image Using Diffusion: DiffusionCLIP & DATID-3D
Innerverz Seminar, Innerverz (Remote), 2023
DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation
London Machine Learning Meetup, London Machine Learning Group (Remote), 2022
Diffusion Models for Vision-Language Tasks
Kakao Brain Open Seminar, Kakao Brain, 2022
Deep Learning-based Diagnosis of Infectious Diseases on CXR and Audio data
NVIDIA AI Developer Meetup, NVIDIA (Remote), 2020

Services

Conference reviewers: CVPR, ICCV, ECCV, NeurIPS, ICLR, ICML, AAAI
Journal Reviewers: T-PAMI, T-CSVT, ACM Comput Surv

Mentoring

Heechang Kim (BS@SNU): Text-to-4D Generation, Summer 2023
Hoigi Seo, Hayeon Kim (BS@SNU): Text-to-3D Generation, Winter 2022
DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Model

Extracurricular Activities

Yonsei Mixed Choir (Aven ante), Club president & Section leader, 2014 - 2019