Junwei Zhou

I'm a first year Ph.D. student at Dartmouth College, advised by Prof. Yu-Wing Tai. Previously, I have worked with Prof. Ming-Hsuan Yang, Prof. Lu Qi, Dr. Xueting Li at UC Merced, and Prof. Xinggang Wang at HUST. I received my B.E. from Huazhong University of Science and Technology.

My research interest mainly lies in utilizing different modalities (language, 2D visual signal, 3D representations) to achieve general intelligence that can understand the real-world. Specifically, 3D & generative models, Multimodal Large Language Models for 3D.

Now I am actively seeking a potential summer research internship in 2026. Please drop me an email if you are interested.

Also, I am open to collaborations, please drop me an email if you want to have a chat.

Email  /  Google Scholar  /  Github

profile photo

Research

Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimation
Junwei Zhou, Yu-Wing Tai
Arxiv, 2026
project page / arXiv

We propose a perceive-then-plan framework with two VLMs (Perceiver and LaP Planner) for monocular 3D layout estimation, enabling both visual alignment and scene Coherence.

GENA3D: Generative Amodal 3D Modeling by Bridging 2D Priors and 3D Coherence
Junwei Zhou, Yu-Wing Tai
Arxiv, 2025
project page / arXiv

Intergrating 2D amodal completion and 3D generative modeling to achieve amodal 3D objects generation from multiple partial occluded input images.

CoCo4D: Comprehensive and Complex 4D Scene Generations
Junwei Zhou, Xueting Li, Lu Qi, Ming-Hsuan Yang
Arxiv, 2025
project page / arXiv

Generating a comprehensive and complex 4D scene by dividing a 4D scene and progressive dynamic content extrapolation.

Layout-your-3D: Controllable and Precise 3D Generation with 2D Blueprint
Junwei Zhou, Xueting Li, Lu Qi, Ming-Hsuan Yang
ICLR, 2025
project page / arXiv

Given a text prompt describing multiple objects and their spatial relationships, our method generates a 3D scene depicting these objects naturally interacting with one another.

WeakSAM: Segment Anything Meets Weakly-supervised Instance-level Recognition
Lianghui Zhu*, Junwei Zhou*, Yan Liu, Xin Hao, Wenyu Liu, Xinggang Wang
ACM Multimedia, 2024
project page / arXiv

SAM in helping weakly-supervised instance perception task.

Service

Reviewer, ICLR 2025, 2026 | NeurIPS 2026
Reviewer, IJCV
Teaching Assistant, Dartmouth College, COSC074 2025 Fall, 2026 Spring

Website borrowed from JonBarron.