pottrait

Wenyan Cong

University of Texas at Austin

Email  /  Google Scholar  /  Github  /  CV  /  Linkedin  /  Twitter

About Me

I am a third-year Ph.D. student in Electrical Computer Engineering at University of Texas at Austin, under the supervision of Prof. Atlas Wang. I received the B.Eng. and M.S. degree (advised by Prof. Li Niu and Prof. Liqing Zhang) in Computer Science and Technology from Shanghai Jiao Tong University, in 2019 and 2022, respectively.

I was a research intern at Meta Fair with Weiyao Wang, Matt Feiszli, at Snap Research with Jian Wang.

I received MLSys'25 Outstanding Paper Award (Honorable Mention) and CVPR'25 AI4CC Workshop Best Paper Award.

Recent Updates

  • One paper is accepted by COLM 2025.
  • Our abstract paper of VideoLifter received the Best Paper Award at CVPR'25 AI4CC Workshop.
  • I joined Adobe as Research Scientist Intern this summer!
  • We are organizing End-to-End 3D Learning workshop at ICCV'25! See you in Hawaii.
  • Our APOLLO received the Outstanding Paper Award (Honorable Mention) at MLSys'25.

    • Research Interests

    My research focuses on modeling dynamic and complex 3D/4D environments: both capturing the real world through digital reconstruction and synthesizing controllable virtual worlds. I’m also interested in efficient AI algorithems, with an emphasis on improving the training and inference efficiency of large foundation models.

    Adobe Meta Snapchat UT Austin SJTU

    Selected Publications
    Full publication list at Google Scholar

    E3D-Bench: A Benchmark for End-to-End 3D Geometric Foundation Models
    Wenyan Cong, Yiqing Liang, Yancheng Zhang, Ziyi Yang, Yan Wang, Boris Ivanovic, Marco Pavone, Chen Chen, Zhangyang Wang, Zhiwen Fan
    In Submission
    PaperProjectCode
    Can Scaling Test-Time Compute Improve World Foundation Model?
    Wenyan Cong*, Hanqing Zhu*, Peihao Wang, Bangya Liu, Dejia Xu, Kevin Wang, David Z. Pan, Yan Wang, Zhiwen Fan, Zhangyang Wang
    COLM 2025
    PaperProjectCode
    Videolifter: Lifting videos to 3d with fast hierarchical stereo alignment
    Wenyan Cong, Hanqing Zhu, Kevin Wang, Jiahui Lei, Colton Stearns, Yuanhao Cai, Dilin Wang, Rakesh Ranjan, Matt Feiszli, Leonidas Guibas, Zhangyang Wang, Weiyao Wang, Zhiwen Fan
    AI4CC CVPRW 🏆 Best Paper Award (Abstract paper). In Submission
    PaperProjectCode
    APOLLO: SGD-like Memory, AdamW-level Performance
    Hanqing Zhu*, Zhenyu Zhang*, Wenyan Cong, Xi Liu, Sem Park, Vikas Chandra, Bo Long, David Z Pan, Zhangyang Wang, Jinwon Lee
    MLSys 2025 🏆 Outstanding Paper Honorable Mention Award GitHub stars  
    Paper Project Code Video Hugging Face Transformer
    LLaMA-Factory FluxML Hacker News 机器之心
    Large spatial model: End-to-end unposed images to semantic 3d
    Zhiwen Fan*, Jian Zhang*, Wenyan Cong, Peihao Wang, Renjie Li, Kairun Wen, Shijie Zhou, Achuta Kadambi, Zhangyang Wang, Danfei Xu, Boris Ivanovic, Marco Pavone, Yue Wang
    NeurIPS 2024
    PaperProjectCode
    PACE: Pacing Operator Learning to Accurate Optical Field Simulation for Complicated Photonic Devices
    Hanqing Zhu, Wenyan Cong, Guojin Chen, Shupeng Ning, Ray T Chen, Jiaqi Gu, David Z Pan
    NeurIPS 2024  
    PaperCode
    InstantSplat: Sparse-view SfM-free Gaussian Splatting in Seconds
    Zhiwen Fan*, Wenyan Cong*, Kairun Wen*, Kevin Wang, Jian Zhang, Xinghao Ding, Danfei Xu, Boris Ivanovic, Marco Pavone, Georgios Pavlakos, Zhangyang Wang, Yue Wang
    In Submission 
    PaperProjectCode
    Enhancing NeRF akin to Enhancing LLMs: Generalizable NeRF Transformer with Mixture-of-View-Experts
    Wenyan Cong*, Hanxue Liang*, Peihao Wang, Zhiwen Fan, Tianlong Chen, Mukund Varma, Yi Wang, Zhangyang Wang
    ICCV 2023 
    PaperCode
    High-resolution Image Harmonization via Collaborative Dual Transformations
    Wenyan Cong, Xinhao Tao, Li Niu, Jing Liang, Xuesong Gao, Qihao Sun, Liqing Zhang
    CVPR 2022 
    PaperCode
    Deep Image Harmonization by Bridging the Reality Gap
    Junyan Cao, Wenyan Cong, Li Niu, Jianfu Zhang, Liqing Zhang
    BMVC 2022 
    Paper
    Making Images Real Again: A Comprehensive Survey on Deep Image Composition
    Li Niu, Wenyan Cong, Liu Liu, Yan Hong, Bo Zhang, Jing Liang, Liqing Zhang
    ArXiv 2021 
    Paper
    Dovenet: Deep Image Harmonization via Domain Verification
    Wenyan Cong, Jianfu Zhang, Li Niu, Liu Liu, Zhixin Ling, Weiyuan Li, Liqing Zhang
    CVPR 2020 
    PaperCode