avatar

Ziyu Guo

Ph.D. Student
The Department of Computer Science and Engineering,
The Chinese University of Hong Kong

SHB 903, CUHK, Hong Kong S.A.R., China

 ziyuguo@link.cuhk.edu.hk


About Me

I am a second-year PhD student at The Chinese University of Hong Kong supervised by Prof. Pheng-Ann Heng. Before that, I received my bachelor’s degree in Computer Science from Peking University supervised by Prof. Bin Cui. I previously worked as a research intern at Tencent, Shanghai AI Laboratory, Amazon AWS AI Lab and Roblox.

My research interests mainly include Multi-modal Learning, Large Language/Vision Models, and 3D Vision.

Selected Publications and Preprints

    * Equal contribution, # Corresponding author
  1. arXiv24
    SAM2Point: Segment Any 3D as Videos in Zero-shot and Promptable Manners
    Ziyu Guo, Renrui Zhang, Xiangyang Zhu, Chengzhuo Tong, Peng Gao, Chunyuan Li, Pheng-Ann Heng.
    Technical Report
    PDF Code Webpage Demo


  2. arXiv24
    MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Engines
    Dongzhi Jiang*, Renrui Zhang*, Ziyu Guo, Yanmin Wu, Jiayi Lei, Pengshuo Qiu, Pan Lu, Zehui Chen, Guanglu Song, Peng Gao, Yu Liu, Chunyuan Li, Hongsheng Li.
    arXiv 2024
    PDF Code Webpage Dataset


  3. arXiv23
    Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following
    Ziyu Guo, Renrui Zhang#, Xiangyang Zhu, Yiwen Tang, Xianzheng Ma, Jiaming Han, Kexin Chen, Peng Gao, Xianzhi Li#, Hongsheng Li, Pheng-Ann Heng.
    Under Review
    PDF Code


  4. ICLR24
    Personalize Segment Anything Model with One Shot
    Renrui Zhang, Zhengkai Jiang*, Ziyu Guo*, Shilin Yan, Junting Pan, Hao Dong, Peng Gao, Hongsheng Li#.
    ICLR 2024
    PDF Code


  5. ICCV23
    ViewRefer: Grasp the Multi-view Knowledge for 3D Visual Grounding with GPT and Prototype Guidance
    Ziyu Guo*, Yiwen Tang*, Renrui Zhang*, Dong Wang, Zhigang Wang, Bin Zhao.
    ICCV 2023
    PDF Code


  6. AAAI23
    CALIP: Zero-Shot Enhancement of CLIP with Non-Parametric Attention
    Ziyu Guo*, Renrui Zhang*, Longtian Qiu*, Xupeng Miao, Bin Cui#.
    AAAI 2023 Oral
    PDF Code


  7. IJCAI23
    Joint-MAE: 2D-3D Joint Masked Autoencoders for 3D Point Cloud Pre-training
    Ziyu Guo*, Renrui Zhang*, Longtian Qiu, Xianzhi Li#, Pheng-Ann Heng.
    IJCAI 2023 Oral
    PDF


  8. CVPR22
    PointCLIP: Point Cloud Understanding by CLIP
    Renrui Zhang*, Ziyu Guo*, Wei Zhang, Kunchang Li, Xupeng Miao, Bin Cui, Yu Qiao, Peng Gao, Hongsheng Li#.
    CVPR 2022
    PDF Code


  9. NeurIPS22
    Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training
    Renrui Zhang, Ziyu Guo, Rongyao Fang, Bin Zhao, Dong Wang, Yu Qiao, Hongsheng Li, Peng Gao#.
    NeurIPS 2022
    PDF Code


  10. WACV23
    Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysis
    Renrui Zhang, Liuhui Wang, Ziyu Guo, Jianbo Shi#.
    WACV 2023
    PDF

    Services

      Conference Reviewers
        NeurIPS 2023, ACM MM 2023, ICCV 2023, ICLR 2024, CVPR 2024, ICASSP 2024, ACL 2024, ECCV 2024, NeurIPS 2024, EMNLP 2024, ACL 2024, ICASSP 2025, ICLR 2025, CVPR 2025
      Journal Reviewers
        TPAMI, IJCV, TCSVT, Neurocomputing, RA-L, Access