Ziyu Guo

Ph.D. Student
The Department of Computer Science and Engineering,
The Chinese University of Hong Kong
ziyuguo@link.cuhk.edu.hk

About Me

I am a PhD student at the Chinese University of Hong Kong supervised by Prof. Pheng-Ann Heng. Before that, I received my bachelor’s degree in Computer Science from Peking University supervised by Prof. Bin Cui. I previously worked as an intern at Tencent and Shanghai AI Laboratory, and will join Amazon Lex as a research intern this summer.

My research interests mainly include Multi-modal Learning, Large Language Models, and 3D Vision.

Selected Publications and Preprints

* Equal contribution, # Corresponding author

arXiv23

Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following

Ziyu Guo, Renrui Zhang#, Xiangyang Zhu, Yiwen Tang, Xianzheng Ma, Jiaming Han, Kexin Chen, Peng Gao, Xianzhi Li#, Hongsheng Li, Pheng-Ann Heng.

arXiv 2023
PDF Code
ICLR2024

Personalize Segment Anything Model with One Shot

Renrui Zhang, Zhengkai Jiang*, Ziyu Guo*, Shilin Yan, Junting Pan, Hao Dong, Peng Gao, Hongsheng Li#.

arXiv 2023
PDF Code
AAAI23

CALIP: Zero-Shot Enhancement of CLIP with Non-Parametric Attention

Ziyu Guo*, Renrui Zhang*, Longtian Qiu*, Xupeng Miao, Bin Cui#.

AAAI 2023 Oral
PDF Code
IJCAI23

Joint-MAE: 2D-3D Joint Masked Autoencoders for 3D Point Cloud Pre-training

Ziyu Guo*, Renrui Zhang*, Longtian Qiu, Xianzhi Li#, Pheng-Ann Heng.

IJCAI 2023 Oral
PDF
CVPR22

PointCLIP: Point Cloud Understanding by CLIP

Renrui Zhang*, Ziyu Guo*, Wei Zhang, Kunchang Li, Xupeng Miao, Bin Cui, Yu Qiao, Peng Gao, Hongsheng Li#.

CVPR 2022
PDF Code
NeurIPS22

Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training

Renrui Zhang, Ziyu Guo, Rongyao Fang, Bin Zhao, Dong Wang, Yu Qiao, Hongsheng Li, Peng Gao#.

NeurIPS 2022
PDF Code
WACV23

Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysis

Renrui Zhang, Liuhui Wang, Ziyu Guo, Jianbo Shi#.

WACV 2023
PDF

Services