Chaoyang Zhu

About Me

“The devil lies in the details, but also macros.”

Just a short bio here, currently I’m a first year PhD student at MAC Lab in XMU under the guidance of Prof. Rongrong Ji. Before that, I obtained my master and bachelor degree both in CSE from XMU (2020 - 2023) and HDU (2015 - 2019), respectively. I have also interned at Tencent Youtu Lab (Jul. 2021 - Mar. 2022), Shanghai.

Research Interests

I’m interested by many, if not all, topics that in practice, can shape and transform both industry and society, with a primary focus on perception task, be it 2D/3D/Video close-set/open-vocabulary detection/segmentation with MLLMs/Point Cloud/NeRF/3DGS involved. I’m also facinated by the beauty of coding, be it CUDA kernels, C++ extensions and so on.

Prospective Collaboration

I’m building a team now. Extremely self-motivated post graduates are welcome if you are interested in my topic, please reach me via e-mail in advance.

Blogging

“Writing is self-instruction and self-development”. The learning curve is high when entering a new area, online resources are typically copy-paste with little value. So my blogs are hosted via Notion as a reminder in future, hope it is also beneficial to you guys out there 👋.

• Beginner-friendly Annotations for CUDA codes of 3D Gaussian Splatting - Jul, 2024
• A Basic Tutorial on 3D Radiance & Semantic Field - Jul, 2024
• Tentative Math Derivation of Diffusion Models - Oct, 2023
• OpenMMLab API Framework - Aug, 2023

News

• [Jan. 2025] One paper on Open-vocabulary Detection was accepted by ICLR.
• [Oct. 2024] Coming back to MAC Lab.
• [Jul. 2024] One paper on Instruction-tuned SAM was accepted by MM.
• [May. 2024] One survey on Open-Vocabulary Perception was accepted by TPAMI.
• [Aug. 2023] Joining Hong Kong University of Science and Technology as a PhD candidate.
• [Jul. 2022] One paper was accepted by ECCV’22 as Oral.

Services

Conference/Journal Reviewers

Teaching Assistant

• (Archived) Advanced Topics in Multimodal Machine Learning, 2024, Spring

Selected Publications

Awards

• Outstanding PGTA honorable mentions by CSE dept, HKUST
• Star of future prize awarded by Youtu Lab, Tencent
• Outstanding graduate mentions by HDU

Last modified on 23 Jan, 2025.