Rongyu (Roy) Zhang

   News  |  Publications  |  Miscellaneous  |  Contact  |  Links

Dual Ph.D. student of Nanjing University and The Hong Kong Polytechnic University
School of Electronic Science and Engineering and Department of Computing
Email1: rongyuzhang at link dot cuhk dot edu dot cn  
Email2: rongyuzhang at smail dot nju dot edu dot cn

I am a dual Ph.D. student at NJU and PolyU, where I am co-supervised by Prof. Shanghang Zhang from PKU, Prof. Yuan Du from NJU, and Prof. Dan Wang from PolyU
My broad interest lies in 3D Generalized Perception and Lightweight for the Open World, especially for applications of autonomous driving and robots. I am also focusing on Neural Video Delivery.

Previously, I received the M.Phil. degree from the Chinese University of Hong Kong, Shenzhen, where I am supervised by Prof. Fangxin Wang, and received the B.Eng. and B.M. degree from the joint program of Beijing University of Posts and Telecommunications (BUPT) and Queen Mary University of London (QMUL).

Email  /  CV  /  Google Scholar  /  Github  / 

News

📌We have several academic visitor and intern positions at HMI Lab (Peking University). We actively work on Out Of Distribution Generalization, Automatic Driving Perception, Multi-Modal Learning, and 3D Vision. If you like what we do, don't hesitate to contact me.

[03.2024] The Panasonic Corporation is integrating the MoFME(AAAI24) into its actual business operations.

[01.2024] One paper was accepted by ICRA 2024 as first author (CCF-B)

[12.2023] One paper was accepted by AAAI 2024 as first author (CCF-A)

[08.2023] I joined the AI2Robotics a Research Intern supervised by Yandong Guo.

[08.2023] We won the 2nd place of the SHIFT Challenge 2023 - Continuous Test-time Adaptation for Semantic Segmentation in the challenges of VCL Workshop, ICCV2023.

[06.2023] I joined the HMI Lab of NATIONAL ENGINEERING RESEARCH CENTER OF VISUAL TECHNOLOGY at Peking University as a Ph.D. student

[04.2023] One paper was accepted by ACM NOSSDAV 2023 as first author (CCF-B)

[03.2023] One paper was accepted by IEEE ICME 2023 as first author (CCF-B)

[03.2023] One paper was accepted by IEEE Network as first author (JCR Q1 IF=10.34)

[03.2023] One paper was accepted by IEEE IoTJ (JCR Q1)

[03.2023] Two paper was accepted by IEEE CVPR 2023 (CCF-A)

[03.2023] I received M.Phil. degree from CUHKSZ.

[02.2023] I joined the Chiplego a Research Intern.

[09.2022] I joined OPPO research as a Research Intern.

[08.2021] I joined INML lab in CUHKSZ as a M.Phil. student.

Selected Publications
[Journal] [Conference] [👉Full publications & Under review]

Conference
2024
BEVUDA: Multi-geometric Space Alignments for Domain Adaptive BEV 3D Object Detection
Jiaming Liu*, Rongyu Zhang*(equal contribution), Xiaoqi Li, Xiaowei Chi, Zehui Chen, Ming Lu, Yandong Guo, Shanghang Zhang,
2024 IEEE International Conference on Robotics and Automation (ICRA) (CCF-A)
[Paper] [Code]
Efficient Deweahter Mixture-of-Experts with Uncertainty-Aware Feature-wise Linear Modulation
Rongyu Zhang, Yulin Luo, Jiaming Liu, Huanrui Yang, Zhen Dong, Denis Gudovskiy, Tomoyuki Okuno, Yohei Nakata, Kurt Keutzer, Yuan Du, Shanghang Zhang,
AAAI Conference on Artificial Intelligence 2024. (CCF-A)
[Paper]
2023
RepCaM: Re-parameterization Content-aware Modulation for Neural Video Delivery
Rongyu Zhang, Lixuan Du, Jiaming Liu, Congcong Song, Fangxin Wang, Ming Lu, Xiaoqi Li, Yandong Guo, Shanghang Zhang,
ACM the Workshop on Network and Operating System Support for Digital Audio and Video 2023. (CCF-B)
[Paper] [Code]
Cluster-driven GNN-based Federated Recommendation System with Biased Message Dropout
Rongyu Zhang, Yun Chen, Chenrui Wu, Fangxin Wang,
IEEE International Conference on Multimedia and Expo. 2023. (CCF-B)
[Paper]
Cloud-Device Collaborative Adaptation to Continual Changing Environments in the Real-world
Yulu Gan, Mingjie Pan, Rongyu Zhang, Zijian Ling, Jiaming Liu, Lingran Zhao, Shanghang Zhang,
IEEE Computer Vision and Pattern Recognition 2023. (CCF-A)
[Paper]
BEV-SAN: Accurate BEV 3D Object Detection via Slice Attention Networks
Xiaowei Chi, Jiaming Liu, Ming Lu, Rongyu Zhang, Zhaoqing Wang, Yandong Guo, Shanghang Zhang,
IEEE Computer Vision and Pattern Recognition 2023. (CCF-A)
[Paper] [Code]

Journal
2023
Optimizing Efficient Personalized Federated Learning with Hypernetworks at Edge
Rongyu Zhang, Yun Chen, Chenrui Wu, Fangxin Wang, Jiangchuan Liu,
IEEE Network (JCR Q1), 2023.
[Paper]
FedAB: Truthful Federated Learning with Auction-based Combinatorial Multi-Armed Bandit
Chenrui Wu, Yifei Zhu, Rongyu Zhang, Yun Chen, Fangxin Wang, Shuguang Cui,
IEEE Internet of Things Journal (JCR Q1), 2023.
[Paper]
Arxiv
2024
Intuition-aware Mixture-of-Rank-1-Experts for Parameter Efficient Finetuning
Yijiang Liu, Rongyu Zhang*(equal contribution), Huanrui Yang, Kurt Keutzer, Yuan Du, Li Du, Shanghang Zhang,
In submission
[Paper]
VeCAF: VLM-empowered Collaborative Active Finetuning wit Training Objective Awareness
Rongyu Zhang, Zefan Cai, Huanrui Yang, Zidong Liu, Denis Gudovskiy, Tomoyuki Okuno, Yohei Nakata, Kurt Keutzer, Yuan Du, Li Du, Shanghang Zhang,
In submission
[Paper]
M2Chat: Empowering VLM for Multimodal LLM Interleaved Text-Image Generation
Xiaowei Chi, Rongyu Zhang*(equal contribution), Jiangkai Zhang*, Yijiang Liu*, Yatian Wang, Xingqun Qi, Wenhan Luo, Peng Gao, Shanghang Zhang, Qifeng Liu, Yike Guo,
In submission
[Paper] [Project]
2023
Unimodal Training-Multimodal Prediction: Cross-modal Federated Learning with Hierarchical Aggregation
Rongyu Zhang, Xiaowei Chi, Guiliang Liu, Wenyi Zhang, Yuan Du, Fangxin Wang,
In submission
[Paper]


Experience
AI2Robotics (Aug. 2023 - Dec. 2023)
Research Intern
Chiplego (Jan. 2023 - May. 2023)
Research Intern
OPPO Research (Sep. 2022 - Mar. 2023)
Research Intern
Lenovo Research (Nov. 2020 - May. 2021)
Research Intern

Academic Service
  • Conference review: ICCV 2023, ICASSP 2023,2024, IWQOS 2023
  • Journal review: To be updated

Miscellaneous
  • 🐶Dog, 🎧pop music, 🎬movie lover.
  • 🏸Badminton, 🏀basketball, and ⚽️football.
    Member of several sports team.
  • 🍕🍮🍦Food, dessert. 🎮Video Games.
This page has been visited for Free Hit Counters Times.

Last update: Jan 29, 2024