Zhongzhu Zhou / Charlie Zhou $\approx$ /ZHONG-JOO JOH/
- Ph.D. Student
School of Computer Science, Faculty of Engineering
The University of Sydney
🏢 Office: Room 408, J12/1 Cleveland St, Darlington NSW 2008
📮 Email: zhongzhu.zhou [at] sydney.edu.au, zhouzhzh8 [at] mail2.sysu.edu.cn
$\mathcal{“Let\ everything\ happen\ to\ you.\ Beauty\ and\ terror.\ Just\ keep\ going.\ No\ feeling\ is\ final.”\ -\ Rainer\ Maria\ Rilke}$
Who am I?
I am a Ph.D. student at the School of Computer Science, Faculty of Engineering, The University of Sydney, supervised by Prof. Shuaiwen Song.
Prior to my current position, I was a research assistant at the School of Computer Science and Engineering, Sun Yat-sen University from 2019 to 2022, under the supervision of Prof. Dan Huang, Yunfei Du, and Yutong Lu. I received my B.E. degree from the School of Computer Science and Engineering, Sun Yat-sen University in 2019.
My research focuses on multiple aspects of the deep learning algorithm and system stack, including the design of general neural network improvement algorithms, GPU kernel development, and efficient compiler and runtime framework optimization. Specifically, I aim to enhance and bridge the gap between emerging machine learning algorithms & applications and heterogeneous hardware (CPU/GPU) kernel, compiler, and runtime framework in terms of productivity and performance.
Feel free to drop me an email if you have aligned interests.
Currently, I am working on:
- Diffusion Model Algorithm and Architecture Exploration
- Neural Collapse in Reinforcement Learning Exploration
- Sparse Kernel Design in GPU TensorCore
- I/O Framework Support for AI4Science Application in DeepSpeed Framework.
- DeepSpeed Chat: Easy, Fast, and Affordable RLHF Training of ChatGPT-like Models at All Scales
- I/O Framework Support for Deep Learning Application
- HybridShare: Universal Resource Scheduling for Hybrid Jobs
- MAEM - Multiple Applications co-Execution time Estimation
- EmReal: A Digital Twin Framework of Emulated and Real Components for Robots with Reinforcement Learning
Education
The University of Sydney (USYD) Sydney Australia
Doctor of Philosophy (Ph.D.) Oct. 2022 - Present
Accumulated GPA: 4.0/4.0Sun Yat-sen University (SYSU) Guangzhou, China
Research Assistant Sep. 2019 - Present
Accumulated GPA: 3.41/4.0University of Illinois Urbana-Champaign (UIUC) Remotely & Champaign, IL, United States
Summer Seission Student Jun. 2018 - Sep. 2018Sun Yat-sen University (SYSU) Guangzhou, China
Bachelor of Engineering in Computer Science and Technology Sep. 2015 - Jun. 2019Changjun High School Changsha, China
Senior Student Sep. 2012 - Jun. 2015