CHAOYUE
profile photo

Chaoyue Wang

Hi! My name is Chaoyue Wang, a researcher specializing in generative models and artificial intelligence-generated content (AIGC). Prior to that, I worked as a postdoctoral researcher in machine learning and generative modeling at the School of Computer Science, University of Sydney. I obtained my bachelor's degree from Tianjin University in 2014 and my PhD degree from the University of Technology Sydney in 2018.

My research primarily focuses on addressing three fundamental challenges in generative modeling: "Generative Model Training," "Controllable and Interpretable Generative Models," and "Generalized Generative Applications." I have authored over 30 academic works published in prestigious journals and conferences such as IEEE T-PAMI, T-EVC, IEEE T-IP, NeurIPS, CVPR, ECCV, IJCAI, among others. My research has garnered recognition from the academic community, including receiving the Distinguished Student Paper Award at IJCAI-17 for my first-author work on TDGAN and having my first-author work on E-GAN selected as Best of the Physics arXiv by MIT TR and Best of GAN Papers in the Year 2018 by DTRANSPOSED. Additionally, I played a leading role in writing the first official white paper on AIGC.

My current research interests center on developing foundation generative models that are generalizable, interpretable, and controllable. I currently focus on conducting cutting-edge research in the directions of "Pretraining of Foundation Generative Models," "Disentangled Feature Learning within Pretrained Generative Models," and "Multimodal Data Fine-tuning of Pre-trained Generative Models." If you are also interested in these topics or related applications, please feel free to contact me at chaoyue[dot]wang[at]outlook[dot]com.

Email  /   Google Scholar

News

Selected Publications (Last Update: 2021.05)

* indicates Equal Contribution; #indicates (Co-)Supervised Students
Exposure Trajectory Recovery from Motion Blur
Youjian Zhang#, Chaoyue Wang, Stephen J. Maybank, and Dacheng Tao
IEEE TPAMI 2021 [PDF] [Code] [Video]

Exposure Trajectory Recovery from Motion Blur
Youjian Zhang#, Chaoyue Wang, Stephen J. Maybank, and Dacheng Tao
IEEE TPAMI 2021 [PDF] [Code] [Video]

MRI-based Alzheimer's Disease Prediction via Distilling the Knowledge in Multi-modal Data
Hao Guan#, Chaoyue Wang, and Dacheng Tao
NeuroImage 2021 [PDF]

MRI-based Alzheimer's Disease Prediction via Distilling the Knowledge in Multi-modal Data
Hao Guan#, Chaoyue Wang, and Dacheng Tao
NeuroImage 2021 [PDF]

Experimental Quantum Generative Adversarial Networks for Image Generation
He-Liang Huang*, Yuxuan Du*, Ming Gong, Youwei Zhao, Yulin Wu, Chaoyue Wang, Shaowei Li, Futian Liang, Jin Lin, Yu Xu, Rui Yang, Tongliang Liu, Min-Hsiu Hsieh, Hui Deng, Hao Rong, Cheng-Zhi Peng, Chaoyang Lu, Yu-Ao Chen, Dacheng Tao, Xiaobo Zhu, and Jian-Wei Pan
Physical Review Applied 2021 [PDF]

Experimental Quantum Generative Adversarial Networks for Image Generation
He-Liang Huang*, Yuxuan Du*, Ming Gong, Youwei Zhao, Yulin Wu, Chaoyue Wang, Shaowei Li, Futian Liang, Jin Lin, Yu Xu, Rui Yang, Tongliang Liu, Min-Hsiu Hsieh, Hui Deng, Hao Rong, Cheng-Zhi Peng, Chaoyang Lu, Yu-Ao Chen, Dacheng Tao, Xiaobo Zhu, and Jian-Wei Pan
Physical Review Applied 2021 [PDF]

Video Frame Interpolation without Temporal Priors
Youjian Zhang#*, Chaoyue Wang*, and Dacheng Tao
NeurIPS 2020 [PDF] [Code] [Video]

Video Frame Interpolation without Temporal Priors
Youjian Zhang*#, Chaoyue Wang*, and Dacheng Tao
NeurIPS 2020 [PDF] [Code] [Video]

FeatureFlow: Robust Video Interpolation via Structure-to-texture Generation
Shurui Gui#*, Chaoyue Wang*, Qihua Chen#, and Dacheng Tao
CVPR 2020 [PDF] [Code] [Video]

FeatureFlow: Robust Video Interpolation via Structure-to-texture Generation
Shurui Gui#*, Chaoyue Wang*, Qihua Chen#, and Dacheng Tao
CVPR 2020 [PDF] [Code] [Video]

Syntax-Aware Action Targeting for Video Captioning
Qi Zheng#, Chaoyue Wang, and Dacheng Tao
CVPR 2020 [PDF] [Code]

Syntax-Aware Action Targeting for Video Captioning
Qi Zheng#, Chaoyue Wang, and Dacheng Tao
CVPR 2020 [PDF] [Code]

PuppeteerGAN: Arbitrary Portrait Animation with Semantic-aware Appearance Transformation
Zhuo Chen#, Chaoyue Wang, Bo Yuan, and Dacheng Tao
CVPR 2020 [PDF] [Video]

PuppeteerGAN: Arbitrary Portrait Animation with Semantic-aware Appearance Transformation
Zhuo Chen#, Chaoyue Wang, Bo Yuan, and Dacheng Tao
CVPR 2020 [PDF] [Video]

Self-supervised Pose Adaptation for Cross-Domain Image Animation
Chaoyue Wang, Chang Xu, and Dacheng Tao
IEEE TAI 2020 [Paper]

Self-supervised Pose Adaptation for Cross-Domain Image Animation
Chaoyue Wang, Chang Xu, and Dacheng Tao
IEEE TAI 2020 [Paper]

Multistage GAN for Fabric Defect Detection
Juhua Liu*, Chaoyue Wang*, Hai Su, Bo Du, and Dacheng Tao
IEEE TIP 2020 [Paper]

Multistage GAN for Fabric Defect Detection
Juhua Liu*, Chaoyue Wang*, Hai Su, Bo Du, and Dacheng Tao
IEEE TIP 2020 [Paper]

Evolutionary Generative Adversarial Networks
Chaoyue Wang, Chang Xu, Xin Yao, and Dacheng Tao
IEEE TEVC 2019 [PDF] [Code] [Video] (The Best Paper of the Physics arXiv, selected by MIT Technology Review)

Evolutionary Generative Adversarial Networks
Chaoyue Wang, Chang Xu, Xin Yao, and Dacheng Tao
IEEE TEVC 2019 [PDF] [Code] [Video] (The Best Paper of the Physics arXiv, selected by MIT Technology Review)

Perceptual Adversarial Networks for Image-to-Image Transformation
Chaoyue Wang, Chang Xu, Chaohui Wang, and Dacheng Tao
IEEE TIP 2018 [PDF] [Code] [Related report]

Perceptual Adversarial Networks for Image-to-Image Transformation
Chaoyue Wang, Chang Xu, Chaohui Wang, and Dacheng Tao
IEEE TIP 2018 [PDF] [Code] [Related report]

Tag Disentangled Generative Adversarial Network for Object Image Re-rendering
Chaoyue Wang, Chaohui Wang, Chang Xu, and Dacheng Tao
IJCAI 2017 [PDF] [Related report] (Distinguished Student Paper Award, 1 out of 2540)

Tag Disentangled Generative Adversarial Network for Object Image Re-rendering
Chaoyue Wang, Chaohui Wang, Chang Xu, and Dacheng Tao
IJCAI 2017 [PDF] [Related report] (Distinguished Student Paper Award, 1 out of 2540)

Multiple Sclerosis Lesion Filling using a Non-Lesion Attention based Convolutional Network
Hao Xiong*, Chaoyue Wang*, Michael Barnett and Chenyu Wang
ICONIP 2020 [Paper]

Multiple Sclerosis Lesion Filling using a Non-Lesion Attention based Convolutional Network
Hao Xiong*, Chaoyue Wang*, Michael Barnett and Chenyu Wang
ICONIP 2020 [Paper]

A novel deep learning-based method for damage identification of smart building structures
Yang Yu, Chaoyue Wang, Xiaoyu Gu, and Jianchun Li
Structural Health Monitoring 2019 [Paper]

A novel deep learning-based method for damage identification of smart building structures
Yang Yu, Chaoyue Wang, Xiaoyu Gu, and Jianchun Li
Structural Health Monitoring 2019 [Paper]

Talks

Service

Conference Senior Program Committee (SPC) Member

  • International Joint Conferences on Artificial Intelligence (IJCAI)
  • AAAI Conference on Artificial Intelligence (AAAI)
  • Conference Program Committee (PC) Member

  • Neural Information Processing Systems (NeurIPS)
  • International Conference on Machine Learning (ICML)
  • International Conference on Learning Representations (ICLR)
  • IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • International Conference on Computer Vision (ICCV)
  • European Conference on Computer Vision (ECCV)
  • ACM Multimedia (ACM MM)
  • IEEE International Conference on Data Mining (ICDM)
  • International Conference on Database Systems for Advanced Applications (DASFAA)
  • Journal Reviewer

  • International Journal of Computer Vision (IJCV)
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE T-PAMI)
  • IEEE Transactions on Neural Networks and Learning Systems (IEEE T-NNLS)
  • IEEE Transactions on Evolutionary Computation (IEEE T-EVC)
  • IEEE Transactions on Image Processing (IEEE T-IP)
  • IEEE Transactions on Cybernetics (IEEE T-CYB)
  • IEEE Transactions on Circuits and Systems for Video Technology (IEEE T-CSVT)
  • Selected Awards

    [2018] The Best Paper of the Physics arXiv (selected by MIT Technology Review)

  • Week’s most thought-provoking papers from the Physics arXiv (week ending Mar. 17, 2018)
  • [2017] Distinguished Student Paper Award (selected by IJCAI-17)

  • The 26th International Joint of Conference on Artificial Intelligence (1 selected out of 2540 submissions)
  • [2012] Tianjin Physics Contest in common colleges and universities, Tianjin, China

  • Grand prize (15 selected out of about 1500 undergraduates)
  • [2012] Scholarship of Excellent Student Cadre, Tianjin University

  • Awarded for outstanding performance in Tianjin University every year
  • [2019] Chinese Physics Olympiad , China

  • Second prize (35 selected out of all high school students in Yunnan province)
  • [2009] The national senior high school students applied physics knowledge competition , Yunnan, China

  • Placed first in Yunnan province