Tao Yu (俞涛)

I am a Senior Researcher at Tencent, where I focus on reinforcement learning and game AI. My research interests lie in reinforcement learning, multimodal models, AIGC, etc. My final goal of research is to develop intelligent agents that can perceive, think and behave like humans.

Before my current role, I earned my Ph.D. in 2023 from the University of Science and Technology of China (USTC), under the guidance of Professors Zhibo Chen and Weiping Li. Additionally, I was a Research Student at the National University of Singapore (NUS) from 2022 to 2023, where I worked with Prof. Xinchao Wang. Prior to that, I was a Research Intern at Microsoft Research Asia (MSRA) from 2020 to 2022, where I was mentored by Dr. Cuiling Lan and Professor Wenjun Zeng.

I like doing interesting projects. My recent project Inpaint Anything has received over 6.5k stars on GitHub. If you are interested in my work or want to collaborate, please feel free to contact me via email (yutao666@mail.ustc.edu.cn).

Selected Publications

Inpaint Anything: Segment Anything Meets Image Inpainting
Tao Yu, Runseng Feng, Ruoyu Feng, Jinming Liu, Xin Jin, Wenjun Zeng, Zhibo Chen
Technical Report 2023
Code

Task Residual for Tuning Vision-Language Models
Tao Yu*, Zhihe Lu*, Xin Jin, Zhibo Chen, Xinchao Wang
CVPR 2023
Code

Mask-based Latent Reconstruction for Reinforcement Learning
Tao Yu*, Zhizheng Zhang*, Cuiling Lan, Yan Lu, Zhibo Chen
NeurIPS 2022
Code

PlayVirtual: Augmenting Cycle-Consistent Virtual Trajectories for Reinforcement Learning
Tao Yu, Cuiling Lan, Wenjun Zeng, Mingxiao Feng, Zhizheng Zhang, Zhibo Chen
NeurIPS 2021
Code

Region Normalization for Image Inpainting
Tao Yu, Zongyu Guo, Xin Jin, Shilin Wu, Zhibo Chen, Weiping Li, Zhizheng Zhang, Sen Liu
AAAI 2020
Code

Local Patch Autoaugment with Multi-Agent Collaboration
Shiqi Lin*, Tao Yu*, Ruoyu Feng, Xin Li, Xiaoyuan Yu, Lei Xiao, Zhibo Chen
IEEE Transactions on Multimedia 2023
Code

GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessment
Simeng Sun*, Tao Yu*, Jiahua Xu, Wei Zhou, Zhibo Chen
IEEE Transactions on Multimedia 2023
Code

(* indicates equal contribution)

Selected Awards and Competitions

2024 Tencent Knowledge Award
2023 Outstanding Ph.D Graduate of USTC
2023 AI Rising Star Award
2022 Champion of CVPR 2022 Challenge on Learned Image Compression (Perceptual Track)
2019 Champion of ICME 2019 Grand Challenge on Learning-Based Image Inpainting
2017 Honorable Prize of International Mathematical Contest in Modeling
2016 First Prize of China Undergraduate Mathematical Contest in Modeling

Service

Reviewer: NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV, AAAI, TPAMI, IJCV, TMM, etc.