Profile image
Kaipeng Zhang
Shanghai AI Lab

About Me (curriculum vitae)

I am a researcher in Shanghai AI Lab and working on foundation vision models (likes CLIP, INTERN, and Florence).

Before coming to Shanghai AI Lab, I received my PhD degree in 2022 from The University of Tokyo, supervised by Prof. Yoichi Sato, M.S. degree in 2018 from National Taiwan University supervised by Winston Hsu, and B.E. degree in 2016 from Donghua University. I was a researcher in SenseTime and algorithm consultant in ULSee. I also did research internships at Microsoft Research Asia, Tencent AI Lab, and MMLAB of SIAT.

My research interest mainly lies in computer vision, deep learning and focus on face analysis, active learning, and foundation vision models. I am fortunate to work closely with Dr. Zhanpeng Zhang, Dr. Zhifeng Li, Dr. Wei Liu, Dr. Yu Qiao and Yandong Wen

I'm looking for interns with computer vision or deep learning background. Please send me your resume if interested.

Selected Publications (full list)

Neural Routing by Memory
Kaipeng Zhang, Zhenqiang Li, Zhifeng Li, Wei Liu and Yoichi Sato
Conference on Neural Information Processing Systems (NeurIPS), 2021

FarSee-Net: Real-Time Semantic Segmentation by Efficient Multi-scale Context Aggregation and Feature Space Super-resolution
Zhanpeng Zhang, Kaipeng Zhang
IEEE International Conference on Robotics and Automation (ICRA), 2020

A Comprehensive Study on Center Loss for Deep Face Recognition
Yandong Wen*, Kaipeng Zhang*, Zhifeng Li and Yu Qiao
(* indicates equal contribution)
International Journal of Computer Vision (IJCV), 2019

Super-Identity Convolutional Neural Network for Face Hallucination
Kaipeng Zhang, Zhanpeng Zhang, Chia-Wen Cheng, Winston Hsu, Yu Qiao, Wei Liu and Tong Zhang
European Conference on Computer Vision (ECCV) 2018

Detecting Faces Using Inside Cascaded Contextual CNN
Kaipeng Zhang, Zhanpeng Zhang, Hao Wang, Zhifeng Li, Yu Qiao and Wei Liu
IEEE International Conference on Computer Vision (ICCV) 2017

A Discriminative Deep Feature Learning Approach for Face Recognition
Yandong Wen, Kaipeng Zhang, Zhifeng Li and Yu Qiao
European Conference on Computer Vision (ECCV) 2016
a.k.a. Center loss, the 21st most cited paper published in ECCV (1990-2021).
Paper Code& Model

Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Neural Networks
Kaipeng Zhang, Zhanpeng Zhang, Zhifeng Li and Yu Qiao
IEEE Signal Processing Letters, 23(10), 2016
a.k.a. MTCNN, the 2nd most cited paper published in IEEE SPL (1994-2021).
Paper Code& Model


Ph.d. in CS, The University of Tokyo, Tokyo, Japan
Apr. 2019 - Mar. 2022
M.S. in CS, National Taiwan University, Taipei, Taiwan
Sep. 2016 - Aug. 2018
B.Eng. in CS, Donghua University, Shanghai, China
Sep. 2012 - July 2016

Selected Awards and Competitions

  • World's TOP 2% Scientists (published by Stanford University), 2020 & 2021
  • JSPS Research Fellowships for Young Scientists, 2020
  • Tencent Rhino-Bird Elite Training Program, 2020
  • MSRA Fellowship Nomination Award, 2019
  • Emotion Recognition in the Wild: Engagement Prediction (ICMI 2019 Grand Challenge), 3rd place
  • Emotion Recognition in the Wild: Group-based Cohesion Prediction (ICMI 2019 Grand Challenge), 2nd place
  • Disguised Faces in the Wild Challenge (in conjunction with CVPR 2018), 1st place
  • Emotion Recognition in the Wild: Group-level emotion recognition (ICMI 2018 Grand Challenge), 2nd place
  • Emotion Recognition in the Wild: Group-level emotion recognition (ICMI 2017 Grand Challenge), 1st place
  • ChaLearn Looking at People Challenge: Accessories Classification (in conjunction with CVPR 2016), 1st place
  • ChaLearn Looking at People Challenge: Smile and Gender Classification (in conjunction with CVPR 2016), 1st place
  • Outstanding Undergraduate Thesis, 2016
  • Academic Service

  • Senior program committee of IJCAI
  • Reviewer/Program committee of NeurIPS, ICML, ICLR, AAAI, ICCV, ECCV, CVPR, BMVC, WACV and ACCV
  • Reviewer of TPAMI, TIP, TCSVT, TNNLS, TMM, TIFS, Neurocomputing, Pattern Recognition, and SPL
  • Work Experience

    Research Institute
    Shenzhen, China
    Sept. 2018 - Mar. 2019
    Visual Computing Group
    Beijing, China
    Jan. 2018 - Jul. 2018
    Algorithm consultant
    Face Team
    Hangzhou, China
    Oct. 2016 - Mar. 2018
    AI Lab & AI Advertisement Department
    Shenzhen, China
    Jul. 2017 - Aug. 2017
    Sep. 2020 - Feb. 2021
    Visiting Student
    Shenzhen Institutes of Advanced Technology
    Multimedia Research Center
    Shenzhen, China
    Jul. 2015 - Aug. 2016


    Zhanpeng Zhang (SenseTime), Yandong Wen (CMU), Zhe Wang (UCI), Tong He (ADELAIDE), Zhi Tian (ADELAIDE), Sheng Guo (MALONG), Bowen Zhang (USC), Pan He (UFL), Jiaming Liu (Microsoft), Cheng-Han Li (NTU Taiwan), Chia-Wen Cheng (Facebook), Yifei Huang (UTokyo), Zhixiang Wang (UTokyo), Zheng Wang (UTokyo), Lixiong Chen (Oxford)