Kaipeng Zhang

About Me (curriculum vitae)

I am a researcher in Shanghai AI Lab and working on foundation vision models (likes CLIP, INTERN, and Florence).

Before coming to Shanghai AI Lab, I received my PhD degree in 2022 from The University of Tokyo, supervised by Prof. Yoichi Sato, M.S. degree in 2018 from National Taiwan University supervised by Winston Hsu, and B.E. degree in 2016 from Donghua University. I was a researcher in SenseTime and algorithm consultant in ULSee. I also did research internships at Microsoft Research Asia, Tencent AI Lab, and MMLAB of SIAT.

My research interest mainly lies in computer vision, deep learning and focus on face analysis, active learning, and foundation vision models. I am fortunate to work closely with Dr. Zhanpeng Zhang, Dr. Zhifeng Li, Dr. Wei Liu, Dr. Yu Qiao and Yandong Wen

I'm looking for interns with computer vision or deep learning background. Please send me your resume if interested.

Selected Publications (full list)

Neural Routing by Memory

Kaipeng Zhang, Zhenqiang Li, Zhifeng Li, Wei Liu and Yoichi Sato

Conference on Neural Information Processing Systems (NeurIPS), 2021

Conference

Paper

FarSee-Net: Real-Time Semantic Segmentation by Efficient Multi-scale Context Aggregation and Feature Space Super-resolution

Zhanpeng Zhang, Kaipeng Zhang

IEEE International Conference on Robotics and Automation (ICRA), 2020

Conference

Paper

A Comprehensive Study on Center Loss for Deep Face Recognition

Yandong Wen*, Kaipeng Zhang*, Zhifeng Li and Yu Qiao

(* indicates equal contribution)

International Journal of Computer Vision (IJCV), 2019

Journal

Paper

Super-Identity Convolutional Neural Network for Face Hallucination

Kaipeng Zhang, Zhanpeng Zhang, Chia-Wen Cheng, Winston Hsu, Yu Qiao, Wei Liu and Tong Zhang

European Conference on Computer Vision (ECCV) 2018

Conference

Paper

Detecting Faces Using Inside Cascaded Contextual CNN

Kaipeng Zhang, Zhanpeng Zhang, Hao Wang, Zhifeng Li, Yu Qiao and Wei Liu

IEEE International Conference on Computer Vision (ICCV) 2017

Conference

Paper

A Discriminative Deep Feature Learning Approach for Face Recognition

Yandong Wen, Kaipeng Zhang, Zhifeng Li and Yu Qiao

European Conference on Computer Vision (ECCV) 2016

a.k.a. Center loss, the 21st most cited paper published in ECCV (1990-2021).

Conference

Paper Code& Model

Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Neural Networks

Kaipeng Zhang, Zhanpeng Zhang, Zhifeng Li and Yu Qiao

IEEE Signal Processing Letters, 23(10), 2016

a.k.a. MTCNN, the 2nd most cited paper published in IEEE SPL (1994-2021).

Journal

Paper Code& Model

Education

Ph.d. in CS, The University of Tokyo, Tokyo, Japan

Apr. 2019 - Mar. 2022

M.S. in CS, National Taiwan University, Taipei, Taiwan

Sep. 2016 - Aug. 2018

B.Eng. in CS, Donghua University, Shanghai, China

Sep. 2012 - July 2016

Selected Awards and Competitions

World's TOP 2% Scientists (published by Stanford University), 2020 & 2021

JSPS Research Fellowships for Young Scientists, 2020

Tencent Rhino-Bird Elite Training Program, 2020

MSRA Fellowship Nomination Award, 2019

Emotion Recognition in the Wild: Engagement Prediction (ICMI 2019 Grand Challenge), 3rd place

Emotion Recognition in the Wild: Group-based Cohesion Prediction (ICMI 2019 Grand Challenge), 2nd place

Disguised Faces in the Wild Challenge (in conjunction with CVPR 2018), 1st place

Emotion Recognition in the Wild: Group-level emotion recognition (ICMI 2018 Grand Challenge), 2nd place

Emotion Recognition in the Wild: Group-level emotion recognition (ICMI 2017 Grand Challenge), 1st place

ChaLearn Looking at People Challenge: Accessories Classification (in conjunction with CVPR 2016), 1st place

ChaLearn Looking at People Challenge: Smile and Gender Classification (in conjunction with CVPR 2016), 1st place

Outstanding Undergraduate Thesis, 2016

Academic Service

Senior program committee of IJCAI

Reviewer/Program committee of NeurIPS, ICML, ICLR, AAAI, ICCV, ECCV, CVPR, BMVC, WACV and ACCV

Reviewer of TPAMI, TIP, TCSVT, TNNLS, TMM, TIFS, Neurocomputing, Pattern Recognition, and SPL

Work Experience

Researcher

SenseTime

Research Institute

Shenzhen, China

Sept. 2018 - Mar. 2019

Intern

MSRA

Visual Computing Group

Beijing, China

Jan. 2018 - Jul. 2018

Algorithm consultant

ULSee

Face Team

Hangzhou, China

Oct. 2016 - Mar. 2018

Intern

Tencen

AI Lab & AI Advertisement Department

Shenzhen, China

Jul. 2017 - Aug. 2017

Sep. 2020 - Feb. 2021

Visiting Student

Shenzhen Institutes of Advanced Technology

Multimedia Research Center

Shenzhen, China

Jul. 2015 - Aug. 2016

Interest

Friends

Zhanpeng Zhang (SenseTime), Yandong Wen (CMU), Zhe Wang (UCI), Tong He (ADELAIDE), Zhi Tian (ADELAIDE), Sheng Guo (MALONG), Bowen Zhang (USC), Pan He (UFL), Jiaming Liu (Microsoft), Cheng-Han Li (NTU Taiwan), Chia-Wen Cheng (Facebook), Yifei Huang (UTokyo), Zhixiang Wang (UTokyo), Zheng Wang (UTokyo), Lixiong Chen (Oxford)