Xiaoming Liu

Add links
From Wikipedia, the free encyclopedia
Xiaoming Liu
Born
China
NationalityChinese-American
Occupation(s)Computer scientist and academic
Academic background
EducationB.A., Computer Science and Engineering
M.S., Computer Science and Engineering
Ph.D., Electrical and Computer Engineering
Alma materBeijing Information Technology Institute
Zhejiang University
Carnegie Mellon University
Academic work
InstitutionsMichigan State University

Xiaoming Liu is a Chinese-American computer scientist and an academic. He is a Professor in the Department of Computer Science and Engineering, MSU Foundation Professor as well as Anil K. and Nandita Jain Endowed Professor of Engineering at Michigan State University.[1]

Liu is most known for his works in the fields of computer vision, machine learning, and biometrics, with a particular focus on facial analysis and three-dimensional (3D) vision.[2] Moreover, he is the recipient of the 2018 and 2023 Withrow Distinguished Scholar Award from the Michigan State University College of Engineering.

Liu is a fellow of the International Association for Pattern Recognition (IAPR)[3] and The Institute of Electrical and Electronics Engineers (IEEE).[4] Additionally, he is the Associate Editor of the journal IEEE Transactions on Pattern Analysis and Machine Intelligence.[5]

Education[edit]

Liu completed his Bachelor of Arts degree in Computer Science and Engineering from Beijing Information Technology Institute in 1997. In 2000, he obtained a Master of Science degree in Computer Science and Engineering from Zhejiang University under the supervision of Yueting Zhuang.[6] This was followed by a Ph.D. in Electrical and Computer Engineering, supervised by Tsuhan Chen and Vijayakumar Bhagavatula from Carnegie Mellon University in 2004.[1]

Career[edit]

Liu began his academic career in 1998 by joining the Intelligent CAD Lab at Zhejiang University as a research assistant and served until 1999. Between 2000 and 2004, he worked at the Advanced Multimedia Processing Lab at Carnegie Mellon University as a research assistant. In 2012, Liu joined Michigan State University, where he assumed various academic roles over the years. He began as an assistant professor in the Department of Computer Science and Engineering, a position he held from 2012 to 2018, and subsequently became an associate professor in the same department from 2018 to 2020. Since 2020, he has been serving as a professor in the Department of Computer Science and Engineering at Michigan State University. Additionally, he holds appointments as an MSU Foundation Professor since 2021 and as the Anil K. and Nandita Jain Endowed Professor of Engineering at Michigan State University since 2022.[1]

From 2004 to 2012, Liu worked as a Computer Scientist at the Visualization & Computer Vision Lab at GE Global Research. Since 2021, he has held the role of Visiting Researcher Scientist as part of Google's Visiting Researcher Program. He has also been serving as an Associate Editor for the Journal IEEE Transactions on Pattern Analysis and Machine Intelligence since 2023.[5] He has served as Associate Editor for the journal of Neurocomputing, Pattern Recognition Letters, Pattern Recognition, and IEEE Transaction on Image Processing.

Research[edit]

With an h-index of 71 and a citation count of 23,105,[2] he has authored over 200 publications spanning the field of computer vision, with a primary focus on recognition, modeling, and 3D perception.[2]

Recognition[edit]

The recognition and analysis of human facial images have been a central focus in the field of computer vision since its inception. Liu's recognition research has focused on fundamental problems such as designing effective loss functions for face matcher learning, integrating identity information across frames, exploring the link between image restoration and recognition in low-quality imagery, and investigating the role of 2D and 3D shapes in recognition.[2] His group designed a margin-based loss function that is adaptive to the diverse image quality in face recognition training dataset, which resulted in a generic face matcher called Adaface. Concentrating his research efforts on tackling video-based face recognition, his study underscored the contribution of temporal dynamics in recognition[7] and introduced an adaptable method called "CAFace" for understanding the connections between identity details across video frames and executing sequential recognition while streaming video.[8]

One of the primary research objectives of Liu's recognition research is to cultivate trust between AI systems and their users. He led research in face presentation attack detection (PAD) and published papers.[9][10][11][12] He created algorithms to mitigate bias in facial recognition by revealing that different demographic groups require distinct convolutional neural network (CNN) kernels, leading to an adaptive architecture that enhances accuracy while reducing bias.[13][14] Moreover, he proposed a technique Model Parsing for reverse engineering GMs to understand their hyperparameters.[15] His group also developed passive and proactive approaches to deep fake detection and localization.[16][17]

Modeling[edit]

Liu's modeling research has centered on image alignment and intrinsic image decomposition. He developed Boosted Appearance Model, a discriminative model for image alignment that uses a boosting-based classifier to distinguish between correctly aligned images with ground-truth landmarks and incorrectly aligned images with perturbed landmarks.[18][19] Additionally, to address the limitations of BAM, he introduced BRM, which focused on learning a score function that is concave in the vicinity of the correct alignment, potentially improving alignment accuracy. Furthermore, he identified the challenge of aligning profile-view faces accurately and addressed this by developing approaches that treat image alignment as a 3D Morphable Models (3DMM) fitting problem, enabling the estimation of 3D facial landmarks.[20][21][22]

Liu's intrinsic image decomposition research addressed the problem of 3D reconstruction from 2D images, aiming to estimate high-fidelity 3D surface information of objects or scenes. He proposed an approach based on intrinsic image decomposition, breaking down an image into four components: camera projection matrix, shape parameters, albedo parameters, and illumination parameters, achieved through an encoder. Notably, the absence of ground truth labels for training the encoder leads them to employ two decoders, one for generating 3D shape and another for albedo maps. He used a differentiable renderer to jointly learn the encoder and decoders, ensuring that the rendered image closely matches the original input.[23][24] Initially developed for faces, this framework serves as a deformable appearance and shape model, akin to the conventional 3D Morphable Model (3DMM) but capable of learning directly from 2D in-the-wild images without the need for 3D scans. Moreover, it was extended to generic objects through the development of implicit functions.[25]

3D perception[edit]

Liu's 3D vision research has explored the fields of 3D object detection and multi-sensor fusion. He proposed a method, referred to as M3D-RPN (Monocular 3D Region Proposal Network) which enhanced the effectiveness of monocular 3D object detection and Bird's Eye View tasks when applied to the KITTI urban autonomous driving dataset.[26] This research was further extended in the direction of video-based detection, the creation of depth equivariant networks and non-maximum suppression (NMS) techniques.[27][28] Moreover, he specialized in the field of multi-sensor fusion, focusing on integrating cameras with LiDAR or Radar sensors to enhance 3D perception capabilities. His work encompassed tasks like depth completion, velocity estimation, and 3D object detection.[29]

Awards and honors[edit]

  • 2018 – Withrow Distinguished Scholar–Junior Award[30]
  • 2020 – Fellow, International Association for Pattern Recognition[3]
  • 2021 – MSU Foundation Professor, Michigan State University
  • 2022 – Fellow, Institute of Electrical and Electronics Engineers[4]
  • 2022 – Anil K. and Nandita Jain Endowed Professor of Engineering, Michigan State University
  • 2023 – Withrow Distinguished Scholar–Senior Award[31]

Selected articles[edit]

  • Zhu, X., Lei, Z., Liu, X., Shi, H., & Li, S. Z. (2016). Face alignment across large poses: A 3D solution. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 146–155).
  • Tai, Y., Yang, J., & Liu, X. (2017). Image super-resolution via deep recursive residual network. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3147–3155).
  • Tai, Y., Yang, J., Liu, X., & Xu, C. (2017). MemNnet: A persistent memory network for image restoration. In Proceedings of the IEEE international conference on computer vision (pp. 4539–4547).
  • Tran, L., Yin, X., & Liu, X. (2017). Disentangled representation learning GAN for pose-invariant face recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1415–1424)
  • Liu, Y., Jourabloo, A., & Liu, X. (2018). Learning deep models for face anti-spoofing: Binary or auxiliary supervision. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 389–398).

References[edit]

  1. ^ a b c "Xiaoming Liu | College of Engineering". www.egr.msu.edu.
  2. ^ a b c d "Xiaoming Liu". scholar.google.com.
  3. ^ a b "Alphabetical List of IAPR Fellows – International Association for Pattern Recognition".
  4. ^ a b "IEEE names Xiaoming Liu to prestigious Fellows list for 2023 | Michigan State University | College of Engineering | Future Engineers". www.egr.msu.edu.
  5. ^ a b "CSDL | IEEE Computer Society". www.computer.org.
  6. ^ "Yueting Zhuang". scholar.google.com.
  7. ^ Liu, Xiaoming; Chen, Tsuhan (June 18, 2003). Video-based face recognition using adaptive hidden markov models. IEEE Computer Society. pp. 340–345. ISBN 9780769519005 – via ACM Digital Library.
  8. ^ Kim, Minchul; Liu, Feng; Jain, Anil; Liu, Xiaoming (February 15, 2023). "Cluster and Aggregate: Face Recognition with Large Probe Set". arXiv:2210.10864 [cs.CV].
  9. ^ Guo, Xiao; Liu, Yaojie; Jain, Anil; Liu, Xiaoming (April 16, 2023). "Multi-domain Learning for Updating Face Anti-spoofing Models". arXiv:2208.11148 [cs.CV].
  10. ^ "Face De-Spoofing: Anti-Spoofing via Noise Modeling" (PDF).
  11. ^ Liu, Yaojie; Jourabloo, Amin; Liu, Xiaoming (March 29, 2018). "Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision". arXiv:1803.11097 [cs.CV].
  12. ^ Liu, Yaojie; Stehouwer, Joel; Jourabloo, Amin; Liu, Xiaoming (April 9, 2019). "Deep Tree Learning for Zero-shot Face Anti-Spoofing". arXiv:1904.02860 [cs.CV].
  13. ^ Gong, Sixue; Liu, Xiaoming; Jain, Anil K. (July 31, 2020). "Jointly De-biasing Face Recognition and Demographic Attribute Estimation". arXiv:1911.08080 [cs.CV].
  14. ^ "Mitigating Face Recognition Bias via Group Adaptive Classifier" (PDF).
  15. ^ Asnani, Vishal; Yin, Xi; Hassner, Tal; Liu, Xiaoming (July 29, 2023). "Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Images". arXiv:2106.07873 [cs.CV].
  16. ^ Asnani, Vishal; Yin, Xi; Hassner, Tal; Liu, Sijia; Liu, Xiaoming (March 31, 2022). "Proactive Image Manipulation Detection". arXiv:2203.15880 [cs.CV].
  17. ^ Guo, Xiao; Liu, Xiaohong; Ren, Zhiyuan; Grosz, Steven; Masi, Iacopo; Liu, Xiaoming (March 29, 2023). "Hierarchical Fine-Grained Image Forgery Detection and Localization". arXiv:2303.17111 [cs.CV].
  18. ^ Liu, Xiaoming (2007). "Generic Face Alignment using Boosted Appearance Model". 2007 IEEE Conference on Computer Vision and Pattern Recognition. pp. 1–8. doi:10.1109/CVPR.2007.383265. ISBN 978-1-4244-1179-5. S2CID 1560575.
  19. ^ "Discriminative Face Alignment" (PDF).
  20. ^ Jourabloo, Amin; Liu, Xiaoming (June 11, 2015). "Pose-Invariant 3D Face Alignment". arXiv:1506.03799 [cs.CV].
  21. ^ "Large-pose Face Alignment via CNN-based Dense 3D Model Fitting" (PDF).
  22. ^ Jourabloo, Amin; Liu, Xiaoming (September 1, 2017). "Pose-Invariant Face Alignment via CNN-Based Dense 3D Model Fitting". International Journal of Computer Vision. 124 (2): 187–203. doi:10.1007/s11263-017-1012-z. S2CID 255100305 – via Springer Link.
  23. ^ Tran, Luan; Liu, Feng; Liu, Xiaoming (April 9, 2019). "Towards High-fidelity Nonlinear 3D Face Morphable Model". arXiv:1904.04933 [cs.CV].
  24. ^ Tran, Luan; Liu, Xiaoming (August 26, 2018). "Nonlinear 3D Face Morphable Model". arXiv:1804.03786 [cs.CV].
  25. ^ Liu, Feng; Tran, Luan; Liu, Xiaoming (April 1, 2021). "Fully Understanding Generic Objects: Modeling, Segmentation, and Reconstruction". arXiv:2104.00858 [cs.CV].
  26. ^ Brazil, Garrick; Liu, Xiaoming (August 11, 2019). "M3D-RPN: Monocular 3D Region Proposal Network for Object Detection". arXiv:1907.06038 [cs.CV].
  27. ^ Brazil, Garrick; Pons-Moll, Gerard; Liu, Xiaoming; Schiele, Bernt (July 18, 2020). "Kinematic 3D Object Detection in Monocular Video". arXiv:2007.09548 [cs.CV].
  28. ^ Kumar, Abhinav; Brazil, Garrick; Corona, Enrique; Parchami, Armin; Liu, Xiaoming (July 21, 2022). "DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detection". arXiv:2207.10758 [cs.CV].
  29. ^ Imran, Saif; Liu, Xiaoming; Morris, Daniel (July 25, 2021). "Depth Completion with Twin Surface Extrapolation at Occlusion Boundaries". arXiv:2104.02253 [cs.CV].
  30. ^ "2018 Withrow Awards". www.egr.msu.edu.
  31. ^ "Congratulations: 2023 Engineering and Withrow Award winners". www.egr.msu.edu.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Xiaoming_Liu&oldid=1182403967"