I am a Ph.D. student at the National Engineering Research Center of Robot Visual Perception and Control Technology of Hunan University, supervised by Prof. Wei Sun. I am currently a Visiting Ph.D. Student at the Machine Intelligence Group of the University of Western Australia, supervised by Prof. Ajmal Mian. I also work closely with Prof. Nicu Sebe and Prof. Hossein Rahmani.

My research focuses on 3D machine vision, deep learning, and their applications for robotic manipulation. Specifically, I have worked on object pose estimation and tracking. Subsequent research focuses include label-efficient learning for generalized robotic multimodal perception and manipulation. I was motivated to conduct this doctoral research due to my passion for realizing intelligent perception and autonomous manipulation of robots in 3D space.

🔥 News

  • 2024.09:  🎉🎉 One paper was accepted by IEEE IoT-J.
  • 2024.05:  🎉🎉 A comprehensive survey of deep learning-based object pose estimation was posted on arXiv. Feel free to contact us if you have any suggestions.
  • 2024.02:  🎉🎉 One paper was accepted by IEEE TII.
  • 2024.01:  🎉🎉 One paper was accepted by IEEE TNNLS.
  • 2024.01:  🎉🎉 One paper was accepted by IEEE TMC.
  • 2023.11:  🎉🎉 One paper was accepted by IEEE TIM.
  • 2023.02:  🎉🎉 One paper was accepted by IEEE TII.
  • 2022.06:  🎉🎉 One paper was accepted by IEEE TCSVT.

📝 Some Publications

arXiv 2024
sym

Deep Learning-Based Object Pose Estimation: A Comprehensive Survey
Jian Liu, Wei Sun, Hui Yang, Zhiwen Zeng, Chongpei Liu, Jin Zheng, Xingyu Liu, Hossein Rahmani, Nicu Sebe, Ajmal Mian

  • We present a comprehensive survey of deep learning-based object pose estimation methods. This survey covers all three problem formulations in the domain, including instance-level, category-level, and unseen object pose estimation. We hope to provide readers with a complete picture of the research progress of deep learning-based object pose estimation.
IEEE TNNLS 2024
sym

MH6D: Multi-Hypothesis Consistency Learning for Category-Level 6-D Object Pose Estimation
Jian Liu, Wei Sun, Chongpei Liu, Hui Yang, Xing Zhang, Ajmal Mian

  • We propose a multi-hypothesis consistency learning framework for category-level 6-D object pose estimation, which utilizes a parallel consistency learning structure, alleviating the uncertainty problem of single-shot feature extraction and promoting self-adaptation of domain to reduce the synthetic-to-real domain gap.
IEEE TII 2023
sym

Robotic Continuous Grasping System by Shape Transformer-Guided Multi-Object Category-Level 6D Pose Estimation
Jian Liu, Wei Sun, Chongpei Liu, Xing Zhang, Qiang Fu

  • A transformer-guided shape reconstruction network is proposed to reconstruct the NOCS shape of intra-class known objects, which can fully use the prior feature, current observation feature, and their feature difference by internal self-attention, as well as strengthen their correlation by mutual cross-attention. By doing so, the shape variation can be explicitly highlighted.
IEEE TCSVT 2022
sym

HFF6D: Hierarchical Feature Fusion Network for Robust 6D Object Pose Tracking
Jian Liu, Wei Sun, Chongpei Liu, Xing Zhang, Shimeng Fan, Wei Wu

  • We propose a lightweight and robust hierarchical feature fusion network for 6D object pose tracking. It establishes sufficient spatial-temporal information interaction between adjacent frames and explicitly highlights the feature differences between adjacent frames, thus improving the robustness of relative pose estimation in challenging scenes.

💻 Projects

sym

Robotic Continuous Grasping System (Demo can be seen through link1 or link2)

  • We build an end-to-end robotic continuous grasping system, which achieves high-accuracy 6D pose estimation for multiple intra-class unknown objects and high-efficiency robotic grasping in 3D space. For continuous grasping, we propose a low-computation and effective grasping strategy based on the pre-defined vector orientation, and develop a GUI for monitoring and control.

🎖 Honors and Awards

  • 2018.11 The National First Prize in “Higher Education Society Cup” National Undergraduate Mathematical Contest in Modeling (Top 1.5 %).
  • 2019.08 The National Second Prize in “RoboMaster2019” National Undergraduate Robotics Competition (Hosted by DJI-Innovations).
  • 2018.06 Hong Kong “Zhong Huiming” Social Scholarship.

📖 Review Services

I serve as a reviewer for the following journals:

  • IEEE Transactions on Image Processing
  • IEEE Transactions on Neural Networks and Learning Systems
  • IEEE Transactions on Industrial Informatics
  • IEEE Transactions on Circuits and Systems for Video Technology
  • IEEE Transactions on Circuits and Systems I: Regular Papers
  • IEEE Transactions on Instrumentation and Measurement
  • Pattern Recognition
  • Neural Networks
  • ACM Transactions on Sensor Networks