I am a 2nd year Ph.D. student at the National Engineering Research Center of Robot Visual Perception and Control Technology of Hunan University, supervised by Prof. Wei Sun. I am currently a Visiting Ph.D. Student at the Machine Intelligence Group of the University of Western Australia, supervised by Prof. Ajmal Mian.

My research focuses on 3D computer vision, deep learning, and their applications for robotic manipulation. Specifically, I have worked on category-level 6D object pose estimation and instance-level 6D object pose tracking. Subsequent research focuses include: label-efficient learning for generalized 6D object pose estimation and tracking. I was motivated to conduct this doctoral research due to my passion for realizing intelligent perception and autonomous manipulation of robots in 3D space.

🔥 News

  • 2024.02:  🎉🎉 One paper is accepted by IEEE TII!
  • 2024.01:  🎉🎉 One paper is accepted by IEEE TNNLS!
  • 2023.02:  🎉🎉 One paper is accepted by IEEE TII!
  • 2022.06:  🎉🎉 One paper is accepted by IEEE TCSVT!

📝 Some Publications

IEEE TNNLS 2024
sym

MH6D: Multi-Hypothesis Consistency Learning for Category-Level 6-D Object Pose Estimation
Jian Liu, Wei Sun, Chongpei Liu, Hui Yang, Xing Zhang, Ajmal Mian

  • We propose a multi-hypothesis consistency learning framework for category-level 6-D object pose estimation, which utilizes a parallel consistency learning structure, alleviating the uncertainty problem of single-shot feature extraction and promoting self-adaptation of domain to reduce the synthetic-to-real domain gap.
IEEE TII 2023
sym

Robotic Continuous Grasping System by Shape Transformer-Guided Multi-Object Category-Level 6D Pose Estimation
Jian Liu, Wei Sun, Chongpei Liu, Xing Zhang, Qiang Fu

  • A transformer-guided shape reconstruction network is proposed to reconstruct the NOCS shape of intra-class known objects, which can fully use the prior feature, current observation feature, and their feature difference by internal self-attention, as well as strengthen their correlation by mutual cross-attention. By doing so, the shape variation can be explicitly highlighted.
IEEE TCSVT 2022
sym

HFF6D: Hierarchical Feature Fusion Network for Robust 6D Object Pose Tracking
Jian Liu, Wei Sun, Chongpei Liu, Xing Zhang, Shimeng Fan, Wei Wu

  • We propose a lightweight and robust hierarchical feature fusion network for 6D object pose tracking. It establishes sufficient spatial-temporal information interaction between adjacent frames and explicitly highlights the feature differences between adjacent frames, thus improving the robustness of relative pose estimation in challenging scenes.

💻 Projects

sym

Robotic Continuous Grasping System (Demo can be seen through link1 or link2)

  • We build an end-to-end robotic continuous grasping system, which achieves high-accuracy 6D pose estimation for multiple intra-class unknown objects and high-efficiency robotic grasping in 3D space. For continuous grasping, we propose a low-computation and effective grasping strategy based on the pre-defined vector orientation, and develop a GUI for monitoring and control.

🎖 Honors and Awards

  • 2018.11 The National First Prize in “Higher Education Society Cup” National Undergraduate Mathematical Contest in Modeling (Top 1.5 %).
  • 2019.08 The National Second Prize in “RoboMaster2019” National Undergraduate Robotics Competition (Hosted by DJI-Innovations).
  • 2018.06 Hong Kong “Zhong Huiming” Social Scholarship.

📖 Review Services

I served as a reviewer for the following journals:

  • IEEE Transactions on Image Processing
  • IEEE Transactions on Neural Networks and Learning Systems
  • IEEE Transactions on Industrial Informatics
  • IEEE Transactions on Circuits and Systems for Video Technology
  • IEEE Transactions on Circuits and Systems I: Regular Papers
  • Pattern Recognition
  • Neural Networks
  • ACM Transactions on Sensor Networks