I am a Ph.D. student at the National Engineering Research Center of Robot Visual Perception and Control Technology of Hunan University, supervised by Prof. Wei Sun. I am currently a Visiting Ph.D. Student at the Machine Intelligence Group of the University of Western Australia, supervised by Prof. Ajmal Mian. I also work closely with Prof. Nicu Sebe and Prof. Hossein Rahmani.
My research focuses on 3D machine vision, deep learning, and their applications for robotic manipulation. Specifically, I have worked on object pose estimation and tracking. Subsequent research focuses include label-efficient learning for generalized robotic multimodal perception and manipulation. I was motivated to conduct this doctoral research due to my passion for realizing intelligent perception and autonomous manipulation of robots in 3D space.
🔥 News
- 2024.09: 🎉🎉 One paper was accepted by IEEE IoT-J.
- 2024.05: 🎉🎉 A comprehensive survey of deep learning-based object pose estimation was posted on arXiv. Feel free to contact us if you have any suggestions.
- 2024.02: 🎉🎉 One paper was accepted by IEEE TII.
- 2024.01: 🎉🎉 One paper was accepted by IEEE TNNLS.
- 2024.01: 🎉🎉 One paper was accepted by IEEE TMC.
- 2023.11: 🎉🎉 One paper was accepted by IEEE TIM.
- 2023.02: 🎉🎉 One paper was accepted by IEEE TII.
- 2022.06: 🎉🎉 One paper was accepted by IEEE TCSVT.
📝 Some Publications
Deep Learning-Based Object Pose Estimation: A Comprehensive Survey
Jian Liu, Wei Sun, Hui Yang, Zhiwen Zeng, Chongpei Liu, Jin Zheng, Xingyu Liu, Hossein Rahmani, Nicu Sebe, Ajmal Mian
- We present a comprehensive survey of deep learning-based object pose estimation methods. This survey covers all three problem formulations in the domain, including instance-level, category-level, and unseen object pose estimation. We hope to provide readers with a complete picture of the research progress of deep learning-based object pose estimation.
MH6D: Multi-Hypothesis Consistency Learning for Category-Level 6-D Object Pose Estimation
Jian Liu, Wei Sun, Chongpei Liu, Hui Yang, Xing Zhang, Ajmal Mian
- We propose a multi-hypothesis consistency learning framework for category-level 6-D object pose estimation, which utilizes a parallel consistency learning structure, alleviating the uncertainty problem of single-shot feature extraction and promoting self-adaptation of domain to reduce the synthetic-to-real domain gap.
Robotic Continuous Grasping System by Shape Transformer-Guided Multi-Object Category-Level 6D Pose Estimation
Jian Liu, Wei Sun, Chongpei Liu, Xing Zhang, Qiang Fu
- A transformer-guided shape reconstruction network is proposed to reconstruct the NOCS shape of intra-class known objects, which can fully use the prior feature, current observation feature, and their feature difference by internal self-attention, as well as strengthen their correlation by mutual cross-attention. By doing so, the shape variation can be explicitly highlighted.
HFF6D: Hierarchical Feature Fusion Network for Robust 6D Object Pose Tracking
Jian Liu, Wei Sun, Chongpei Liu, Xing Zhang, Shimeng Fan, Wei Wu
- We propose a lightweight and robust hierarchical feature fusion network for 6D object pose tracking. It establishes sufficient spatial-temporal information interaction between adjacent frames and explicitly highlights the feature differences between adjacent frames, thus improving the robustness of relative pose estimation in challenging scenes.
💻 Projects
Robotic Continuous Grasping System (Demo can be seen through link1 or link2)
- We build an end-to-end robotic continuous grasping system, which achieves high-accuracy 6D pose estimation for multiple intra-class unknown objects and high-efficiency robotic grasping in 3D space. For continuous grasping, we propose a low-computation and effective grasping strategy based on the pre-defined vector orientation, and develop a GUI for monitoring and control.
🎖 Honors and Awards
- 2018.11 The National First Prize in “Higher Education Society Cup” National Undergraduate Mathematical Contest in Modeling (Top 1.5 %).
- 2019.08 The National Second Prize in “RoboMaster2019” National Undergraduate Robotics Competition (Hosted by DJI-Innovations).
- 2018.06 Hong Kong “Zhong Huiming” Social Scholarship.
📖 Review Services
I serve as a reviewer for the following journals:
- IEEE Transactions on Image Processing
- IEEE Transactions on Neural Networks and Learning Systems
- IEEE Transactions on Industrial Informatics
- IEEE Transactions on Circuits and Systems for Video Technology
- IEEE Transactions on Circuits and Systems I: Regular Papers
- IEEE Transactions on Instrumentation and Measurement
- Pattern Recognition
- Neural Networks
- ACM Transactions on Sensor Networks