Dianye Huang

Links & Profiles

Google Scholar  LinkedIn  GitHub 

Research Interests

Dianye Huang is a Ph.D. candidate at the Chair for Computer Aided Medical Procedures (CAMP), Technical University of Munich, supervised by Prof. Nassir Navab. His research focuses on intelligent robotic ultrasound imaging, with the goal of fusing multiple sensing modalities to enable human-like, autonomous ultrasound scanning. This approach aims to reduce inter- and intra-operator variability inherent in manual scans. His broader research interests include:

• Medical Robotics: Robotic Ultraosund, Spatial Temporal Ultrasound Image Analysis
• Robot Learning: Embodied Agents empowered by large language/vision-language/action models (LLM/LVLM/VLA)
• Intelligent Robotic Control: physical Human-Robot / Robot-Environment Interaction

Curriculum Vitae

• Sept. 2021 - Ongoing:  PhD candidate at the Chair for Computer Aided Medical Procedures, Technical University of Munich, Germany
• Sept. 2017 - June 2020:  MEng. in Control Science and Engineering at South China University of Technology, Guangzhou, China
• Sept. 2013 - June 2017:  BEng. in Automation at South China University of Technology, Guangzhou, China

Student Projects

Feel free to reach out if you are looking for IDP, Guided Research Project, or Master Thesis and have any interesting ideas or topics related to, but not limited to, robotic ultrasound scanning, dynamic ultrasound imaging processing, ultrasound-based human-machine interaction, or embodied agents with LLM/LVLM. 

Below are some of the topics currently offered:

1. Topic: Continuous Hand Movement Prediction and Hand Force Assessment
2. Topic: On-site Immersive Teleoperation Control of Ultrasound Scanning
3. Topic: Share Control for Teleopearted Ultrasound Scanning System
4. etc..

Year	Type	Titile	Student	Status
2025	Master Thesis	VLM-Enhanced Hand Movement Prediction Using Ultrasound Images	Jiamei Guo	ongoing
2025	Master Thesis	Robotic Ultrasound Scanning System with Action Justifications	Ziping Cong	ongoing
2024	Master Thesis	Enhancing Needle Tip Detection using Motion Magnification Algorithms	Chenyang Li	Pub. in IEEE TMI

Publications

1. Dianye Huang, Nassir Navab, Zhongliang Jiang, "Improving Probe Localization for Freehand 3D Ultrasound using Lightweight Cameras," ICRA 2025
2. Feng Li, Yuan Bi, Dianye Huang, Zhongliang Jiang, Nassir Navab, “Robotic CBCT meets robotic ultrasound,” International Journal of Computer Assisted Radiology and Surgery, 2025
3. Dianye Huang, Chenyang Li, Angelos Karlas, Xiangyu Chu, KW Samuel Au, Nassir Navab, Zhongliang Jiang, “VibNet: Vibration-Boosted Needle Detection in Ultrasound Images,” IEEE Transactions on Medical Imaging, 2025
4. Shangding Gu, Dianye Huang, Muning Wen, Guang Chen, Alois Knoll, "Safe Multiagent Learning With Soft Constrained Policy Optimization in Real Robot Control," IEEE Transactions on Industrial Informatics, 2024
5. Yuan Bi, Zhongliang Jiang, Felix Duelmer, Dianye Huang, and Nassir Navab, "Machine learning in robotic ultrasound imaging: Challenges and perspectives," , Annual Review of Control, Robotics, and Autonomous Systems, 2024
6. Dianye Huang, Chenguang Yang, Mingchuan Zhou, Angelos Karlas, Nassir Navab, and Zhongliang Jiang, "Robot-assisted deep venous thrombosis ultrasound examination using virtual fixture," IEEE Transactions on Automation Science and Engineering, 2024
7. Guangyao Zhai, Xiaoni Cai, Dianye Huang, Yan Di, Fabian Manhardt, Federico Tombari, Nassir Navab, and Benjamin Busam, "Sg-bot: Object rearrangement via coarse-to-fine robotic imagination on scene graphs, " ICRA 2024
8. Dianye Huang, Yuan Bi, Nassir Navab, and Zhongliang Jiang, "Motion magnification in robotic sonography: enabling pulsation-aware artery segmentation, ", IROS 2023
9. Guangyao Zhai, Dianye Huang, Shun-Cheng Wu, HyunJun Jung, Yan Di, Fabian Manhardt, Federico Tombari, Nassir Navab, and Busam, Benjamin,  "Monograspnet: 6-dof grasping with a single rgb image", ICRA 2023
10. Yingbai Hu, Mingyang Cui, Jianghua Duan, Wenjun Liu, Dianye Huang, Alois Knoll and Guang Chen, "Model predictive optimization for imitation learning from demonstrations," in Robotics and Autonomous Systems(2023): 104381.
11. Chenguang Yang, Dianye Huang, Wei He and Long Cheng, "Neural Control of Robot Manipulators With Trajectory Tracking Constraints and Input Saturation," in IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 9, pp. 4231-4242, Sept. 2021.
12. Dianye Huang, Chenguang Yang, Yongping Pan, and Long Cheng, "Composite Learning Enhanced Neural Control for Robot Manipulator With Output Error Constraints," in IEEE Transactions on Industrial Informatics, vol. 17, no. 1, pp. 209-218, Jan. 2021.
13. Hong Zhan, Dianye Huang, Zhaopeng Chen, Min Wang, Chenguang Yang. “Adaptive dynamic programming-based controller with admittance adaptation for robot–environment interaction,” International Journal of Advanced Robotic Systems. 2020;17(3).
14. Dianye Huang, Chenguang Yang, Ning Wang, Andy Annamalai, and Chun-Yi Su. Online Robot Reference Trajectory Adaptation for Haptic Identification of Unknown Force Field. Int. J. Control Autom. Syst. 16, 318–326 2018
15. Dianye Huang, Chenguang Yang, Yongping Pan, Shilu Dai and Zhaojie Ju, "Composite Learning for Trajectory Tracking Control of Robot Manipulators with Output Constraints," 2018 Eighth International Conference on Information Science and Technology (ICIST), Cordoba, Granada, and Seville, Spain, 2018, pp. 301-306