Ongoing ResearchForce-Guided Robotic Ultrasonic Inspection Using Imitation and Reinforcement Learning
Robot Learning · Reinforcement Learning · Imitation Learning · Sim-to-Real
Developing learning-based approaches for robotic ultrasonic inspection using force-sensor feedback. Investigating force-guided contact-control policies and sim-to-real transfer using MuJoCo, NVIDIA Isaac Sim, and Isaac Lab.
Technologies
- Python
- PyTorch
- MuJoCo
- Isaac Sim
- Isaac Lab
- ROS 2
- Force Sensing
Vision-Language AI-Guided Robotic Ultrasonic Inspection
Robotic Perception · Multimodal AI · Computer Vision · Autonomous Inspection
Developed a vision-language-guided robotic inspection framework using Grounding DINO, SAM 2, CLIP, and Qwen2.5-VL-32B for material identification and contact-aware inspection planning.
Achieved 90.3% material-identification accuracy, 90.5% proper-contact selection, and an F1 score of 0.867 in the evaluated tasks.
Technologies
- UR3e
- ROS 2
- Intel RealSense D435i
- Qwen2.5-VL
- Grounding DINO
- SAM 2
- CLIP
- Python
- PyTorch