Robotic Compliant Object Prying Using Diffusion Policy Guided by Vision and Force Observations

Mar 1, 2025ยท
Jeon Ho Kang
Jeon Ho Kang
,
Sagar Joshi
,
Ruopeng Huang
,
Satyandra K. Gupta
ยท 0 min read
Image credit: IEEE
Abstract
The growing adoption of batteries in the electric vehicle industry and various consumer products has created an urgent need for effective recycling solutions. These products often contain a mix of compliant and rigid components, making robotic disassembly a critical step toward achieving scalable recycling processes. Diffusion policy has emerged as a promising approach for learning low-level skills in robotics. To effectively apply diffusion policy to contact-rich tasks, incorporating force as feedback is essential. In this paper, we apply diffusion policy with vision and force in a compliant object prying task. However, when combining low-dimensional contact force with high-dimensional image, the force information may be diluted. To address this issue, we propose a method that effectively integrates force with image data for diffusion policy observations. We validate our approach on a battery prying task that demands high precision and multi-step execution. Our model achieves a 96% success rate in diverse scenarios, marking a 57% improvement over the vision-only baseline. Our method also demonstrates zero-shot transfer capability to handle unseen objects and battery types. Supplementary videos and implementation codes are available on our project website - Project Website
Type
Publication
Robotics and Automation Letters, 2025