Ruoqu Chen

A framework that learns visual-tactile dexterous manipulation skills from human videos by leveraging simulated interaction, bridging the gap between passive human demonstrations and executable robot policies.

Present UltraDP, a Diffusion-Policy-based method that receives multi-sensory inputs (ultrasound images, wrist camera image, contact wrench, and probe pose) and generates actions that are fit for multi-modal action distributions in autonomous ultrasound scanning. UltraDP achieves a 95% success rate in transverse scanning on previously unseen subjects, demonstrating its effectiveness.

HuMiT is a whole-body teleoperation system that drives a humanoid from sparse human keypoints alone, achieving  20 ms communication-to-inference latency to enable reactive whole-body skills such as ball catching and loco-manipulation.

An evaluation pipeline that pairs real-to-sim calibration with a vision-language model evaluator: calibrated simulator rollouts replace repeated hardware trials, and pairwise VLM preferences are aggregated into policy rankings, enabling automated, statistically stable, and quality-aware evaluation of robot behavior.

Developed a Whole-Body Model Predictive Control (WBMPC) framework to manage task priorities and scheduling in multi-task mobile manipulation scenarios. Integrated task priorities into a unified weight matrix, enabling smooth transitions across tasks in both spatial and temporal dimensions.