Back to Portfolio

Real World Robotics

📅 09/2025-12/2025
🏫 ETH Zürich
Completed

Overview

This project developed a low-cost, anthropomorphic robotic hand system specifically engineered for efficient data collection using data gloves for imitation learning on manipulation tasks. The 16 DOF (Degrees of Freedom) tendon-driven robotic hand features integrated force sensors in each fingertip and a sophisticated control system that enables precise teleoperation through human hand motion capture.


The system addresses key challenges in imitation learning research: the high cost of dexterous robotic hands and the difficulty of collecting high-quality expert demonstration data. By combining innovative mechanical design, advanced control algorithms including retargeting and Gaussian Process modeling, and streamlined data collection workflows, the project enables researchers to focus on developing capable control policies rather than struggling with hardware limitations and data quality issues.

Key Features

Technologies & Tools

ROS2 MuJoCo Simulation Rokoko Smart Gloves Gaussian Processes MediaPipe ESP32/MicroROS Python 3D Printing/CAD

Team & Supervision

Florian Lange

Researcher (CAD)
ETH Zürich

Anton Pollak

Researcher (CAD/ROS)
ETH Zürich

Richard Kuhlmann

Researcher (CAD)
ETH Zürich

Jaú Gretler

Researcher (Computer Vision)
ETH Zürich

Sai Bommisetty

Researcher (Motion Capture)
ETH Zürich

Rajiv Bhardawaj

Researcher (Machine Learning)
ETH Zürich

Fabio Hübel

Researcher (Controls & Simulation)
ETH Zürich

Project Gallery

Results & Impact

Results: The system demonstrated improved data collection efficiency and successfully enabled training of an autonomous color-based cube sorting policy deployed on a FRANKA manipulator. The retargeting system achieved real-time performance and high precision, while the custom force sensors achieved sensitivity down to 49mN, enabling detection of light touches crucial for manipulation tasks.


Impact: This work lowers the barrier to entry for imitation learning research by providing an affordable, capable platform for collecting expert demonstrations. The modular design and open architecture enable adaptation to various manipulation tasks and research applications. The improved data collection efficiency and quality directly translates to faster iteration cycles and better performing learned policies.

References