BLACK FOREST HACKATHON

Challenges

Here’s how the hackathon challenges work: each challenge is provided by our challengers and will be introduced by them on Friday. They will also be available to answer questions and share any required datasets during the introduction.
Every challenge must be covered by at least two teams. During team formation, we will provide an overview showing how many teams have already selected each challenge, so you can see where your ideas and skills are most needed.

Challenge 1 - Vega

🦾 Tactile Intelligence: Object Localization with a Humanoid Robot Hand

🔍 Problem Statement: Humans can pick up an object and identify its position and orientation just by touch. They can then place it at a specific location without seeing it. For a humanoid robot, this is much more difficult. The robot must use data from tactile sensors in its hand to understand where the object is and how it is oriented.

🎯 Hackathon Challenge: How can tactile sensor data be used to estimate the position and orientation of an object held in a humanoid robot hand and provide this information for accurate placement?

📊 Available Data & Resources:

  • Dexterity Hand RH56DFTP-2R/2L
  • 17 tactile sensors per hand
  • Python API for robot control and sensor data processing
  • Real-time tactile sensor data
  • Sample objects and technical documentation

🏆 Success Criteria:

  • Accurately estimate the position and orientation of a grasped object
  • Detect object movement or slippage while the object is being held
  • Provide information that enables consistent and repeatable placement
  • Work reliably with different types of objects

💡 Key Considerations:

  • Real-time performance
  • Combining sensor data from multiple fingers
  • Visualizing the estimated object pose
  • Robustness to different grasping styles and finger positions
  • Generalization across different objects

Bonus Challenge: Can the solution create a simple 3D model or estimate the pose of the grasped object using only tactile sensor data, without using any camera information?

Sponsor werden? Kein Problem

Der Black Forest Hackathon wird durch Sponsoren ermöglicht. Sie wollen dabei sein, wenn sich die Tech-Community in der Ortenau trifft? Dann melden sie sich bei uns unter info@blackforesthackathon.de