Optimizing Robot-to-Human Object Handovers using Vision-based Affordance Information

Daniel Lehotský, Albert Daugbjerg Christensen, Dimitrios Chrysostomou*

*Corresponding author for this work

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

4 Citations (Scopus)
172 Downloads (Pure)

Abstract

Robotic handovers of objects to humans require selecting appropriate grasp poses and orientations to enable efficient subsequent use. We present two methods to compute suitable handover orientations based solely on object affordances rather than object categories or predefined object-specific rules. The first uses human demonstration data to learn average handover orientations per object directly from affordances. The second is a rule-based method that orients graspable affordances towards the receiver. We integrated both approaches into a robotic system performing task-oriented grasping and handovers based on affordance segmentation. A user study indicates the rule-based method produces equally comfortable and natural handover orientations compared to learning from demonstration, while being simpler to implement. Further experiments demonstrate the robot's ability to successfully hand over objects with proper orientations. This is the first prototype deriving handover orientations solely from affordances treated as pixel-wise semantic segmentation, providing a practical approach without per-object datasets. https://bit.ly/RobotHandovers

Original languageEnglish
Title of host publicationIST 2023 - IEEE International Conference on Imaging Systems and Techniques, Proceedings
PublisherIEEE Signal Processing Society
Publication date20 Dec 2023
ISBN (Print)979-8-3503-3084-7
ISBN (Electronic)9798350330830
DOIs
Publication statusPublished - 20 Dec 2023
Event2023 IEEE International Conference on Imaging Systems and Techniques, IST 2023 - Copenhagen, Denmark
Duration: 17 Oct 202319 Oct 2023

Conference

Conference2023 IEEE International Conference on Imaging Systems and Techniques, IST 2023
Country/TerritoryDenmark
CityCopenhagen
Period17/10/202319/10/2023
SponsorIEEE, IEEE Instrumentation and Measurement Society
SeriesIST 2023 - IEEE International Conference on Imaging Systems and Techniques, Proceedings

Bibliographical note

Publisher Copyright:
© 2023 IEEE.

Keywords

  • human robot collaboration
  • human robot interaction
  • industry 4.0
  • object affordances
  • robot to human handover
  • robotic handover
  • robotics

Fingerprint

Dive into the research topics of 'Optimizing Robot-to-Human Object Handovers using Vision-based Affordance Information'. Together they form a unique fingerprint.

Cite this