research-article

Robot grasp planning based on demonstrated grasp strategies

Authors:

Yu SunAuthors Info & Claims

International Journal of Robotics Research, Volume 34, Issue 1

Pages 26 - 42

https://doi.org/10.1177/0278364914555544

Published: 01 January 2015 Publication History

Abstract

This paper presents a novel robot grasping planning approach that extracts grasp strategies (grasp type, and thumb placement and direction) from human demonstration and integrates them into the grasp planning procedure to generate a feasible grasp concerning the target object geometry and manipulation task. Our study results show that the grasp strategies of grasp type and thumb placement not only represent important human grasp intentions, but also provide meaningful constraints on hand posture and wrist position, which highly reduce both the feasible workspace of a robotic hand and the search space of the grasp planning. This approach has been thoroughly evaluated both in simulation and with a real robotic system for multiple daily living representative objects. We have also demonstrated the robustness of our approach in the experiment with different levels of perception uncertainties.

References

[1]

Aleotti J,Caselli S.Grasp recognition in virtual reality for robot pregrasp planning by demonstration.IEEE international conference on robotics and automation; 2006; 2006. 2801.

[2]

Balasubramanian R,Ling X,Brook PD, et al.Human-guided grasp measures improve grasp robustness on physical robot.International conference on robotics and automation; 2010; 2010. 2294.

[3]

Belkin M,Niyogi P.Laplacian eigenmaps and spectral techniques for embedding and clustering.NIPS. 2001;:585-591

[4]

Ben Amor H,Kroemer O,Hillenbrand U, et al.Generalization of human grasping for multi-fingered robot hands.IEEE/RSJ international conference on intelligent robots and systems; 2012; 2012. 2043.

[5]

Butterfass J,Grebenstein M,Liu H, et al.DLR-Hand II: Next generation of a dextrous robot hand.IEEE international conference on robotics and automation; 2001; 2001. 109.

[6]

Ciocarlie MT,Allen PK.Hand posture subspaces for dexterous robotic grasping.The International Journal of Robotics Research. 2009;28 (7): 851-867

[7]

Cutkosky MR.On grasp choice, grasp models, and the design of hands for manufacturing tasks.IEEE Transactions on Robotics and Automation. 1989;5 (3): 269-279

[8]

Dai W,Sun Y,Qian X.Functional analysis of grasping motion.IEEE/RSJ international conference on intelligent robots and systems; 2013; 2013. .

[9]

Ekvall S,Kragic D.Grasp recognition for programming by demonstration.IEEE international conference on robotics and automation; 2005; 2005. 748.

[10]

El-Khoury S,Sahbani A.A new strategy combining empirical and analytical approaches for grasping unknown 3D objects.Robotics and Autonomous Systems. 2010;58 (5): 497-507

[11]

Ferrari C,Canny J.Planning optimal grasps.IEEE international conference on robotics and automation; 1992; 1992. 2290.

[12]

Fischer M,van der Smagt P,Hirzinger G.Learning techniques in a dataglove based telemanipulation system for the DLR hand.IEEE international conference on robotics and automation; 1998; 1998. 1603.

[13]

Fisher RA.The use of multiple measurements in taxonomic problems.Annals of Eugenics. 1936;7 (2): 179-188

[14]

Gioioso G,Salvietti G,Malvezzi M, et al.Mapping synergies from human to robotic hands with dissimilar kinematics: An object based approach.IEEE international conference on robotics and automation; 2011; 2011. .

[15]

Heumer G,Amor HB,Weber M, et al.Grasp recognition with uncalibrated data gloves - A comparison of classification methods.IEEE virtual reality conference; 2007; 2007. 19.

[16]

He X,Niyogi P.Locality preserving projections.NIPS. 2003;:

[17]

Hotelling H.Analysis of a complex of statistical variables into principal components.Journal of Educational Psychology. 1933;24 (6): 417

[18]

Hsiao K,Lozano-Perez T.Imitation learning of whole-body grasps.IEEE/RSJ international conference on intelligent robots and systems; 2006; 2006. 5657.

[19]

Hueser M,Baier T,Zhang J.Learning of demonstrated grasping skills by stereoscopic tracking of human head configuration.IEEE international conference on robotics and automation; 2006; 2006. 2795.

[20]

Jacobsen SC,Wood JE,Knutti DF, et al.The Utah/MIT dextrous hand: Work in progress.The International Journal of Robotics Research. 1984;3 (4): 21-50

[21]

Kang SB,Ikeuchi K.Toward automatic robot instruction from perception-mapping human grasps to manipulator grasps.IEEE Transactions on Robotics and Automation. 1997;13 (1): 81-95

[22]

KimJ (2007) Example-based grasp adaptation. PhD Thesis, Massachusetts Institute of Technology, MA.

[23]

Kim J,Iwamoto K,Kuffner J, et al.Physically based grasp quality evaluation under pose uncertainty.IEEE Transactions on Robotics. 2013;29 (6): 1424-1439

[24]

Kochan A.Shadow delivers first hand.Industrial Robot: An International Journal. 2005;32 (1): 15-16

[25]

Kootstra G,Popović M,Jørgensen JA, et al.Enabling grasping of unknown objects through a synergistic use of edge and surface information.The International Journal of Robotics Research. 2012;31 (10): 1190-1213

[26]

Le QV,Kamm D,Kara AF, et al.Learning to grasp objects with multiple contact points.IEEE international conference on robotics and automation; 2010; 2010. 5062.

[27]

Lin Y,Sun Y.Grasp mapping using locality preserving projections and kNN regression.International conference on robotics and automation; 2013a; 2013a. .

[28]

Lin Y,Sun Y.Task-oriented grasp planning based on disturbance distribution.International symposium on robotics research (ISRR). 2013b;:

[29]

Lin Y,Ren S,Clevenger M, et al.Learning grasping force from demonstration.IEEE international conference on robotics and automation; 2012; 2012. 1526.

[30]

Liu G,Xu J,Wang X, et al.On quality functions for grasp synthesis, fixture planning, and coordinated manipulation.IEEE Transactions on Automation Science and Engineering. 2004;1 (2): 146-162

[31]

Li Y,Fu JL,Pollard N.Data-driven grasp synthesis using shape matching and task-based pruning.IEEE Transactions on Visualization and Computer Graphics. 2007;13 (4): 732-747

[32]

Lovchik CS,Diftler MA.The Robonaut hand: A dexterous robot hand for space.IEEE international conference on robotics and automation; 1999; 1999. 907.

[33]

Marzke MW,Marzke RF.Evolution of the human hand: Approaches to acquiring, analysing and interpreting the anatomical evidence.Journal of Anatomy. 2000;197 (1): 121-140

[34]

Napier JR.Studies of the hands of living primates.Proceedings of the Zoological Society of London; 1960; 1960. 647.

[35]

Napier JR.Evolution of the human hand.Proceedings of the Royal Institution of Great Britain; 1965; 1965. 544.

[36]

Nguyen VD.Constructing force-closure grasps.The International Journal of Robotics Research. 1988;7 (3): 3-16

[37]

Oztop E,Arbib MA.Schema design and implementation of the grasp-related mirror neuron system.Biological Cybernetics. 2002;87 (2): 116-140

[38]

Papazov C,Haddadin S,Parusel S, et al.Rigid 3D geometry matching for grasping of known objects in cluttered scenes.The International Journal of Robotics Research. 2012;31 (4): 538-553

[39]

Peer A,Einenkel S,Buss M.Multi-fingered telemanipulation-mapping of a human hand to a three finger gripper.The 17th IEEE international symposium on robot and human interactive communication; 2008; 2008. 465.

[40]

Pollard NS.Closure and quality equivalence for efficient synthesis of grasps from examples.The International Journal of Robotics Research. 2004;23 (6): 595-613

[41]

Ponce J,Faverjon B.On computing three-finger force-closure grasps of polygonal objects.IEEE Transactions on Robotics and Automation. 1995;11 (6): 868-881

[42]

Roa MA,Suárez R.Finding locally optimum force-closure grasps.Robotics and Computer-Integrated Manufacturing. 2009;25 (3): 536-544

[43]

Romero J,Kjellstrom H,Kragic D.Modeling and evaluation of human-to-robot mapping of grasps.International conference on advanced robotics; 2009; 2009. 1.

[44]

Rosales C,Ros L,Porta JM, et al.Synthesizing grasp configurations with specified contact regions.The International Journal of Robotics Research. 2011;30 (4): 431-443

[45]

Roweis ST,Saul LK.Nonlinear dimensionality reduction by locally linear embedding.Science. 2000;290 (5500): 2323-2326

[46]

Sahbani A,El-Khoury S,Bidaud P.An overview of 3D object grasp synthesis algorithms.Robotics and Autonomous Systems. 2012;60 (3): 326-336

[47]

Santello M,Flanders M,Soechting JF.Postural hand synergies for tool use.The Journal of Neuroscience. 1998;18 (23): 10,105-10,115

[48]

Saxena A,Driemeyer J,Ng AY.Robotic grasping of novel objects using vision.The International Journal of Robotics Research. 2008;27 (2): 157-173

[49]

Sun Y.Fingertip force and contact position and orientation sensor.2011 IEEE international conference on robotics and automation (ICRA); 2011; 2011. 1114.

[50]

Susman RL.Hand function and tool behavior in early hominids.Journal of Human Evolution. 1998;35 (1): 23-46

[51]

Tegin J,Ekvall S,Kragic D, et al.Demonstration-based learning and control for automatic grasping.Intelligent Service Robotics. 2009;2 (1): 23-30

[52]

Tenenbaum JB.Mapping a manifold of perceptual observations.Advances in Neural Information Processing Systems. 1998;:682-688

[53]

Young RW.Evolution of the human hand: The role of throwing and clubbing.Journal of Anatomy. 2003;202 (1): 165-174

[54]

Zhu X,Wang J.Synthesis of force-closure grasps on 3-D objects based on the Q distance.IEEE Transactions on Robotics and Automation. 2003;19 (4): 669-679

[55]

Zöllner R,Pardowitz M,Knoop S, et al.Towards cognitive robots: Building hierarchical task representations of manipulations from human demonstration.IEEE international conference on robotics and automation; 2005; 2005. 1535.

Cited By

Jaquier NRozo LGonzález-Duque MBorovitskiy VAsfour TSalakhutdinov RKolter ZHeller KWeller AOliver NScarlett JBerkenkamp F(2024)Bringing motion taxonomies to continuous domains via GPLVM on hyperbolic manifoldsProceedings of the 41st International Conference on Machine Learning10.5555/3692070.3692929(21373-21409)Online publication date: 21-Jul-2024
https://dl.acm.org/doi/10.5555/3692070.3692929
Huang RZheng WZhang BZhou JCui ZZhang Z(2023)Deep learning with tactile sequences enables fruit recognition and force prediction for damage-free graspingComputers and Electronics in Agriculture10.1016/j.compag.2023.107985211:COnline publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1016/j.compag.2023.107985
Páez-Ubieta ICastaño-Amorós JPuente SGil P(2023)Vision and Tactile Robotic System to Grasp Litter in Outdoor EnvironmentsJournal of Intelligent and Robotic Systems10.1007/s10846-023-01930-2109:2Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1007/s10846-023-01930-2
Show More Cited By

Recommendations

A heuristic approach to grasp planning for a multifingered hand-arm robot based on the structure of empty space

This paper proposes a grasp planning for a multifingered hand-arm robot in the presence of obstacles. When the hand grasps an object, neither the hand nor the arm should collide with obstacles. However, it is very difficult to generate a collision-free ...
Dynamic grasp and trajectory planning for moving objects

This paper shows how a robot arm can follow and grasp moving objects tracked by a vision system, as is needed when a human hands over an object to the robot during collaborative working. While the object is being arbitrarily moved by the human co-worker,...
EMG-based decoding of grasp gestures in reaching-to-grasping motions

Predicting the grasping function during reach-to-grasp motions is essential for controlling a prosthetic hand or a robotic assistive device. An early accurate prediction increases the usability and the comfort of a prosthetic device. This work proposes ...

Comments

Information & Contributors

Information

Published In

cover image International Journal of Robotics Research

International Journal of Robotics Research Volume 34, Issue 1

January 2015

126 pages

ISSN:0278-3649

Issue’s Table of Contents

Publisher

Sage Publications, Inc.

United States

Publication History

Published: 01 January 2015

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jaquier NRozo LGonzález-Duque MBorovitskiy VAsfour TSalakhutdinov RKolter ZHeller KWeller AOliver NScarlett JBerkenkamp F(2024)Bringing motion taxonomies to continuous domains via GPLVM on hyperbolic manifoldsProceedings of the 41st International Conference on Machine Learning10.5555/3692070.3692929(21373-21409)Online publication date: 21-Jul-2024
https://dl.acm.org/doi/10.5555/3692070.3692929
Huang RZheng WZhang BZhou JCui ZZhang Z(2023)Deep learning with tactile sequences enables fruit recognition and force prediction for damage-free graspingComputers and Electronics in Agriculture10.1016/j.compag.2023.107985211:COnline publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1016/j.compag.2023.107985
Páez-Ubieta ICastaño-Amorós JPuente SGil P(2023)Vision and Tactile Robotic System to Grasp Litter in Outdoor EnvironmentsJournal of Intelligent and Robotic Systems10.1007/s10846-023-01930-2109:2Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1007/s10846-023-01930-2
Wake NSaito DSasabuchi KKoike HIkeuchi K(2023)Text-driven object affordance for guiding grasp-type recognition in multimodal robot teachingMachine Vision and Applications10.1007/s00138-023-01408-z34:4Online publication date: 5-Jun-2023
https://dl.acm.org/doi/10.1007/s00138-023-01408-z
Sun YAmatova EChen T(2022)Multi-Object Grasping - Types and Taxonomy2022 International Conference on Robotics and Automation (ICRA)10.1109/ICRA46639.2022.9812388(777-783)Online publication date: 23-May-2022
https://dl.acm.org/doi/10.1109/ICRA46639.2022.9812388
Chen TShenoy AKolinko AShah SSun Y(2021)Multi-Object Grasping – Estimating the Number of Objects in a Robotic Grasp2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS51168.2021.9636777(4995-5001)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1109/IROS51168.2021.9636777
Paulius DDong KSun Y(2021)Task Planning with a Weighted Functional Object-Oriented Network2021 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA48506.2021.9561680(3904-3910)Online publication date: 30-May-2021
https://dl.acm.org/doi/10.1109/ICRA48506.2021.9561680
Qiu SKermani M(2021)Arm-Hand Systems As Hybrid Parallel-Serial Systems: A Novel Inverse Kinematics Solution2021 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA48506.2021.9561414(6401-6407)Online publication date: 30-May-2021
https://dl.acm.org/doi/10.1109/ICRA48506.2021.9561414
Qiu SKermani M(2021)Inverse Kinematics of High Dimensional Robotic Arm-Hand Systems for Precision GraspingJournal of Intelligent and Robotic Systems10.1007/s10846-021-01349-7101:4Online publication date: 25-Mar-2021
https://dl.acm.org/doi/10.1007/s10846-021-01349-7
Wilches JHuang YSun Y(2020)Generalizing Learned Manipulation Skills in Practice2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS45743.2020.9340739(9322-9328)Online publication date: 24-Oct-2020
https://dl.acm.org/doi/10.1109/IROS45743.2020.9340739
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents