James Kuffner

The Robotics Institute

Carnegie Mellon University

(currently working at Google Research)

Digital Human
Research
Center (AIST)

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Stanford University
1995-1999
•  University of Tokyo
JSK Lab
1999-2001
•  Carnegie Mellon University H5 H6 H7 Asimo HRP2 HRP3
The Robotics Institute
2001-present
•  Digital Human Research Center (AIST)
2001-present

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 ?

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 http://openrave.programmingvision.com/
- OR -
http://www.sourceforge.net/
keyword: “openrave”
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 reachability

8 CMU PhD thesis: Rosen Diankov

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 CMU PhD thesis: Rosen Diankov
9
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 10 CMU PhD thesis: Rosen Diankov
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Given the robot’s position, where can the arm reach?

11 CMU PhD thesis: Rosen Diankov

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Modeling Object Pose Error

12
CMU PhD thesis: Rosen Diankov
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 13
CMU PhD thesis: Rosen Diankov
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 14 CMU PhD thesis: Rosen Diankov
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Documents “live”
in the cloud
(backed up and
accessible anywhere)
•  Netbook
•  Supercomputing:
(Heavy CPU or
data-intensive
processing handled
by distributed
network)
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Physical separation of Hardware (motors &
sensors) and Software (high-level processes)

JSK (U.Tokyo) mini-Humanoids (1990s)

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Human acts as
the “remote-brain”

•  Not suitable for

all tasks

•  Issues:
–  Latency
–  Data Bandwidth NAIST-Hand I

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 HRP3 (AIST/Kawada)

Google DataCenter
•  Recent proposals:
“DAvinCi: A cloud computing framework for service
robots” [ Arumugam, et. Al. , ICRA 2010 ]
–  Hadoop cluster with ROS communication
infrastructure
–  FastSLAM map/reduce
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Wireless networking:
–  Fast
–  Reliable
–  Ubiquitous
–  Sufficient bandwidth

(e.g: Mobile Broadband

64 kbps to 150 Mbps
in 10 years = 2400x)

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Provides a shared knowledge database
–  Organizes and unifies information about the world
in a format usable by robots
•  Offloads heavy computing tasks to the cloud
–  Cheaper, lighter, easier-to-maintain hardware
(akin to desktop PC vs. a thin-client “netbook”)
–  Longer battery life
–  Less need for software pushes/updates
–  CPU hardware upgrades are invisible & hassle-free
•  Skill / Behavior Database
–  reusable library of “skills” or behaviors that map to
perceived task requirements / complex situations.
–  Data-mining the history of all cloud-enabled robots

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Cloud-enabled Object Recognition
–  e.g. “Google Goggles”

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Upload image(s) ! Download Semantics
–  Object name
–  3D model, mass, materials, friction properties
–  Usage instructions (function, how to grasp, operate)
–  Context / Domain knowledge

ARMAR III (KIT)

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Recognition
•  Translation
•  Synthesis

Alex Waibel’s group (CMU & KIT)

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Statistical Machine Translation

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Shared, highly-
detailed maps of
the world stored
in the cloud

•  Updates/
changes can be
published and
immediately
used

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Navigation •  Difficult task or
motion planning
problems solved in
the cloud
(e.g “God’s Number”)

- 43,252,003,274,489,856,000 positions
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
- 35 CPU-years used
 •  An “App Store” for robots
•  Task ! Objects/Domain Info ! Usage
Instructions ! Behaviors/Motor Skills

“Contact
Tamim”

James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots
 •  Cloud computing can enable
cheaper, lighter, “smarter” robots
•  The infrastructure exists and is
rapidly evolving in terms of
performance and accessibility
•  Create a “shared knowledgebase” for robots
–  Information about the world
–  Robot experiences / history / behavior
outcomes / learned skills can all be published or
data mined.
James Kuffner (Google) - Humanoids2010 Workshop “What’s Next” – Cloud-Enabled Humanoid Robots