blank

I study Robotics, Reinforcement Learning, and Task and Motion Planning.

Teleoperation of Robot Manipulation through Goal Specification
Bringing in Context and Environment Awareness

Direct teleoperation had been the most prevalent form of humans’ remote operation of robots in completing sophisticated manipulation tasks. When using direct teleoperation tools, due to the complexity of robot motion, human operators mostly focus their attention on solving low-level motion control. This would lead to the operators’ heightened cognitive load. We propose a new approach to programming robots by providing an interface which a human operator can model the world and set goal states for a given task. Operators are able to locate three dimensional (3D) templates on points clouds to set the initial poses, grasp positions and goal positions of objects. We also provide a novel method for a human to designate grasp access points for a complex object like a bookshelf for more effective motion planning. In this work, for comparison we picked two existing frameworks, the interactive marker based direct control and way-point based control systems. While a human operator controls the robot for the pick and place task, the pilot study measured total execution and operation time and execution failure rates. The proposed goal-based interface took the least execution time and has the lowest failure rate among the three interfaces. From the NASA TLX questionnaire results, the goal-based interface requires the least effort in order to complete the tasks.

J. K. Lee (2015), “Teleoperation for Robot Manipulation through Goal Specification”, PhD Forum, the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, Washington.
J. K. Lee, and O. C. Jenkins (2014), "Goal-Based Teleoperation for Robot Manipulation", presented at AAAI Fall Symposium on Artificial Intelligence for Human-Robot Interaction, Arlington, Va, 2014.

Classes

Subject Name	Instructors
Human Robot Interaction Seminar	Prof. Odest Chadwicke Jenkins
Grounded Language for Robots	Prof. Stefanie Tellex
Introduction to Computational Linguistics	Prof. Eugene Charniak
Building Intelligent Robots	Prof. Odest Chadwicke Jenkins
Computational Probabiltiy and Statistics	Prof. Stuart Geman
Probabilistic Graphical Models	Prof. Erik Sudderth
Probabilistic Methods in Computer Science	Prof. Eli Upfal
Human Computer Interaction Seminar	Prof. Jeff Huang
Learning and Sequential Decision Making	Prof. Michael Littman