TY - GEN
T1 - Collision-free trajectory planning in human-robot interaction through hand movement prediction from vision
AU - Wang, Yiwei
AU - Ye, Xin
AU - Yang, Yezhou
AU - Zhang, Wenlong
N1 - Publisher Copyright:
© 2017 IEEE.
PY - 2017/12/22
Y1 - 2017/12/22
N2 - We present a framework from vision based hand movement prediction in a real-world human-robot collaborative scenario for safety guarantee. We first propose a perception submodule that takes in visual data solely and predicts human collaborator's hand movement. Then a robot trajectory adaptive planning submodule is developed that takes the noisy movement prediction signal into consideration for optimization. To validate the proposed systems, we first collect a new human manipulation dataset that can supplement the previous publicly available dataset with motion capture data to serve as the ground truth of hand location. We then integrate the algorithm with a six degree-of-freedom robot manipulator that can collaborate with human workers on a set of trained manipulation actions, and it is shown that such a robot system outperforms the one without movement prediction in terms of collision avoidance. We verify the effectiveness of the proposed motion prediction and robot trajectory planning approaches in both simulated and physical experiments. To the best of the authors' knowledge, it is the first time that a deep model based movement prediction system is utilized and is proven effective in human-robot collaboration scenario for enhanced safety.
AB - We present a framework from vision based hand movement prediction in a real-world human-robot collaborative scenario for safety guarantee. We first propose a perception submodule that takes in visual data solely and predicts human collaborator's hand movement. Then a robot trajectory adaptive planning submodule is developed that takes the noisy movement prediction signal into consideration for optimization. To validate the proposed systems, we first collect a new human manipulation dataset that can supplement the previous publicly available dataset with motion capture data to serve as the ground truth of hand location. We then integrate the algorithm with a six degree-of-freedom robot manipulator that can collaborate with human workers on a set of trained manipulation actions, and it is shown that such a robot system outperforms the one without movement prediction in terms of collision avoidance. We verify the effectiveness of the proposed motion prediction and robot trajectory planning approaches in both simulated and physical experiments. To the best of the authors' knowledge, it is the first time that a deep model based movement prediction system is utilized and is proven effective in human-robot collaboration scenario for enhanced safety.
UR - http://www.scopus.com/inward/record.url?scp=85044448781&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85044448781&partnerID=8YFLogxK
U2 - 10.1109/HUMANOIDS.2017.8246890
DO - 10.1109/HUMANOIDS.2017.8246890
M3 - Conference contribution
AN - SCOPUS:85044448781
T3 - IEEE-RAS International Conference on Humanoid Robots
SP - 305
EP - 310
BT - 2017 IEEE-RAS 17th International Conference on Humanoid Robotics, Humanoids 2017
PB - IEEE Computer Society
T2 - 17th IEEE-RAS International Conference on Humanoid Robotics, Humanoids 2017
Y2 - 15 November 2017 through 17 November 2017
ER -