Human-Robot Interaction Control Using Reinforcement Learning

Human-Robot Interaction Control Using Reinforcement Learning PDF Author: Wen Yu
Publisher: John Wiley & Sons
ISBN: 1119782740
Category : Technology & Engineering
Languages : en
Pages : 290

Get Book

Book Description
A comprehensive exploration of the control schemes of human-robot interactions In Human-Robot Interaction Control Using Reinforcement Learning, an expert team of authors delivers a concise overview of human-robot interaction control schemes and insightful presentations of novel, model-free and reinforcement learning controllers. The book begins with a brief introduction to state-of-the-art human-robot interaction control and reinforcement learning before moving on to describe the typical environment model. The authors also describe some of the most famous identification techniques for parameter estimation. Human-Robot Interaction Control Using Reinforcement Learning offers rigorous mathematical treatments and demonstrations that facilitate the understanding of control schemes and algorithms. It also describes stability and convergence analysis of human-robot interaction control and reinforcement learning based control. The authors also discuss advanced and cutting-edge topics, like inverse and velocity kinematics solutions, H2 neural control, and likely upcoming developments in the field of robotics. Readers will also enjoy: A thorough introduction to model-based human-robot interaction control Comprehensive explorations of model-free human-robot interaction control and human-in-the-loop control using Euler angles Practical discussions of reinforcement learning for robot position and force control, as well as continuous time reinforcement learning for robot force control In-depth examinations of robot control in worst-case uncertainty using reinforcement learning and the control of redundant robots using multi-agent reinforcement learning Perfect for senior undergraduate and graduate students, academic researchers, and industrial practitioners studying and working in the fields of robotics, learning control systems, neural networks, and computational intelligence, Human-Robot Interaction Control Using Reinforcement Learning is also an indispensable resource for students and professionals studying reinforcement learning.

Human-Robot Interaction Control Using Reinforcement Learning

Human-Robot Interaction Control Using Reinforcement Learning PDF Author: Wen Yu
Publisher: John Wiley & Sons
ISBN: 1119782740
Category : Technology & Engineering
Languages : en
Pages : 290

Get Book

Book Description
A comprehensive exploration of the control schemes of human-robot interactions In Human-Robot Interaction Control Using Reinforcement Learning, an expert team of authors delivers a concise overview of human-robot interaction control schemes and insightful presentations of novel, model-free and reinforcement learning controllers. The book begins with a brief introduction to state-of-the-art human-robot interaction control and reinforcement learning before moving on to describe the typical environment model. The authors also describe some of the most famous identification techniques for parameter estimation. Human-Robot Interaction Control Using Reinforcement Learning offers rigorous mathematical treatments and demonstrations that facilitate the understanding of control schemes and algorithms. It also describes stability and convergence analysis of human-robot interaction control and reinforcement learning based control. The authors also discuss advanced and cutting-edge topics, like inverse and velocity kinematics solutions, H2 neural control, and likely upcoming developments in the field of robotics. Readers will also enjoy: A thorough introduction to model-based human-robot interaction control Comprehensive explorations of model-free human-robot interaction control and human-in-the-loop control using Euler angles Practical discussions of reinforcement learning for robot position and force control, as well as continuous time reinforcement learning for robot force control In-depth examinations of robot control in worst-case uncertainty using reinforcement learning and the control of redundant robots using multi-agent reinforcement learning Perfect for senior undergraduate and graduate students, academic researchers, and industrial practitioners studying and working in the fields of robotics, learning control systems, neural networks, and computational intelligence, Human-Robot Interaction Control Using Reinforcement Learning is also an indispensable resource for students and professionals studying reinforcement learning.

A Hybrid Physical and Data-drivApproach to Motion Prediction and Control in Human-Robot Collaboration

A Hybrid Physical and Data-drivApproach to Motion Prediction and Control in Human-Robot Collaboration PDF Author: Min Wu
Publisher: Logos Verlag Berlin GmbH
ISBN: 383255484X
Category : Technology & Engineering
Languages : en
Pages : 212

Get Book

Book Description
In recent years, researchers have achieved great success in guaranteeing safety in human-robot interaction, yielding a new generation of robots that can work with humans in close proximity, known as collaborative robots (cobots). However, due to the lack of ability to understand and coordinate with their human partners, the ``co'' in most cobots still refers to ``coexistence'' rather than ``collaboration''. This thesis aims to develop an adaptive learning and control framework with a novel physical and data-driven approach towards a real collaborative robot. The first part focuses on online human motion prediction. A comprehensive study on various motion prediction techniques is presented, including their scope of application, accuracy in different time scales, and implementation complexity. Based on this study, a hybrid approach that combines physically well-understood models with data-driven learning techniques is proposed and validated through a motion data set. The second part addresses interaction control in human-robot collaboration. An adaptive impedance control scheme with human reference estimation is presented. Reinforcement learning is used to find optimal control parameters to minimize a task-orient cost function without fully knowing the system dynamic. The proposed framework is experimentally validated through two benchmark applications for human-robot collaboration: object handover and cooperative object handling. Results show that the robot can provide reliable online human motion prediction, react early to human motion variation, make proactive contributions to physical collaborations, and behave compliantly in response to human forces.

Designing Robot Behavior in Human-Robot Interactions

Designing Robot Behavior in Human-Robot Interactions PDF Author: Changliu Liu
Publisher: CRC Press
ISBN: 0429602855
Category : Computers
Languages : en
Pages : 206

Get Book

Book Description
In this book, we have set up a unified analytical framework for various human-robot systems, which involve peer-peer interactions (either space-sharing or time-sharing) or hierarchical interactions. A methodology in designing the robot behavior through control, planning, decision and learning is proposed. In particular, the following topics are discussed in-depth: safety during human-robot interactions, efficiency in real-time robot motion planning, imitation of human behaviors from demonstration, dexterity of robots to adapt to different environments and tasks, cooperation among robots and humans with conflict resolution. These methods are applied in various scenarios, such as human-robot collaborative assembly, robot skill learning from human demonstration, interaction between autonomous and human-driven vehicles, etc. Key Features: Proposes a unified framework to model and analyze human-robot interactions under different modes of interactions. Systematically discusses the control, decision and learning algorithms to enable robots to interact safely with humans in a variety of applications. Presents numerous experimental studies with both industrial collaborative robot arms and autonomous vehicles.

Robot Learning from Human Demonstration

Robot Learning from Human Demonstration PDF Author: Sonia Dechter
Publisher: Springer Nature
ISBN: 3031015703
Category : Computers
Languages : en
Pages : 109

Get Book

Book Description
Learning from Demonstration (LfD) explores techniques for learning a task policy from examples provided by a human teacher. The field of LfD has grown into an extensive body of literature over the past 30 years, with a wide variety of approaches for encoding human demonstrations and modeling skills and tasks. Additionally, we have recently seen a focus on gathering data from non-expert human teachers (i.e., domain experts but not robotics experts). In this book, we provide an introduction to the field with a focus on the unique technical challenges associated with designing robots that learn from naive human teachers. We begin, in the introduction, with a unification of the various terminology seen in the literature as well as an outline of the design choices one has in designing an LfD system. Chapter 2 gives a brief survey of the psychology literature that provides insights from human social learning that are relevant to designing robotic social learners. Chapter 3 walks through an LfD interaction, surveying the design choices one makes and state of the art approaches in prior work. First, is the choice of input, how the human teacher interacts with the robot to provide demonstrations. Next, is the choice of modeling technique. Currently, there is a dichotomy in the field between approaches that model low-level motor skills and those that model high-level tasks composed of primitive actions. We devote a chapter to each of these. Chapter 7 is devoted to interactive and active learning approaches that allow the robot to refine an existing task model. And finally, Chapter 8 provides best practices for evaluation of LfD systems, with a focus on how to approach experiments with human subjects in this domain.

Cognitive Computing for Human-Robot Interaction

Cognitive Computing for Human-Robot Interaction PDF Author: Mamta Mittal
Publisher: Academic Press
ISBN: 0323856470
Category : Computers
Languages : en
Pages : 420

Get Book

Book Description
Cognitive Computing for Human-Robot Interaction: Principles and Practices explores the efforts that should ultimately enable society to take advantage of the often-heralded potential of robots to provide economical and sustainable computing applications. This book discusses each of these applications, presents working implementations, and combines coherent and original deliberative architecture for human–robot interactions (HRI). Supported by experimental results, it shows how explicit knowledge management promises to be instrumental in building richer and more natural HRI, by pushing for pervasive, human-level semantics within the robot's deliberative system for sustainable computing applications. This book will be of special interest to academics, postgraduate students, and researchers working in the area of artificial intelligence and machine learning. Key features: Introduces several new contributions to the representation and management of humans in autonomous robotic systems; Explores the potential of cognitive computing, robots, and HRI to generate a deeper understanding and to provide a better contribution from robots to society; Engages with the potential repercussions of cognitive computing and HRI in the real world. Introduces several new contributions to the representation and management of humans in an autonomous robotic system Explores cognitive computing, robots and HRI, presenting a more in-depth understanding to make robots better for society Gives a challenging approach to those several repercussions of cognitive computing and HRI in the actual global scenario

Trends in Control and Decision-Making for Human–Robot Collaboration Systems

Trends in Control and Decision-Making for Human–Robot Collaboration Systems PDF Author: Yue Wang
Publisher: Springer
ISBN: 3319405330
Category : Technology & Engineering
Languages : en
Pages : 418

Get Book

Book Description
This book provides an overview of recent research developments in the automation and control of robotic systems that collaborate with humans. A measure of human collaboration being necessary for the optimal operation of any robotic system, the contributors exploit a broad selection of such systems to demonstrate the importance of the subject, particularly where the environment is prone to uncertainty or complexity. They show how such human strengths as high-level decision-making, flexibility, and dexterity can be combined with robotic precision, and ability to perform task repetitively or in a dangerous environment. The book focuses on quantitative methods and control design for guaranteed robot performance and balanced human experience from both physical human-robot interaction and social human-robot interaction. Its contributions develop and expand upon material presented at various international conferences. They are organized into three parts covering: one-human–one-robot collaboration; one-human–multiple-robot collaboration; and human–swarm collaboration. Individual topic areas include resource optimization (human and robotic), safety in collaboration, human trust in robot and decision-making when collaborating with robots, abstraction of swarm systems to make them suitable for human control, modeling and control of internal force interactions for collaborative manipulation, and the sharing of control between human and automated systems, etc. Control and decision-making algorithms feature prominently in the text, importantly within the context of human factors and the constraints they impose. Applications such as assistive technology, driverless vehicles, cooperative mobile robots, manufacturing robots and swarm robots are considered. Illustrative figures and tables are provided throughout the book. Researchers and students working in controls, and the interaction of humans and robots will learn new methods for human–robot collaboration from this book and will find the cutting edge of the subject described in depth.

Human-in-the-loop Learning and Control for Robot Teleoperation

Human-in-the-loop Learning and Control for Robot Teleoperation PDF Author: Chenguang Yang
Publisher: Elsevier
ISBN: 0323958435
Category : Computers
Languages : en
Pages : 268

Get Book

Book Description
Human-in-the-loop Learning and Control for Robot Teleoperation presents recent, research progress on teleoperation and robots, including human-robot interaction, learning and control for teleoperation with many extensions on intelligent learning techniques. The book integrates cutting-edge research on learning and control algorithms of robot teleoperation, neural motor learning control, wave variable enhancement, EMG-based teleoperation control, and other key aspects related to robot technology, presenting implementation tactics, adequate application examples and illustrative interpretations. Robots have been used in various industrial processes to reduce labor costs and improve work efficiency. However, most robots are only designed to work on repetitive and fixed tasks, leaving a gap with the human desired manufacturing effect. Introduces research progress and technical contributions on teleoperation robots, including intelligent human-robot interactions and learning and control algorithms for teleoperation Presents control strategies and learning algorithms to a teleoperation framework to enhance human-robot shared control, bi-directional perception and intelligence of the teleoperation system Discusses several control and learning methods, describes the working implementation and shows how these methods can be applied to a specific and practical teleoperation system

Human-in-the-Loop Robot Control and Learning

Human-in-the-Loop Robot Control and Learning PDF Author: Luka Peternel
Publisher: Frontiers Media SA
ISBN: 2889633128
Category :
Languages : en
Pages : 229

Get Book

Book Description
In the past years there has been considerable effort to move robots from industrial environments to our daily lives where they can collaborate and interact with humans to improve our life quality. One of the key challenges in this direction is to make a suitable robot control system that can adapt to humans and interactively learn from humans to facilitate the efficient and safe co-existence of the two. The applications of such robotic systems include: service robotics and physical human-robot collaboration, assistive and rehabilitation robotics, semi-autonomous cars, etc. To achieve the goal of integrating robotic systems into these applications, several important research directions must be explored. One such direction is the study of skill transfer, where a human operator’s skilled executions are used to obtain an autonomous controller. Another important direction is shared control, where a robotic controller and humans control the same body, tool, mechanism, car, etc. Shared control, in turn invokes very rich research questions such as co-adaptation between the human and the robot, where the two agents can benefit from each other’s skills or must adapt to each other’s behavior to achieve effective cooperative task executions. The aim of this Research Topic is to help bridge the gap between the state-of-the-art and above-mentioned goals through novel multidisciplinary approaches in human-in-the-loop robot control and learning.

Robot Learning Human Skills and Intelligent Control Design

Robot Learning Human Skills and Intelligent Control Design PDF Author: Chenguang Yang
Publisher: CRC Press
ISBN: 1000395170
Category : Technology & Engineering
Languages : en
Pages : 190

Get Book

Book Description
In the last decades robots are expected to be of increasing intelligence to deal with a large range of tasks. Especially, robots are supposed to be able to learn manipulation skills from humans. To this end, a number of learning algorithms and techniques have been developed and successfully implemented for various robotic tasks. Among these methods, learning from demonstrations (LfD) enables robots to effectively and efficiently acquire skills by learning from human demonstrators, such that a robot can be quickly programmed to perform a new task. This book introduces recent results on the development of advanced LfD-based learning and control approaches to improve the robot dexterous manipulation. First, there's an introduction to the simulation tools and robot platforms used in the authors' research. In order to enable a robot learning of human-like adaptive skills, the book explains how to transfer a human user’s arm variable stiffness to the robot, based on the online estimation from the muscle electromyography (EMG). Next, the motion and impedance profiles can be both modelled by dynamical movement primitives such that both of them can be planned and generalized for new tasks. Furthermore, the book introduces how to learn the correlation between signals collected from demonstration, i.e., motion trajectory, stiffness profile estimated from EMG and interaction force, using statistical models such as hidden semi-Markov model and Gaussian Mixture Regression. Several widely used human-robot interaction interfaces (such as motion capture-based teleoperation) are presented, which allow a human user to interact with a robot and transfer movements to it in both simulation and real-word environments. Finally, improved performance of robot manipulation resulted from neural network enhanced control strategies is presented. A large number of examples of simulation and experiments of daily life tasks are included in this book to facilitate better understanding of the readers.

Interactive Collaborative Robotics

Interactive Collaborative Robotics PDF Author: Andrey Ronzhin
Publisher: Springer
ISBN: 3319995820
Category : Computers
Languages : en
Pages : 302

Get Book

Book Description
This book constitutes the proceedings of the Third International Conference on Interactive Collaborative Robotics, ICR 2018, held in Leipzig, Germany, in September 2018, as a satellite event of the 20th International Conference on Speech and Computer, SPECOM 2018. The 30 papers presented in this volume were carefully reviewed and selected from 51 submissions. The papers presents challenges of human-robot interaction, robot control and behavior in social robotics and collaborative robotics, as well as applied robotic and cyberphysical systems.