Dynamic Interconnection and Damping Injection for Input-to-State Stable Bilateral Teleoperation
Yuan Yang, Daniela Constantinescu, Yang Shi

TL;DR
This paper introduces a novel control strategy for bilateral teleoperation that ensures exponential input-to-state stability despite time-varying delays and unpredictable user and environment forces, without requiring their explicit modeling.
Contribution
It proposes a dynamic interconnection and damping injection controller that robustly synchronizes master and slave robots under uncertain conditions, ensuring stability and convergence.
Findings
Ensures exponential input-to-state stability in teleoperation with delays.
Confines position error to an invariant set and drives it exponentially to a global attractor.
Robustly synchronizes master and slave robots under user and environment perturbations.
Abstract
In bilateral teleoperation, the human who operates the master and the environment which interacts with the slave are part of the force feedback loop. Yet, both have time-varying and unpredictable dynamics and are challenging to model. A conventional strategy for sidestepping the demand for their models in the stability analysis is to assume passive user and environment, and to control the master-communications-slave system to be passive as well. This paper circumvents the need to model the user and environment in a novel way: it regards their forces as external excitations for a semi-autonomous force feedback loop, which it outfits with a dynamic interconnection and damping injection controller that renders bilateral teleoperation with time-varying delays exponentially input-to-state stable. The controller uses the position and velocity measurements of the local robot and the delayed…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTeleoperation and Haptic Systems · Robot Manipulation and Learning · Soft Robotics and Applications
Dynamic Interconnection and Damping Injection for Input-to-State Stable Bilateral Teleoperation
Yuan Yang, Daniela Constantinescu, and Yang Shi The authors are with the Department of Mechanical Engineering, University of Victoria, Victoria, BC V8W 2Y2 Canada (e-mail: [email protected]; [email protected]; [email protected]).
Abstract
In bilateral teleoperation, the human who operates the master and the environment which interacts with the slave are part of the force feedback loop. Yet, both have time-varying and unpredictable dynamics and are challenging to model. A conventional strategy for sidestepping the demand for their models in the stability analysis is to assume passive user and environment, and to control the master-communications-slave system to be passive as well. This paper circumvents the need to model the user and environment in a novel way: it regards their forces as external excitations for a semi-autonomous force feedback loop, which it outfits with a dynamic interconnection and damping injection controller that renders bilateral teleoperation with time-varying delays exponentially input-to-state stable. The controller uses the position and velocity measurements of the local robot and the delayed position transmitted from the other robot to robustly synchronize the master and slave under the user and environment perturbations. Lyapunov-Krasovskii stability analysis shows that the proposed strategy (i) can confine the position error between the master and slave to an invariant set, and (ii) can drive it exponentially to a globally attractive set. Thus, the dynamic interconnection and damping injection approach has practical relevance for telemanipulation tasks with given precision requirements.
I Introduction
As a tool for remote sensing and manipulation, a bilateral teleoperator strives to synchronize its master and slave robots tightly, and to provide its human operator with useful haptic cues about the slave-environment interactions. Therefore, the bilateral teleoperation feedback loop includes the human who operates the master, the environment which interacts with the slave and the master-communications-slave system [1]. Because operators vary their dynamics according to their volition, and environments are typically unknown, neither are predictable or trvial to model [2]. Additionally, the master and slave exchange information distorted by time-varying communication delays [3]. Thus, bilateral teleoperation is a nonlinear, time-varying and interconnected system with communication delays and uncertain user and environment dynamics [4].
The physical interactions between the robotic master-communications-slave system (aka the teleoperator) and the user and the environment (aka its external terminators) involve exchange of energy [5]. As a key theory for modeling and controlling the exchange of energy among interconnected systems, passivity is ofen pivotal to the rigorous treatment of closed-loop teleoperation without user and environment models [6]. Existing research exploits the stability of the feedback interconnection of passive systems by assuming passive operator and environment and by employing Lyapunov-like analysis [7] or energy monitoring [8] to offer controllers which maintain teleoperators with time delays passive.
Scattering-based, damping injection and adaptive strategies can all be designed to provably stabilize bilateral teleoperation with a unified Lyapunov-like energy function. Scattering or wave-based control can render the time-delayed communication channel passive, as well as reduce wave reflections [9] and improve trajectory tracking [10, 11] and transparency [12, 13, 14, 15, 11]. Damping injection control, Proportional-Derivative plus damping (PD+d) [16] or Proportional plus damping (P+d) [17], and extensions to position-force architectures with and without gravity compensation [18, 19, 20], output feedback [21] and bounded actuation [22, 23, 24] implement a virtual spring between, and local dampers at, the master and slave sites. Joint-space [25, 26] and task-space [27, 28] adaptive strategies can synchronize master and slave robots with uncertain parameters and constant delays.
Energy monitoring-based control can render the teleoperator passive by dynamic damping injection, dynamic modulation of the nominal control force, or both. Time-domain passivity control [29, 30] and extensions to eliminate position drift [31] inject sufficient damping to dissipate the delay-induced energy at each step. The energy bounding [32] and passive set-position modulation (PSPM) [33] strategies regulate the nominal control inputs to ensure that the teleoperator generates less energy than its physical and control damping dissipates. The two-layer approach [8, 34] modulates the forces computed in the transparency layer and adds damping in the passivity layer to limit energy accumulation in the system.
Input-output stability provides another path to rigorous stability of time-delay systems with uncertain dynamics [35]. In particular, input-to-state stability has diminished the conservatism of passive strategies in haptic rendering [36], and has offered robust position tracking for time-delayed bilateral shared control of an aerial vehicle [37].
This paper introduces a novel dynamic interconnection and damping injection strategy for robust position tracking in time-delayed bilateral teleoperation based on a position-position structure. While force-reflection [38, 39, 8, 34] and force-reproduction [40, 41, 42, 43] architectures can improve transparency, force and acceleration measurements are unavailable or noisy for many commercial robots. Therefore, the proposed controllers employ only the position and velocity of the local robot and the delayed position of the remote robot. Rigorous Lyapunov stability analysis proves that they render the teleoperator input-to-state stable (ISS).
The P+d [17], PSPM [33] and two-layer [8, 44] approaches are most closely related to the dynamic strategy introduced in this paper. Whereas the P+d and PSPM algorithms synchronize the master and slave exactly in the absence of user and environment forces but over-inject constant damping compared to the two-layer method, the dynamic strategy proposed in this paper offers a unique property for robust position tracking in time-delayed bilateral teleoperation: given full (unlimited) actuation, it can confine the master-slave position error to a prescribed invariant set, and can drive it exponentially to a globally attractive set which includes the origin. More importantly, the control gains determine the Lebesgue measure of the invariant and globally attractive sets, and the rate of convergece to the latter. Therefore, sufficiently large control gains can tighten the master-slave coupling, and can indirectly convey the slave-environment interactions to the operator [34]. The unique property of the dynamic interconnection and damping injection strategy is advantageous for high-precision telemanipulation tasks with position tracking error constraints.
II Preliminaries
II-A System Dynamics
Let the master and slave robots be -degree-of-freedom (-DOF) serial manipulators with revolute joints. Their joint space dynamics are:
[TABLE]
where the subscript indexes master and slave quantities, , and are joint acceleration, velocity and position, and are matrices of inertia and of Coriolis and centrifugal effects, are control torques, and and are user and environment torques.
The following properties of the dynamics (1), and assumptions on communication delays and on user and environment torques, facilitate later control design and stability analysis.
- P.1
The inertia matrix is symmetric, positive definite and uniformly bounded by , with and positive constants. 2. P.2
The matrix is skew-symmetric. 3. P.3
There exists such that .
- A.1
The time-varying communication delays from robot to robot , , are bounded, , for . 2. A.2
The joint torques due to operator and environment forces are bounded by , .
II-B Input-to-State Stability
This section overviews the definitions and theorems required by the stability analysis in Section III.
A function is of class if it is continuous, strictly increasing and ; of class if it is of class and unbounded; of class if it decreases to zero as its argumet tends to . A function is of class if it is of class in its first argument and of class in the second argument. Let denote the set of the continuous functions defined on and with values in . For any essentially bounded function , let and be a norm of such that:
[TABLE]
for some positive reals and .
- D.1
[45] The nonlinear delay-free system
[TABLE]
is ISS with input and state if there exist functions and such that:
[TABLE] 2. D.2
[46] The nonlinear time-delay system:
[TABLE]
with the standard function , and the maximum involved delay, , and , is ISS with input and state if there exist functions and such that:
[TABLE]
Because the time-delay system (5) is infinite dimensional [35], the input-to-state stability of it is defined differently than that of the delay-free system (3). Correspondingly, the following two theorems using ISS-Lyapunov functions and Lyapunov-Krasovskii functionals facilitate proving ISS teleoperation without delays and with time-varying delays, respectively.
- T.1
[45] The delay-free system (3) is ISS if and only if there exist an ISS-Lyapunov function , and functions , such that:
- (a)
, ; 2. (b)
, . 2. T.2
[46] The time-delay system (5) is ISS if there is a Lyapunov-Krasovskii functional , functions , such that:
- (a)
, ; 2. (b)
, .
III Main Result
This section presents the control design and stability analysis for ISS bilateral teleoperation, considering communications both without, and with time-varying, delays.
III-A ISS Teleoperation Without Time Delays
Define sliding surfaces for the master and slave robots by:
[TABLE]
where is a constant to be determined. Then, the dynamics (1) can be transformed to:
[TABLE]
where the state-dependent master and slave mismatches are:
[TABLE]
The master and slave receive each other’s position instantly, and their dynamic interconnection and damping injection controllers are:
[TABLE]
where , and , , are diagonal positive definite gain matrices to be designed.
Remark 1**.**
The velocity-dependent gains are designed to suppress the state-dependent mismatch in (9). Rewritting (10) in the form:
[TABLE]
where and , reveals that the controller dynamically modulates the master-slave interconnection and the local damping through . The transformed system dynamics (8) are input-output passive with input and output , where and , respectively. However, the teleoperator (1) in closed-loop with the controller (10) is not guaranteed stable because the modulated interconnection may be non-passive [33] and thus may render the teleoperator non-passive. The following rigorous analysis is required to show ISS teleoperation.
The following Lyapunov candidate:
[TABLE]
serves to evaluate stability. After using property P.2, the time derivative of along the closed-loop dynamics (8) with the control (10) can be evaluated as:
[TABLE]
The definitions of in (9) together with properties P.1 and P.3 lead to the following inequalities for :
[TABLE]
Remark 2**.**
The inequalities (13) show that the impact of master and slave mismatches can be upper-bounded using the velocities of the two robots and their position error. Thus, they indicate the demand for a dynamic interconnection and damping injection strategy. More specifically, as will be illustrated in (19), the terms in inequalities (13) can be dominated by selecting velocity-dependent gains in the controls . Alternatively, the terms \Big{|}\mathbf{s}^{\mathsf{T}}_{i}\mathbf{C}_{i}(\mathbf{q}_{i},\dot{\mathbf{q}}_{i})\cdot(\mathbf{q}_{m}-\mathbf{q}_{s})\Big{|} can be bounded by , and the gains can be updated based on the master-slave position error. Therefore, both the master and slave velocities and their position error can be used to dynamically modulate their coupling and local damping injection, to achieve ISS bilateral teleoperation.
The definitions of the sliding surfaces , lead to:
[TABLE]
where , and, similarly, to:
[TABLE]
where . Further algebraic manipulations yield:
[TABLE]
where , .
After substitutions from Equations (13)-(16), the derivative of the Lyapunov candidate (12) can then be bounded by:
[TABLE]
where:
[TABLE]
Theorem 1**.**
The teleoperator (1) with the control (10) is ISS with input and state if the control gains , , , and positive parameters , , , , satisfy:
[TABLE]
Proof.
The definitions of the sliding surfaces imply that:
[TABLE]
Then, Property P.1 and Equations (11) and (20) lead to:
[TABLE]
for the minimum eigenvalue of , and with:
[TABLE]
and also to
[TABLE]
for the maximum eigenvalue of , and with:
[TABLE]
Because functions and are of class , satisfies condition a) of Theorem T.1.
If condition (19) is satisfied, in (17) can be further upper-bounded by:
[TABLE]
where . Then, choosing class functions:
[TABLE]
ensures that in (11) also satisfies condition b) of Theorem T.1 and thus, that the teleoperator is ISS. ∎
Corollary 1**.**
ISS teleoperation under the control (10) renders invariant the set:
[TABLE]
and globally exponentially attractive the set:
[TABLE]
where .
Proof.
Time integration of in (23) yields:
[TABLE]
which, together with (21), complete the proof. ∎
III-B ISS Teleoperation With Time-Varying Delays
For each robot, construct the following auxiliary system (proxy):
[TABLE]
where: and ; ; , , , and are diagonal positive definite matrices to be determined; and is the output of the auxiliary system of robot received with a delay by robot . Let the sliding surface of the proxy of robot be:
[TABLE]
with:
[TABLE]
Then, the auxiliary dynamics can be rearranged in the form:
[TABLE]
Let the sliding surface of robot be:
[TABLE]
with . As in Section III-A, the master and slave dynamics can be transformed into (8) but with mismatch:
[TABLE]
Correspondingly, the master and slave controllers are designed by:
[TABLE]
with and diagonal positive definite gain matrices to be determined.
Remark 3**.**
The auxiliary systems (28) have inertia , are connected to each other through static Proportional control, and are driven by the master and slave through static interconnection and damping control. In contrast, the master and slave are connected to their proxies by the dynamic interconnection and damping injection controls (34), which are updated according to each robot velocity . Thus, the delays distort only information transmitted between statically coupled proxies and classical damping injection [17] can overcome their destabilizing effect. The state-dependent mismatches in (33) affect only the master and slave, as in the case of non-delayed communications in Section III-A. The dynamic control strategy (34) will be designed in (37) to address these mismatches.
Stability is validated using the Lyapunov candidate with:
[TABLE]
where , , and the following lemma [18]:
- L.1
[18] For any positive definite matrix and vectors and with appropriate dimensions, the following inequality holds:
[TABLE]
Using property P.2, the time derivative of along the transformed master and slave dynamics (8) and their auxiliary dynamics (31) is:
[TABLE]
Further, the definition of mismatches in (33) leads to:
[TABLE]
The sliding surfaces (32) imply that:
[TABLE]
with . Similarly, the sliding surfaces (29) imply that:
[TABLE]
with a positive constant, and that:
[TABLE]
with another positive constant.
The derivative of is bounded by:
[TABLE]
[TABLE]
where and .
After substitution from (37)-(40), (42) and (16), the sum of (36) and (41) leads to:
[TABLE]
where:
[TABLE]
Letting and using the definition of in (30) lead to:
[TABLE]
where with and:
[TABLE]
Proposition 1**.**
Let:
[TABLE]
and:
[TABLE]
for . Then there exists such that:
[TABLE]
Proof.
It suffices to show that is positive definite. By the Schur complement decomposition, if and only if:
[TABLE]
From (46)-(48), it follows that , that:
[TABLE]
and, further, that:
[TABLE]
∎
Theorem 2**.**
The teleoperator (1) in closed-loop with (28) and (34) is ISS with input and state if the parameters and control gains satisfy conditions (47)-(48) and:
[TABLE]
where and .
Proof.
The definitions of and , , imply that:
[TABLE]
and that:
[TABLE]
Because and
[TABLE]
where and are the maximum eigenvalue of and , the Lyapunov candidate can be lower-bounded by:
[TABLE]
where and are the minimum eigenvalue of and , and is a function of class with:
[TABLE]
Further, the definition of indicates that:
[TABLE]
where is the maximum eigenvalue of . Then can be upper-bounded by:
[TABLE]
where with
[TABLE]
Let and , define to satisfy (2), and select functions and of class to trivially guarantee condition a) of Theorem T.2.
After substitution from (45) in (43), using condition (50) and setting , can be upper-bounded by:
[TABLE]
Then the functions and of class and defined by:
[TABLE]
ensure condition b) of Theorem T.2 [46].
Thus, the Lyapunov candidate obeys both conditions of Theorem T.2 [46] and the teleoperator is ISS. ∎
Corollary 2**.**
ISS teleoperation renders invariant the set:
[TABLE]
and globally attractive the set:
[TABLE]
where .
Proof.
Time integration of (57) leads to:
[TABLE]
while the definition of implies that
[TABLE]
and completes the proof. ∎
III-C Discussion
Closed-loop bilateral teleoperation includes uncertain and practically uncontrollable user and environment dynamics. To robustly stabilize closed-loop teleoperation, this paper regards the user and environment forces as time-varying and unpredictable teleoperator inputs, and designs controllers to render the teleoperator input-to-state stable. ISS teleoperation guarantees robust position synchronization of the master and slave under user and environment perturbations [47], and thus, reflects slave-environment interactions to the operator [34]. According to the definitions in Section II-B, ISS teleoperation implies: (i) ; and (ii) if . Thus, ISS teleoperation matches the stability definition in [33] for bilateral teleoperation.
According to Corollary 1 and Corollary 2, an invariant set and a globally attractive set characterize the master-slave position error of ISS teleoperation: the error stays in and exponentially approaches for . The Lebesgue measure of and can be reduced by increasing , , and . The speed of (exponential) convergence to is determined by . When the user and environment forces disppear, the steady-state position error becomes zero by the definition of input-to-state stability.
The controllers (10) and (34) assume gravity-compensated master and slave. Inaccurate gravity compensation can introduce bounded disturbances , , in practical teleoperation systems. By including in the teleoperator input , the proposed dynamic strategy can render the teleoperator ISS with the augmented input and the same state as defined in Theorem 1 and Theorem 2. Alternatively, minor modifications of adaptive control techniques [26] can be employed in the design to provide parameter estimates and to facilitate position synchronization.
IV Conclusions
This paper has presented a constructive dynamic interconnection and damping injection strategy for robust stabilization of bilateral teleoperation without, and with, time-varying delays. Lyapunov stability analysis has proven that the proposed strategy renders bilateral teleoperation exponentially input-to-state stable, even in the presence of time-varying delays. It has also shown that an invariant set and a globally attractive set characterize the master-slave position errors during teleoperation under the control of the proposed strategy. Suitable selection and updating of the control gains can decrease the master-slave position error to any prescribed level with a certain rate of convergence and, thus, can improve robust position tracking performance.
Practical teleoperation systems suffer from inaccurate gravity compensation and unreliable velocity measurements. Disturbances caused by inaccurate gravity compensation can increase position tracking errors. Unreliable velocity measurements impede damping injection and the modulation of control gains and thus, can destabilize the teleoperation. Future work will focus on input-to-state stability of bilateral teleoperators without gravity compensation and velocity measurements.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Y.-C. Liu and N. Chopra, “Control of semi-autonomous teleoperation system with time delays,” Automatica , vol. 49, no. 6, pp. 1553–1565, 2013.
- 2[2] S. Hirche and M. Buss, “Human-oriented control for haptic teleoperation,” Proceedings of the IEEE , 2012.
- 3[3] E. J. RodrÍguez-Seda, D. Lee, and M. W. Spong, “Experimental comparison study of control architectures for bilateral teleoperators,” IEEE Transactions on Robotics , vol. 25, no. 6, pp. 1304–1318, 2009.
- 4[4] H. Ito, P. Pepe, and Z.-P. Jiang, “A small-gain condition for iiss of interconnected retarded systems based on lyapunov–krasovskii functionals,” Automatica , vol. 46, no. 10, pp. 1646–1656, 2010.
- 5[5] C. Secchi, S. Stramigioli, and C. Fantuzzi, Control of interactive robotic interfaces: A port-Hamiltonian approach . Springer Science & Business Media, 2007, vol. 29.
- 6[6] P. F. Hokayem and M. W. Spong, “Bilateral teleoperation: An historical survey,” Automatica , vol. 42, no. 12, pp. 2035 – 2057, 2006.
- 7[7] E. Nuño, L. Basañez, and R. Ortega, “Passivity-based control for bilateral teleoperation: A tutorial,” Automatica , vol. 47, no. 3, pp. 485 – 495, 2011.
- 8[8] M. Franken, S. Stramigioli, S. Misra, C. Secchi, and A. Macchelli, “Bilateral telemanipulation with time delays: A two-layer approach combining passivity and transparency,” IEEE Transactions on Robotics , vol. 27, no. 4, pp. 741–756, 2011.
