2. Related Literature
One of the most significant capabilities of MARS is cooperation among the agents in order to achieve efficiently a common goal. The first thing one must consider during the designing phase of a MARS, is to determine the kind of cooperation among the system’s agents. In this work, we consider a multi-robot fleet consisted of unicycle mobile robots. Thus, the first step is to determine the formation architecture of the fleet. Many studies have been conducted referring around the subject of the formation control of multiple mobile robots as mentioned in [
6,
7,
8,
9,
10,
11,
12,
13,
14,
15,
16,
17,
18,
19]. Most of these works propose a formation based on the graph theory, meaning that they can perform from complex shapes to more simple, like a straight line (leader-follower formation). The authors in [
6,
7,
8,
9,
10,
11,
12,
13,
14] propose a strategy focused on a communication network. The paper [
20] introduces a unified coordinated control scheme developed for networked multi-robot systems, with a particular emphasis on object transportation. This scheme incorporates a discontinuous cooperative control law for individual sub-formations around targets, complemented by a continuous control protocol designed to tackle implementation challenges. Another approach many researchers have adopted is the use of artificial potential fields [
21,
22] as well as the exploitation of a reference point for their system like a camera placed in the ceiling or a 360° camera mounted on each robotic agent [
15,
16,
17,
18,
19].
Moreover, the authors in [
23,
24,
25,
26] propose a vision based algorithm to solve the formation control problem thus introducing various constraints into the system’s design. This means that each robot must keep its predecessor in its Field Of View (FOV). Particularly, in [
23] the authors use a novel Lyapunov barrier function to deal with the system’s constraints while using a recursive adaptive backstepping method and Neural Network approximation to solve the formation tracking problem. Similarly, the authors in [
24] proposed a robust depth-based visual predictive controller, which optimizes the trajectory planned while taking into account the constraints presented by the visual feedback. On the other hand, in [
25] a differential game is suggested where one agent stays within the FOV of the other in a set workspace. Moreover, in [
26], the relative position and bearing angle between the predecessor and follower are obtained using a camera. This work integrates the kinematics of the robot with Lyapunov theory to effectively address formation control.
One common requirement for the aforementioned algorithms to work, is the fact that the follower robot should always have the preceding robot in its line of sight (LOS) which should never break when an obstruction occurs. That is why vision based algorithms suffer under presented occlusions in the workspace, so various researchers [
27,
28,
29,
30] have studied how to maintain visual connectivity between agents to resolve this problem. In [
27], the researchers use an RGB-D camera to solve the formation control problem while detecting and avoiding obstacles as well as preserving the predecessor in the follower’s FOV. Also, a similar approach is adopted in [
28], where two methods are proposed for serial and parallel formation tracking based on Lyapunov theory and vision constraints, capable of obstacle avoidance and vision maintenance. Moreover, the authors in [
29] approach the visual obstruction in a different way, they place virtual predecessor at the last known place it was shown and after some time they expect to have visual connectivity. In a similar fashion, in reference [
30], a visual based algorithm with collision avoidance capabilities is proposed, considering the limitations of the hardware and applying them to a correction system where a negative gradient, achieves the formation tracking.
It is of vital importance to venture further into the obstacle avoidance methods like in [
31,
32,
33,
34,
35]. In [
31], a controller is designed based on a fuzzy cascaded PID method, which employs artificial potential algorithm to avoid obstacles and ensure the fleet stays in formation. Similarly, in [
32] the authors propose an artificial potential function, which does not stuck in local minima, and by utilizing the Lyapunov theorem and Riccati equations they ensure stability of the suggested formation. Another interesting approach is proposed in [
33], where the robot follows a human while avoiding obstacles. The task was formulated as a receding-horizon optimization problem and was solved under the Nonlinear Model Predictive Control (NMPC) framework, while an Extended Kalman Filter (EKF) is integrated into the robot’s controller for the human’s movements. Furthermore, the authors in [
34] propose a scheme for cooperative reconnaissance of multiple unmanned ground vehicles. Initially, the robotic agents are exploring the partially known workspace and secondly the agents get into formation and transverse the set space. Lastly, in [
35] a dynamic leader-follower formation robust controller is proposed. This approach utilizes the relative position of each robot pair, explores the situation where an agent fails and showcases how the fleet adapts in a case like this.
Contribution
In this work, we aim at extending the control algorithm in [
36], that solves the motion coordination of multiple wheeled robots, by incorporating hard input constraints to the system along with the soft constraints regarding the output performance. When the velocity of a robot follower gets saturated, due to the actuation limitations standing as hard constraint, it is a possible that the robot starts losing visual contact with its predecessor due to the collision avoidance protocol. For this reason, we propose a new event-triggered decentralized control system that every follower sends a signal to its predecessor to slow down when some criteria are met, thus guaranteeing safe passage for all mobile robots of the fleet.
Each of these robotic agents is equipped with proximity sensors, which allow them to measure the distance to the nearest obstacles on the workspace and a front monocular camera with limited FOV that allows any robot follower to get its relative position and bearing angle to its preceding robot. Furthermore, the leader of the robot fleet is the only one capable of localizing itself within the given workspace and move around without compromising the safety of the platoon. The most crucial part of this work is the design of a decentralized control scheme based on the APC methodology [
37] dealing with input-output constraints, which ensures that the platoon of robots navigates safely through the environment. Additionally, the proposed control protocol assures a-priori visual connectivity between a robot follower and its preceding robot and keeps the predecessor in its FOV at all times while avoiding any obstructions caused by the static obstacles. The main contributions of this work are outlined as follows:
In contrast with [
36], we incorporate hard constraints regarding the actuation capacity of the system. This addition is crucial as it tackles a significant issue encountered when the follower robot reaches its maximum velocity and attempts to avoid an obstacle simultaneously. In such scenarios, maintaining the predefined distance from its predecessor becomes challenging, potentially resulting in an increase in inter-robot distance or even collisions with obstacles. To address this challenge, we dynamically relax the bounds on relative error, treating them as soft constraints that can be relaxed when they conflict with hard constraints. Meanwhile, we ensure adherence to hard constraints, including collision avoidance with obstacles and other agents as well as input limitations.
Contrary to the recent works [
10,
17,
23], we consider multiple input and output, possibly conflicting, constraints, simultaneously. In the presence of multiple hard constraints, i.e., safety and input constraints, we propose a distributed control strategy that leverages unidirectional communication between each robot and its predecessor. By sending signals to force the predecessor to slow down when hard constraints are at risk of being breached, we ensure that the follower maintains visual connectivity and keeps pace.
The proposed control strategy is characterized by simple structure and easy gain selection, which boost its scalability. These characteristics are validated through multiple realistic and complex simulations, as well as a real-time experiment involving two Amigobots.
3. Problem Formulation and Preliminaries
First, let us consider
to be a planar workspace occupied by n static obstacles
, where
with
and the free space is define as
. Additionally, consider a fleet of
robots
, that are disk shaped, with radius
for
with
and obey the unicycle model as follows:
where
and
represent the position and orientation of the
i-th robot with respect to its inertial coordinate frame, respectively and
. Additionally,
denotes the control input, containing the commanded linear and angular velocities, respectively. To account for actuation limitations, the velocity of each robot is constrained within the compact set:
where
is the maximum wheel velocity and
represents half the distance between the two driving wheels. Each robot follower
is equipped with a monocular camera fixed at the robot’s center that extracts the relative position
of the robot
expressed in the camera’s body frame as long as it is detectable. Furthermore, a robot follower’s predecessor
is only visible if:
The robot is located within the field of view of robot ’s camera, which is defined as a sector with angle and radius .
The line segment , or LOS, that connects to does not go through or be interrupted by an obstacle .
In addition,
is the minimum distance allowed between the robots
and
.
Figure 1 shows in depth the parameters explained above.
As mentioned before, all robots are equipped with proximity sensors that can detect obstacles in range
allowing to compute
between the robot and the outer rim of the
. The distances
, which are the minimum distances left or right to the LOS
can be computed using the sign line distance very effectively. Lastly, let us define the relative distance and angle of view corresponding to robot
and
, respectively as:
with
for all followers
. Now, the problem can be precisely formulated as follows.
Problem 1. Assuming that the leader navigates within the workspace , the goal of this work is to design a decentralized control scheme for the constrained input , such that the entire robotic platoon navigates safely within the workspace while there are no collisions to the static obstacles nor inter-robot ones. In this vein, there are specific constraints that must be held as follows:and also every predecessor robot remain within the FOV of follower robot such that: for all time and . Moreover, due to the aforementioned operational constraints the formation of the platoon should keep up a desired inter-robot distance with zero angle of view, meaning that each follower keeps the preceding robot at the center of its camera and at a distance .
To solve the aforementioned problem we operate under the assumption of unidirectional communication, where each robot is capable of transmitting a packet of information exclusively to its predecessor. Additionally, we assume that the initial configuration of robots meets the following condition:
Remark 1. It should be emphasized that the above-mentioned assumptions are not restrictive because they make the problem feasible and ensure that initially all robots are safe and monitor their predecessors, allowing the proposed control method to be implemented. In the presence of input constraints, some form of communication between the robots becomes necessary to guarantee the fulfillment of output constraints at all times. In addition, if the robot fleet is folded and the initial conditions mentioned above are not eligible, then the collision and visibility constraints cannot be met simultaneously. In that scenario there must be a reordering of the robots of the fleet to alleviate the deadlock.
Remark 2. Note that in this work, we do not study the motion planning of the leader robot towards its goal position. Hence, the main goal of this paper is the coordination of the platoon of robots under the multiple constraints mentioned above.
4. Controller Design
In this section, we design the control scheme adopting the APC methodology [
37] to deal with input constraints. In this way, various safety requirements are ensured while collision avoidance and visibility maintenance are guaranteed, in the presence of hard input constraints. The design procedure can be divided in the following steps:
Step 1. Let us initially define the the distance and angle of view errors:
for each robot
. By differentiating
and
with respect to time and substituting
,
to their equivalent in (
3), the error dynamics are obtained as follows:
As observed in
Figure 1, the distance between robots
and
is not influenced by their angular velocities; therefore, the two terms in (
10) correspond to the robots’ projected linear velocities in the direction of their LOS, which determine the rate at which their distance changes. However, the rate of change of the angle of view (
11) is solely affected by the angular velocity of robot
and the cross-radial velocity of the robots.
The control objective is to design the velocity inputs of
, such that the following output constraints are respected:
for all
and for properly designed performance functions
which incorporate the following safety constraints:
These conditions, concerning the performance functions of distance and angle of view errors, guarantee that each follower keeps the preceding robot inside its camera FOV
and prevent collisions with it. The satisfaction of (
12) and (
13) leads, via (
14) and (
15), to:
and therefore owing to the definition of
:
for all
.
Step 2. Following the definition of tracking errors and their associated performance specifications, we proceed to design the ideal distributed control laws governing the linear and angular velocities. These control laws are intended to enforce the prescribed performance attributes on the robots, assuming the absence of input constraints. Next, we design the desired velocity signals for each robot
,
, that impose prescribed performance as dictated by (
12) and (
13). One more step that needs to be done is the calculation of the error transformation for the distance and angle of view. It is worth noting that for appropriately chosen initial value of the performance functions
,
,
,
the transformed errors are finite at
. Thus, we maintain the transformed error signals
and
bounded for all time via the appropriate selection of the velocity control commands. Then, the satisfaction of (
12) and (
13) is guaranteed for all time, owing to the properties of the inverse error mappings
,
. Hence, the constrained problem at hand has been reformulated as a simple unconstrained stabilization problem of the transformed error signals
and
, which is solved using the following velocity control protocol:
with
denoting the maximum linear velocity of
-th robot and
,
are positive control gains.
Step 3. In step 2 we designed the reference control input
that ensures safe navigation with prescribed performance guarantees. Note that
serves as the ideal control signal designed to enforce prescribed output performance specifications on robot
i. Nevertheless, since
is constrained within the compact set
, we exploit a saturation function to produce a feasible control input that obeys the input constraints. Hence, by selecting
and
, as the translational and rotational velocity saturation levels, respectively, we adopt a saturation function
that maps the desired control signals
on the boundary of the set
, based on the radial distance of
from the origin as depicted in
Figure 2.
Thus, the control input incorporating both input and output constraints is obtained by:
Note that in the presence of input limitations each robot might face challenges in keeping its predecessor within its FOV when executing saturated control commands, such as moving at its maximum linear velocity. Maintaining all robots within the FOV of their followers is critical, i.e., a hard constraint, for the coordinated navigation, as only the leader possesses knowledge about the desired path through the workspace. To address this practical problem, each robot sends a signal
to its predecessor. This signal serves to gradually decelerate the predecessor when the distance and FOV performance functions exceed a safety threshold. Specifically, each robot adopts the following distributed control input:
where:
with:
for some positive constants
, denoting the safety thresholds, selected to satisfy
and
.
Step 4. Finally, we design the adaptive performance functions such that all operational and safety requirements are ensured along with input limitations, i.e., the soft error constraints regarding output performance, are adjusted dynamically, to meet the multiple hard constraints of the system. Note that designing such an adaptation mechanism is crucial for ensuring the boundedness of closed-loop signals, as singularities arise when the tracking error exceeds the specified performance envelope. Specifically, we address two common scenarios in which each robot in the fleet reacts to the presence of obstacles. Firstly, considering a static obstacle appearing either to the left or the right side of robot i and its follower, there is a possibility of the obstacle obstructing their path, potentially causing the follower to lose sight of its predecessor or collide with the obstacle. In such instances, the performance functions related to the FOV, i.e., and , must be adjusted to ensure that the LOS of the robot moves away from the obstacle, thereby preventing the risk of losing visibility or collision.
However, in a second scenario, another obstacle may emerge from the opposite side of the robot fleet, rendering the aforementioned maneuver ineffective as it attempts to avoid both obstacles, thereby conflicting with the control command. So, the angle of view is not going to deviate, meaning that the robot follower will probably not be able to successfully avoid the obstacle. A control strategy for the critical case mentioned above, is for the follower to approach its predecessor by reducing the distance performance functions while keeping the distance greater than . Additionally, in presence of hard input constraints, that do not allow the satisfaction of the prescribed performance specifications, the performance functions have to be adjusted online to guarantee the best feasible output response w.r.t. the actuation limitations.
Driven by the aforementioned discussion, we introduce the adaptive performance functions that incorporate input-output and safety constraints as:
where:
with
and
,
and the bump function
S given by (
25). Note that the prescribed performance specifications are incorporated through the parameters of the first term in (
26)–(
29). Particularly, the parameter
determines the exponential rate of convergence of the distance and angle of view errors
,
to compact sets close to the origin with sizes explicitly regulated by
. One point worth mentioning is, that if the constraints in (
14) and (
15) being held, the follower robot is maintaining its predecessor within its camera FOV, while it is avoiding any collisions between the two. Notice that when input saturation is active, i.e.,
the magnitude of the performance update laws (
27)–(
29) increases. This adjustment ensures the appropriate balance between input (hard) and output (soft) constraints, guaranteeing the boundedness of all closed-loop signals. On the other hand, when input saturation is inactive, the performance update laws return to their nominal form, exponentially fast. In particular, if a single obstacle intervenes from the left or right between the follower and the predecessor robot then the terms
and
will increase. This causes the distance performance functions to decrease, meaning that the follower is going to approach its preceding robot. Similarly, in the case of obstacles appearing on both sides of the leader-follower robots, the distance performance functions will increase and the robot follower will get closer to its predecessor. Furthermore, the angle of view performance functions will decrease or increase based on the obstacle’s relative position to the robot, so it deviates its LOS away in order to begin executing the obstacle avoidance maneuver.
Finally, to ensure that the constraints bestowed in (
14) and (
15) regarding the performance functions
,
,
and
are always met, a projection operator [
38] is necessary to be applied over the sets:
and
. The projection operator over a compact convex set
is defined as follows:
where
for a positive number
. The proposed control algorithm (
8)–(
30) is summarized in
Figure 3 for readers’ convenience.
Remark 3. In a multi-robot system, it is common to impose constraints that regulate the distances between all pairs of robots to prevent collisions. The constraints (
16)
and (
17)
establish the minimum and maximum allowable distance between any two robots, ensuring safe navigation and collision avoidance. As a result, while the algorithm primarily prioritize constraints with the predecessor robot and obstacles, it implicitly integrates constraints between all pairs of robots to uphold safe inter-agent distances. Stability Analysis
Theorem 1. Given a planar workspace cluttered with obstacles, consider a platoon of unicycle robots, described by (
1)
, operating under input constraints as well as safety and visual constraints as described in this section. Moreover, the leader robot tracks a feasible path within the workspace and the system initializes under the appropriate conditions so that all the constraints are initially met. The distributed control protocol (
20)–(
29)
guarantees the safe navigation of the robot fleet within the workspace, ensuring collision avoidance with obstacles and maintaining visibility between robots for all . Proof. Based on the formulated problem discussed, the robot fleet takes the form of a line beginning from the leader robot and expanding backwards to the last follower. For this reason, the analysis will be conducted into pairs of follower and predecessor. Consider the Lyapunov function candidate:
Differentiating with respect to time and applying the error dynamics (
10) and (
11):
Hence, substituting the control protocol (
20)–(
29) the above equation takes the form below:
with
Note that the form of (
31) is valid as long as the projection operator (
30) on the performance functions is inactive. However, since (
30) is activated to ensure that
and
, the corresponding tracking errors, as well as the transformed ones, decrease owing to the signal
sent from robot
i to its predecessor and forces it to stop when the corresponding performance function exceeds a predefined safety threshold within a compact set where (
30) is active. Thenceforward, the stability of the multi-agent system is concluded by solely studying the properties of (
31).
Notice that the terms
,
,
,
,
,
are strictly positive due to (
12) and (
13). Owing to input saturation on both linear and angular velocities of all robots, there exist positive constants
such that
and
. Additionally, (
32) and (
33) are positive and radially unbounded functions, strictly increasing in
and
, respectively, which leads us to:
Hence,
when
and
. Moreover, provided that the safety and visibility criteria are initially met, then the
and
are properly clarified, from which someone derives that the transformed errors
and
are uniformly ultimately bounded. Consequently, all closed-loop signals remain bounded, the constraints (
12) and (
13) are fulfilled at all times and neither crashes nor inter-robot visibility breaks take place, which completes the proof. □
Remark 4. It should be noted that the input limitations as well as the operational specifications are achieved by adaptively modifying the performance functions (
26)–(
29)
, thus simplifying the selection of the control gains and . Moreover, establish the maximum allowable steady-state distance and AOV error, respectively, setting prescribed performance specifications on the closed-loop system. Note that due to the adaptive performance laws (
26)–(
29)
, the aforementioned performance parameters can be selected arbitrarily small without jeopardizing the stability of the system. This adaptability allows for fine-tuning the algorithm’s performance based on specific application requirements and enhances the robustness against input saturation. Furthermore, the threshold δ determines when the terms , , and nullify. In particular, as the distance of the robot and the LOS with surrounding obstacles is greater than δ, these terms vanish, resulting in prescribed output response. Meanwhile, adjusting ϵ affects the sensitivity of the projection operator (
30)
to deviations in performance boundaries, balancing precision and flexibility in error correction. Remark 5. The adaptive performance method proposed in this work, forces the distance and angle of view errors to remain rigorously in and at all times. Modulating the transformed errors and and keeping them bounded, results to the satisfaction of inequalities (
12) and (
13)
. Correspondingly, the current problem can be represented as stabilization of the transformed errors and . By observing the introduced control protocol, it is evident that the performance functions act as barrier functions used in constraint optimization. Namely, the errors and can never reach their limits due to the proposed control protocol mentioned in this section.