Next Article in Journal
Long-Term Culture Performance of a Polyelectrolyte Complex Microcapsule Platform for Hyaline Cartilage Repair
Next Article in Special Issue
Structural Identifiability and Observability of Microbial Community Models
Previous Article in Journal
Craniotomy Simulator with Force Myography and Machine Learning-Based Skills Assessment
Previous Article in Special Issue
Analytical Models of Intra- and Extratumoral Cell Interactions at Avascular Stage of Growth in the Presence of Targeted Chemotherapy
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Theoretical Framework for Implementable Nucleic Acids Feedback Systems

1
School of Engineering, University of Warwick, Coventry CV4 7AL, UK
2
Department of Biomedical Engineering, Eindhoven University of Technology, 5600 MB Eindhoven, The Netherlands
3
Department of Life Sciences, Pohang University of Science and Technology (POSTECH), Pohang 37673, Gyeongbuk, Republic of Korea
*
Author to whom correspondence should be addressed.
Current address: GMV, 1990-392 Lisbon, Portugal.
Bioengineering 2023, 10(4), 466; https://doi.org/10.3390/bioengineering10040466
Submission received: 8 March 2023 / Revised: 5 April 2023 / Accepted: 6 April 2023 / Published: 12 April 2023
(This article belongs to the Special Issue Role of Computational Methods for Living Systems at Different Scales)

Abstract

:
Chemical reaction networks can be utilised as basic components for nucleic acid feedback control systems’ design for Synthetic Biology application. DNA hybridisation and programmed strand-displacement reactions are effective primitives for implementation. However, the experimental validation and scale-up of nucleic acid control systems are still considerably falling behind their theoretical designs. To aid with the progress heading into experimental implementations, we provide here chemical reaction networks that represent two fundamental classes of linear controllers: integral and static negative state feedback. We reduced the complexity of the networks by finding designs with fewer reactions and chemical species, to take account of the limits of current experimental capabilities and mitigate issues pertaining to crosstalk and leakage, along with toehold sequence design. The supplied control circuits are quintessential candidates for the first experimental validations of nucleic acid controllers, since they have a number of parameters, species, and reactions small enough for viable experimentation with current technical capabilities, but still represent challenging feedback control systems. They are also well suited to further theoretical analysis to verify results on the stability, performance, and robustness of this important new class of control systems.

1. Introduction

With the recent advancement of cost-effective approaches for assembling oligonucleotides, synthetic DNA has become an appealing preference for constructing circuits using hybridisation and DNA strand displacement (DSD) reactions. Programmable and biologically compatible synthetic circuits that utilise DSD reactions have been shown to function effectively in living organisms (in vivo), as reported in a study by [1]. Therefore, these DSD networks are a promising candidate for building synthetic feedback controllers in biomolecular settings [2], to drive DNA-based molecular devices, or for the realisation of biochemical computing circuits with emerging opportunities and challenges also for applications in vivo [3].
Systematic methods to compose and program DNA circuits have been proposed [4] that enable the translation of chemical programs to reactions through the use of nucleic acids, where the binding affinities and the reaction rates can, to a certain degree, be controlled [5,6]. Feedback control systems can be assembled with elementary chemical reaction networks (CRNs) that provide an abstract layer for designing mathematical operators [7], prior to being translated to biomolecular applications. As a result, the networks of fundamental reactions such as catalysis, degradation, and annihilation can then be mapped to their equivalent DSD reactions [8], where the DNA sequences effectively program the biochemical interactions and each of the strand displacement reaction rates [5,9].
Nonetheless, at first glance, the concentrations of biomolecular species are seemingly ill-suited to represent signals in the theory of feedback control, given that they are limited to positive quantities. For instance, in a typical reference tracking control problem, the error between the reference and the plant output can take either a negative or a positive value, but then, this cannot be represented by a positive concentration. An alternative technique that works around this limitation is to employ the so-called dual-rail representation, in which pairs of concentrations are used to represent system state variables [10]. Specifically, a signal x ( t ) is described by the difference between two concentrations x ( t ) = x + ( t ) x ( t ) , which corresponds to two chemical species X + and X . By making such an abstraction, this approach enables the representation of gains and negative signals using positive quantities that are essential for error computation in a negative feedback control system. The dual-rail representation and implementations for elementary catalysis, degradation and annihilation reactions provide a systematic framework to convert control theory into biochemistry, which can be implemented with synthetic DNA oligonucleotides, where the representation of transfer functions [11], linear feedback systems [12,13,14,15,16,17], and nonlinear controllers [18,19,20] can be realised through the assembly of DSD networks.
While open-loop cascades for analogue or logical computations implemented with DSD networks have been constructed [21], there remains a considerable gap between theory and experiment when it comes to dynamical circuits that implement negative feedback. Moreover, even the most basic types of feedback controllers have yet to be implemented and reported. This is an important limitation to further progress, because the proposed dual-rail representation requires annihilation reactions, which are essential to ensure that species concentrations remain within the bounds of experimental feasibility, but lead to nonlinear dynamics due to the bimolecular nature of annihilation reactions.
Ideally, these additional nonlinear dynamics are not observable in the represented input to output linear dynamics, but still determine some important properties of the CRN, which need careful consideration for experimental implementation, such as the level of concentrations at which the circuit operates and unforced positive equilibria with persistent consumption of chemical species [22,23]. Additionally, the implementation of the DSD reactions introduce leakage and spurious effects [24], which prompted study on leakage analysis and ways to mitigate it [25]. Furthermore, the variability and granular design of hybridisation rates [5] introduce error and mismatches in the reaction rates. All these aforementioned issues show that we are lacking an experimental validation of control systems based on DNA hybridisation, to help us understand how nonlinearities and uncertainty in the implementation impact the stability and performance of these control circuits.
Due to several technical challenges, which include cross-talk, designing toehold sequences, leakage, etc., there is a substantial lag in the construction, validation, and scale-up of nucleic acid control systems compared to the theoretical advancements’ counterpart [5,24]. While the nucleotide sequence can be predicted from the toehold affinities [5], the kinetics can be affected by undesirable binding scenarios, resulting in the modification of the reaction rate constants and the dynamics (e.g., in oscillating circuits [24] or the seesaw gate circuit [26]). The activation of these undesirable reactions that yields the leakage of the outputs in the absence of the input also poses another major experimental hurdles. A potential approach in addressing this issue is the use of clamps, which could impede the spurious hybridisations [24,27], or compartmentalisation and localisation strategies [28,29,30], which isolate strand complexes, which could cause leak reactions. Additionally, the severity of leakage increases when concentrations are high; thus, it is a common practice to ensure low concentrations of the reacting species [31]. This leakage at high concentrations along with the restrictions on hybridisation rates [5] impose upper bounds on the speed at which these circuits can operate. A technique that can be used to mitigate this is localisation, whereby the adjacent gates are placed for interaction without diffusion at faster rates [26]. Lastly, despite measures taken to prevent these spurious reactions, it is still essential that the sequence of reactions, which are competing for common reactants, are well-managed through the means of timescale separation or compartmentalisation [32]. With larger and more complex circuits, sequence similarity aggravates all these undesired effects, with a stronger need for toehold-mediated strand displacement circuits, which are robust to molecular noise [33].
All the experimental challenges described above can be addressed through the designs of circuits that have a lesser amount of reactions. With a lesser amount of reactions and species, this reduces the number of designs required for the template strands. This concurrently reduces the demand for the characterisation and tuning of the kinetic rates, lessens the sources of error, as well as curtails the possibility of leakage and undesired interactions. Ensuring fewer reactions and species are of pertinence, especially in using the dual-rail representation, which necessitates a duplication of nearly all of the reactions [19].
A key challenge from a theoretical perspective is, therefore, to design circuits of reduced complexity, using the least amount of chemical reactions, at the same time still able to represent a negative feedback control problem of interest in an accurate manner. All these are done to ensure that, with the presently available technical capacity, the likelihood of implementing a successful experiment can be maximised. Here, we suggest chemical representations for two fundamental types of feedback control systems in order to achieve the above objective. Our first type of circuit is a reference-tracking problem employing integral control for a stable first-order system, with a single tuning parameter. The second type of circuit is a combined reference tracking and stabilisation problem of a marginally stable plant, i.e., the classic double-integrator system employing the static state feedback control of the two integrated states with two tunable gains. The dual-rail framework is used in both of these circuits, and their parametrisations can be tuned to satisfy control requirements such as steady-state tracking and transient dynamics. The supplied circuits of reduced complexity are ideal candidates for the first experimental validation and robustness assessment of nucleic acid controllers implemented via the dual-rail representation.
An early version of this study can be found in [34], where we established the fundamental theories of chemical reaction network that are required to realise the reference tracking control problem. Here, we extended the work in [34] by applying the theories to design two types of controllers and investigated the impact of the nonlinearities and uncertainties on the experimental implementation, in particular the effect of leakage, which was not considered previously.
The remainder of this article is organised as follows. Section 2 introduces the definitions and methods used in this work. The formulations and constructions with DNA hybridisation reactions are detailed for control systems with integral action in Section 3 and with state feedback in Section 4. Section 5 discusses the impact of nonlinearities and uncertainty in performance and robustness, highlighting the properties of interest for the experimental investigation. Section 6 summarises the main conclusions.

2. Definitions and Preliminaries

2.1. Chemical Reaction Networks

The theory of CRNs has its roots in chemistry [35], whereby the same principle is applied in a similar manner to biomolecules to model and analyse biochemical reaction networks. With their extensive computational capabilities [36,37], CRNs provide a convenient representation for implementing elementary arithmetic operations [7] or the computation of polynomials [38], using any chemical system with mass action kinetics. They also provide an appropriate level of abstraction for designing complex circuits [39] and integrate the different elements necessary to build linear feedback control systems [12,13].
Definition 1.
Given a set of M reactions between N chemical species X j , a chemical reaction network is represented by
j = 1 N a j m X j γ m j = 1 N b j m X j , m = 1 , , M
where the stoichiometric coefficients a j m and b j m determine, for each reaction m, the quantities of the reactants consumed on the left and the products output on the right, at a rate γ m . When, due to degradation or sequestration, a product is removed or becomes nonreactive, it is omitted or replaced by the symbol Ø.
When the same species is utilised in multiple reactions, it creates links between different species that can be expressed as a graph to describe the network. There are various sources that provide the definitions of the models and properties pertaining to CRNs. These include Petri nets and monotone systems [40,41]; deficiency theorems and structural analysis work [42,43,44,45]; and biochemical networks’ application [46].
Different principles have been used to model the time evolution of the concentration of species [35]. In this study, the main principle that we used is the Mass-Action-Kinetics (MAK)-based deterministic models, which have been traditionally used to model biochemical processes [47,48,49], as well as used in the implementation of polynomial Ordinary Differential Equations (ODEs) and Turing universal CRNs [36,50]. Assuming the MAK, a set of ODE can be used to express a deterministic model [51,52,53] that is appropriate for the analysis of control and systems theory, despite being nonlinear, with the reaction fluxes depending on the product of the reatanct’s concentrations.
Definition 2.
For a deterministic model based on the MAK [35], we have that, for each species X j in (1), the dynamics of its concentration x j is given by
x ˙ j = m = 1 M γ m b j m a j m j = 1 N x j a j m
Example 1.
Take the reaction between the reactant species X 1 and X 2 , which produces species X 3 , represented by
a 1 X 1 + a 2 X 2 γ b X 3
where the reactants on the left are converted into the product on the right at a rate γ, according to the stoichiometric coefficients a 1 , a 2 , and b. The MAK model results in the ODEs:
x ˙ 1 = a 1 γ x 1 a 1 x 2 a 2
x ˙ 2 = a 2 γ x 1 a 1 x 2 a 2
x ˙ 3 = + b γ x 1 a 1 x 2 a 2
where the stoichiometric coefficients a 1 , a 2 , and b indicate, respectively, the relative number of molecules consumed and produced during the reaction.
Let R 0 + denote the positive orthant, where v j R 0 + v j 0 ; the dynamics of (4) to (6) are expressed in their natural coordinates, and the concentrations x j R 0 + are always non-negative. The system is non-negative ( j , x j ( 0 ) 0 x j ( t ) 0 ) if the sets of reactions are modelled properly using realistic non-negative initial conditions.

2.2. Dual-Rail Representation

In the context of feedback control, a key challenge in employing CRNs is their inability to directly represent negative signals, since the concentrations of chemical species are always positive. In a linear negative feedback system, we cannot restrict ourselves to considering only a positive difference between two positive inputs, i.e., “one-sided” subtraction [54]. The limitation of the positivity of CRNs can be circumvented using the dual-rail representation [10,12,55], where this enables the positive and, in particular, the negative signals that are vital for error signals’ computation in a feedback control to be represented using molecular concentrations.
Definition 3.
Consider two chemical species X j + and X j and respective concentrations x j + 0 and x j 0 . A dual-rail signal p j R is represented by p j = x j + x j , with dynamics given by p ˙ j = x ˙ j + x ˙ j .
Here, we have signals that are generated by subtracting two positive quantities, which enables us to obtain positive or negative results when subtracting signals instead of concentrations.
Definition 4.
The Input–Output (I/O) system is the response Y ( s ) = G ( s ) U ( s ) , from an input u = u + u to an output y = y + y . The states are also dual-rail p j = x j + x j , where u , y , p j R and u ± , y ± , x j ± R 0 + .
Combining the MAK and the dual-rail representation, we can model linear systems with both positive and negative signals, using CRNs composed of only the three types of reactions:
X i γ X i + X j
X i γ Ø
X i + X j η Ø
where we have unimolecular reactions for catalysis (7) and degradation (8) and a bimolecular reaction in annihilation (9).
Example 2
(First-order system). To chemically represent the first-order system with a negative gain given by the transfer function:
Y ( s ) = k 1 s + k 2 U ( s )
with u , y R , we take the pairs of chemical species U ± , Y ± and the CRN from Figure 1 with
U ± k 1 U ± + Y
Y ± k 2 Ø
Y + + Y η Ø
From the MAK, we derive the ODEs for the concentrations:
y ˙ + = k 2 y + + k 1 u η y + y
y ˙ = k 2 y + k 1 u + η y + y
From Definition 4, the linear I/O system results:
y ˙ + y ˙ = k 2 y + y k 1 u + u y ˙ = k 2 y k 1 u
The computation of a two-sided subtraction with the steady-state of a CRN or the representation of negative gains is enabled by the dual-rail representation [55]. Although this increases the number of required reactions (by duplicating the unimolecular reactions), it does provide a systematic framework with which to represent linear and negative feedback systems [11,12,14].

2.3. DNA Strand Displacement Reactions

Sequences of four types of nucleotides, i.e., Adenine (A), Guanine (G), Cytosine (C), and Thymine (T), are formed by chains of nucleotides in nucleic acids. The formation of hydrogen bonds between nucleotide pairs A-T and C-G results in a double-stranded DNA with a helical shape. As depicted in Figure 2, this DNA structure is composed of two strands of DNA that run antiparallel to each other. The bonding between the complementary pairs of A-T and C-G is stabilised by the hydrophilic backbone and the hydrophobic nature of the bases. As illustrated in Figure 2b, this results in the formation of double-stranded DNA through an enzyme-free hybridisation reaction between two antiparallel complementary strands of DNA [56].
The dynamics of simple chemical reactions such as catalysis, degradation, and annihilation can be readily translated into nucleic-acid-based reactions with comparable behaviours [8,9]. This approach enables technology for implementing circuits designed using CRNs, where the DNA sequence of the nucleotides within the strands can efficaciously be used to program the biochemical circuitry to realise both analogue and digital computations [4,5,26,54]. Each of these reactions has equivalent representations with DSD reactions, where formal species and reactions in the CRN are mapped to sets of DNA species. Various suggested architectures [8,9,24,32] permit the creation of circuits that are aided by a high-level of automation through the utilisation of existing syntax and software tools [4,13,57].
The DSD reaction uses DNA molecules as signal species, and they consist of binding domains and single-stranded overhanging and exposed toeholds. The function of these toeholds is to initiate and adjust the reaction rates of strand hybridisation [4,5], as depicted in Figure 2c. The hybridisation process leads to bimolecular reactions with unitary stoichiometric coefficients. Using the following DSD reaction of A + B C + D as an illustration (Figure 3), the toehold 1 of the approaching strand A is hybridised to its complementary toehold 1 * in B, which leads to the commencement of branch migration. This then displaces Domain 2 and releases the two output species of C and D. From the thermodynamic point of view, the unbinding of toehold 1 is less favoured compared to the displacement of the incumbent domain 2, resulting in C being completely displaced. With the two output species C and D having no overhanging complementary toeholds for further hybridisation, the displacement mechanism is deemed not reversible, assuming leakage reaction rates are much slower than the displacement mediated by the toehold reactions. The reverse reaction, where C displaces the strand A from D, can be up to orders of magnitude slower [58] and be considered effectively unreactive.
With the assumption of an irreversible reaction coupled with the output strand C being able to take part in other reactions, the cascade of several reactions ensues. It is often a challenge to describe the hybridisation reaction with good accuracy. Nonetheless, there are several predictive models available that utilise the nucleotide sequences to provide a good approximation of the reaction rate [5]. Using Visual DSD [57], which is a specifically designed computer-aided design software for strand displacement reactions’ analysis, we conducted a simulation to analyse and verify the DSD circuity by programming the species and their affinities in the software. We ran the simulation in “default” mode, which is the mode that considers finite binding/unbinding rates. The affinities between the toeholds, which facilitate the initial hybridisation between the strands, are determined based on the reaction rates in the CRNs.

3. Integral Feedback Control System

We now propose a CRN with reduced complexity to represent the integral feedback control system in Figure 4. This is then followed by implementing it in Visual DSD using strand displacement reactions.
Example 3
(Reference tracking problem using integral control). Define the first-order plant and the control law:
Y ( s ) = b s + a V ( s ) s Y ( s ) = b V ( s ) a Y ( s )
V ( s ) = k i s R ( s ) Y ( s )
where V ( s ) is the integral control action to have the output Y ( s ) track a reference R ( s ) , according to Figure 4.
The transfer function for the closed-loop dynamics results:
Y ( s ) = b k i s 2 + a s + b k i R ( s )
where the integral control ensures steady-state tracking with Y ( 0 ) = R ( 0 ) . The transient dynamics are defined by the roots of the characteristic polynomial:
λ = 1 2 a ± a 2 4 b k i
with a natural frequency ω n = b k i and damping coefficient ξ = a 2 b k i .

3.1. Representation with Chemical Reactions

The closed-loop response represented by a network of catalysis, degradation, and annihilation reactions is shown in Figure 5, where
V + b V + + Y + , V b V + Y
Y + a Ø , Y a Ø
R + k i R + + V + , R k i R + V
Y + k i Y + + V , Y k i Y + V +
Y + + Y η Ø , V + + V η Ø
The reactions (21) and (22) describe the plant, where the reaction rates a and b, respectively, set the gain and the degradation reactions, with a stable pole at s = a .
The additional dynamics of the chemical reactions used to solve the subtraction and compute the control error as found in [12] or [14] are removed. Instead of using separate CRNs for subtraction and integration, both operations are combined to reduce the number of reactions and simplify the circuit. Thus, Equations (23) and (24) describe the subtraction of the contributing reference and the output to the integral action through the crossing of the contributions from Y ± to V . The control gain is applied by the reaction rate k i in the corresponding catalysis reactions. The annihilation reactions in (25) ensure low (i.e., experimentally feasible) concentrations of the chemical species [12,23].
The respective MAK governing the species concentrations can be written as
v ˙ + = k i r + + k i y η v + v
v ˙ = k i r + k i y + η v + v
y ˙ + = b v + a y + η y + y
y ˙ = b v a y η y + y
This gives us then that, for the dual-rail variables y = y + y , v = v + v , and r = r + r , the dynamics of the I/O are the outcome of the expressions v ˙ = v ˙ + v ˙ and y ˙ = y ˙ + y ˙ , and this yields
v ˙ = k i r + r + k i y + + y = k i r y
y ˙ = b v a y
The swapped contributions from Y ± to V still result in positive gains in the dynamics of the concentrations in (26) to (29), but result in a negative gain on the output y when computing the dynamics in (30) to (31).
The dynamics of the input–output given in (30) to (31) are linear, corresponding to the transfer function of the closed-loop system in (19). To further simplify the construction, we disregarded any annihilation reaction among the reference species R + + R η Ø with the assumption that we have low and constant input concentrations during the whole circuit operation, and the dynamics in (30) to (31) rely solely on the difference of r instead of the R + and R concentration levels.

3.1.1. Dual-Rail CRN as a Nonlinear Internal Positive Representation

The dual-rail representation uses a positive system (the MAK of the CRN) to represent a non-positive system. This approach of having an Internally Positive Representation (IPR) [59] lifts the constraint of positivity imposed by the implementation of the physical system using chemical species. The representation uses input and output transformations that translate the input and output of the system into and from positive states of the dynamics, respectively, to realise arbitrary I/O dynamics. In our case, the internal positive dynamics are represented by CRNs (Figure 6) and the positive variables are the natural coordinates of the MAK given by positive concentrations.
When representing linear I/O systems with a linear IPR, we need to ensure that the system is stable from input to output, but also internally stable. This results in limitations when building the internal linear process [59]. However, the dual-rail representation constructed with the elementary reactions of catalysis, degradation, and annihilation reactions results in a nonlinear MAK. The I/O system in (30) to (31) is linear because the dynamics of the differences of concentrations have the nonlinear terms of the MAK in (26) to (29) cancelling out. However, internally, we have a process that is not only positive, but also nonlinear and not observable in the I/O system.
Definition 5
(Rotated coordinates [23]). Define the transformation of coordinates v ¯ = v + v and v ^ = v + + v , where we can recover the concentrations with v ± = 1 2 v ^ ± v ¯ .
In the new coordinates, we can clearly express the relationship between the I/O system and the internal positive nonlinear dynamics [23]. Since η y + y = η 4 y ^ 2 y ¯ 2 , we can express the MAK of Example 3 in the new coordinates, where we obtain
v ¯ ˙ = k i r ¯ y ¯
y ¯ ˙ = b v ¯ a y ¯
v ^ ˙ = k i r ^ + y ^ η 2 v ^ 2 + η 2 v ¯ 2
y ^ ˙ = b v ^ + a y ^ η 2 y ^ 2 + η 2 y ¯ 2
The dynamics of v ¯ ˙ and y ¯ ˙ correspond to the I/O system and v ^ ˙ and y ^ ˙ are the remaining dynamics in the dual-rail representation, which are nonlinear and depend on the trajectories of the I/O system. It is noteworthy that the I/O system does not rely on v ^ ˙ or y ^ ˙ , and these underlying nonlinear dynamics are, by design, not observable in the represented linear system.
Assumption 1.
It was assumed that the designed I/O system results in a stable closed feedback system.
Assuming that the controller is designed to ensure stability for the feedback system, we have that the I/O system is a bounded and stable input into the internal nonlinear dynamics. Assumption 1 together with previous theoretical results from [23] ensure that, although nonlinear and partially unobservable, the dynamics in (32) to (35) remain stable.

3.2. Representation with Strand Displacement Reactions

In order for CRNs to be translated into nucleic acid chemistry, the DSD reactions are set with comparable dynamics to each of the three elementary reactions, coupled with toehold mediation to tune their reaction rates. Following [9], both catalysis and degradation reactions can be implemented using the Join–Fork templates. A signal strand can be released through the interaction of a J o i n double-stranded complex with either one or a few single-stranded inputs. This then leads to a sequence of DSD reactions in the F o r k template, where one or more output strands are released. The auxiliary templates, namely the J o i n and F o r k templates, as well as the auxiliary two-domain strands, need to be present in high concentrations and supplied at the start of the reaction.
Figure 7 shows an example of sets of DSD reactions equivalent to the unimolecular reaction of catalysis R R + V , where the interactions with the intermediary strands and auxiliary templates are mediated utilising toeholds. The sets of reactions are
R + JoinVR k b n d c i × k t J o i n V R _ 1 + aux _ hrtp
J o i n V R _ 1 + aux _ tphpr k b n d k b n d J o i n V R _ 2 + s i g _ h p r t q
s i g _ h p r t q + ForkVR k b n d k b n d F o r k V R _ 1 + aux _ tphpr
F o r k V R _ 1 + aux _ hrtp k t k b n d F o r k V R _ 2 + R
F o r k V R _ 2 + aux _ hvtr k t k t F o r k V R _ 3 + V
F o r k V R _ 3 + aux _ hitv k t Ø
The species highlighted in bold in (36) to (41) are the template complexes and auxiliary single-stranded species, which are made available at a high concentration C m a x , to avoid their irreversible consumption from significantly impacting the dynamics.
As shown in Figure 7, every signal species is a single-stranded DNA that consists of toehold (<tr>) and binding (<hr>) domains. The hybridisation to the multi-stranded complex J o i n V R is initiated by the toehold domain, which activates a series of processes, leading to an intermediary strand s i g _ h p r t q being released. The presence of this new intermediary strand activates another series of strand displacements, but this time involving the F o r k V R complex. This results in the signal species V being released and a strand of R being returned (following the stoichiometry of R R + V ).
Remark 1.
The reversible reactions in (37) and (38) assume the same forward and backward binding rate k b n d . Implicit in this assumption is that the sequences of the toeholds <tp> and <tp*> can be designed to have the same maximum binding rate as the toeholds <tq> and <tq*>. The same assumption is made in (40) for <tr>, <tr*>, <tv>, and <tv*>.
As depicted in Figure 8, the DSD reactions for the degradation reaction are less complicated given that the J o i n Y complex only requires capturing the signal species Y in an irreversible manner, with
JoinY + Y k t × c a J o i n Y _ 1 + d Y
Considering that there are no exposed toeholds in the product of the double-strand, this product becomes inactive and participates no further in the reactions.
To implement the annihilation reactions, we propose the cooperative hybridisation from [61] and applied in [32]. An auxiliary species A n n V V at high concentrations quickly hybridises with both input signals to generate waste species, and in order for the cascade to become irreversible, the two input species need to be present. In the ensuing cooperative hybridisation mechanism, a single template per signal is then used to set the annihilation reactions V + V Ø , where
V + V + A n n V V c V V × k t Ø
As shown in Figure 9, there is a set of DSD reactions that includes intermediary complexes together with reversible displacement reactions, resulting in the following CRNs:
AnnVV + V k u b n d c V V × k t I v
I v + V c V V × k t W v + W v
AnnVV + V k u b n d c V V × k t I v
I v + V c V V × k t W v + W v
Both V and V , when present, facilitate the production of two double-stranded waste complexes W v and W v from the second irreversible reaction.
The nucleotide sequences in the toeholds, which initiate strand hybridisation, allow for the programmability of the DSD reactions. It is well known that the predictable hybridisation kinetics is defined by the affinities between the base pairs [5] despite several factors that could likewise impact the effective reaction rate constants [24]. To facilitate our programming and analysis using Visual DSD, we adjusted the rates of the DSD reactions through the assignment of complementarity degrees between toeholds [13,57] based on the assumption that the binding affinities are weakened by the possibility of toehold design and nucleotide sequences mismatch. As illustrated in Figure 7, the complex J o i n V R has the toehold <tr*ci> that possesses the complementarity degree to the signal toehold <tr> of 0 < c i 1 . This slows down the reaction mediated by <tr> and <tr*ci> to k t × c i , where k t is the maximum binding rate of two complementary toeholds <tr> and <tr*>.
Assumption 2.
The auxiliary strands were assumed to be present at high concentrations and to remain constant or approximately close to their initial value during the operation of the circuit (or indefinitely through replenishment).
Assumption 2 allowed us to approximate the bimolecular hybridisation reactions with the unimolecular reactions in (7) and (8). For example, the implementation in (42) can be approximated assuming J o i n Y ( t ) J o i n Y ( 0 ) = C m a x , resulting in the approximating unimolecular reaction:
Y C m a x × c a × k t J o i n Y _ 1 + d Y
where the constant and large presence of the auxiliary species J o i n Y is translated directly into the unimolecular reaction rate [8].

3.3. Initialisation and Modelling of the Integral Control System

The six catalysis and two degradation reactions from the CRN in (21) to (25) with the exception of one annihilation reaction were used in implementing the DSD reactions. In the analysis using Visual DSD, the reaction Y + + Y Ø can be removed to further reduce the implementation given that both the Y + and Y concentrations are sufficiently low.
The templates shown in Figure 7, Figure 8 and Figure 9 were employed to set the DSD reactions. A single F o r k template was used for both the outputs of the catalysis reaction, where through cooperative hybridisation, the identical sequestering template is shared between the two annihilated species. A high concentration of 15 double-stranded and 20 single-stranded DNA templates and auxiliary species, respectively, was used for circuit initialisation. The domains for signal species V, V′, Y, Y′, and R, R′ that, respectively, represent V + , V , Y + , Y , and R + , R are shown in Figure 10. The same figure also shows the provided auxiliary templates with the details of their toeholds and domains that were constructed for hybridisation and strand displacement.
In the Visual DSD simulation, we set C m a x = 10 4 nM (the consumption of the auxiliary strands are not reversible and replenished). We also set the maximum binding and unbinding rate of the toehold to 10 3 ( nMs ) 1 and 0.1 s 1 , respectively. Table 1 provides the details of all the parameters.
From Figure 11, we note that there was an agreement between the output y = y + y reference tracking behaviour, as well as the concentration evolution in the DSD reactions and the CRN concentrations obtained by the MAK, as in (26) to (29). Despite the DSD reactions circuit exhibiting a desirable tracking behaviour, the dynamics of the transient were damped further. One probable reason for this is the additional auxiliary species and bimolecular reactions that were present.

4. State Feedback Control System

The closed-loop dynamics of the static state feedback can be modified by the controller utilising only the gains on the plant state and adding no dynamics to the open-loop system. The plant considered here was the classic double-integrator that represents the simplest second-order system. Thus, there was an extra state for the feedback apart from the output feedback.
Compared to the previous example, the control of this plant was more difficult as it was a marginally stable system due to the presence of two poles at the origin. Hence, the closed-loop system not only had to achieve the reference tracking capability, but to stabilise the open-loop system as well.
Example 4
(Double-integrator with linear state feedback). The state space description of the process to be controlled is
x ˙ y ˙ = 0 0 q 0 x y + q 0 r
where each integration has a gain q (Figure 12), and reference tracking was achieved with the control law:
v = r k 1 x k 2 y
There are two parameters, k 1 and k 2 , that can be used to adjust the closed-loop state space system dynamics:
x ˙ y ˙ = q k 1 q k 2 q 0 x y + q 0 r
The closed-loop frequency response results in a second-order system with the transfer function:
Y ( s ) = q 2 s 2 + q k 1 s + q 2 k 2 R ( s )
where the poles describing the transient response are given by
λ = q 2 k 1 ± k 1 2 4 k 2
There are only three parameters in the closed-loop system, i.e., two controller gains and one plant gain. From (52), there are q that define the system timescale, 1 / k 2 , which is the static gain, ω n = q k 2 that denote frequency, and ξ = k 1 2 k 2 that represent the damping coefficient. The parameter k 2 is required to be set to unity for achieving steady-state reference tracking. This implies that any implementation-related error or deviation in this parameter will be visible in the steady-state error. It follows also that, for an overdamped response, ξ > 1 k 1 > 2 .

4.1. Representation with Chemical Reactions

Similar to the previous example, further simplification of the CRN can be achieved through the combination of the integration of the first state with the sum of the feedback contributions and reference. The additional reactions to represent the sum operation suggested in the following studies [12,13,14] can be avoided through this simplification.
By considering the dual-rail representation, the eight catalysis and two annihilation reactions resulting from the CRN are given by
R + q R + + X + , R q R + X
X + q X + + Y + , X q X + Y
X + q k 1 X + + X , X q k 1 X + X +
Y + q k 2 Y + + X , Y q k 2 Y + X +
X + + X η Ø , Y + + Y η Ø
The plant double-integrator is represented by (54) and (55), which depicts the chain of two catalysis reactions. The negative gains meanwhile are represented by the reactions in (56) and (57), which can be realised through the exchange of contributions between the dual-rail species, as shown in Figure 13a. Lastly, to ensure that the concentrations are maintained at feasible levels, the annihilation reactions are implemented in (58).
The MAK for the chemical network results in
x ˙ + = q r + + k 2 y + k 1 x η x + x
x ˙ = q r + k 2 y + + k 1 x + η x + x
y ˙ + = q x + η y + y
y ˙ = q x η y + y
From the reversed contributions in (59) and (60), the negative signs appear in the gains in the I/O dynamics of x ˙ = x ˙ + x ˙ and y ˙ = y ˙ + y ˙ , given by
x ˙ = q r q k 2 y q k 1 x
y ˙ = q x
In (63) to (64), we recover the linear closed-loop dynamics.
Having the catalysis reactions X ± q k 1 X ± + X crossing the production of each dual-species X together with a fast annihilation X + + X η Ø corresponding to the alternative catalytic degradation proposed in [13], with a self-repressing gain analogous to having X ± q k 1 Ø (for fast η q k 1 ), hence we can alternatively replace the catalysis in (56) with degradation reactions. Interestingly, the absence of degradation reactions in the produced species to ensure bounded concentrations and the marginal stability of the stoichiometry in the catalysis reactions can be related to the marginal stability of the integrators in the plant. In this construction, the stabilising feedback gain on x can be directly related to degradation reactions on x ± , which introduce a stable pole in the state.
This results in the CRN from Figure 13b with six catalysis, two degradation, and two annihilation reactions given by
R + q R + + X + , R q R + X
X + q X + + Y + , X q X + Y
X + q k 1 Ø , X q k 1 Ø
Y + q k 2 Y + + X , Y q k 2 Y + X +
X + + X η Ø , Y + + Y η Ø
Here, we have a different MAK, i.e.,
x ˙ + = q r + + k 2 y k 1 x + η x + x
x ˙ = q r + k 2 y + k 1 x η x + x
albeit that x ˙ has the same I/O dynamics as in (63). In Figure 14, the comparison of the linear design with the CRN representation is shown. There is a good agreement of the trajectories between the linear control design and the dual-signals obtained from the CRN I/O dynamics, which follows the predefined reference tracking behaviour.
We must keep in mind, however, that the dynamics of the CRN are still a nonlinear system. Writing the MAK of (65) to (69) in the new coordinates from Definition 5, we obtain
x ¯ ˙ = q r ¯ k 2 y ¯ k 1 x ¯
y ¯ ˙ = q x ¯
x ^ ˙ = q r ^ + k 2 y ^ + k 1 x ^ η 2 x ^ 2 + η 2 x ¯ 2
y ^ ˙ = q x ^ η 2 y ^ 2 + η 2 y ¯ 2
Again, we have the static state feedback in the I/O system, with nonlinear dynamics unobservable in the representation of the linear feedback system. Although the negative state feedback gains in x ¯ ˙ become positive state feedback gains in the dynamics of x ^ ˙ , the dynamics in (72) to (75) can be shown to be bounded [23].

4.2. Construction with Strand Displacement Reactions

For the DSD representation, the catalysis, degradation, and annihilation reactions are constructed again according to Section 3.2, applying the architectures from Figure 7, Figure 8 and Figure 9, to obtain DSD reactions equivalent to the CRN in (65) to (69).
Following the above discussion, the construction in (65) to (69) is adhered to for further simplification to the circuit. Here, we replace the catalysis reactions that are responsible for realising the state feedback with the degradation reactions given in (67) that utilise fewer species and a simpler template complex shown in Figure 8. Nevertheless, solely depending on catalysis (also annihilation) reactions for circuit building may have its own benefit. When proposing a catalytic degradation scheme, the authors in [13] advocated that spatial localisation of the catalysis reaction enables degradation at faster rates.
Moreover, through the Visual DSD simulation and analysis, we observed that the circuit was still functional even with the annihilation reaction X + + X η Ø omitted considering their concentrations stayed low. This is yet another plausible simplification, depending on the experimental setup.
These aforementioned simplifications resulted in the implementation of state feedback having the same complexity level as the integral control problem (i.e., six catalysis, two degradation, and one annihilation reactions), despite the former needing to control a more complex second-order system with marginal stability with more degrees of freedom. In the Visual DSD simulation, there were, respectively, 15 and 20 double-stranded complexes and auxiliary single-stranded species that were initialised at C m a x = 10 4 nM (the consumption was not reversible and replenished). Furthermore, the maximum toehold binding and unbinding rates were set to 10 3 ( nMs ) 1 and 0.1 s 1 , respectively. For the details of all the parameters and the supplied auxiliary strands, see Table 2 and Figure 15, respectively.
In Figure 14, the reference-tracking behaviour of the DSD circuits is shown. We note that there was good agreement between the CRN I/O dynamics with the linear design. The DSD reactions on the other hand had slower transient dynamics. When we compared the concentrations of the CRN with the Visual DSD simulation counterpart (Figure 16), we also observed slower dynamics and lower equilibrium for Y ± and X ± , respectively, suggesting state x was subjected to higher damping.
Nevertheless, the dynamics were similar to the desired design of the state feedback. This observation provided us with another strong indication that we can omit the annihilation reaction for X ± given its limiting degradation.

5. Impacts of Nonlinearities and Uncertainty on Experimental Implementations

The goal of the proposed circuits was to represent two linear feedback systems with chemical reactions, with a number of species and reactions, which can be implemented with currently available capabilities.
Synthetic DNA and strand displacement reactions have been shown to be applicable for biocomputation and implementation of dynamical systems [9,24] and scalable to dozens of distinct molecules [26,32]. Distributed setups can increase even further the number of reactions and species, where the management of the chemical interactions is defined by spatial separation or co-localisation [30], rather than the specificity and orthogonality of the sequences of the programmed toeholds [62]. The constructions proposed in this work relied on systems of DSD reactions of a smaller scale and were based on already implemented schemes such as cooperative hybridisation [32,61].
Despite the obvious potential and capabilities of DNA-based chemistry, from the existing demonstrations of circuits based on DSD reactions, none dealt with the representation of feedback control. The biocomputation of linear feedback systems with nucleic acids remains to be validated experimentally, and beyond the basic validation of the designs, there are additional properties that deserve investigation with an experimental setup.

5.1. Positive Equilibrium

It was pointed out in Section 3.1.1 that the linear I/O systems rely on an internal positive and nonlinear representation, albeit unobservable and stable. For a linear IPR, the stability of the IPR implicates a single equilibrium at the origin [59]. In the case of the dual-rail representation applied here and, specifically in the representation of feedback with integral action, previous work from the authors showed that the positive nonlinear dynamics of the CRN realisation can admit an unforced positive equilibrium, which defines the levels of concentration at which the circuit operates and leads to persistent consumption of chemical species [23].
Take again Example 3, assuming that k i was designed for a stable closed-loop system. Then, v ¯ and y ¯ in (32) to (35) have stable trajectories, and for r ± = 0 (no input concentrations), the equilibrium of the I/O system at y ¯ * = 0 and v ¯ * = 0 is globally asymptotically stable. For the internal dynamics with r ± = 0 , the unforced equilibrium conditions result in
0 = k i y ^ η 2 v ^ 2
0 = b v ^ + a y ^ η 2 y ^ 2
Solving for y ^ , we can write
v ^ = η 2 b y ^ 2 a b y ^ 0 = k i y ^ η 2 η 2 b y ^ 2 a b y ^ 2 η 3 8 b 2 y ^ 3 a η 2 2 b 2 y ^ 2 + η a 2 2 b 2 y ^ k i y ^ = 0
Besides the trivial solution y ^ = 0 , we have from Descartes’ rules of signs at least another equilibrium y ^ = y ^ * > 0 , and
y ^ = 0 v ^ = 0
y ^ * > 0 v ^ * = + 2 k i η y ^ * > 0
The reasons for the positive unforced concentrations have been theoretically predicted [23] and can be quickly understood for Examples 3 and 4. Writing the unforced dynamics ( v ¯ = y ¯ = r ± = 0 ) of the internal dynamics from (32) to (35), we have linear and nonlinear components with
v ^ ˙ y ^ ˙ = 0 k i b a v ^ y ^ η 2 v ^ 2 y ^ 2
The nonlinear quadratic contribution is always negative and stabilising. However, for the linear term, we have the eigenvalues of the matrix as the solutions of s s + a k i b = 0 (which are different from the characteristic polynomial of the I/O system) and
0 = s 2 + a s k i b λ = 1 2 a ± a 2 + 4 k i b
Due to the positivity of the parameters, we have k i > 0 λ = 1 2 a + a 2 + 4 k i b > 0 . This means the matrix in the internal positive dynamics has modes that push the unforced dynamics away from the origin. The positive eigenvalue is, in fact, the Frobenius eigenvalue, and it can be used to show that the origin is an unstable unforced equilibrium of the MAK [23]. We have the same issue present in Example 4, where, from the dynamics in (72) to (75), we can write the unforced response of the positive dynamics with
x ^ ˙ y ^ ˙ = q k 1 k 2 1 0 x ^ y ^ η 2 x ^ 2 y ^ 2
and the eigenvalues of the matrix in the linear term has an unstable positive eigenvector with the associated eigenvalue k 1 , k 2 > 0 , λ = q 2 k 1 + k 1 2 + 4 k 2 > 0 .
The nonlinear quadratic terms ensure the system is bounded, and although for cascaded systems of CRNs without feedback, the annihilation reactions are a practical mechanism to keep the concentrations low, for the representation of feedback, including such reactions may become essential to keep the concentrations bounded [23].

5.2. Positive Concentrations and Persistent Consumption

Note that the levels of the operating concentrations and the existence of an unforced equilibrium have direct experimental consequences, such as the continuous depletion of auxiliary strands in the implementation with bimolecular strand displacement reactions.
The histories in Figure 17 show the consumptions of the auxiliary species from the simulation in Visual DSD of the state feedback control in Example 4. The consumed auxiliary species are converted into the outputs of the DSD cascades, which includes the signal species, but also the unreactive waste species that accumulate as the auxiliary species are consumed. Figure 18 shows the histories of the concentrations of the accumulated waste species that result from the DSD implementation in Example 4, where the species W y and W y result from the implementation of Y + + Y Ø , while J o i n X _ 1 and J o i n X _ 1 result from sequestering the signal species in X ± Ø . At the end of the DSD cascades for the implementations of the catalysis reactions, there is a waste species: F o r k X R _ 4 and F o r k X R _ 4 result from X ± X ± + R ± ; F o r k Y X _ 4 and F o r k Y X _ 4 result from X ± X ± + Y ± ; F o r k X Y _ 4 and F o r k X Y _ 4 result from Y ± Y ± + X .
The simulation shows the consequences of a positive equilibrium, with the continuous consumption of auxiliary species and the production of waste, even when the output is reaching the steady-state, in Figure 14. The consumption of the auxiliary species should be slow to ensure the approximation of large and constant concentrations of the auxiliary species, during the complete duration of the operation of the DSD circuit. This calls for some care in the parametrisation and experimental setup to ensure the concentrations of auxiliary species remain large during the duration of operation of the circuit or the mechanisms for the replenishment of the auxiliary species and removal of waste species.
The properties of dual-rail implementations of feedback controllers predicted by the above theory have yet to be experimentally tested. The systems proposed in this paper are simple, but they still constitute powerful examples, wherein these theoretical results [22,23] can be tested. The role of annihilation reactions in the implementation of feedback systems, to bound the signal species and to slow down the consumption of auxiliary species and the production of waste species, deserves immediate experimental investigation.

5.3. Variability in the Reaction Rates

The underlying assumption of the dual-rail representation of I/O systems is that it relies on perfectly tuned reaction rates. In the derivation of the I/O dynamics in (30) to (31), it is assumed in the CRN in (21) to (25) that the pairs of equations have exactly the same reaction rates.
However, such an assumption is hindered by the design of affinities based on the complementarity of toeholds, which suffer from granularity and variability [5]. For example, the implementation of the catalysis assumes the designs of different toehold sequences with the same maximum hybridisation (see Remark 1), which we can hope to be similar, but not exactly the same. The differences will change the equilibrium conditions of the reversible reactions and introduce error and uncertainty into the effective rate of output release.
Moreover, besides the hybridisation rates, there is the approximation of large and constant concentrations of the auxiliary species from Assumption 2. Although, theoretically, the concentration of individual auxiliary species can be used to fine-tune the speed of the equivalent unimolecular reaction rates [11], experimental variations will always introduce errors and variability. In Figure 7, we have for catalysis that k i C m a x × c i × k t , which is the limiting reaction in (36) to (41), and in Figure 8, for degradation, we have a C m a x × c a × k t . Hence, the accuracy of the initial concentrations C m a x impacts the resulting reaction speed.
Consider Example 3, where, despite the system’s simplicity, the physical parameters in the implementation of the degradation reactions impact directly on the dynamic response of the represented I/O system. If we look at the eigenvalues of the closed-loop represented in (19) given by
λ = a 2 ± 1 2 a 2 4 k i b
we have that, for a high gain k i > a 2 4 b , it results in λ = a 2 . The real part of the pole depends directly on the implementation of the degradation reactions, and the variability in the designs of the toeholds c a × k t , as well as the impact of the variations of J o i n Y ( t ) during operation, can be observed in the response time.
With a realisation with strand displacement reactions, the parametrisation of the CRN will necessarily depend on several experimental effects, which introduce variability and uncertainty in the reaction rates. The known issues of the dual-rail representation with the mismatching of the reaction rates [11,12] were formally addressed by the author’s theoretical analysis and the characterisation of the asymmetric parametrisation of the dual-rail representations in [22,23].
In particular, the authors showed in [23] that, under parametric variability, the representation of a stable linear model does not necessarily result in a CRN with stable dynamics and the stability of the realisation with DSD reactions. The dual-rail representation relies on the assumption of perfectly symmetrical pairs of chemical reactions, which is broken when considering variability in the parametrisation of the reaction rates. Asymmetric parametrisation of the pairs in the CRNs causes feedback between the input-to-output dynamics and the internal nonlinear positive dynamics of the kinetics, which can lead to unstable feedback within the network, and stability must be analysed for the complete CRN of the dual-rail representation.
However, the emergence of the behaviours predicted by theoretical and numerical analysis and simulation in Visual DSD [22,23] still need validation with actual variability from experimental realisation with DSD reactions.

5.4. Robustness

One of the main questions for experimental testing are how the physical parameters impact the reaction rates of the CRN, not only for nominal performance, but also for robustness.
For example, in practice, experimental variability leads to mismatches not only on the representation of the plants with a + a , b + b , and q + q , but also in the representation of the control laws with k i + k i , q k 1 + q k 1 , and q k 2 + q k 2 .
The reasons are clearer in the rotated dynamics. Take again Example 3, but now assuming independent reaction rates for all reactions. The MAK then results:
v ˙ + = k i + r + + k i y η v + v
y ˙ + = b + v + a + y + η y + y
v ˙ = k i r + k i + y + η v + v
y ˙ = b v a y η y + y
Expressing the dynamics in the coordinates from Definition 5, we obtain
v ¯ ˙ = k i + r + k i r + k i y k i + y +
y ¯ ˙ = b + v + b v a + y + + a y
v ^ ˙ = k i + r + + k i r + k i y + k i + y + 2 η v + v
y ^ ˙ = b + v + + b v + a + y + + a y 2 η y + y
Remark 2.
Note that, for a signal y ¯ = y + y and y ^ = y + + y and applying the same notation to a parameter a such that a ¯ = a + a , a ^ = a + + a , we have the equivalences
a + y + a y = a ^ 2 y ¯ + a ¯ y ^ 2
a + y + + a y = a ¯ 2 y ¯ + a ^ y ^ 2
The correspondences in (93) to (94) allow us to express the rotated dynamics as
v ¯ ˙ = k i ^ 2 r ¯ y ¯ + k i ¯ 2 r ^ y ^
y ¯ ˙ = b ^ 2 v ¯ a ^ 2 y ¯ + b ¯ 2 v ^ a ¯ 2 y ^
v ^ ˙ = k ^ i 2 r ^ + y ^ η 2 v ^ 2 v ¯ 2 + k ¯ i 2 r ¯ + y ¯
y ^ ˙ = b ^ 2 v ^ + a ^ 2 y ^ η 2 y ^ 2 y ¯ 2 + b ¯ 2 v ¯ + a ¯ 2 y ¯
If the parameters are symmetric, k ¯ i = a ¯ = b ¯ = 0 , we recover the desired I/O system decoupled from the positive and nonlinear dynamics. With mismatching reaction rates, we have instead interconnected inputs from the nonlinear to I/O system that change fundamentally the properties of the CRN, and robustness must be addressed for the complete CRN.
Even if the nonlinearities do not participate in the I/O dynamics directly, v ¯ ˙ and y ¯ ˙ are no longer decoupled from internal positive dynamics. The Assumption 1 of a represented stable I/O system no longer provides guarantees of stability for the interdependent dynamics. Moreover, we can see that, for an unforced response, r ^ = 0 , the equilibrium conditions:
0 = k i ^ 2 y ¯ k i ¯ 2 y ^
0 = b ^ 2 v ¯ a ^ 2 y ¯ + b ¯ 2 v ^ a ¯ 2 y ^
0 = k ^ i 2 y ^ η 2 v ^ 2 v ¯ 2 + k ¯ i 2 y ¯
0 = b ^ 2 v ^ + a ^ 2 y ^ η 2 y ^ 2 y ¯ 2 + b ¯ 2 v ¯ + a ¯ 2 y ¯
can have non-zero equilibrium since v ^ * > 0 and y ^ * > 0 lead to v ¯ * 0 and y ¯ * 0 , with
y ¯ * = k i ¯ k i ^ y ^
v ¯ * = b ¯ b ^ v ^ + y ^ a ^ b ^ k i ¯ k i ^ + a ¯ b ^
The experimental variability of the reaction rates entail that, even in the representation of stable linear feedback systems, the error and uncertainty in the parametrisation of the reaction rates, introduced by the implementation with DSD reactions, can lead to a violation of the symmetry assumptions of the dual-rail methodology and result in unstable circuits [23]. The work by the authors in [22] investigated the impact of such variability and mismatch of the reaction rates in the stability of the mass action kinetics of the CRN, based on robust control techniques based on the structured singular value, adapted to address uncertainty, positivity, and nonlinearities. For small variations in the reaction rates and mismatches in the parametrisation of the dual-rail representation, the method can provide a representative and quantified robustness stability margin for the dual-rail-representation of a feedback system.
Therefore, we know how to quantify the robustness of the CRN to inform how much error and uncertainty introduced by the realisation with DSD reaction networks can be tolerated by the chemical representation. However, we lack experimental assessments of such theoretical results, even with the most basic example of the dual-rail representation of feedback.
The proposed systems with reduced complexity rely on a very few parameters, even considering the complete MAK of the CRN. That means that fewer uncertainty intervals need to be characterised and simpler models for robustness analysis can be generated, while still providing examples where theoretical robustness results could be tested experimentally.

5.5. Leakage Dynamics

Finally, one of the most-problematic issues in the implementation of DSD networks is the existence of leakage, where the output strands are released even in the absence of input. Leakage without exposed toeholds does exist experimentally, albeit at much lower rates, and strands that are designed to be unreactive will unbind and expose domains and toeholds. For example, leakage in the previously unidirectional in the (42) reaction can be represented with
Y + JoinY k l e a k c a × k t J o i n Y _ 1 + d Y
With a finite unbinding rate k l e a k , irreversible reactions in the constructed CRN are actually implemented with reversible cascades of DSD reactions, and such reversibility can change the effective reaction rate and cause the buffering of the input species [8,13].
Moreover, even if the leakage rate can be assumed to be very low k l e a k k t × c i , the large concentrations of auxiliary strands used in the DSD cascades amplifies the leakage of the output, and its impact on the circuit operation can become relevant [24]. Consider in Example 3 that there are additional and undesired processes that lead to the release of Y ± , where
Z + ρ + Z + + Y +
Z ρ Z + Y
In this case, these reactions model the presence of strands Z ± that interact with auxiliary species at high concentrations, which can be approximated with unimolecular reactions, where ρ ± C m a x × k l e a k .
Assumption 3.
Assume that the same leakage processes exist for Y + and Y and have the same network structure. As the network of unimolecular catalysis and degradation reactions are duplicated, we consider that the leakage processes are also duplicated.
From the construction methodology of the dual-rail representation, the cascades of DSD reactions for catalysis and degradation have a symmetrical structure. That is, the representation always results in pairs of catalysis and degradation reactions with ideally matching reaction rates. See, for example, Figure 5 and Figure 13, where the symmetry of the construction methodology is clear in the graphs of the networks. With the additional leakage reactions from (106) to (107), we then have in the MAK that
v ˙ + = k i + r + + k i y η v + v
y ˙ + = b + v + a + y + η y + y + ρ + z +
v ˙ = k i r + k i + y + η v + v
y ˙ = b v a y η y + y + ρ z
and
v ¯ ˙ = k i ^ 2 r ¯ y ¯ + k i ¯ 2 r ^ y ^
y ¯ ˙ = b ^ 2 v ¯ a ^ 2 y ¯ + b ¯ 2 v ^ a ¯ 2 y ^ + ρ ^ 2 z ¯ + ρ ¯ 2 z ^
v ^ ˙ = k ^ i 2 r ^ + y ^ η 2 v ^ 2 v ¯ 2 + k ¯ i 2 r ¯ + y ¯
y ^ ˙ = b ^ 2 v ^ + a ^ 2 y ^ η 2 y ^ 2 y ¯ 2 + b ¯ 2 v ¯ + a ¯ 2 y ¯ + ρ ^ 2 z ^ + ρ ¯ 2 z ¯
Even in the absence of input r ^ = 0 , the leakage will trigger the production of y ^ , and indirectly also v ^ , since in the representation of the feedback, the leaked output species Y ± will trigger the closed-loop response.
An interesting result that needs experimental investigation is to what extent the symmetry of the dual-rail representation helps with the impact of leakage. For illustration, consider Example 3 with ideal k i , b, and a parameters, but with the existence of leakage with asymmetric rates ρ + ρ . Then
v ¯ ˙ = k i r ¯ y ¯
y ¯ ˙ = b v ¯ a y ¯ + ρ ^ 2 z ¯ + ρ ¯ 2 z ^
v ^ ˙ = k i r ^ + y ^ η 2 v ^ 2 v ¯ 2
y ^ ˙ = b v ^ + a y ^ η 2 y ^ 2 y ¯ 2 + ρ ^ 2 z ^ + ρ ¯ 2 z ¯
and we see that the dynamics of the I/O system depend on the asymmetry of the leakage reaction rate ρ ¯ and the difference of leaking strands Z ± . If the initial conditions are the same for Z ± such that z + ( t ) z ( t ) , then ρ ^ z ¯ 0 , and even if there is a considerable presence of Z ± , if the leakage process is symmetric such that ρ ¯ 0 , then ρ ¯ z ^ 0 .
We then have that, while the presence of Z ± can result in serious leakage for each of the components of the signal y ± , with the dual-rail representation of the I/O system, the impact of leakage may be mitigated by reducing the differences between leaked strands and leakage reaction rates. The proposed systems can be used to investigate how the symmetry of the leaking process can be more relevant than the amplitude of the leakage, and if the dual-rail representation can result in systems that are less sensitive to leakage.

6. Conclusions

There currently exist mature theoretical frameworks for the design of linear feedback controllers with CRNs. Systematic procedures and software tools provide a translation to equivalent reactions based on nucleic acid chemistry, which should be amenable to experimental implementation. However, the readiness level of this technology has not followed the theoretical developments, and we are lacking experimental validation of such systems.
The viability of the two proposed constructions is increased by the very few DSD reactions and strands necessary for the chemical representation of linear feedback control systems, with the objective of a near-future experimentation and validation of feedback circuits based on toehold-mediated displacement reactions. For the representation of integral control, we propose a representation simpler than found in the literature, by combining in the same pairs of CRNs the operations of gain, subtraction, and integration. With this, we removed from the implementation two catalytic, two degradation, and one annihilation reaction. The representation of the state feedback candidate was simplified by combining the gain, subtraction, and integration of the first state in the same CRNs. Although a double-integrator is not a stable plant, its representation does not need degradation reactions, and with these choices, four catalytic and one annihilation reaction were removed from the representation.
Both representations capture traditional dynamical features of general classes of linear feedback control systems and can be implemented using six catalytic, two degradations, and one or two annihilation reactions. The reduced number of chemical reactions and the size of the DSD networks puts the proposed candidate constructions within current capabilities of experimental implementation.
Although the representations were simplified to fit viable experimentation with current technical capabilities, the examples still represent challenging feedback control systems, and the circuits are interesting for experimental investigation of the dependence of closed-loop dynamics on toehold design and the impact of the annihilation reactions and internal nonlinear positive dynamics on the stability, persistent equilibrium, and concentration levels of the circuit. Furthermore, the proposed systems are rich enough to investigate spurious effects and dynamics present in DSD networks and how much the differential nature of the dual-rail representation may help mitigate experimental perturbations.

Author Contributions

Conceptualisation, D.G.B., M.F., T.F.A.d.G. and J.K.; methodology, N.M.G.P., T.F.A.d.G. and J.K.; formal analysis, N.M.G.P. and M.F.; investigation, N.M.G.P., T.F.A.d.G. and J.K.; writing—original draft preparation, N.M.G.P., M.F. and D.G.B.; writing—review and editing, N.M.G.P., M.F., T.F.A.d.G., J.K. and D.G.B.; supervision, D.G.B. and M.F.; funding acquisition, D.G.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by BBSRC/EPSRC (BB/M017982) and the EPSRC and BBSRC Centre for Doctoral Training in Synthetic Biology (EP/L016494/1).

Data Availability Statement

The simulation files of this study are available upon reasonable request from the first author, N.M.G.P.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of the data; in the writing of the manuscript; nor in the decision to publish the results.

Abbreviations

The following abbreviations are used in this manuscript:
CRNChemical Reaction Network
DNADeoxyribonucleic Acid
DSDDNA Strand Displacement
I/OInput-to-Output
IPRInternal Positive Representation
MAKMass Action Kinetics
ODEOrdinary Differential Equations
PIProportional and Integral
PIDProportional–Integral–Derivative
RNARibonucleic Acid
SFIState Feedback and Integral

References

  1. Hemphill, J.; Deiters, A. DNA computation in mammalian cells: MicroRNA logic operations. J. Am. Chem. Soc. 2013, 135, 10512–10518. [Google Scholar] [CrossRef] [PubMed]
  2. Groves, B.; Chen, Y.J.; Zurla, C.; Pochekailov, S.; Kirschman, J.L.; Santagelo, P.J.; Seelig, G. Computing in mammalian cells with nucleic acid strand exchange. Nat. Nanotechnol. 2016, 11, 287–294. [Google Scholar] [CrossRef] [Green Version]
  3. Wang, T.; Hellmer, H.; Simmel, F.C. Genetic switches based on nucleic acid strand displacement. Curr. Opin. Biotechnol. 2023, 79, 102867. [Google Scholar] [CrossRef] [PubMed]
  4. Phillips, A.; Cardelli, L. A programming language for composable DNA circuits. J. R. Soc. Interface 2009, 6, S419–S436. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Zhang, J.X.; Fang, J.Z.; Duan, W.; Wu, L.R.; Zhang, A.W.; Dalchau, N.; Yordanov, B.; Petersen, R.; Phillips, A.; Zhang, D.Y. Predicting DNA hybridization kinetics from sequence. Nat. Chem. 2018, 10, 91–98. [Google Scholar] [CrossRef] [Green Version]
  6. Hertel, S.; Spinney, R.E.; Xu, S.Y.; Ouldridge, T.E.; Morris, R.G.; Lee, L.K. The stability and number of nucleating interactions determine DNA hybridization rates in the absence of secondary structure. Nucleic Acids Res. 2022, 50, 7829–7841. [Google Scholar] [CrossRef] [PubMed]
  7. Buisman, H.J.; ten Eikelder, H.M.M.; Hilbers, P.A.J.; Liekens, A.M.L. Computing algebraic functions with biochemical reaction networks. Artif. Life 2009, 15, 5–19. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Soloveichik, D.; Seelig, G.; Winfree, E. DNA as a universal substrate for chemical kinetics. Proc. Natl. Acad. Sci. USA 2010, 107, 5393–5398. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Chen, Y.J.; Dalchau, N.; Srinivas, N.; Phillips, A.; Cardellil, L.; Soloveichik, D.; Seelig, G. Programmable chemical controllers made from DNA. Nat. Nanotechnol. 2013, 8, 755–762. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Seelig, G.; Soloveichik, D.; Zhang, D.Y.; Winfree, E. Enzyme-free nucleic acid logic circuits. Science 2006, 314, 1585–1588. [Google Scholar] [CrossRef] [Green Version]
  11. Chiu, T.Y.; Chiang, H.J.K.; Huang, R.Y.; Jiang, J.H.R.; Fages, F. Synthesizing configurable biochemical implementation of linear systems from their transfer function specifications. PLoS ONE 2015, 10, e0137442. [Google Scholar] [CrossRef]
  12. Oishi, K.; Klavins, E. Biomolecular implementation of linear I/O systems. IET Syst. Biol. 2011, 5, 252–260. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Yordanov, B.; Kim, J.; Petersen, R.L.; Shudy, A.; Kulkarni, V.V.; Phillips, A. Computational design of nucleic acid feedback control circuits. ACS Synth. Biol. 2014, 3, 600–616. [Google Scholar] [CrossRef]
  14. Paulino, N.M.G.; Foo, M.; Kim, J.; Bates, D.G. PID and state feedback controllers using DNA strand displacement reactions. IEEE Contr. Syst. Lett. 2019, 3, 805–810. [Google Scholar] [CrossRef]
  15. Wang, Y.; Ji, H.; Wang, Y.; Sun, J. Stability based on PI control of three-dimensional chaotic oscillatory system via DNA chemical reaction networks. IEEE Trans. Nanobiosci. 2021, 20, 311–322. [Google Scholar] [CrossRef]
  16. Whitby, M.; Cardelli, L.; Kwiatkowska, M.; Laurenti, L.; Tribastone, M.; Tschaikowski, M. PID control of biochemical reaction networks. IEEE Trans. Autom. Control 2022, 67, 1023–1030. [Google Scholar] [CrossRef]
  17. Li, Y.; Lv, H.; Wang, X. The design of 2DOF IMC-PID controller in biochemical reaction networks. Appl. Sci. 2023, 13, 3402. [Google Scholar] [CrossRef]
  18. Sawlekar, R.; Montefusco, F.; Kulkarni, V.V.; Bates, D.G. Implementing nonlinear feedback controllers using DNA strand displacement reactions. IEEE Trans. Nanobiosci. 2016, 15, 443–454. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Foo, M.; Kim, J.; Sawlekar, R.; Bates, D.G. Design of an embedded inverse-feedforward biomolecular tracking controller for enzymatic reaction processes. Comput. Chem. Eng. 2017, 99, 145–157. [Google Scholar] [CrossRef] [PubMed]
  20. Sun, J.; Shan, Z.; Liu, P.; Wang, Y. Backstepping synchronization control for three-dimensional chaotic oscillatory system via DNA strand displacement. IEEE Trans. Nanobiosci. 2022. [Google Scholar] [CrossRef]
  21. Thubagere, A.J.; Thachuk, C.; Berleant, J.; Johnson, R.F.; Ardelean, D.A.; Cherry, K.M.; Qian, L. Compiler-aided systematic construction of large-scale DNA strand displacement circuits using unpurified components. Nat. Commun. 2017, 8, 14373. [Google Scholar] [CrossRef] [Green Version]
  22. Paulino, N.M.G.; Foo, M.; Kim, J.; Bates, D.G. Robustness analysis of a nucleic acid controller for a dynamic biomolecular process using the structured singular value. J. Process Control 2019, 78, 34–44. [Google Scholar] [CrossRef]
  23. Paulino, N.M.G.; Foo, M.; Kim, J.; Bates, D.G. On the stability of nucleic acid feedback control systems. Automatica 2020, 119, 109103. [Google Scholar] [CrossRef]
  24. Srinivas, N.; Parkin, J.; Seelig, G.; Winfree, E.; Soloveichik, D. Enzyme-free nucleic acid dynamical systems. Science 2017, 358, eaal2052. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Zarubiieva, I.; Spaccasassi, C.; Kulkarni, V.; Phillips, A. Automated leak analysis of nucleic acid circuits. ACS Synth. Biol. 2022, 11, 1931–1948. [Google Scholar] [CrossRef]
  26. Qian, L.; Winfree, E. Scaling up digital circuit computation with DNA strand displacement cascades. Science 2011, 332, 1196–1201. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Wang, B.; Thachuk, C.; Ellington, A.; Soloveichik, D. The design space of strand displacement cascades with toehold-size clamps. In DNA Computing and Molecular Programming 23; Springer: Berlin/Heidelberg, Germany, 2017; pp. 64–81. [Google Scholar]
  28. Dannenberg, F.; Kwiatkowska, M.; Thachuk, C.; Turberfield, A.J. DNA walker circuits: Computational potential, design, and verification. Nat. Comput. 2015, 14, 195–211. [Google Scholar] [CrossRef] [Green Version]
  29. Chatterjee, G.; Dalchau, N.; Muscat, R.A.; Phillips, A.; Seelig, G. A spatially localized architecture for fast and modular DNA computing. Nat. Nanotechnol. 2017, 12, 920–927. [Google Scholar] [CrossRef]
  30. Joesaar, A.; Yang, S.; Bögels, B.; van der Linden, A.; Pieters, P.; Kumar, B.V.V.S.P.; Dalchau, N.; Phillips, A.; Mann, S.; de Greef, T.F.A. DNA-based communication in populations of synthetic protocells. Nat. Nanotechnol. 2019, 14, 369–378. [Google Scholar] [CrossRef]
  31. Wang, B.; Thachuk, C.; Ellington, A.D.; Winfree, E.; Soloveichik, D. Effective design principles for leakless strand displacement systems. Proc. Natl. Acad. Sci. USA 2018, 115, E12182–E12191. [Google Scholar] [CrossRef] [Green Version]
  32. Cherry, K.M.; Qian, L. Scaling up molecular pattern recognition with DNA-based winner-take-all neural networks. Nature 2018, 559, 370–376. [Google Scholar] [CrossRef]
  33. Mayer, T.; Oesinghaus, L.; Simmel, F.C. Toehold-mediated strand displacement in random sequence pools. J. Am. Chem. Soc. 2023, 145, 634–644. [Google Scholar] [CrossRef]
  34. Paulino, N.M.G.; Foo, M.; de Greef, T.F.A.; Kim, J.; Bates, D.G. Minimally complex nucleic acid feedback control systems for first experimental implementations. In Proceedings of the 21st IFAC World Congress, Berlin, Germany, 11–17 July 2020; pp. 16745–16752. [Google Scholar]
  35. Tóth, P.; Érdi, J. Mathematical Models of Chemical Reactions: Theory and Applications of Deterministic and Stochastic Models; Manchester University Press: Manchester, UK, 1989. [Google Scholar]
  36. Fages, F.; LeGuludec, G.; Bournez, O.; Pouly, A. Strong Turing completeness of continuous chemical reaction networks and compilation of mixed analogue-digital programs. In Proceedings of the 15th International Conference on Computational Methods in Systems Biology, Darmstadt, Germany, 27–29 September 2017; pp. 108–127. [Google Scholar]
  37. Brijder, R. Computing with chemical reaction networks: A tutorial. Nat. Comput. 2019, 18, 119–137. [Google Scholar] [CrossRef] [Green Version]
  38. Salehi, S.A.; Parhi, K.K.; Riedel, M.D. Chemical reaction networks for computing polynomials. ACS Synth. Biol. 2017, 6, 76–83. [Google Scholar] [CrossRef] [PubMed]
  39. Vasić, M.; Soloveichik, D.; Khurshid, S. CRN++: Molecular programming language. Nat. Comput. 2020, 19, 391–407. [Google Scholar] [CrossRef] [Green Version]
  40. Angeli, D. A tutorial on chemical reaction network dynamics. Eur. J. Control 2009, 15, 398–406. [Google Scholar] [CrossRef]
  41. David, A.; Sontag, E.D. Graphs and the dynamics of biochemical networks. In Control Theory and Systems; Iglesias, P., Ingalls, B.P., Eds.; MIT Press: Cambridge, MA, USA, 2010; pp. 125–143. [Google Scholar]
  42. Feinberg, M. Chemical reaction network structure and the stability of complex isothermal reactors-I. The deficiency zero and deficiency one theorems. Chem. Eng. Sci. 1987, 42, 2229–2268. [Google Scholar] [CrossRef]
  43. Craciun, G.; Feinberg, M. Multiple equilibria in complex chemical reaction networks: II. The species-reaction graph. SIAM J. Appl. Math. 2006, 66, 1321–1338. [Google Scholar] [CrossRef] [Green Version]
  44. Craciun, G.; Feinberg, M. Multiple equilibria in complex chemical reaction networks: I. The injectivity property. SIAM J. Appl. Math. 2005, 65, 1526–1546. [Google Scholar] [CrossRef] [Green Version]
  45. Shinar, G.; Alon, U.; Feinberg, M. Sensitivity and robustness in chemical reaction networks. SIAM J. Appl. Math. 2009, 69, 977–998. [Google Scholar] [CrossRef] [Green Version]
  46. Otero-Muras, I.; Szederkényi, G.; Hangos, K.M.; Alonso, A.A. Dynamic analysis and control of biochemical reaction networks. Math. Comput. Simul. 2008, 79, 999–1009. [Google Scholar] [CrossRef] [Green Version]
  47. Daniel, R.; Rubens, J.R.; Sarpeshkar, R.; Lu, T.K. Synthetic analogue computation in living cells. Nature 2013, 497, 619–623. [Google Scholar] [CrossRef]
  48. Koch, M.; Faulon, J.L.; Borkowski, O. Models for cell-free synthetic biology: Make prototyping easier, better, and faster. Front. Bioeng. Biotechnol. 2018, 6, 182. [Google Scholar] [CrossRef]
  49. Jeong, D.; Klocke, M.; Agarwal, S.; Kim, J.; Choi, S.; Franco, E.; Kim, J. Cell-free synthetic biology platform for engineering synthetic biological circuits and systems. Methods Protoc. 2019, 2, 39. [Google Scholar] [CrossRef] [Green Version]
  50. Bournez, O.; Graça, D.S.; Pouly, A. Polynomial time corresponds to solutions of polynomial ordinary differential equations of polynomial length. J. ACM 2017, 64, 1–76. [Google Scholar] [CrossRef] [Green Version]
  51. Ingalls, B. Mathematical Modeling in Systems Biology: An Introduction; MIT Press: Cambridge, MA, USA, 2013. [Google Scholar]
  52. Cosentino, C.; Bates, D.G. Feedback Control in Systems Biology; CRC Press: Boca Raton, FL, USA, 2012. [Google Scholar]
  53. Murray, J.D. Mathematical Biology: I. An Introduction; Springer: Berlin/Heidelberg, Germany, 2007. [Google Scholar]
  54. Song, T.; Garg, S.; Mokhtar, R.; Bui, H.; Reif, J. Analog computation by DNA strand displacement circuits. ACS Synth. Biol. 2016, 5, 898–912. [Google Scholar] [CrossRef] [PubMed]
  55. Zou, C.; Wei, X.; Zhang, Q.; Liu, C.; Zhou, C.; Liu, Y. Four-analogue computation based on DNA strand displacement. ACS Omega 2017, 2, 4143–4160. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Horton, R.; Mauran, L.; Rawn, D.; Scrimgeour, G.; Perry, M. Principles of Biochemistry; Pearson Education: London, UK, 2011. [Google Scholar]
  57. Lakin, M.R.; Youssef, S.; Polo, F.; Emmott, S.; Phillips, A. Visual DSD: A design and analysis tool for DNA strand displacement systems. Bioinformatics 2011, 27, 3211–3213. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  58. Zhang, D.Y.; Winfree, E. Control of DNA strand displacement kinetics using toehold exchange. J. Am. Chem. Soc. 2009, 131, 17303–17314. [Google Scholar] [CrossRef] [Green Version]
  59. Cacace, F.; Farina, L.; Germani, A.; Manes, C. Internally positive representation of a class of continuous time systems. IEEE Trans. Autom. Control 2012, 57, 3158–3163. [Google Scholar] [CrossRef]
  60. Lakin, M.R.; Petersen, R.L.; Phillips, A. Visual DSD User Manual v0.14 Beta; Microsoft Corporation: Cambridge, UK, 2017. [Google Scholar]
  61. Zhang, D.Y. Cooperative hybridization of oligonucleotides. J. Am. Chem. Soc. 2011, 133, 1077–1086. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  62. Clamons, S.; Qian, L.; Winfree, E. Programming and simulating chemical reaction networks on a surface. J. R. Soc. Interface 2020, 17, 20190790. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The first-order transfer function described in Example 2 depicted as a network with the dual-rail representation. Here, we have the duplication of unimolecular reactions of degradation and catalysis. In the subsequent graphs, the autocatalysis represented in grey will be omitted. Through a bimolecular reaction, the two components of the output signal y = y + y annihilate each other.
Figure 1. The first-order transfer function described in Example 2 depicted as a network with the dual-rail representation. Here, we have the duplication of unimolecular reactions of degradation and catalysis. In the subsequent graphs, the autocatalysis represented in grey will be omitted. Through a bimolecular reaction, the two components of the output signal y = y + y annihilate each other.
Bioengineering 10 00466 g001
Figure 2. Single- and double-stranded DNA represented in three different manners: (a) sugar-phosphate backbones with either forming a helicoidal double structure or exposed sugar bases; (b) sequences of bound pairs of complementary sequences of nucleotides; (c) numbering the domains, where 2 * is the complementary sequence to the domain 2.
Figure 2. Single- and double-stranded DNA represented in three different manners: (a) sugar-phosphate backbones with either forming a helicoidal double structure or exposed sugar bases; (b) sequences of bound pairs of complementary sequences of nucleotides; (c) numbering the domains, where 2 * is the complementary sequence to the domain 2.
Bioengineering 10 00466 g002
Figure 3. An illustration of a bimolecular DSD reaction of A + B C + D that involves single- and double-strands. The hybridisation between overhanging complementary toeholds 1 and 1 * initiates the displacement, resulting in competition for domain 2 * between the incumbent strand and the incoming strand A. The hybridisation carries on till the incumbent is fully displaced, yielding new “species” C and D. There is an exposed toehold for the single-strand C, which can trigger other hybridisation reactions. In view of the absence of exposed toeholds, species D is deemed unreactive waste.
Figure 3. An illustration of a bimolecular DSD reaction of A + B C + D that involves single- and double-strands. The hybridisation between overhanging complementary toeholds 1 and 1 * initiates the displacement, resulting in competition for domain 2 * between the incumbent strand and the incoming strand A. The hybridisation carries on till the incumbent is fully displaced, yielding new “species” C and D. There is an exposed toehold for the single-strand C, which can trigger other hybridisation reactions. In view of the absence of exposed toeholds, species D is deemed unreactive waste.
Bioengineering 10 00466 g003
Figure 4. Reference tracking problem with integral control of a stable first-order plant.
Figure 4. Reference tracking problem with integral control of a stable first-order plant.
Bioengineering 10 00466 g004
Figure 5. Dual-rail representation for the CRN of the catalysis, degradation, and annihilation reactions for realising integral control employing the MAK.
Figure 5. Dual-rail representation for the CRN of the catalysis, degradation, and annihilation reactions for realising integral control employing the MAK.
Bioengineering 10 00466 g005
Figure 6. The depiction of input-to-output dynamics of a nonlinear internal positive representation using a linear system, given by the MAK of a CRN.
Figure 6. The depiction of input-to-output dynamics of a nonlinear internal positive representation using a linear system, given by the MAK of a CRN.
Bioengineering 10 00466 g006
Figure 7. An example of a set of DSD reactions in which their dynamics are equivalent to a catalysis reaction R k t × c i R + V generated in Visual DSD utilising the J o i n - F o r k templates following [9]. The toehold <tr*ci> in the complex J o i n V R contains a complementarity degree to the signal toehold <tr> of 0 < c i 1 . This slows down the reaction mediated by <tr> and <tr*ci> to k t × c i , where k t is the maximum binding rate of two complementary toeholds <tr> and <tr*> [13,60].
Figure 7. An example of a set of DSD reactions in which their dynamics are equivalent to a catalysis reaction R k t × c i R + V generated in Visual DSD utilising the J o i n - F o r k templates following [9]. The toehold <tr*ci> in the complex J o i n V R contains a complementarity degree to the signal toehold <tr> of 0 < c i 1 . This slows down the reaction mediated by <tr> and <tr*ci> to k t × c i , where k t is the maximum binding rate of two complementary toeholds <tr> and <tr*> [13,60].
Bioengineering 10 00466 g007
Figure 8. An example of a set of DSD reactions in which their dynamics are equivalent to a degradation reaction Y k t × c a , Ø , generated in Visual DSD utilising the J o i n - F o r k templates following [9]. The toehold <tyca> has a degree of complementarity of 0 < ca, kt < 1 to the toehold <ty>, effectively slowing down the binding rate from kt to kt×ca.
Figure 8. An example of a set of DSD reactions in which their dynamics are equivalent to a degradation reaction Y k t × c a , Ø , generated in Visual DSD utilising the J o i n - F o r k templates following [9]. The toehold <tyca> has a degree of complementarity of 0 < ca, kt < 1 to the toehold <ty>, effectively slowing down the binding rate from kt to kt×ca.
Bioengineering 10 00466 g008
Figure 9. An example of a set of DSD reactions in which their dynamics are equivalent to an annihilation reaction generated in Visual DSD utilising the cooperative hybridisation approach following [32,61].
Figure 9. An example of a set of DSD reactions in which their dynamics are equivalent to an annihilation reaction generated in Visual DSD utilising the cooperative hybridisation approach following [32,61].
Bioengineering 10 00466 g009
Figure 10. The species that were used to initialise the DSD network for integral feedback control system representation. Here, R, R′, V, V′, and Y, Y′ depict the signal strands. Together with the auxiliary strands, they are initialised at high concentrations.
Figure 10. The species that were used to initialise the DSD network for integral feedback control system representation. Here, R, R′, V, V′, and Y, Y′ depict the signal strands. Together with the auxiliary strands, they are initialised at high concentrations.
Bioengineering 10 00466 g010
Figure 11. The integral control (Example 3) simulation results: (a) output y for the step response of the open-loop plant, closed-loop dynamics, the MAK from the CRN and DSD reactions; (b) concentrations in both the CRN and DSD representations.
Figure 11. The integral control (Example 3) simulation results: (a) output y for the step response of the open-loop plant, closed-loop dynamics, the MAK from the CRN and DSD reactions; (b) concentrations in both the CRN and DSD representations.
Bioengineering 10 00466 g011
Figure 12. Block diagram representation of a static state feedback controller stabilising a double-integrator plant.
Figure 12. Block diagram representation of a static state feedback controller stabilising a double-integrator plant.
Bioengineering 10 00466 g012
Figure 13. Network of chemical reactions for dual-rail representation of the state feedback control system, using (a) catalytic degradation or (b) degradation reactions.
Figure 13. Network of chemical reactions for dual-rail representation of the state feedback control system, using (a) catalytic degradation or (b) degradation reactions.
Bioengineering 10 00466 g013
Figure 14. The state feedback control (Example 4) simulation results: steady-state tracking response of the linear design and the CRN and DSD reactions representing the I/O dynamics.
Figure 14. The state feedback control (Example 4) simulation results: steady-state tracking response of the linear design and the CRN and DSD reactions representing the I/O dynamics.
Bioengineering 10 00466 g014
Figure 15. Set of toehold-mediated species present initially for the DSD network representation of the state feedback control of the double-integrator. The strands R, R′, X, X′, and Y, Y′ are the dual-species for the signals. Together with the auxiliary strands, they were initialised at high concentrations.
Figure 15. Set of toehold-mediated species present initially for the DSD network representation of the state feedback control of the double-integrator. The strands R, R′, X, X′, and Y, Y′ are the dual-species for the signals. Together with the auxiliary strands, they were initialised at high concentrations.
Bioengineering 10 00466 g015
Figure 16. Simulation of the abstract CRN and the DSD implementation for the state feedback control in Example 4. The simulation of the DSD realisation has the output species Y ± steady-state close to the expected from the CRN representation. X ± , on the other hand, is smaller for the DSD circuit.
Figure 16. Simulation of the abstract CRN and the DSD implementation for the state feedback control in Example 4. The simulation of the DSD realisation has the output species Y ± steady-state close to the expected from the CRN representation. X ± , on the other hand, is smaller for the DSD circuit.
Bioengineering 10 00466 g016
Figure 17. Histories of the consumptions of the auxiliary species from the simulation in Visual DSD of the state feedback control in Example 4, with concentrations remaining close to their initial value of C m a x = 10 4 nM throughout the operation of the circuit.
Figure 17. Histories of the consumptions of the auxiliary species from the simulation in Visual DSD of the state feedback control in Example 4, with concentrations remaining close to their initial value of C m a x = 10 4 nM throughout the operation of the circuit.
Bioengineering 10 00466 g017
Figure 18. Histories of the concentrations of the waste species from the simulation in Visual DSD of the state feedback control in Example 4: W y and W y result from the implementation of Y + + Y Ø ; J o i n X _ 1 and J o i n X _ 1 result from implementing X ± Ø ; F o r k X R _ 4 and F o r k X R _ 4 result from X ± X ± + R ± ; F o r k Y X _ 4 and F o r k Y X _ 4 result from X ± X ± + Y ± ; F o r k X Y _ 4 and F o r k X Y _ 4 result from Y ± Y ± + X .
Figure 18. Histories of the concentrations of the waste species from the simulation in Visual DSD of the state feedback control in Example 4: W y and W y result from the implementation of Y + + Y Ø ; J o i n X _ 1 and J o i n X _ 1 result from implementing X ± Ø ; F o r k X R _ 4 and F o r k X R _ 4 result from X ± X ± + R ± ; F o r k Y X _ 4 and F o r k Y X _ 4 result from X ± X ± + Y ± ; F o r k X Y _ 4 and F o r k X Y _ 4 result from Y ± Y ± + X .
Bioengineering 10 00466 g018
Table 1. The integral control circuit’s parametrisation for Visual DSD simulation.
Table 1. The integral control circuit’s parametrisation for Visual DSD simulation.
VariableDescriptionValuesUnits
C m a x Template and auxiliary species initial concentrations 10 4 nM
k b n d Auxiliary strands’ (<tp>,<tq>) toehold maximum binding rate 10 3 ( nMs ) 1
k u b n d Unbinding rate 0.1 ( s ) 1
k t Signal species’ (<tr>,<ty>,<tv>) toehold maximum binding rate 10 4 ( nMs ) 1
c a Degradation of Y ± toehold complementarity degree 2.5 × 10 3
c b Plant catalysis reaction toehold complementarity degree 10 3
c i Feedback catalysis implementing integral control toehold complementarity degree 5 × 10 2
c V V Annihilation reaction toehold complementarity degree 0.25
Table 2. The state feedback control circuit’s parametrisation for the Visual DSD simulation.
Table 2. The state feedback control circuit’s parametrisation for the Visual DSD simulation.
VariableDescriptionValesUnits
C m a x Template and auxiliary species’ initial concentrations 10 4 nM
k b n d Auxiliary strands’ (<tp>,<tq>) toehold maximum binding rate 10 3 ( nMs ) 1
k u b n d Unbinding rate 0.1 ( s ) 1
k t Signal species’ (<tr>,<ty>,<tx>) toehold maximum binding rate 10 4 ( nMs ) 1
c q Plant reaction toehold complementarity degree 8 × 10 3
c 1 Degradation of X ± toehold complementarity degree 8 × 10 3
c 2 Feedback catalysis of Y ± toehold complementarity degree 8 × 10 3
c Y Y Annihilation reaction toehold complementarity degree1
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Paulino, N.M.G.; Foo, M.; de Greef, T.F.A.; Kim, J.; Bates, D.G. A Theoretical Framework for Implementable Nucleic Acids Feedback Systems. Bioengineering 2023, 10, 466. https://doi.org/10.3390/bioengineering10040466

AMA Style

Paulino NMG, Foo M, de Greef TFA, Kim J, Bates DG. A Theoretical Framework for Implementable Nucleic Acids Feedback Systems. Bioengineering. 2023; 10(4):466. https://doi.org/10.3390/bioengineering10040466

Chicago/Turabian Style

Paulino, Nuno M. G., Mathias Foo, Tom F. A. de Greef, Jongmin Kim, and Declan G. Bates. 2023. "A Theoretical Framework for Implementable Nucleic Acids Feedback Systems" Bioengineering 10, no. 4: 466. https://doi.org/10.3390/bioengineering10040466

APA Style

Paulino, N. M. G., Foo, M., de Greef, T. F. A., Kim, J., & Bates, D. G. (2023). A Theoretical Framework for Implementable Nucleic Acids Feedback Systems. Bioengineering, 10(4), 466. https://doi.org/10.3390/bioengineering10040466

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop