All articles published by MDPI are made immediately available worldwide under an open access license. No special
permission is required to reuse all or part of the article published by MDPI, including figures and tables. For
articles published under an open access Creative Common CC BY license, any part of the article may be reused without
permission provided that the original article is clearly cited. For more information, please refer to
https://www.mdpi.com/openaccess.
Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature
Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for
future research directions and describes possible research applications.
Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive
positive feedback from the reviewers.
Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world.
Editors select a small number of articles recently published in the journal that they believe will be particularly
interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the
most exciting work published in the various research areas of the journal.
This paper is devoted to the research of the isomorphic multidimensional cyclic structure and multidimensional phase structure of the cyclic random process (CRP) and to its formation method, which enables a rigorous formalization of intuitive ideas concerning cyclic stochastic motion. The fundamental properties of the cyclic random process and analytical dependencies between the multidimensional cyclic structure, multidimensional phase structure and rhythm structure of the CRP have been established. This work shows that the CRP is able to take into account the cyclicity of multidimensional distribution functions of cyclic signals as well as the variability in the rhythm of the investigated signals. A subclass of the CRP is the periodic random process, which allows for the use of classical processing methods of cyclic signals with a regular rhythm. Based on a series of experiments, significant advantages of the CRP as a mathematical model of electrocardiographic signals (ECG) compared to the periodic random process are shown.
Humanity has been engaged in the study of cyclical phenomena and processes since ancient times. The current stage of cyclic phenomena and signal research is characterized by the intensive use of highly efficient automated information systems and technologies, in particular, signal processing, data mining and machine learning. Both in ancient times and in the modern period of research on cyclic phenomena with the help of information systems and technologies, the central concept is the mathematical model of a cyclic phenomenon (process or signal), since the mathematical model of cyclic signals significantly determines the accuracy and reliability of the methods of their processing and determines the level of informativity of the diagnostic features in such information systems.
Historically, the first mathematical models that were used to describe cyclic processes were deterministic functions: harmonic, periodic, poly-periodic and almost-periodic functions. Based on these deterministic functions, spectral analysis methods are used, in particular, Fourier series and Fourier transforms [1,2]. Differential (ordinary and partial derivative, linear and nonlinear) and difference equations have been actively used to describe dynamic systems with cyclic patterns of functioning [3,4,5,6]. The deterministic functions mentioned above are the solutions of such equations. The next important stage in the creation of mathematical models of oscillating phenomena and signals is the application of probability theory, the theory of random processes and mathematical statistics. During the formation of the theory of random processes, cyclic phenomena and signals were studied as stationary random processes [7,8,9], applying methods of signal processing in both the time and spectral domains. However, such a stochastic model does not have the means to take into account the cyclical probabilistic characteristics of the signals, which led to the development of non-stationary probabilistic models. The simplest non-stationary probabilistic models of cyclic signals are additive, multiplicative and additive–multiplicative models, which somehow combine a stationary random process and periodic deterministic functions. Much more complex probabilistic models of cyclic signals are non-stationary random processes, such as cyclostationary (periodic) and almost-cyclostationary (almost periodic) random processes [10,11,12,13,14,15,16,17,18,19,20,21], periodic Markov random processes and chains [22,23,24,25,26,27], stochastic difference and differential equations with periodic solutions [28,29,30], and linear periodic random processes [31,32].
Cyclostationary and almost-cyclostationary random processes have received the greatest amount of theoretical development and have had the most applications in solving problems of probabilistic modeling and cyclic signal processing in mechanical, telecommunication, energy, astrophysical and biological systems [33,34,35,36,37,38,39,40,41,42,43,44]. Various generalizations of cyclostationary and almost-cyclostationary random processes are made in the works of [45,46]. Despite the significant progress in the use of these probabilistic mathematical models of cyclic signals, these models are inadequate (or weakly adequate) for cyclic signals whose rhythm is irregular (variable). More precisely, random processes with periodic probabilistic characteristics do not have the formal means to display (consider) the variability in the rhythm of the studied cyclic signals; these models are adequate and effective for describing cyclic signals with a regular rhythm (or when the irregularity of the rhythm can be ignored).
Another group of nonstationary models with non-periodic probabilistic characteristics, namely, the poly-periodic cyclostationary stochastic process, almost-cyclostationary stochastic process, generalized almost-cyclostationary process, spectrally correlated process, oscillatory almost-cyclostationary process and oscillatory spectrally correlated process, are generalizations of random processes with periodic probabilistic characteristics, which are based on the possibility of representing these processes through superpositions (using analogues of the Fourier series or Fourier integrals) of complex exponents (complex harmonic functions) with constant or time-varying amplitudes and phases; however, such generalization strategies for periodic random processes (the class-forming properties of these non-periodic random processes) are not oriented and do not ensure the preservation of the cyclic structure that is typical for random processes with periodic probabilistic characteristics. Thus, the probabilistic characteristics of these non-periodic random processes are, in general, not cyclic (only the spectral components of the corresponding analogues of the Fourier series or Fourier integrals have a cyclic structure), which indicates a certain inadequacy (excessive generality) for modeling cyclic stochastic signals, for which the cyclicity of the structure of probabilistic characteristics is an attributive property.
In the dissertation of [47], a new approach to mathematical modeling, computer simulation and the processing of cyclic signals was created. This approach has been widely used for modeling cyclic signals of various natures [48,49,50,51,52]. As part of this approach, a conditional cyclic random process was developed, which enabled a consistent mathematical description of cyclic signals with double stochasticity, namely, with simultaneous stochasticity of their cyclic and rhythmic structures [53]. The developed models, methods and software tools for processing cyclic signals are organized in the form of a computer ontology, which is built on the basis of an axiomatic deductive strategy for the systematization of knowledge in modern intellectualized information systems [54,55]. Somewhat similar approaches to modeling cyclic signals with irregular cyclicity are carried out in the works of [56,57,58,59,60].
The CRP has a cyclic structure of probabilistic characteristics and adequately describes cyclic signals with both regular and irregular rhythms, which gives it a significant advantage over other known probabilistic models of cyclic stochastic signals. However, there are no research studies devoted to the method of formation such processes and procedures for constructing multidimensional cyclic and phase structures. In contrast to the cyclic random process in the strict sense, the construction procedure and fundamental properties of a cyclically correlated random process in a broad sense were presented in the work of [61]. The purpose of this work is to construct isomorphic time-invariant structures of a CRP in an explicit, meaningful, interpretable and mathematical form, to describe its multidimensional cyclic and phase structures and to form the basis for a procedure for the construction and definition of CRPs. Also, an important task of this work is to establish fundamental properties and analytical dependencies between the multidimensional cyclic structure, multidimensional phase structure and rhythmic structure of the CRP, which will be the basis of the theory of mathematical modeling and rhythm-adaptive processing methods (statistical estimation, sampling, spectral analysis and computer modeling) of cyclic signals with both regular and irregular rhythms. Also, this work aims to identify the advantages of the CRP in comparison with a classical periodic random process in the tasks of the modeling and statistical processing of biomedical signals, in which the rhythm is variable.
The paper is organized as follows: The Section 2 is devoted to the procedure of the CRP construction. The Section 3 and Section 4 are devoted to the multidimensional cyclic and phase structures of the CRP. The Section 5 deals with representations of the CRP and its distribution functions through their cyclic structures. The Section 6 is devoted to representations of the CRP and its distribution functions through their phase structures. In the Section 7, analytical dependencies are considered between cyclic and phase multidimensional structures of the CRP. The Section 8 is devoted to the main subclasses of the CRP, in particular, to fractal cyclic random processes. The Section 9 is devoted to statistical analyses of the ECG results, which are based on the mathematical models of the ECG in the form of the CRP and a periodic random process.
2. The Multidimensional Structures in the Procedure of CRP Construction
In order to build a mathematical construction based on a strict definition of the CRP, we formalize intuitive (informal) fundamental concepts such as the multidimensional cycle and phase structures of a cyclic process within the framework of the theory of random processes. The first stage of the procedure for the CRP’s construction coincides with the first stage of constructing a cyclically correlated random process, which is described in detail in the work of [61]. Therefore, in order to ensure the integrity of the content of the article, here we present only the main elements of this stage of construction. As shown in the work of [61], in general, a cyclic signal is random process () which is given as a set of pairs (argument , value ) with the same probability space . A necessary prerequisite for building a one-dimensional and multidimensional cyclic structure of a CRP is the ordered (ordered by m) countable partition of domain , then, for the elements of , the following can be determined [61]:
where . Set is a subset of whose elements correspond to the moments at the beginning of the cycles of a cyclic signal. In the work of [61], the elements of partition are interpreted as carriers of relational systems with the linear order and are ordered by the countable family of the subrelational systems of a relational system , between which there is an isomorphism with respect to the linear order (see Figure 1).
In work [61] it is shown that by bijection from partition of domain can be built countable family of the isomorphic with respect to binary relation of linear order subrelational systems of relational system . Linear order here is generated in by linear order in ().
The countable family represents the one-dimensional isomorphic structures of a random process . To display the multidimensional (-dimensional) isomorphic structures of a random process , let us consider the Cartesian degree of the -th order () of the random process and the bijection , which can always be constructed because any -dimensional vector corresponds to one and only one -dimensional vector and vice versa. Furthermore, for the two different -dimensional vectors and the corresponding two -dimensional vectors and are also different, and vice versa. The Cartesian degree can be considered as a carrier of the relational system with a binary relation of the linear order . The ordinal type of coincides with the ordinal type of the set . Namely, for any two -dimensional vectors and , the following relationships can be seen: if or if . In the case when , we will have the following order: if or if . In general, in the case when (), we will have the following order: if or if .
Let us form the countable partition of based on the countable partition of . Due to in , the elements of are linearly ordered sets. Let us consider the elements of as carriers of relational systems with a binary relation of the linear order . The partition generates the isomorphic (with respect to the linear order ) family of the subrelational systems of a relational system (see Figure 2).
Due to the bijective mapping of , the partition of generates an ordered countable partition with a Cartesian degree of the -th order, in which every is the truncation of the to the set . That is, every is the set of those ordered -dimensional vectors of the . The argument belongs to , and the arguments belong to
Since the Cartesian product is the carrier of the relational system , then with its partition , it is always possible to connect the countable family of the subrelational systems of a system . From the isomorphism between with respect to the binary relation of the linear order due to the isomorphism we can determine the isomorphism between with respect to the binary relation of the linear order .
So, the following can be noted: (1) the isomorphism with respect to and between and ; (2) the isomorphism with respect to between the subrelational systems of the relational system ; (3) the isomorphism with respect to between the elements of family of the subrelational systems of the relational system ; (4) the isomorphism with respect to and between arbitrary pair and , taken from of set and from the partition of the Cartesian product .
Since for the construction of a random process , in the strict sense, a countable family of its distribution functions is required, then in the mathematical model of the cyclic signals, it is necessary to take into account the sequence of its multidimensional cyclic structures. For this, we will introduce a variable , the value of which will be interpreted as the dimension of the cyclic structure of the random process . Let us consider a sequence of relational systems , the carriers of which are the elements of the sequence of the Cartesian products of the random process , and the relations of these relational systems are elements of a sequence of the relations of a linear order on these carriers. The first relational system at is the relational system discussed above , and all subsequent relational systems at are relational systems, which will be used to model a sequence of multidimensional cyclic structures of a random process . Let us integrate the sequence of relational systems into one relational system .
In the next step for the construction of an adequate mathematical model of the cyclic signals as random processes, it is necessary to take into account the similarities of multidimensional cyclic structures of a cyclic signal not only regarding their type of phase ordering, but also regarding the families of their distribution functions:
For this purpose, let us supplement the relational system with a new sequence of carriers and new sequence of functional relations The result is a new relational system as follows:
where is a sequence of distribution function spaces , namely, —the functional space of distribution functions of a -dimensional random vector (vector of random variables) and —the sequence of functional relations, which represent the distribution functions of random process as follows:
In order to exclude non-cyclic processes, in the future, we will consider only functional relations from , for which there exists number , so that the following inequalities can be achieved:
Let us introduce a relational system (3) in a more compact form, as shown below:
where and are sequences of carriers and are sequences of the relations of a relational system (6).
The partition of the Cartesian product of the random process generates the family of subrelational systems as follows:
for relational system (6), where are carriers of the subrelational system . In the case when as shown in Formula (5), we can assume that .
Let us amplify the isomorphism between the relational systems of the family by adding requirements for the equality of values of distribution functions of the random process for bijectively connected vectors and from two different arbitrary Cartesian products and . Namely, the isomorphism with respect to relations for two arbitrary relational systems and must be supplemented by an isomorphism with respect to their functional relations .
Let us give a definition a certain type of isomorphism between the relational systems and for any .
Definition1.
The sequences of bijective mappings between appropriate Cartesian products and , which are carriers of relational systems and , will be called the isomorphism with respect to the relations and with respect to the distribution functions from family (1), which are the values of the functional relations in the arguments , between the relational systems and , if:
There are isomorphisms between relational systems and with respect to the linear order , namely, the types of ordering of the Cartesian products and , which are identical for any .
There are isomorphisms between and with respect to the distribution function of a random process . Namely, for all the bijectively connected vectors and for any there are equal values of distribution functions from family (2), as shown below:
Definition2.
The Cartesian products and , which are carriers of the relational systems and , will be called the isomorphic Cartesian products with respect to the linear order and with respect to the distribution functions from family (2), which are the values of the functional relations in the arguments , or more simply—the isomorphic Cartesian products.
Note that Definition 2 generalizes and significantly supplements the definition the isomorphic random processes with respect to and the mathematical expectation () as well as the definition the isomorphic Cartesian products with respect to and the correlation function (), which are introduced in the work of [61].
The family of the isomorphic subrelational systems, the carriers of which are the elements of the ordered countable partitions from the sequences constructed above, makes it possible to obtain the definition of the CRP.
Definition3.
A random process () given in the probability space and on a set of real numbers will be called a cyclic random process (or cyclically distributed random process) if the ordered countable partition exists for each of the sequences , whose elements are carriers of systems with respect to the relations of the linear order and with respect to the distribution functions from family (1), which are values of functional relations in the arguments .
3. The Multidimensional Cycle Structures of CRP
The next step is the formalization of the cycle and the set of cycles of the cyclic signal. For this purpose, let’s consider the concept of minimal ordered countable partition into isomorphic random processes of CRP . Under minimal ordered countable partition into isomorphic random processes with respect to the relation of linear order and to the functional relation , which is distribution function from family (2) of CRP , we will understand such partition , when the arbitrary partitioning of its elements will form a new one smaller partition , between all the elements of which simultaneously there are no isomorphisms with respect to and with respect to the distribution function from family (2), which is value of functional relation , in the argument .
Definition4.
The minimal ordered countable partition of the CRP into isomorphic random processes with respect to the relation of the linear order and with respect to the distribution function from family (1), which is value of functional relation in the argument will be called the partition into cycles of the CRP , and the random process is the m-th cycle of the CRP .
The following definition can then be obtained.
Definition5.
The set will be called the definition domain of m-th cycle of the CRP .
Given the fact that the CRP , in addition to its one-dimensional probability structure determined by its distribution functions , has a -dimensional (multidimensional) probability structure given by its distribution functions from family (2), then, in addition to the partition into one-dimensional cycles , it is possible to obtain a definition of the partition of the Cartesian product of the -th order () into -dimensional cycles of the CRP .
Under the minimal ordered countable partition of the Cartesian product of the CRP into isomorphic Cartesian products with respect to and with respect to the distribution function from family (2), which is value of the functional relation in , we obtain the partition as , when the arbitrary partitioning of its elements forms a new, smaller partition between all the elements of which simultaneously there are no isomorphisms with respect to and with respect to the distribution function from family (2), which is the value of the functional relation in .
Definition6.
The minimal ordered countable partition of the Cartesian product of the CRP into isomorphic Cartesian products with respect to and with respect to the distribution function from family (2), which is value of the functional relation in , will be called the partition into -dimensional cycles of the CRP , and Cartesian product will be called the m-th -dimensional cycle of the CRP .
The following definition can then be obtained.
Definition7.
The set will be called the definition domain of -dimensional m-th cycle of the CRP .
Thus, the cyclic structure of CRP is given by the sequence , whose elements are partitions into the -dimensional cycles of the CRP .
Let us consider another ordered countable partition of the Cartesian product of the CRP , as shown below:
Note that there are not isomorphisms between all the elements of partition with respect to the relations of the linear order and with respect to the distribution function from family (2), which is the value of the functional relation in . This type of isomorphism exists between elements of only certain subsets of the partition , namely, between all the elements of only these subsets as follows:
where is a Cartesian product of the one-dimensional cycles of the CRP that form diagonal stripes in . If , then between the arbitrary elements and of the subsets and () does not have isomorphisms with respect to and to the functional relation , which is the distribution function from family (1). That is, between the elements and from different diagonal stripes and in there are not any isomorphisms. In general, this type of isomorphism between the elements of a set takes place only if (see Figure 3).
Any -th -dimensional cycle of a CRP can be represented by the elements of the ordered countable partition :
The Cartesian product of the CRP can be represented by the elements of the ordered countable partition :
The Cartesian product of the CRP can be represented by a set of all diagonal stripes :
4. The Multidimensional Phase Structure of CRPs
The one-dimensional phase structure of a cyclically correlated random process was investigated in the work of [61]. In this section, we will introduce and establish the main properties of the multidimensional phase structure of a CRP, which summarizes and extends the results of the article of [61]. Similarly to the definition of the -dimensional cycles of a CRP, it is possible to define the concept of its -dimensional phase. Let us have the definition domain of the -dimensional -th cycle of the CRP . Due to isomorphism between relational systems and (), for any in the definition domain of arbitrary -dimensional -th cycle , there is only one element , which is bijectively connected with . Since for a CRP , we have a countable set of -dimensional cycles, then for every -dimensional vector , we will have a countable set of -dimensional vectors , which are bijectively connected to it. Set of all bijectively connected vectors with a vector is defined as follows:
For each fixed we will have specific set . If runs the all ordered set then we get the ordered in the indexes uncountable partition of the definition domain of Cartesian product of CRP .
Let’s create an ordered in the indexes uncountable partition of Cartesian product of CRP by bijective mapping of elements from partition into subsets of Cartesian product (), that is, everyone is matched by the subset of those -dimensional vectors of Cartesian product , the first elements of which belong to . Since is a countable set, then and is also a countable set, defined as:
According to (15), is a countable set, ordered by .
Since the set is isomorphic with respect to for any set , then between the partition and the arbitrary sets , there is an isomorphism with respect to the linear order. Let us note that is a countable set of the -dimensional vectors of the Cartesian product , among which there are no two vectors belonging to the same -dimensional cycle; that is, among the elements of there are no two vectors where and where for which .
For different elements and from , according to Equation (11), there is equality between distribution functions, as shown below:
Let us obtain the mathematical definition of the -dimensional phase of the CRP .
Definition8.
Ordered by the indexes the uncountable partition of the Cartesian product of the CRP , whose elements are countable sets formed according to (15) and for which the equalities in Equation (16) exist, is called the partition into -dimensional phases, and the set is called the -dimensional phase (-dimensional phase) of the CRP .
Definition9.
The m-th element of the set is called the actualization of the -dimensional phase (-dimensional phase) in the -dimensional m-th cycle of the CRP .
Definition10.
The set which is determined according to Expression (14) is called the definition domain of the -dimensional phase (-dimensional phase) of the CRP .
Definition11.
The set is determined according to following expression:
and is called the set ( series) of single-phase values of the -dimensional phase of the CRP .
The set of all the sets of -dimensional single-phase values is ordered by the vector of the parameters . Each is a -dimensional vector of stationary and stationary connected random sequences with respect to its -dimensional distribution function .
Definition12.
The m-th element of the set is called the actualization of the set ( series) single-phase values of the -dimensional phase in the -dimensional m-th cycle of the CRP .
The -dimensional phase unites a countable set of bijectively connected vectors with one from each of -dimensional m-th cycles of taken; that is, the concept of the -dimensional phase is based on the concept of the minimal ordered countable partition of the Cartesian product of process into isomorphic Cartesian products .
Let us consider the -dimensional phase structure, based on the ordered countable partition of the Cartesian product of the CRP . Since there are not isomorphisms between all elements of partition with respect to and to the functional relation , which is a distribution function from family (2), and isomorphisms exist only between all the elements of sets ), which form diagonal stripes in , then the -dimensional phases cover only the vectors that belong to these diagonal stripes. Let us define the domain of the -dimensional isomorphic elements of subset , which form diagonal stripes in . Let us accept that (). Due to isomorphisms between relational systems and (), for any in the definition domain of the -dimensional element of subset there is only one element that is bijectively connected with . Since the set is a countable set, for every -dimensional vector , we will have a countable set of -dimensional vectors , which are bijectively connected to it. Set of all bijectively connected vectors with is defined as follows:
For each fixed we will have specific set . If runs the all ordered sets then we get the ordered in the indexes uncountable partition of the definition domain of diagonal stripe in .
Let us create ordered indexes for the uncountable partition of the diagonal stripe in by the bijective mapping of elements from partition into subsets of (); that is, all elements are matched by the subset of the -dimensional vectors of , the first elements of which belong to . Since is a countable set, then is also a countable set, defined as follows:
According to (19), any set can be ordered by the countable set.
Since set is isomorphic with respect to for any set , then between the partition and the arbitrary sets , there is an isomorphism with respect to the linear order, or rather, there is an isomorphism between the relational system and arbitrary relational system with respect to the binary relations of the linear order and (). And the ordering type of partition is determined by the type of ordering of any set and in particular, by the type of ordering of set .
For different elements of , according to Equation (6), there are equalities between distribution functions, namely:
Since the Cartesian product of a CRP can be represented through the set of all diagonal stripes according to Formula (13), and each diagonal stripe in can be represented through the elements of , then the Cartesian product can be represented through the set , namely:
Let us unite all elements of the set as follows:
Then the set consists of the following elements:
Note that can be represented as a Cartesian product of corresponding the one-dimensional phases , …,:
The definition domain of can be represented as a Cartesian product of the definition domains , …, of the corresponding one-dimensional phases , …,:
Each element of partition can be represented as follows:
Substituting Formula (26) into Formula (11), the -th -dimensional cycle of the CRP can be presented as follows:
The partition into -dimensional phases of Cartesian product of CRP can be presented as a union of partitions into -dimensional phases of all diagonal stripes in , namely:
As can be seen from Formula (28), each countable set is a -dimensional phase of the CRP , which is equal to the appropriate -dimensional phase as follows:
5. Representations of CRP and Its Distribution Functions through Their Cyclic Structures
Given that the sequence always exists and its elements are the partitions of the CRP into -dimensional cycles , a random process and its Cartesian product can be represented as follows:
If we consider a vector of random processes, which in the areas coincide with the random processes , but in the areas , the random processes are all equal to zero , it is possible to represent the CRP in another way as follows:
Similarly to the representations of the random process and its Cartesian product according to Formulas (30) and (31), we can obtain representations of -dimensional distribution functions (in another designation ) of the CRP as follows:
where is a -dimensional distribution function of m-th -dimensional cycle of the CRP .
It is possible to represent the -dimensional distribution functions of the CRP in another way if we consider a countable dimensional vector whose components in the areas coincide with the , but whose components in the areas are all equal to zero :
Note that the components of a countable dimensional vector are not distribution functions in the areas .
In practice, the CRP should be considered for the subset :
where is the integer number. In this case, the -dimensional distribution functions will also be considered in the set .
Apart from the sequence , there is the sequence , whose elements are partitions of the Cartesian product of the CRP , and this Cartesian product can be represented according to (9) through the elements of partitions . Thus, the following representations of the -dimensional distribution functions of the CRP can be obtained:
where is a -dimensional distribution function, which shows that belong to the areas in the definition of one-dimensional cycles .
If we consider the set , whose elements in the areas coincide with , but whose elements in the areas are all equal to zero , then the -dimensional distribution functions of the CRP can be given as the sum of the elements of the set :
Note that the elements of the set are not distribution functions in the areas .
Formulas (30)–(37) are the foundation for CRP models, computer simulations and hardware generation (formation) [53,54].
6. Representations of CRP and Its Distribution Functions through Their Phase Structures
Let us represent the CRP and its Cartesian product through the elements of their phase structures, namely, through the elements of the partitions and :
Similarly to the representations of the Cartesian product according to Formula (39), we can obtain representations of the -dimensional distribution functions (in another designation ) of the CRP :
where is a -dimensional distribution function of the -dimensional phase of the CRP , for which the following equality is given:
Note that .
Formulas (38)–(41) reflect the basic dependences of the phase structure of the CRP and are the basis for applications of statistical estimation methods of the probabilistic characteristics of the CRP.
7. Analytical Dependencies between Cyclic, Phase and Rhythm Structures of Cyclic Random Process
The arbitrary m-th cycle of the CRP can be presented as follows:
The -dimensional m-th cycle of the CRP can be presented as follows:
or it can be presented as follows:
Given Formula (30), which represents the CRP by the set of all its cycles , and based on Formula (42), let us represent this random process through the set of the actualizations of all of its phases in the all the cycles of the CRP :
Given Formula (31), which represents a Cartesian product of the CRP by the set of all of its -dimensional cycles , and based on Formula (43), let us represent the Cartesian degree through the set of actualizations of all of its -dimensional phases in the all of the -dimensional cycles of the CRP :
Let us represent an arbitrary phase of the CRP through the set of its actualizations in all of the cycles of the CRP :
Let us represent an arbitrary -dimensional phase of the CRP through the set of its actualizations in all of the -dimensional cycles of the CRP as follows:
Let us represent an arbitrary set of the single-phase values of the CRP through the set of its actualizations in all of the cycles of the CRP as follows:
Let us represent an arbitrary set of -dimensional single-phase values of the cyclic random process through the set of its actualizations in all of the -dimensional cycles of the CRP as follows:
Formulas (42)–(50) establish a strong relationship between the cyclic and phase multidimensional structures of CRPs.
To obtain a cyclically correlated random process [61] for the CRP, let us formulate the following theorem.
Theorem1.
For a CRP , there exists a numerical function , for which the following properties occur:
for any and , for which , and for function a strict inequality holds as shown below:
and for each -dimensional distribution function from families of consistent distribution functions (1) of the CRP , there are the following equalities:
In contrast, if for a random process , there exists a numerical function with all the above-mentioned properties ((51) and (52)) and if the equalities in (53) are true for any , then it is a CRP.
Similar to the results of the work of [61], we can provide the following definition.
Definition13.
The function which is the smallest in modulus among all such functions which satisfy (51)–(53) is called a rhythm function of a CRP .
Using the rhythm function of a CRP, let us represent an arbitrary -dimensional phase of the CRP by the set of its actualizations in all -dimensional cycles of the CRP as follows:
Let us represent an arbitrary set of -dimensional single-phase values of the CRP by the set of its actualizations in all -dimensional cycles of the CRP as follows:
Using the rhythm function of the CRP , similar to expressions (45) and (46), let us represent the CRP and its Cartesian product as follows:
Similarly to the representations of the Cartesian product according to Formula (57), we can provide the following representations of the -dimensional distribution functions of the CRP :
For the -dimensional distribution functions of the CRP from family (2), the following equality is obtained:
The analytical dependencies presented above show that although cyclic, phase and rhythm structures are separate structures that reflect different aspects of the temporal (spatial) structure of cyclic signals, they are conceptually, formally and methodologically interrelated, as they are different aspects of the same mathematical model of cyclic signals. As an illustration of the close relationship between the cyclic, phase, and rhythm structures of a cyclic signal, Figure 4 presents a graphical representation of a segment of a cyclic deterministic function , along with its cycles, phases and rhythm function. The cyclic deterministic function can be interpreted as a degenerate case of a CRP, namely, as a CRP with zero dispersion.
Definition 3 for cyclic random processes does not contain the requirement of separability; however, this definition can always be supplemented with this requirement, which enables a full probabilistic description of a CRP using the countable family (2) of its consistent distribution functions. As follows from Theorem 1, it is possible to provide another definition of a CRP.
Definition14.
A separable random process is called a cyclic random process of continuous argument if the function exists and satisfies conditions (51) and (52) and if for any from the set of separability of the process , the -dimensional random vectors and are stochastically equivalent in a broad sense for all and for all .
At the theoretical level, such dependences of cyclic, phase and rhythm structures will be manifested in the fact that if there are given phase and rhythm structures, then it is possible to reproduce the cyclic structure of a cyclic signal, and vice versa: if the cyclic structure is given, then it is possible to reproduce the phase and rhythm structures. At the applied level, the connection of cyclic, phase and rhythm structures is manifested in the need to evaluate the characteristics of some structures in order to be able to evaluate the characteristics of other structures, for example, in the need to pre-determine the rhythm function of a cyclic signal in order to evaluate the characteristics of its cyclic and phase structures. On the other hand, in order to evaluate the characteristics of the rhythmic structure (rhythm function), it is necessary first to have information about the cyclic and phase structures, for example, information about the time points of the beginning of the cycles of a cyclic signal.
8. The Main Subclasses of CRP
CRPs include many different subclasses of random processes with cyclic probabilistic characteristics [47]. In particular, if the type of function of the rhythm of the process is a feature of the division of the class, then it is possible to distinguish a class of CRPs with a regular (stable) rhythm, known in the literature as periodic (cyclostationary) random processes, and CRPs with an irregular (variable) rhythm. Namely, the periodic random process is a CRP with a regular (stable) rhythm, or rather with a rhythm function . The irregular rhythm signal (variable rhythm signal) is a signal whose model is a CRP with a rhythm function (). Depending on the type of distribution function of a CRP, it is possible to distinguish a class of normally distributed CRPs, a class of CRPs with a Poisson distribution, a class of CRPs with a uniform distribution, etc. It is also possible to distinguish a class of cyclic Markov random processes and a class of CRPs with independent values (a class of cyclic white noise). Provided that the mathematical expectation and correlation function of CRPs exist, then a CRP is a cyclically correlated random process.
Among CRPs, it is important in theoretical and applied dimensions to distinguish the class of fractal cyclic random (stochastic) processes. Namely, CRPs in which all or some probabilistic characteristics (distribution functions and moment functions) have a fractal dimension should be called fractal cyclic random processes (fractal cyclic stochastic processes). These random processes combine both the properties of cyclicity and fractality. Studies of the fractal properties of CRPs such as the Hurst parameter and the Hausdorff measure are promising. Such research is interesting to conduct both from the standpoint of the phase multidimensional structure of a cyclic random process and from the standpoint of its multidimensional cyclic probabilistic structure. It will be necessary to devote a separate scientific article to the construction of such random processes and the study of their properties.
9. Advantages of a Cyclic Random Process Compared to a Periodic Random Process
As shown above, a subclass of the CRP is the cyclostationary (periodic) random process. This enables the use of a set of powerful methods of processing cyclic signals with a stable rhythm, which developed over 60 years of active research. However, the main advantage of a CRP in comparison to a periodic random process is revealed precisely in the tasks of mathematical modeling, computer simulations and the processing of cyclic signals with a variable rhythm, since for such cyclic signals, a periodic random process is an inadequate mathematical model. The main reason for the CRP’s advantage is the presence of the formal means of adaptation to changes in the rhythm of the investigated cyclic signals, which is lacking in the periodic random process. This property of the model enables the development of effective rhythm-adaptive methods for the statistical processing of cyclic signals with a variable (irregular) rhythm in both the time and spectral domains [62]. This ensures high levels of accuracy and reliability in solving many applied problems in medical diagnostics, biometric authentication, the construction of brain–computer interfaces, diagnosing the surface state of materials, and analyzing and forecasting cyclic economic processes and cyclic processes in energy.
Statistical methods for CRP processing are based on its cyclic and phase multidimensional structures (studied above) and make it possible to estimate one-dimensional and multidimensional probabilistic characteristics of cyclic stochastic signals regardless of the type of their rhythm, i.e., they are suitable for analyzing signals with regular and with irregular rhythms. Let us demonstrate the process of the statistical estimation of some one-dimensional and two-dimensional moment functions of cyclic stochastic signals for the task of biometric authentication by ECG signals. We will conduct this study within the framework of two mathematical models of the ECG, namely, in the form of the periodic [32,40,63,64,65] and CRP, which will enable us to demonstrate the advantages of the CRP as a more general random process over the periodic random process. We use ECG signals (see Figure 5 and Figure 6) that were registered in the first and second lead from a conditionally healthy patient at rest over a long observation period. These data were obtained from the open CEBS database (PhysioNet resource) [66], taken from the file entitled m013.dat.
For the statistical processing of the ECG, we used software that was developed in the Python language and is described in the article of [52]. The estimation of the rhythm function for these ECG signals is presented in Figure 7. The estimation of the rhythm function was carried out using the method of the piecewise linear interpolation of a discrete rhythm function [49]. The Python library NeuroKit2 was used for ECG segmentation and the ECG rhythm function evaluation.
The first cycles of the statistical estimations of some initial and central moment functions of the ECG signals are presented in Figure 8, Figure 9, Figure 10, Figure 11 and Figure 12. The statistical estimation of the initial moment function of the -th order of the ECG signals is calculated based on the following formula:
Under the condition that , Formula (60) is a calculation formula for the statistical estimation of the mathematical expectation of the ECG (see Figure 8 and Figure 9).
Under the condition that , Formula (60) is a calculation formula for the statistical estimation of the initial moment function of the second-order of the ECG (see Figure 10 and Figure 11).
The statistical estimation of the central moment function of the -th order of the ECG is calculated based on the following formula:
Under the condition that , Formula (61) is a calculation formula for the statistical estimation of the central moment function of the 2nd order (dispersion) of the ECG (see Figure 12 and Figure 13).
The statistical estimation of the autocorrelation function of the ECG is calculated based on the following formula:
where - the number of cycles in which argument gain value [47].
The statistical estimation of the autocovariation function of the ECG is calculated based on the following formula:
Graphs of the statistical estimations of the autocorrelation and autocovariation functions of the ECG are presented in Figure 14 and Figure 15.
A similar statistical evaluation of the probabilistic characteristics of the studied cardiac signal was carried out within the framework of its model in the form of a periodic (cyclostationary) random process, which is described in works of [32,40,63,64,65]. The average value of the duration of its cardiocycles is taken as a statistical estimate of the period of the cardiac signal, as shown below:
The first cycles of the statistical estimations of some initial and central moment functions of the ECG for processing on the basis of the periodic random process are presented in Figure 16, Figure 17, Figure 18, Figure 19, Figure 20 and Figure 21.
The statistical estimation of the initial moment function of the -th order of the ECG for processing on the basis of the periodic random process is calculated based on the following formula:
Under the condition that , Formula (65) is a calculation formula for the statistical estimation of the mathematical expectation of the ECG for processing on the basis of the periodic random process (see Figure 16 and Figure 17).
Under the condition that , Formula (61) is a calculation formula for the statistical estimation of the initial moment function of the second-order of the ECG for processing on the basis of the periodic random process (see Figure 18 and Figure 19).
The statistical estimation of the central moment function of the -th order of the ECG for processing on the basis of the periodic random process is calculated based on the following formula:
Under the condition that Formula (62) is a calculation formula for the statistical estimation of the central moment function of the second-order (dispersion) of the ECG for processing on the basis of the periodic random process (see Figure 20 and Figure 21).
The statistical estimation of the autocorrelation function of the ECG for processing on the basis of the periodic random process is calculated based on the following formula:
where - the number of cycles in which argument gain value [47].
The statistical estimation of the autocovariation function of the ECG for processing on the basis of the periodic random process is calculated based on the following formula:
Graphs of the statistical estimates of the autocorrelation and autocovariation functions of the ECG for processing on the basis of the periodic random process are presented in Figure 22 and Figure 23.
As can be seen from Figure 8, Figure 9, Figure 10, Figure 11, Figure 12, Figure 13, Figure 14 and Figure 15, the estimated probabilistic characteristics of the ECG based on its mathematical model in the form of the CRP, thanks to the adaptation of our statistical estimation methods to changes in its rhythm, have a clear, non-blurred time structure (the effect of blurring is practically absent). The opposite situation occurs when applying methods for the statistical estimation of probabilistic characteristics of the ECG based on its mathematical model in the form of a periodic (cyclostationary) random process. Namely, as can be seen from Figure 16, Figure 17, Figure 18, Figure 19, Figure 20, Figure 21, Figure 22 and Figure 23, there is a significant effect from blurring statistical ECG estimates, since these statistical methods do not take into account changes in the rhythm of the signal.
Additional indicators that illustrate the significant advantages of CRP over a periodic random process are dependences of the average on the interval (0,1) of the sample standard deviation of the ECG from the number of averaged cycles, which are shown in Figure 24 and Figure 25.
As can be seen from these figures, the average of the interval (0,1) of the sample standard deviation of the ECG within the framework of the CRP is more than 10 times smaller than the same values for a periodic random process, which additionally indicates the rhythm-adaptive methods for processing cyclic biomedical signals based on their model in the form of CRPs have a significant higher accuracy.
Let us demonstrate the practically oriented advantages of the CRP in ECG biometric authentication problems, which is an important way to dynamically biometrically authenticate humans, the methods of which, in particular, are described in [67,68,69]. The main averaged characteristics of the effectiveness and time computational complexity of the authentication of humans using eight different types of binary classifiers (statistical interval classifier (sic), K-nearest neighbors, linear SVM, decision tree, random forest, multilayer perceptron, adaptive boosting and naive Bayes) based on the estimation of the mathematical expectation of the ECG are presented in Table 1, Table 2, Table 3 and Table 4. Note that the characteristics given in Table 1, Table 2, Table 3 and Table 4 are the averaged characteristics of 18 out of 20 people selected from the CEBS database [66].
As can be seen from Table 1, Table 2, Table 3 and Table 4, the use of rhythm-adaptive ECG processing on the basis of a CRP, compared to non-rhythm-adaptive ECG processing on the basis of a periodic random process, is characterized by a significantly higher level of effectiveness in biometrically authenticating people. According to the characteristics of the time computational complexity of authentication algorithms, there are no significant differences between rhythm-adaptive and non-rhythm-adaptive ECG-processing methods.
10. Discussion
The approach to the construction of CRPs developed in the work is based on the ideas of category theory, that is not typical for the theory of random processes, in particular, is based on the idea of a certain type of isomorphism between relational systems, the carriers of which are certain segments of the random process. This made it possible to build a mathematical model of cyclic stochastic signals that simultaneously integrates the properties of the investigated signals with both regular (stable) and irregular (variable) rhythms. Also, the approach proposed in this work made it possible to carry out a formalization of cyclic, phase and rhythm structures of cyclic stochastic signals.
Mathematical objects that represent cyclic, phase and rhythm structures provide a wide range of mathematical tools that can be used as diagnostic and prognostic features in the tasks of cyclic signal processing. In particular, all the features can be divided into two large classes: the features of the morphological structure and the features of the rhythm structure of cyclic signals. Morphological features are determined by the cyclic and phase structures of a cyclic random process, and rhythmic features are determined by the rhythm structure of a CRP. Morphological features complement rhythmic ones, and rhythmic features complement morphological ones. The rhythmic structure, on the other hand, is a carrier of another type of information about the oscillatory process, namely, information on the unfolding of the cyclic phase structure in time, in reference to the time axis. Such information in itself is a valuable feature in the tasks of analyzing the rhythm of many oscillating dynamic systems (biological, physical, economic, energetic and astronomical). For example, this takes place in the tasks of analyzing heart rhythms, the economic system’s own time, and in the tasks of analyzing and predicting the time of occurrence of recurring astronomical phenomena (spots on the Sun, the pulse activity of stars, pulsars and quasars). Without a clear mathematical description of such structures, it is impossible to solve similar problems both at the theoretical and applied levels.
The cyclic structure of a CRP, in addition to its independent role as a fundamental mathematical object in the tasks of modeling and processing cyclic signals, also plays a purely methodological role as a class-forming property that is used as a structural reference point in the task of establishing necessary and sufficient conditions of structural function (rhythm function), which are given in Theorem 1.
11. Conclusions
In this work, for the first time in the literature, we proposed a procedure for constructing a CRP based on the idea of isomorphism between relational systems, whose carriers are certain segments (cycles) of the CRP. The CRP takes into account the cyclicity and stochasticity of cyclic signals and has the effective means of taking into account both the regularity and irregularity of the rhythm of cyclic signals. Mathematical objects that are modeling the cyclic, phase and rhythm structures, in particular, the multidimensional cyclic and phase structures of CRPs, are presented. The fundamental properties of and analytical dependencies between the multidimensional cyclic, phase and rhythm structures of a cyclic random process have been established, which are important for solving theoretical and applied problems for mathematically modeling and statistically processing cyclic stochastic signals with both regular and irregular rhythms.
Based on a series of experiments, the significant advantages of the CRP as a mathematical model of the ECG compared to the periodic random process are shown. In particular, a significantly higher accuracy of the rhythm-adaptive methods of ECG processing based on their model in the form of a cyclic random process was demonstrated. It is also established that the use of rhythm-adaptive ECG processing on the basis of a CRP, compared to non-rhythm-adaptive ECG processing on the basis of a periodic random process, is characterized by a significantly higher level of effectiveness in biometrically authenticating people.
The results obtained in this article significantly improve the theory of the modeling of cyclic stochastic signals within the family of their consistent distribution functions, and, thanks to the detailed formal representation of the multidimensional cyclic structure, multidimensional phase structure and rhythmic structure of CRPs, open up new opportunities to increase the informativeness of analyses of cyclic signals of various natures (biological, physical, economic, energetic and astronomical) in modern systems for automated analyses, forecasting and computer simulations.
Author Contributions
Conceptualization, S.L.; methodology, S.L.; software, R.B.; validation, S.L. and R.B.; investigation, S.L.; data curation, S.L.; writing—original draft preparation, S.L.; writing—review and editing, S.L. and R.B.; visualization, S.L. and R.B.; supervision, S.L. and R.B.; project administration, S.L.; funding acquisition, S.L. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Data Availability Statement
Data are contained within the article.
Conflicts of Interest
The authors declare no conflicts of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.
References
Besicovitch, A.S. Almost Periodic Functions; Cambridge University Press: London, UK, 1932; 180p. [Google Scholar]
Benedetto, J.J. Harmonic Analysis and Applications; CRC Press: New York, NY, USA, 1996; 368p. [Google Scholar]
Mandelstam, L.I. Lectures on Vibrations: Complete Collection of Works; Mandelstam, L.I., Ed.; Publishing House of the Academy of Sciences of the USSR: Moscow, Russia, 1955; 512p. [Google Scholar]
Agarwal, R.P.; Grace, S.R.; O’Regan, D. Oscillation Theory for Difference and Functional Differential Equations; Kluwer Academic Publishers: Dordrecht, The Netherlands, 2000; 337p. [Google Scholar]
Bohner, M.; Peterson, A. Dynamic Equations on Time Scales: An Introduction with Applications; Birkhäuser: Boston, MA, USA, 2001; 358p. [Google Scholar]
Bohner, M.; Peterson, A. Advances in Dynamic Equations on Time Scales; Birkhäuser: Boston, MA, USA, 2003; 359p. [Google Scholar]
Brillinger, D.R. Fourier analysis of stationary processes. Proc. IEEE1974, 62, 1628–1643. [Google Scholar] [CrossRef]
Cramer, H. On the theory of stationary random processes. Ann. Math.1940, 41, 215–230. [Google Scholar] [CrossRef]
Grenander, U.; Rosenblatt, M. Statistical Analysis of Stationary Time Series; Wiley: New York, NY, USA, 1957. [Google Scholar]
Gladyshev, E.G. Periodically correlated random sequences. Soviet Math. Dokl.1961, 2, 385–388. (In Russian) [Google Scholar]
Hurd, H.L. Periodically correlated processes with discontinuous correlation function. Theory Probab. Appl.1974, 19, 804–808. [Google Scholar] [CrossRef]
Hurd, H.L. Nonparametric time series analysis for periodically correlated processes. IEEE Trans. Inf. Theory1989, 35, 350–359. [Google Scholar] [CrossRef]
Gardner, W.A. Representation and Estimation of Cyclostationary Processes. Ph.D. Thesis, University of Massachusetts, Amherst, MA, USA, 1972. [Google Scholar]
Gardner, W.A. The spectral correlation theory of cyclostationary time series. Signal Process.1986, 11, 13–36, Erratum in Signal Process.1986, 11, 405. [Google Scholar] [CrossRef]
Gardner, W.A.; Napolitano, A.; Paura, L. Cyclostationarity: Half a century of research. Signal Process.2006, 86, 639–697. [Google Scholar] [CrossRef]
Dragan, Y.P. The spectral properties of periodically correlated stochastic processes. Otbor i Peredacha Inf.1971, 30, 16–24. (In Russian) [Google Scholar]
Dragan, Y.P.; Yavorskii, I.N. Statistical analysis of periodic random processes. Otbor i Peredacha Inf.1985, 71, 20–29. (In Russian) [Google Scholar]
Izzo, L.; Napolitano, A. Higher-order cyclostationarity properties of sampled time-series. Signal Process.1996, 54, 303–307. [Google Scholar] [CrossRef]
Izzo, L.; Napolitano, A. Multirate processing of time series exhibiting higher order cyclostationarity. IEEE Trans. Signal Process.1998, 46, 429–439. [Google Scholar] [CrossRef]
Javorskyj, I.; Juzefovych, R.; Kravets, I.; Matsko, I. Properties of characteristic estimators of periodically correlated random processes in preliminary determination of the period of correlation. Radioelectron. Commun. Syst.2012, 55, 335–348. [Google Scholar] [CrossRef]
Bittanti, S.; Bolzern, P.; De Nicolao, G.; Piroddi, L. Representation, prediction, and identification of cyclostationary processes—A state-space approach. In Cyclostationarity in Communications and Signal Processing; Gardner, W.A., Ed.; IEEE Press: Piscataway, NJ, USA, 1994; pp. 267–294. [Google Scholar]
Bohme, O. Periodic Markov transition function I, II. Math. Nachr.1982, 108, 231–239. [Google Scholar] [CrossRef]
Ghysels, E. A Time Series Model with Periodic Stochastic Regime Switching; Discussion paper 84; Institute for Empirical Macroeconomics, Federal Reserve Bank of Minneapolis Research Department: Minneapolis, MN, USA, 1993. [Google Scholar]
Ghysels, E.; McCulloch, R.E.; Tsay, R.S. Bayesian Inference for a General Class of Periodic Markov Switching Models. J. Appl. Econom.1998, 13, 129–143. [Google Scholar] [CrossRef]
Ghysels, E. On the Periodic Structure of the Business Cycle; CFDP Number 1028; Cowles Foundation, Yale University: New Haven, CT, USA, 1992. [Google Scholar]
Kochel, P. Periodically stationary Markovian decision models. Elektron. Informationsverarb. Kybernet.1980, 16, 553–567. (In German) [Google Scholar]
Chen, T.; Qiu, L. Linear periodically time-varying discrete-time systems: Aliasing and LTI approximations. Syst. Control Lett.1997, 30, 225–235. [Google Scholar] [CrossRef]
Dorogovtsev, A.Y. Stationary and periodic solutions of stochastic difference and differential equations in Banach space. In New Trends in Probability and Statistics; VSP: Utrecht, The Netherlands, 1990; Volume 1, pp. 375–390. [Google Scholar]
Dorogovtsev, A.Y. Periodicity in distribution. I. Discrete systems. Int. J. Math. Math. Sci.2002, 30, 65–127. [Google Scholar] [CrossRef]
Marchenko, B.G. Linear Periodic Processes; Electrical Engineering, Pr. Institute of Electrodynamics, National Academy of Sciences of Ukraine: Kyiv, Ukraine, 1999; pp. 165–182. (In Ukrainian) [Google Scholar]
Lupenko, S.; Shcherbak, L. Constructive mathematical model of cardiac signals based on linear periodic random processes and fields. Sci. J. Ternopil State Tech. Univ.2000, 5, 101–110. (In Ukrainian) [Google Scholar]
Blachman, N.M. Beneficial effects of spectral correlation on synchronization. In Cyclostationarity in Communications and Signal Processing; Gardner, W.A., Ed.; IEEE Press: Piscataway, NJ, USA, 1994; pp. 362–390. [Google Scholar]
Bloomfield, P.; Hurd, H.L.; Lund, R. Periodic correlation in stratospheric ozone time series. J. Time Ser. Anal.1994, 15, 127–150. [Google Scholar] [CrossRef]
Bouillaut, L.; Sidahmed, M. Cyclostationary approach and bilinear approach: Comparison, applications to early diagnosis for helicopter gearbox and classification method based on HOCS. Mech. Syst. Signal Process.2001, 15, 923–943. [Google Scholar] [CrossRef]
Capdessus, C.; Sidahmed, M.; Lacoume, J.L. Cyclostationary processes: Application in gear faults early diagnosis. Mech. Syst. Signal Process.2000, 14, 371–385. [Google Scholar] [CrossRef]
Cheong, C.; Joseph, P. Cyclostationary spectral analysis for the measurement and prediction of wind turbine swishing noise. J. Sound Vib.2014, 333, 3153–3176. [Google Scholar] [CrossRef]
Chorna, L.B. Statistical estimators of a periodically correlated random process for a voiced speech signal. J. Acoust. Soc. Am.2003, 113, 2271. [Google Scholar] [CrossRef]
Demorest, P.B. Cyclic spectral analysis of radio pulsars. Mon. Not. R. Astron. Soc.2011, 416, 2821–2826. [Google Scholar] [CrossRef]
Fonseca, N.G.; Aleman, M.N. Cardiac arrhythmia classification based on the RMS signal and cyclostationarity. IEEE Latin Amer. Trans.2021, 19, 584–591. [Google Scholar] [CrossRef]
Haritopoulos, M.; Capdessus, C.; Nandi, A.K. Foetal PQRST extraction from ECG recordings using cyclostationarity-based source separation method. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Buenos Aires, Argentina, 30 August–4 September 2010; pp. 1910–1913. [Google Scholar]
Dimc, F.; Baldini, G.; Kandeepan, S. Experimental detection of mobile satellite transmissions with cyclostationary features. Int. J. Satell. Commun. Netw.2015, 33, 163–183. [Google Scholar] [CrossRef]
Dobre, O.; Oner, M.; Rajan, S.; Inkol, R. Cyclostationarity-based robust algorithms for QAM signal identification. IEEE Commun. Lett.2012, 16, 12–15. [Google Scholar] [CrossRef]
Flagiello, F.; Izzo, L.; Napolitano, A. A computationally efficient and interference tolerant nonparametric algorithm for LTI system identification based on higher order cyclostationarity. IEEE Trans. Signal Process.2000, 48, 1040–1052. [Google Scholar] [CrossRef]
Napolitano, A. Generalizations of Cyclostationary Signal Processing: Spectral Analysis and Applications; John Wiley & Sons, Ltd.: Hoboken, NJ, USA; IEEE Press: New York, NY, USA, 2012. [Google Scholar]
Napolitano, A. Cyclostationary Processes and Time Series: Theory, Applications, and Generalizations; Elsevier: Amsterdam, The Netherlands, 2019. [Google Scholar]
Lupenko, S. The Development of the Theory of Modeling and Processing of Cyclic Signals in Information Systems. Ph.D. Thesis, Lviv Polytechnic National University, Lviv, Ukraine, 2010; p. 479. (In Ukrainian). [Google Scholar]
Lupenko, S.; Orobchuk, O.; Stadnik, N.; Zozulya, A. Modeling and signals processing using cyclic random functions. In Proceedings of the 13th IEEE International Scientific and Technical Conference on Computer Sciences and Information Technologies (CSIT), Lviv, Ukraine, 11–14 September 2018; Volume 1, pp. 360–363, ISBN 978-1-5386-6463-6. [Google Scholar]
Vakulenko, D.; Vakulenko, L.; Zaspa, H.; Lupenko, S.; Stetsyuk, P.; Stovba, V. Components of Oranta-AO software expert system for innovative application of blood pressure monitors. J. Reliab. Intell. Environ.2022, 9, 41–56. [Google Scholar] [CrossRef]
Lytvynenko, I.; Lupenko, S.; Marushchak, P. Analysis of multiple cracking of nanocoating as a cyclic random process. Optoelectron. Instrum. Data Process.2013, 49, 68–75. [Google Scholar] [CrossRef]
Lytvynenko, I.; Lupenko, S.; Nazarevych, O.; Shymchuk, G.; Hotovych, V. Mathematical model of gas consumption process in the form of cyclic random process. In Proceedings of the 16th IEEE International Scientific and Technical Conference on Computer Sciences and Information Technologies (CSIT), Lviv, Ukraine, 22–25 September 2021; pp. 232–235. [Google Scholar]
Lupenko, S.; Butsiy, R.; Shakhovska, N. Advanced modeling and signal processing methods in brain–computer interfaces based on a vector of cyclic rhythmically connected random processes. Sensors2023, 23, 760. [Google Scholar] [CrossRef]
Lupenko, S.; Lytvynenko, I.; Stadnyk, N.; Zozulia, A. Model Of Signals With Double Stochasticity In The Form Of A Conditional Cyclic Random Process. In Proceedings of the 2nd International Workshop Information—Communication Technologies & Embedded Systems, Mykolaiv, Ukraine, 12 November 2020; Volume 2762, pp. 201–208. [Google Scholar]
Lupenko, S.; Stadnyk, N.; Nnamene, C. An approach to constructing a taxonomic tree of models cyclic signals in the tasks of developing an onto-oriented system for decisions supporting of models choice. In Proceedings of the 9th International Conference on Advanced Computer Information Technologies (ACIT), Ceske Budejovice, Czech Republic, 5–7 June 2019; pp. 89–92, ISBN 978-1-7281-0449-2. [Google Scholar]
Nnamene, C.; Lupenko, S.; Volyanyk, O.; Orobchuk, O. Computer Ontology of Mathematical Models of Cyclic Space-Time Structure Signals. In Proceedings of the 3rd International Workshop on Intelligent Information Technologies & Systems of Information Security (IntelITSIS 2022), Khmelnytskyi, Ukraine, 23–25 March 2022; pp. 103–118. [Google Scholar]
Napolitano, A.; Gardner, W.A. Algorithms for analysis of signals with time-warped cyclostationarity. In Proceedings of the 50th Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, USA, 6–9 November 2016; pp. 539–543. [Google Scholar]
Napolitano, A. Time-warped almost-cyclostationary signals: Characterization and statistical function measurements. IEEE Trans. Signal Process.2017, 65, 5526–5541. [Google Scholar] [CrossRef]
Gardner, W.A. Statistically inferred time warping: Extending the cyclostationarity paradigm from regular to irregular statistical cyclicity in scientific data. EURASIP J. Adv. Signal Process.2018, 2018, 59. [Google Scholar] [CrossRef]
Napolitano, A. Modeling the electrocardiogram as oscillatory almost-cyclostationary process. IEEE Access2022, 10, 13193–13209. [Google Scholar] [CrossRef]
Das, S.; Genton, M.G. Cyclostationary processes with evolving periods and amplitudes. IEEE Trans. Signal Process.2021, 69, 1579–1590. [Google Scholar] [CrossRef]
Lupenko, S. The Mathematical Model of Cyclic Signals in Dynamic Systems as a Cyclically Correlated Random Process. Mathematics2022, 10, 3406. [Google Scholar] [CrossRef]
Lupenko, S. The rhythm-adaptive Fourier series decompositions of cyclic numerical functions and one-dimensional probabilistic characteristics of cyclic random processes. Digit. Signal Process.2023, 140, 104104. [Google Scholar] [CrossRef]
Haritopoulos, M.; Roussel, J.; Capdessus, C.; Nandi, A.K. Cyclostationarity-Based Estimation of the Foetus Subspace Dimension from ECG Recordings. In Advances in Intelligent Systems and Computing; Springer: Cham, Switzerland, 2014; pp. 726–729. [Google Scholar]
Mihandoost, S.; Chehel Amirani, M. Cyclic spectral analysis of electrocardiogram signals based on GARCH model. Biomed. Signal Process. Control2017, 31, 79–88. [Google Scholar] [CrossRef]
Zhang, M.; Haritopoulos, M.; Nandi, A.K. Fetal ECG subspace estimation based on cyclostationarity. In Proceedings of the 24th European Signal Processing Conference (EUSIPCO), Budapest, Hungary, 28 August–2 September 2016; pp. 2060–2064. [Google Scholar]
García-González, M.A.; Argelagós-Palau, A. Data from: Combined measurement of ECG, breathing, and Seismocardiograms. PhysioNet2013, 101, e215–e220. [Google Scholar] [CrossRef]
Park, G. Analysis of Authentication Technology using Bio-Signals and Construction of Bio-Signal Database; Technical Report; Korea Internet and Security Agency: Naju, Republic of Korea, 2016. [Google Scholar]
Pathoumvanh, S.; Airphaiboon, S.; Hamamoto, K. Robustness study of ECG biometric identification in heart rate variability conditions. IEEE Trans. Electric. Electron. Eng.2014, 9, 294–301. [Google Scholar] [CrossRef]
Fatimah, B.; Singh, P.; Singhal, A.; Pachori, R.B. Biometric Identification From ECG Signals Using Fourier Decomposition and Machine Learning. IEEE Trans. Instrum. Meas.2022, 71, 1–9. [Google Scholar] [CrossRef]
Figure 1.
Illustration of isomorphism between and with respect to linear order .
Figure 1.
Illustration of isomorphism between and with respect to linear order .
Figure 2.
Illustration of isomorphism between and with respect to linear order (.
Figure 2.
Illustration of isomorphism between and with respect to linear order (.
Figure 3.
Illustration of isomorphism between elements of a set. takes place only if (.
Figure 3.
Illustration of isomorphism between elements of a set. takes place only if (.
Figure 4.
Graphical representation of a segment of a cyclic deterministic function, along with its cycles, phases and rhythm function.
Figure 4.
Graphical representation of a segment of a cyclic deterministic function, along with its cycles, phases and rhythm function.
Figure 5.
Graph of ECG results (lead I).
Figure 5.
Graph of ECG results (lead I).
Figure 6.
Graph of ECG results (lead II).
Figure 6.
Graph of ECG results (lead II).
Figure 7.
Graphs of estimations of the rhythm functions of the ECG signals.
Figure 7.
Graphs of estimations of the rhythm functions of the ECG signals.
Figure 8.
Graph of statistical estimation of mathematical expectation of the ECG for processing on the basis of CRP (lead I).
Figure 8.
Graph of statistical estimation of mathematical expectation of the ECG for processing on the basis of CRP (lead I).
Figure 9.
Graph of statistical estimation of mathematical expectation of the ECG for processing on the basis of CRP (lead II).
Figure 9.
Graph of statistical estimation of mathematical expectation of the ECG for processing on the basis of CRP (lead II).
Figure 10.
Graph of statistical estimation of initial moment function of the 2nd order of the ECG for processing on the basis of CRP (lead I).
Figure 10.
Graph of statistical estimation of initial moment function of the 2nd order of the ECG for processing on the basis of CRP (lead I).
Figure 11.
Graph of statistical estimation of initial moment function of the 2nd order of the ECG for processing on the basis of CRP (lead II).
Figure 11.
Graph of statistical estimation of initial moment function of the 2nd order of the ECG for processing on the basis of CRP (lead II).
Figure 12.
Graph of statistical estimation of central moment function of the 2nd order (dispersion) of the ECG for processing on the basis of CRP (lead I).
Figure 12.
Graph of statistical estimation of central moment function of the 2nd order (dispersion) of the ECG for processing on the basis of CRP (lead I).
Figure 13.
Graph of statistical estimation of central moment function of the 2nd order (dispersion) of the ECG for processing on the basis of CRP (lead II).
Figure 13.
Graph of statistical estimation of central moment function of the 2nd order (dispersion) of the ECG for processing on the basis of CRP (lead II).
Figure 14.
Graphs of statistical estimations of autocorrelation function (a) and autocovariation function (b) of the ECG for processing on the basis of CRP (lead I).
Figure 14.
Graphs of statistical estimations of autocorrelation function (a) and autocovariation function (b) of the ECG for processing on the basis of CRP (lead I).
Figure 15.
Graphs of statistical estimations of autocorrelation function (a) and autocovariation function (b) of the ECG for processing on the basis of CRP (lead II).
Figure 15.
Graphs of statistical estimations of autocorrelation function (a) and autocovariation function (b) of the ECG for processing on the basis of CRP (lead II).
Figure 16.
Graph of statistical estimation of mathematical expectation of the ECG for processing on the basis of periodic random process (lead I).
Figure 16.
Graph of statistical estimation of mathematical expectation of the ECG for processing on the basis of periodic random process (lead I).
Figure 17.
Graph of statistical estimation of mathematical expectation of the ECG for processing on the basis of periodic random process (lead II).
Figure 17.
Graph of statistical estimation of mathematical expectation of the ECG for processing on the basis of periodic random process (lead II).
Figure 18.
Graph of statistical estimation of initial moment function of the 2nd order of the ECG for processing on the basis of periodic random process (lead I).
Figure 18.
Graph of statistical estimation of initial moment function of the 2nd order of the ECG for processing on the basis of periodic random process (lead I).
Figure 19.
Graph of statistical estimation of initial moment function of the 2nd order of the ECG for processing on the basis of periodic random process (lead II).
Figure 19.
Graph of statistical estimation of initial moment function of the 2nd order of the ECG for processing on the basis of periodic random process (lead II).
Figure 20.
Graph of statistical estimation of central moment function of the 2nd order (dispersion) of the ECG for processing on the basis of periodic random process (lead I).
Figure 20.
Graph of statistical estimation of central moment function of the 2nd order (dispersion) of the ECG for processing on the basis of periodic random process (lead I).
Figure 21.
Graph of statistical estimation of central moment function of the 2nd order (dispersion) of the ECG for processing on the basis of periodic random process (lead II).
Figure 21.
Graph of statistical estimation of central moment function of the 2nd order (dispersion) of the ECG for processing on the basis of periodic random process (lead II).
Figure 22.
Graphs of statistical estimations of autocorrelation function (a) and autocovariation function (b) of the ECG for processing on the basis of periodic random process (lead I).
Figure 22.
Graphs of statistical estimations of autocorrelation function (a) and autocovariation function (b) of the ECG for processing on the basis of periodic random process (lead I).
Figure 23.
Graphs of statistical estimations of autocorrelation function (a) and autocovariation function (b) of the ECG for processing on the basis of periodic random process (lead II).
Figure 23.
Graphs of statistical estimations of autocorrelation function (a) and autocovariation function (b) of the ECG for processing on the basis of periodic random process (lead II).
Figure 24.
Graphs of dependences of the average on the interval (0,1) of the sample standard deviation of the ECG on the number of averaged cycles for ECG processing on the basis of CRP: (a) lead I; (b) lead II.
Figure 24.
Graphs of dependences of the average on the interval (0,1) of the sample standard deviation of the ECG on the number of averaged cycles for ECG processing on the basis of CRP: (a) lead I; (b) lead II.
Figure 25.
Graphs of dependences of the average on the interval (0,1) of the sample standard deviation of the ECG on the number of averaged cycles for ECG processing on the basis of periodic random process: (a) lead I; (b) lead II.
Figure 25.
Graphs of dependences of the average on the interval (0,1) of the sample standard deviation of the ECG on the number of averaged cycles for ECG processing on the basis of periodic random process: (a) lead I; (b) lead II.
Table 1.
The main averaged characteristics of biometric authentication of humans in case of application of rhythm adaptive methods of ECG processing (lead I).
Table 1.
The main averaged characteristics of biometric authentication of humans in case of application of rhythm adaptive methods of ECG processing (lead I).
Classifier Type
SIC
k-Nearest Neighbors
Linear SVM
Decision Tree
Random Forest
Multilayer Perceptron
Adaptive Boosting
Naive Bayes
Accuracy
0.977
0.999
1.0
1.0
0.992
0.993
1.0
1.0
Balanced Accuracy
0.978
0.999
1.0
1.0
0.992
0.993
1.0
1.0
F1 score
0.978
0.999
1.0
1.0
0.992
0.994
1.0
1.0
Training time (ms.)
0.81
4.98
15.09
8223.5
84.77
34.36
3790.3
673.49
Testing time (ms.)
3.96
28.81
2.34
63.21
2.26
3.31
3.05
11.99
Table 2.
The main averaged characteristics of biometric authentication of humans in case of application of non-rhythm adaptive methods of ECG processing (lead I).
Table 2.
The main averaged characteristics of biometric authentication of humans in case of application of non-rhythm adaptive methods of ECG processing (lead I).
Classifier Type
SIC
k-Nearest Neighbors
Linear SVM
Decision Tree
Random Forest
Multilayer Perceptron
Adaptive Boosting
Naive Bayes
Accuracy
0.629
0.751
0.555
0.714
0.731
0.787
0.813
0.769
Balanced Accuracy
0.618
0.752
0.548
0.703
0.729
0.784
0.813
0.769
F1 score
0.384
0.719
0.529
0.644
0.705
0.761
0.802
0.761
Training time (ms.)
0.71
6.11
61.96
8888.9
160.55
37.49
6328.2
1118.8
Testing time (ms.)
3.73
23.59
13.47
67.44
1.22
3.48
5.46
18.01
Table 3.
The main averaged characteristics of biometric authentication of humans in case of application of rhythm adaptive methods of ECG processing (lead II).
Table 3.
The main averaged characteristics of biometric authentication of humans in case of application of rhythm adaptive methods of ECG processing (lead II).
Classifier Type
SIC
k-Nearest Neighbors
Linear SVM
Decision Tree
Random Forest
Multilayer Perceptron
Adaptive Boosting
Naive Bayes
Accuracy
0.979
0.998
1.0
1.0
0.992
0.993
1.0
0.994
Balanced Accuracy
0.979
0.998
1.0
1.0
0.992
0.993
1.0
0.994
F1 score
0.979
0.998
1.0
1.0
0.992
0.993
1.0
0.994
Training time (ms.)
0.62
4.23
13.31
4833.5
84.71
33.24
1960.1
683.45
Testing time (ms.)
3.15
22.52
2.19
68.62
2.08
2.95
2.14
11.06
Table 4.
The main averaged characteristics of biometric authentication of humans in case of application of rhythm adaptive methods of ECG processing (lead II).
Table 4.
The main averaged characteristics of biometric authentication of humans in case of application of rhythm adaptive methods of ECG processing (lead II).
Classifier Type
SIC
k-Nearest Neighbors
Linear SVM
Decision Tree
Random Forest
Multilayer
Perceptron
Adaptive Boosting
Naive Bayes
Accuracy
0.663
0.738
0.552
0.705
0.717
0.792
0.797
0.777
Balanced Accuracy
0.648
0.741
0.547
0.694
0.718
0.791
0.796
0.777
F1 score
0.419
0.713
0.538
0.667
0.697
0.778
0.783
0.767
Training time (ms.)
0.61
4.49
62.01
9986.2
159.61
29.21
4615.9
1077.9
Testing time (ms.)
2.82
20.51
15.51
60.65
1.24
3.38
5.28
16.82
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Lupenko, S.; Butsiy, R.
Isomorphic Multidimensional Structures of the Cyclic Random Process in Problems of Modeling Cyclic Signals with Regular and Irregular Rhythms. Fractal Fract.2024, 8, 203.
https://doi.org/10.3390/fractalfract8040203
AMA Style
Lupenko S, Butsiy R.
Isomorphic Multidimensional Structures of the Cyclic Random Process in Problems of Modeling Cyclic Signals with Regular and Irregular Rhythms. Fractal and Fractional. 2024; 8(4):203.
https://doi.org/10.3390/fractalfract8040203
Chicago/Turabian Style
Lupenko, Serhii, and Roman Butsiy.
2024. "Isomorphic Multidimensional Structures of the Cyclic Random Process in Problems of Modeling Cyclic Signals with Regular and Irregular Rhythms" Fractal and Fractional 8, no. 4: 203.
https://doi.org/10.3390/fractalfract8040203
APA Style
Lupenko, S., & Butsiy, R.
(2024). Isomorphic Multidimensional Structures of the Cyclic Random Process in Problems of Modeling Cyclic Signals with Regular and Irregular Rhythms. Fractal and Fractional, 8(4), 203.
https://doi.org/10.3390/fractalfract8040203
Article Metrics
No
No
Article Access Statistics
For more information on the journal statistics, click here.
Multiple requests from the same IP address are counted as one view.
Lupenko, S.; Butsiy, R.
Isomorphic Multidimensional Structures of the Cyclic Random Process in Problems of Modeling Cyclic Signals with Regular and Irregular Rhythms. Fractal Fract.2024, 8, 203.
https://doi.org/10.3390/fractalfract8040203
AMA Style
Lupenko S, Butsiy R.
Isomorphic Multidimensional Structures of the Cyclic Random Process in Problems of Modeling Cyclic Signals with Regular and Irregular Rhythms. Fractal and Fractional. 2024; 8(4):203.
https://doi.org/10.3390/fractalfract8040203
Chicago/Turabian Style
Lupenko, Serhii, and Roman Butsiy.
2024. "Isomorphic Multidimensional Structures of the Cyclic Random Process in Problems of Modeling Cyclic Signals with Regular and Irregular Rhythms" Fractal and Fractional 8, no. 4: 203.
https://doi.org/10.3390/fractalfract8040203
APA Style
Lupenko, S., & Butsiy, R.
(2024). Isomorphic Multidimensional Structures of the Cyclic Random Process in Problems of Modeling Cyclic Signals with Regular and Irregular Rhythms. Fractal and Fractional, 8(4), 203.
https://doi.org/10.3390/fractalfract8040203