1. Introduction and Preliminaries
Let
X be a nonempty set and
denote the set of reals. Let
,
and
be fixed. We present a fixed-point method, which is very effective in the study of the solutions
of the following general stochastic functional equation
for
. The equation arises in the stochastic approach in mathematical psychology, which deals with the mathematical modeling of the processes of perception, reasoning, and cognition. We do not make any particular probabilistic assumptions on
X,
b,
and
, because the main considerations are valid without them (i.e., in a general situation).
Mathematical psychology is based on the observation that the learning process in an animal or a human being may be seen as a sequence of decisions resulting from a large number of potential feedbacks. These decisions often appear unexpected even in simple repeated tests conducted under well-controlled circumstances, which suggests that they can be considered to be random. Therefore, it seems to make sense to include in our considerations the systemic changes (in the set of possible choices) that represent fluctuations in the probability of responses between individual trials, which means the investigation of a suitable stochastic process.
The idea that a simple learning experiment may behave stochastically is not novel (see, e.g., Refs. [
1,
2,
3]). It has some drawbacks, but also shows some new relationships. One of the tools applied in the research connected with this idea are functional equations. For instance, in 1967, Epstein [
4] proposed the following functional equation (to discuss the learning process of animals in a two-choice situation):
where
a and
b are fixed real constants and
is an unknown function satisfying the conditions
and
. The analytical solution of the above equation was calculated by using the bilateral Laplace transformation.
In 1976, Istrăţescu [
5] studied the behavior of predatory animals that prey on two distinct types of prey and used the following functional equation
where
are learning-rate parameters and
is an unknown function.
Recently, Turab and Sintunavarat [
6] introduced the following functional equation
where
is an unknown function,
are learning-rate parameters and
are real constants. The functional equation was used to study a specific kind of psychological resistance of dogs enclosed in a small box.
Note that Equations (
2)–(
4) are particular cases of (
1) with
,
and
. For several other studies on human actions in probability-learning scenarios, we refer to [
1,
7,
8,
9,
10] (see also [
11,
12,
13]).
Further, an apparently two-choice situation regarding the movement of the animals towards food can actually be a four-response situation, if we also take into account the food placement, as did Bush and Wilson [
2], dividing the types of responses into four events: right-reward, right-nonreward, left-reward, left-nonreward. They examined the movement of a paradise fish. A very general situation with four different responses is depicted by Equation (
1), which additionally include the possibility of the so called ‘blank trials’.
The notion of ‘blank trials’ is motivated by the following very natural question:
What if an animal or human does not move for any prey or response and sticks to its original position?
Some information on such a situation we can find in the paper of Neimark [
14], concerning the human response in the two-choice experiment, in which it should have been foreseen which of two lights would be turned on in every trial, but the case when ‘no light was turned on’ was possible as well. Such ‘blank trials,’ as the author called them, established another class of events. Turab and Sintunavarat have also investigated such a situation for a paradise fish [
8].
Our objective is to prove results on the existence, uniqueness and stability of solutions to functional Equation (
1) by using the tools afforded to us by fixed-point theory (for details about fixed-point theory we refer to [
15,
16,
17]).
Finally, let us mention that the standard theory of existence and uniqueness of solutions to the stochastic equations can be found in many books, such as [
18]. These books are usually geared towards Polish spaces but methods to extend the standard theory to Tychonoff spaces are now well understood (see [
19]). While our spaces are certainly Tychonoff, it is of interest to come up with a simple direct proof of existence and uniqueness without requiring a lot of specialized machinery.
2. Auxiliary Information and Results
In what follows, always denotes the family of all functions that map a set into a set .
An extended norm, in a real or complex vector space
W, is a function
(i.e., possibly also taking the value
) such that, for each scalar
and every
with
,
and
if and only if
(the zero vector).
If
V is a normed space and
is a set, then such an extended norm in
can be defined by:
An extended metric in a set is a function fulfilling, for every , the subsequent three conditions:
if and only if ;
;
.
If d is an extended metric in a nonempty set B, then we say that the pair is an extended metric space.
If is an extended norm in a real vector space W, then it is easily seen that the formula defines an extended metric in W. For the extended norms and metrics the notions of Cauchy sequence and completeness are the same as for the classical norms and metrics.
In the sequel, given a set and , we sometimes write for simplicity for . Moreover, as usual, and for , (positive integers).
Now, we are in a position to recall the Diaz–Margolis fixed-point alternative (see [
20]), which will be useful in the proof of our main results (
).
Theorem 1. Assume that ρ is an extended complete metric in a set and is a contraction with the constant (i.e., for with ). Let be such that there is with . Then the sequence converges to a fixed point of , is the unique fixed point of in the set and Proof. From [
20] (Theorem) we can easily deduce the convergence of
to a fixed point
of
. Further, for each fixed point
of
, we have the subsequent simple inequality
which yields the uniqueness of
. For the convenience of readers, we also present below a proof of (
5).
First note that, for every
,
,
whence
Further,
and consequently,
Finally, it is easily seen that (
5) can be deduced from the above inequality and from the fact that, for every
with
, we have
□
Remark 1. Let in Theorem 1. Then (5) (with ) yields , which means that . Further, for every fixed point of such that , we have and therefore . This means that , as is the unique in fixed point of .
Consequently, if has a fixed point , then necessarily .
3. Some Preliminary Remarks
Later in this article (unless explicitly stated otherwise),
is a metric space,
and
are fixed,
and we write
It is easily seen that
and consequently
If , then is a real vector space and is an extended norm in . If , then is not a real vector space. However, in either case we can define in an extended metric by .
We show that
is complete. So, take a Cauchy sequence
in
. Then, for every
, there exists
such that
for
with
, which means that
This, with
, yields
Consequently, for every
, the sequence
is Cauchy in
(with the natural metric) and there exists the limit
Thus we define a function
. Next, letting
in (
8) we get
whence
for
. In this way we have shown that (in
)
Let . Then, every function is a Lipschitz function with the Lipschitz constant equal to (i.e., for every ); therefore, it is continuous.
Next, take
for
and assume that (
9) holds with some
, which means that
Then, by (
6) and (
7),
which on account of (
10) implies that
is a Cauchy sequence in
, and consequently there exists finite
Due to (
6), we also have the inequality
Hence, by (
10) (with
), we obtain
, whence
. Thus, we have proved that
is a closed subset of
.
4. Main Results
In this section,
,
and
are fixed. We investigate solutions
to (
1), i.e., to the functional equation
We also need the following three hypotheses.
Hypothesis 1 (
).
For each , is a Lipschitz mapping with a constant , i.e., Hypothesis 2 (). , and .
Hypothesis 3 (
).
For every , Hypothesis may seem quite demanding, but it is easily seen that, in the case , it is fulfilled, for instance, in the following situations:
- -
is a fixed point of and , , ;
- -
is a fixed point of and , ;
- -
is a fixed point of and , , .
Note that if hypothesis is valid, then for every and consequently .
Now, we are in a position to prove the following main result of this paper.
Theorem 2. Let hypotheses be valid, and . Suppose that one of the following three conditions is valid.
- (a)
There exist points such that - (b)
There exist such that for all with , and - (c)
There exist with
If is such that there is with , then the sequence is convergent to a fixed point of , which is the unique solution of Equation (11) in the set Moreover, the speed of convergence is estimated by the following inequality: Proof. We show that is a contraction on .
First, observe that, for each
,
and consequently
Assume that condition (a) is fulfilled. Then by (
14) and (
21), for every
with
,
where
Hence, replacing
f by
, we obtain that
If condition (b) is satisfied, then by (
16) and (
21), for every
with
, we have
where
Hence, as in the previous case we obtain (
22).
Finally, assume that (c) holds. Then by (
18) and (
21), for every
with
, we have
where
Hence, as previously we obtain (
22).
Thus, we have shown that is a contraction in each of the cases (a)–(c). Consequently, Theorem 1 (with , , and ) completes the proof. □
Remark 2. If one of conditions (a)–(c) of Theorem 2 is fulfilled, then every solution of (11) can be obtained in the way depicted in Theorem 2. For, if fulfils (11), then it is a fixed point of and consequently for each , which means that the sequence converges to . Remark 3. Observe that if , for , , are nonexpansive mappings, , and λ is given by (15), then the inequality implies that .
Remark 4. Note that a constant function , , is a solution to (11) if and only if Assume that (24) holds. Since , so under the assumptions of Theorem 2 (with ) is the only solution of Equation (11) which belongs to . If is a fixed point of for , then this is true, e.g., for the equation with and fixed and .
If , then with equation (25) can be (2), while for particular cases of (25) are (3) and (4) and the equations considered in [8,21]. This means that with (under suitable assumptions on ), for Equations (2)–(4) (and equations considered in [8,21]), is the only solution that belongs to . If (24) does not hold, then clearly every solution of (25) must be a nonconstant function. Therefore, in such a case, the statement of Theorem 2 depicts nonconstant solutions to (25) and moreover, if and , then a solution generated in this way belongs to (because is a closed subset of , as it has been shown at the end of Section 3). Remark 5. Assume that (16) holds. Then, for every , with , So, if is a limit of a sequence of points of the set with for , then taking in the above inequalities , , and letting , we get and . This means that condition (14) is valid with . Hence, in the case where (b) holds we obtain anything other than in the case of (a) only when the topology generated in X by d is discrete. 5. Remarks on Ulam Stability
In this section we show that Theorem 2 actually also provides the results on Ulam stability. Let us recall that the theory of Ulam stability (often also called the Hyers–Ulam stability) has been motivated by a problem of S. Ulam, concerning approximate homomorphisms of groups, and an answer to it provided by D. Hyers [
22] (see [
23,
24,
25,
26,
27,
28] for more details and references).
To put it very roughly, the main issue of such stability can be expressed as follows: When a function satisfying an equation approximately (in some sense) must be near an exact solution to the equation?
The next definition (cf. [
25], p. 119, Ch. 5, Definition 8) makes the notion a bit more precise (
).
Definition 1. Let A be a nonempty set, be a metric space, be nonempty, be an operator mapping into and be operators mapping a nonempty set into . We say that the equationis —stable provided for any and withthere exists a solution of Equation (26) such that In short,
–stability of (
26) means that every approximate (in the sense of (
27)) solution of (
26) is always close (in the sense of (
28)) to an exact solution of (
26).
In mathematical modeling, the consistency of solutions to equations applied is critical. Minor changes to the data set, such as those caused by natural measurement errors, should not have a significant impact on the conclusion. Hence, it is also essential to analyze the stability of the suggested functional equation solutions. The next corollary shows that Theorem 2 also yields information on the Ulam stability of Equation (
11), which correspond to and complement various earlier stability results for functional equations in single variable (cf., e.g., [
29,
30,
31,
32]).
Corollary 1. Let hypotheses – be valid and let one of conditions (a)–(c) of Theorem 2 be fulfilled.
If is such that , then the sequence converges to a solution of Equation (11) and Moreover, is the unique in solution to (11) with a finite distance to . Proof. In view of Theorem 2 (with
and
), it is only necessary to show the uniqueness of
. So, suppose that
also is a solution to (
11) with
. Then
Since
and
g also are fixed points of
and from the proof of Theorem 2 it follows that (
22) holds with
, for each
we have
which with
yields
. □
6. Conclusions
Mathematical psychology is a branch of psychology that deals with the mathematical modeling of processes studied in theories of cognition and learning. One of its directions is the so-called stochastic approach. From this perspective, most research on learning processes can be reduced to calculating the probability of events occurring in subsequent trials, which leads to the consideration of appropriate stochastic processes.
In this article, we presented some results on Ulam stability and solution (e.g., their existence and uniqueness) of a general functional equation that may be used to study various learning theory experiments on animals and humans. The main tool that we use is the fixed-point alternative of Diaz and Margolis [
20].
Unlike the authors of [
6,
8,
21], we do not use any boundary conditions in the proof of our Theorem 2. Therefore our findings are applicable to a broader range of problems.
Author Contributions
Conceptualization, A.T. and W.A.; methodology, A.T., J.B. and W.A.; software, A.T., J.B. and W.A.; validation, A.T., J.B. and W.A.; formal analysis, A.T., J.B. and W.A.; investigation, A.T., J.B. and W.A.; resources, A.T., J.B. and W.A.; data curation, A.T., J.B. and W.A.; writing—original draft preparation, A.T. and W.A.; writing—review and editing, A.T., J.B. and W.A.; visualization, A.T., J.B. and W.A.; supervision, A.T.; project administration, A.T., J.B. and W.A.; funding acquisition, A.T., J.B. and W.A. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Estes, W.K.; Straughan, J.H. Analysis of a verbal conditioning situation in terms of statistical learning theory. J. Exp. Psych. 1954, 47, 225–234. [Google Scholar] [CrossRef] [PubMed]
- Bush, A.A.; Wilson, T.R. Two-choice behavior of paradise fish. J. Exp. Psych. 1956, 51, 315–322. [Google Scholar] [CrossRef]
- Bush, R.; Mosteller, F. Stochastic Models for Learning; Wiley: New York, NY, USA, 1955. [Google Scholar]
- Epstein, B. On a difference equation arising in a learning-theory model. Israel J. Math. 1966, 4, 145–152. [Google Scholar] [CrossRef]
- Istrăţescu, V.I. On a functional equation. J. Math. Anal. Appl. 1976, 56, 133–136. [Google Scholar] [CrossRef]
- Turab, A.; Sintunavarat, W. On the solution of the traumatic avoidance learning model approached by the Banach fixed point theorem. J. Fixed Point Theory Appl. 2020, 22, 50. [Google Scholar] [CrossRef]
- Grant, D.A.; Hake, H.W.; Hornseth, J.P. Acquisition and extinction of a verbal conditioned response with differing percentages of reinforcement. J. Exp. Psych. 1951, 42, 1–5. [Google Scholar] [CrossRef] [PubMed]
- Turab, A.; Sintunavarat, W. On analytic model for two-choice behavior of the paradise fish based on the fixed point method. J. Fixed Point Theory Appl. 2019, 21, 56. [Google Scholar] [CrossRef]
- Humphreys, L.G. Acquisition and extinction of verbal expectations in a situation analogous to conditioning. J. Exp. Psych. 1939, 25, 294–301. [Google Scholar] [CrossRef]
- Jarvik, M.E. Probability learning and a negative recency effect in the serial anticipation of alternative symbols. J. Exp. Psych. 1951, 41, 291–297. [Google Scholar] [CrossRef]
- Schein, E.H. The effect of reward on adult imitative behavior. J. Abnorm. Soc. Psych. 1954, 49, 389–395. [Google Scholar] [CrossRef]
- Miller, N.E.; Dollard, J. Social Learning and Imitation; Yale University Press: New Haven, CT, USA, 1941. [Google Scholar]
- Schwartz, N. An Experimental Study of Imitation. The Effects of Reward and Age. Ph.D. Thesis, Radcliffe College, Cambridge, MA, USA, 1953. [Google Scholar]
- Neimark, E.D. Effects of Type of Non-reinforcement and Number of Alternative Responses in Two Verbal Conditioning Situation. Ph.D. Thesis, Indiana University, Bloomington, IN, USA, 1953. [Google Scholar]
- Aydi, H.; Karapinar, E.; Rakocevic, V. Nonunique fixed point theorems on b-metric spaces via simulation functions. Jordan J. Math. Stat. 2019, 12, 265–288. [Google Scholar]
- Karapinar, E. Recent advances on the results for nonunique fixed in various spaces. Axioms 2019, 8, 72. [Google Scholar] [CrossRef] [Green Version]
- Alsulami, H.H.; Karapinar, E.; Rakocevic, V. Ciric type nonunique fixed point theorems on b-metric spaces. Filomat 2017, 31, 3147–3156. [Google Scholar] [CrossRef]
- Ethier, S.N.; Kurtz, T.G. Markov Processes, Characterization and Convergence; Wiley: New York, NY, USA, 1986. [Google Scholar]
- Kouritzin, M.A. On tightness for probability measures on Skorokhod spaces. Trans. Am. Math. Soc. 2016, 368, 5675–5700. [Google Scholar] [CrossRef]
- Diaz, J.B.; Margolis, B. A fixed point theorem of the alternative, for contractions on a generalized complete metric space. Bull. Am. Math. Soc. 1968, 74, 305–309. [Google Scholar] [CrossRef] [Green Version]
- Berinde, V.; Khan, A.R. On a functional equation arising in mathematical biology and theory of learning. Creat. Math. Inform. 2015, 24, 9–16. [Google Scholar] [CrossRef]
- Hyers, D.H. On the stability of the linear functional equation. Proc. Nat. Acad. Sci. USA 1941, 27, 222–224. [Google Scholar] [CrossRef] [Green Version]
- Rassias, T.M. On the stability of the linear mapping in Banach spaces. Proc. Am. Math. Soc. 1978, 72, 297–300. [Google Scholar] [CrossRef]
- Aoki, T. On the stability of the linear transformation in Banach spaces. J. Math. Soc. Jpn. 1950, 2, 64–66. [Google Scholar] [CrossRef]
- Brzdęk, J.; Popa, D.; Raşa, I.; Xu, B. Ulam Stability of Operators; Academic Press: Oxford, UK, 2018. [Google Scholar]
- Hyers, D.H.; Isac, G.; Rassias, T.M. Stability of Functional Equations in Several Variables; Birkhauser: Basel, Switzerland, 1998. [Google Scholar]
- Jung, S.-M. Hyers-Ulam-Rassias Stability of Functional Equations in Nonlinear Analysis; Springer: New York, NY, USA, 2011. [Google Scholar]
- Ulam, S.M. A Collection of the Mathematical Problems; Interscience Publ.: New York, NY, USA, 1960. [Google Scholar]
- Brzdęk, J.; Ciepliński, K.; Leśniak, Z. On Ulam’s type stability of the linear equation and related issues. Discrete Dyn. Nat. Soc. 2014, 2014, 536791. [Google Scholar] [CrossRef]
- Agarwal, R.P.; Xu, B.; Zhang, W. Stability of functional equations in single variable. J. Math. Anal. Appl. 2003, 288, 852–869. [Google Scholar] [CrossRef] [Green Version]
- Xu, B.; Brzdęk, J.; Zhang, W. Fixed point results and the Hyers-Ulam stability of linear equations of higher orders. Pac. J. Math. 2015, 273, 483–498. [Google Scholar] [CrossRef]
- Brzdęk, J.; Popa, D.; Xu, B. On approximate solutions of the linear functional equation of higher order. J. Math. Anal. Appl. 2011, 373, 680–689. [Google Scholar] [CrossRef] [Green Version]
| Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).