Next Article in Journal
Limits of Quantum B-Algebras
Previous Article in Journal
Towards Parameter Identification of a Behavioral Model from a Virtual Reality Experiment
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Flexible Power-Normal Models with Applications

by
Guillermo Martínez-Flórez
1,
Diego I. Gallardo
2,
Osvaldo Venegas
3,*,
Heleno Bolfarine
4 and
Héctor W. Gómez
5
1
Departamento de Matemáticas y Estadística, Facultad de Ciencias, Universidad de Córdoba, Córdoba 2300, Colombia
2
Departamento de Matemática, Facultad de Ingeniería, Universidad de Atacama, Copiapó 1530000, Chile
3
Departamento de Ciencias Matemáticas y Físicas, Facultad de Ingeniería, Universidad Católica de Temuco, Temuco 4780000, Chile
4
Departamento de Estatística, IME, Universidade de São Paulo, São Paulo 05508-090, Brazil
5
Departamento de Matemáticas, Facultad de Ciencias Básicas, Universidad de Antofagasta, Antofagasta 1240000, Chile
*
Author to whom correspondence should be addressed.
Mathematics 2021, 9(24), 3183; https://doi.org/10.3390/math9243183
Submission received: 18 November 2021 / Revised: 2 December 2021 / Accepted: 6 December 2021 / Published: 10 December 2021
(This article belongs to the Section Probability and Statistics)

Abstract

:
The main object of this paper is to propose a new asymmetric model more flexible than the generalized Gaussian model. The probability density function of the new model can assume bimodal or unimodal shapes, and one of the parameters controls the skewness of the model. Three simulation studies are reported and two real data applications illustrate the flexibility of the model compared with traditional proposals in the literature.

1. Introduction

Azzalini [1] introduced the skew-normal (SN) model and Durrans [2] introduced the generalized Gaussian model, also known as the power-normal (PN) model. A limitation of those models is that they only produce uni-modal asymmetric densities, and are therefore not appropriate for fitting bimodal data. An approach typically used for fitting multimodal data is the mixture of normal or asymmetric-normal models, which present difficulties such as identifiability problems (see McLachlan and Peel [3]; Marin et al. [4]) and complicated numerical implementation. Bimodal distributions generated from skew-symmetric distributions can be found in Azzalini and Capitanio [5], Ma and Genton [6], Arellano-Valle et al. [7], Kim [8], Lin et al. [9,10], Elal-Olivero et al. [11], Arnold et al. [12,13], Gómez et al. [14], Braga et al. [15], Venegas et al. [16] and Gómez-Déniz et al. [17], among others.
It is therefore of interest to study asymmetric models that are adequate for fitting possible bimodal data. Hence, the main object of this paper is to propose asymmetric distributions that are more flexible than the SN and PN models; and are also useful for modeling bimodal data, which are very common in practical situations. The proposed model is not a mixture type model, to avoid the identifiability problems mentioned above. Our proposal considers a family of distributions which can adopt both a unimodal shape (competing with the SN and PN models) and a bimodal shape (competing with the mixture of normals).
The following Lemma is introduced in Gómez et al. [14], and is crucial for the construction of the new family of distributions.
Lemma 1.
Let f be a symmetric around zero probability density function (pdf), F its respective cumulative distribution function (cdf) and G an absolutely continuous cdf such that G is a symmetric pdf around zero. Then,
g ( z ; λ , δ ) = c δ f ( z + δ ) G ( λ z ) , z , λ , δ R
is the pdf of a random variable, where c δ 1 = 1 F ( δ ) .
Gómez et al. [14] studied the skew-flexible-normal (SFN) distribution with pdf given by:
f ( z ; λ , δ ) = c δ ϕ ( | z | + δ ) Φ ( λ z ) , z , λ , δ R .
The authors show that, for δ < 0 , the model in (2) is bimodal. We denote this model as SFN( λ , δ ).
The “Lehmann’s alternatives” model proposed in Lehmann [18] is based on the distribution of the maximum of a sample. It is a good alternative for extending models because it incorporates a higher asymmetry and/or kurtosis than the basal model. The cdf of this model is given by:
F F ( z ; α ) = { F ( z ) } α , z R , α > 0 ,
where F is a cdf. For α Z , the cdf corresponds to the random variable defined as ( Z 1 , , Z α ) , where the Z i s are independent and identically distributed with common cdf F. Durrans [2] extends this interpretation to fractional order statistics for α R . We denote a random variable with cdf defined in (3) as Z P F ( α ) . The case, F = Φ , corresponds to the PN model with pdf given by
φ ( z ; α ) = α ϕ ( z ) { Φ ( z ) } α 1 , z R , α > 0 ,
which we denote by Z P N ( α ) . This model has been studied in more detail in Gupta and Gupta [19]. Pewsey et al. [20] derived its Fisher information matrix, showing that it is non-singular in a neighborhood of symmetry point ( α = 1 ), which is not satisfied for the SN distribution under the symmetry hypothesis, that is, at λ = 0 , because its Fisher information matrix is singular.
The paper is organized as follows. In Section 2, the flexible power-normal (FPN) model is introduced and some of its main properties are discussed. An inference of the model via maximum likelihood (ML) estimation is considered in Section 3. Three procedures to draw values from the FPN distribution are discussed in Section 4. Three simulation studies are carried out in Section 5 in order to assess different aspects of the model. Two real data applications are reported in Section 6, illustrating the usefulness of the model compared with other common distributions in the literature. Finally, Section 7 presents a discussion of the main results of the paper.

2. Flexible Power-Normal Distribution

In this section, we introduce a more flexible model than the power-normal model introduced in (4) by incorporating a new shape parameter δ . One of the interesting features of this model is that, for certain values of shape parameter δ , a bimodal pdf can be obtained.
Definition 1.
A random variable Z follows a FPN distribution with parameters α and δ, if its pdf is given by:
φ ( z ; α , δ ) = k ( α , δ ) ϕ ( z + δ ) { Φ ( z ) } α 1 , z , δ R , α R + ,
where
k ( α , δ ) = k α , δ = 2 π ϕ ( δ ) 0 1 u α 1 exp { δ Φ 1 ( u ) } d u 1 ,
is the normalizing constant. We use the notation Z F P N ( 0 , 1 , α , δ ) .

2.1. Some Particular Cases of the FPN Model

For the FPN distribution, we have the following particular cases.
Proposition 1.
If Z F P N ( 0 , 1 , α , δ ) , then
  • φ ( z ; 0 , 1 , α = 1 , δ = 0 ) = ϕ ( z ) .
  • φ ( z ; 0 , 1 , α , δ = 0 ) = α ϕ ( z ) { Φ ( z ) } α 1 .
  • φ ( z ; 0 , 1 , α = 2 , δ = 0 ) = 2 ϕ ( z ) Φ ( z ) .
  • φ ( z ; 0 , 1 , α = 2 , δ ) = c δ ϕ ( z + δ ) Φ ( z ) .
Remark 1.
Note that points 1 and 2 show that N and PN distributions are particular cases of the FPN model. Points 3 and 4 show that the model contains particular cases of the skew-normal and skew-flexible-normal models (SN(1) and SFN(1,δ), respectively).

2.2. Properties of the pdf for the FPN Model

The following propositions illustrate a point where the pdf of the FPN model is not differentiable.
Proposition 2.
Let Z F P N ( 0 , 1 , α , δ ) . If δ 0 , then the pdf of the FPN is not differentiable at z = 0 .
Proof. 
Note that
lim z 0 + φ ( z ; α , δ ) = ( 1 / 2 ) α 2 k α , δ ϕ ( δ ) α 1 2 π δ 2 , and lim z 0 φ ( z ; α , δ ) = ( 1 / 2 ) α 2 k α , δ ϕ ( δ ) α 1 2 π + δ 2 ,
from which we conclude that the pdf of the FPN model is not differentiable at z = 0 as long as δ 0 . □
Proposition 3.
Let Z F P N ( 0 , 1 , α , δ ) . If δ < 0 , the distribution of the random variable Z is bimodal.
Proof. 
Equating to zero the first derivative for the pdf of the random variable Z with FPN distribution, we have the following cases:
  • If z < 0 , then it follows that the solution is given by z 1 = ( α 1 ) ϕ ( z 1 ) / Φ ( z 1 ) + δ .
  • If z 0 , we have the solution z 2 = ( α 1 ) ϕ ( z 2 ) / Φ ( z 2 ) δ .
Moreover, if α 1 , z 1 R and if α 1 + , z 2 R + . Hence, z 1 and z 2 are distinct values. Therefore, Z is a random variable with a bimodal distribution. □
Corollary 1.
Let Z F P N ( 0 , 1 , α , δ ) . If α = 1 and δ < 0 , then random variable Z is symmetric and bimodal.
Proof. 
If α = 1 then φ ( z ; α = 1 , δ ) = 2 c δ 1 ϕ ( z + δ ) , z , δ R . As ϕ is a symmetric function, we conclude that Z is a symmetric random variable. □
Figure 1 shows plots of the pdf for the FPN ( 0 , 1 , α , δ ) for different values of α and δ . As mentioned previously, for δ < 0 a bimodal pdf is obtained, but one of the modes “disappears” when α moves away from one ( α 0 or α + ), whereas for δ 0 a unimodal pdf is obtained with different degrees of kurtosis (leptokurtic, mesokurtic or platykurtic) depending on the value of α . On the other hand, α < 1 and α > 1 produce a positive and negative skew effect in the pdf, respectively, whereas α = 1 corresponds to a symmetrical pdf.

2.3. Moments

Definition 2.
Let Z F P N ( 0 , 1 , α , δ ) . For r = 1 , 2 , , we define the lower and upper r-th incomplete moments of Z as
μ r ( Z ) = z y r φ ( y ; α , δ ) d y a n d μ r + ( Z ) = z y r φ ( y ; α , δ ) d y ,
respectively. With those definitions, the r-th moment of Z is given by
μ r = E ( Z r ) = μ r ( Z ) + μ r + ( Z ) .
The next result presents a recursive expression for computing the moments of the FPN random variable.
Proposition 4.
Let Z F P N ( 0 , 1 , α , δ ) . The r-th moment of the random variable Z is given by:
μ r = ( r 1 ) μ r 2 ( 0 ) + δ k α , δ μ r 1 ( 0 ) μ r 1 + ( 0 ) + + ( α 1 ) k α , δ 0 1 Φ 1 ( v ) r 1 ϕ Φ 1 ( v ) + δ v α 2 d v .
The r-th central moment, say μ r ´ = E [ ( Z E ( Z ) ) r ] , for r = 2 , 3 , 4 , can be computed using the expressions:
μ 2 ´ = μ 2 μ 1 2 , μ 3 ´ = μ 3 3 μ 2 μ 1 + 2 μ 1 3 and μ 4 ´ = μ 4 4 μ 3 μ 1 + 6 μ 2 μ 1 2 3 μ 1 4 .
With those definitions, the variance and the asymmetry and kurtosis coefficients are given by:
σ 2 = V a r ( Z ) = μ 2 ´ , β 1 = μ 3 ´ / [ μ 2 ´ ] 3 / 2 and β 2 = μ 4 ´ / [ μ 2 ´ ] 2 ,
respectively. Figure 2 shows the asymmetry and kurtosis coefficients for the FPN ( 0 , 1 , α , δ ) model with different values of α and δ .

2.4. The Location-Scale Extension

We consider now the location-scale extension for the model. The FPN distribution with location parameter ξ R and scale parameter η R + , is defined as the distribution of the random variable X = ξ + η Z , for which the pdf is given by:
φ ( x ; ξ , η , α , δ ) = k α , δ η ϕ x ξ η + δ Φ x ξ η α 1 , x , ξ , δ R , η , α R + .
If X has a density function as in the Equation (7) model, we use the notation X F P N ( ξ , η , α , δ ) .

3. Inference for the FPN Model

In this section, we discuss the ML estimation of the parameters of the FPN model. Observed and expected (Fisher) information matrices are derived for the standard and location-scale models. For the location-scale situation, we have a four-dimension parameter vector, θ = ( ξ , η , α , δ ) .

3.1. Standard Case

Considering that Z 1 , , Z n are independent and identically distributed with standard FPN distribution, the log-likelihood function for ( α , δ ) based on the sample Z = ( z 1 , , z n ) is given by:
( α , δ ; Z ) = n log k α , δ 2 π 1 2 i = 1 n z i + δ 2 + ( α 1 ) i = 1 n log Φ ( z i ) ,
from which the elements of the score function are given by:
U ( α ) = n 2 π h ( α , δ ) + u ¯ and U ( δ ) = n 2 π g ( α , δ ) z ¯ δ ,
where
h ( α , δ ) = ϕ ( δ ) k α , δ 0 1 z α 1 log z exp δ Φ 1 ( z ) d z , u ¯ = i = 1 n u i / n ,
g ( α , δ ) = ϕ ( δ ) k α , δ 0 1 Φ 1 ( z ) + δ z α 1 exp δ Φ 1 ( z ) d z ,
and z ¯ = i = 1 n z i / n .
Equating the above derivatives to zero, we obtain the ML equations, which are given by:
u ¯ = 2 π h ( α , δ ) and δ = 2 π g ( α , δ ) z ¯ .
To solve the above equations, a numerical procedure is required since analytical solutions are not available. To derive the Fisher information matrix, we consider the second derivatives of the log-likelihood function for parameters ( α , δ ) , which we denote by ( j x y ); these are given by:
j α α = n Δ 1 α ( α , δ ) + Δ 2 α ( α , δ ) , j δ α = n [ 2 π Δ 1 α δ ( α , δ ) + Δ 2 α δ ( α , δ ) ] , and
j δ δ = n Δ 1 δ ( α , δ ) + Δ 2 δ ( α , δ ) + 1 ,
where
Δ 1 α ( α , δ ) = log k α , δ α 2 , Δ 2 α ( α , δ ) = k α , δ 2 k α , δ 1 α 2 , Δ 1 α δ ( α , δ ) = g ( α , δ ) log ( k α , δ ) α ,
Δ 1 δ ( α , δ ) = log k α , δ δ 2 , Δ 2 δ ( α , δ ) = k α , δ 2 k α , δ 1 δ 2 , Δ 2 α δ ( α , δ ) = k α , δ 2 k α , δ 1 α δ .
The elements of the Fisher information matrix are obtained by computing the expected values of the corresponding elements of the observed information matrix.

3.2. The Location-Scale Model

For a random sample of size n, X 1 , , X n , from the F P N ( ξ , η , α , δ ) distribution, the likelihood function for θ = ( ξ , η , α , δ ) based on the sample X = ( x 1 , , x n ) can be written as:
( θ ; X ) = n { log ( k α , δ ) log ( η ) log ( 2 π ) } 1 2 i = 1 n z i 2 n 2 δ 2 δ i = 1 n z i + + ( α 1 ) i = 1 n log Φ z i ,
where z i = x i ξ η . The elements of the score function are given by:
U ( ξ ) = 1 η i = 1 n z i + δ η i = 1 n sign ( z i ) α 1 η i = 1 n w i , U ( η ) = n η + 1 η i = 1 n z i 2 + δ η i = 1 n z i sign ( z i ) α 1 η i = 1 n z i w i , U ( α ) = 2 π n h ( α , δ ) + i = 1 n log { Φ ( z i ) } = n 2 π h ( α , δ ) + u ¯ , a n d U ( δ ) = 2 π n g ( α , δ ) i = 1 n z i n δ = n 2 π g ( α , δ ) z ¯ δ ,
where u i = log Φ ( z i ) , w i = ϕ ( z i ) / Φ ( z i ) and sign is the sign function. The solutions for the score equations are given by:
δ = 2 π g ( α , δ ) z ¯ , ( α 1 ) ( z w ) ¯ + 1 = z 2 ¯ + δ z sign ( z ) ¯ , u ¯ = 2 π h ( α , δ ) a n d z ¯ + δ sign ( z ) ¯ = ( α 1 ) w ¯ ,
where
w ¯ = i = 1 n w i / n , z ¯ = i = 1 n z i / n , z ¯ = i = 1 n z i / n , z 2 ¯ = i = 1 n z i 2 / n a n d z w ¯ = i = 1 n z i w i / n .

3.3. Expected Information Matrix

For an observation ( z i = z ) we have that:
i ( θ ; z ) = log ( k ( α , δ ) ) log ( η ) log 2 π } 1 2 ( z + δ ) 2 + ( α 1 ) log Φ ( z ) ,
where z = ( x ξ ) / η . The second derivatives of the log-likelihood function (11) with respect to the model parameters are given by:
j ξ ξ i = 1 η 2 1 + ( α 1 ) ( z w + w 2 ) , j α ξ i = w η , j δ ξ i = 1 η sign ( z ) , j η ξ i = 1 η 2 sign ( z ) z + δ + z + ( α 1 ) z 2 w + z w 2 w , j η η i = 1 η 2 1 + 2 sign ( z ) z + δ z + z 2 ( α 1 ) 2 z w z 2 w 2 z 3 w , j α η i = z w η , j δ η i = z η sign ( z ) , j α α i = Δ 1 α ( α , δ ) + Δ 2 α ( α , δ ) , j δ α i = [ 2 π Δ 1 α δ ( α , δ ) + Δ 2 α δ ( α , δ ) ] , and j δ δ i = Δ 1 δ ( α , δ ) + Δ 2 δ ( α , δ ) + 1 ,
where Δ 1 α , Δ 2 α , Δ 1 δ , Δ 2 δ , Δ 1 α δ a n d Δ 2 α δ are defined in Section 3.1. Note that z sign ( z ) = z , z sign ( z ) = z , E ( sign ( Z ) ) = μ 0 + ( ξ ) μ 0 ( ξ ) and E ( Z ) = μ 1 + ( ξ ) μ 1 ( ξ ) . Denoting i ξ ξ , i ξ η , , i δ δ as the expected values of the elements of the observed information matrix and defining a k j = E ( Z k W j ) for k = 0 , 1 , 2 , 3 , and j = 0 , 1 , 2 we obtain:
i ξ ξ = 1 η 2 1 + ( α 1 ) ( a 11 + a 02 ) , i α ξ = a 01 η , i δ ξ = μ 0 + ( ξ ) μ 0 ( ξ ) η , i η ξ = 1 η 2 δ ( μ 0 + ( ξ ) μ 0 ( ξ ) ) + 2 a 10 + ( α 1 ) a 21 + a 12 a 01 , i η η = 1 η 2 1 + 2 δ ( μ 1 + ( ξ ) μ 1 ( ξ ) ) + 3 a 20 ( α 1 ) 2 a 11 a 22 a 31 , i α η = a 11 η , i δ η = μ 1 + ( ξ ) μ 1 ( ξ ) η , i α α = E ( Δ 1 α ( α , δ ) ) + E ( Δ 2 α ( α , δ ) ) , i δ α = [ 2 π E ( Δ 1 α δ ( α , δ ) ) + E ( Δ 2 α δ ( α , δ ) ) ] , and i δ δ = E ( Δ 1 δ ( α , δ ) ) + E ( Δ 2 δ ( α , δ ) ) + 1 .
a k j must be computed numerically since they have no closed forms.

4. Simulating Values from the FPN Model

In this section, we discuss three methods for drawing values from the FPN distribution. This model has no stochastic representation, nor does it have a tractable cdf, making data simulation by conventional methods difficult. On the other hand, as the FPN is a location-scale model, we only discuss the case ξ = 0 and η = 1 .

4.1. Acceptance-Rejection Method: Way 1

This method can be used for δ 0 . Note that the pdf of the FPN ( 0 , 1 , α , δ ) model can be written as
φ ( z ; α , δ ) = α 1 k α , δ exp δ 2 2 C × exp δ | z | g 1 ( z ; δ ) × α ϕ ( z ) Φ ( z ) α 1 h 1 ( z ; α ) ,
where g 1 ( z ; δ ) [ 0 , 1 ] , z R , δ 0 and h 1 ( z ; α ) is the pdf of the PN ( α ) . For this reason, to draw values from the standard FPN model, we can use the following algorithm:
  • Simulate U U ( 0 , 1 ) .
  • Simulate Y P N ( α ) .
    • Simulate U 1 U ( 0 , 1 ) .
    • Do Y = Φ 1 U 1 1 / α .
  • If U exp ( δ | Y | ) , accept Y. Otherwise, back to step 1.
The probability of a value being accepted is 1 / C = α k α , δ 1 exp ( δ 2 / 2 ) .

4.2. Acceptance-Rejection Method: Way 2

This method can be used for α 1 . Note that:
φ ( z ; α , δ ) = 2 k α , δ c δ 1 C × Φ α 1 ( z ) g 1 ( z ; α ) × 0.5 c δ ϕ ( | z | + δ ) h 1 ( z ; α ) ,
where g 1 ( z ; α ) [ 0 , 1 ] , z R , α 1 and h 1 ( z ; δ ) is the pdf of the S F N ( 0 , δ ) . For this reason, to draw values from the standard FPN model, we can use the following algorithm:
  • Simulate U U ( 0 , 1 ) .
  • Simulate Y S F N ( 0 , δ ) .
    • Simulate U 1 , U 2 U ( 0 , 1 ) independently.
    • Do Y 1 = Φ 1 Φ ( δ ) + U 1 [ 1 Φ ( δ ) ] δ .
    • If U 2 1 / 2 , do S = 1 . Otherwise, do S = 1 .
    • Do Y = Y 1 × S .
  • If U { Φ ( Y ) } α 1 , accept Y. Otherwise, back to step 1.
The probability of a value being accepted is 1 / C = 0.5 k α , δ 1 c δ . Figure 3 shows the constant C for the two ways discussed of drawing values from the FPN model. Results suggest that neither method is appropriate for drawing values from the FPN model for large values of δ .

4.3. A Metropolis-Hastings Algorithm

The Metropolis–Hastings algorithm is used extensively in a Bayesian context, because it allows values to be drawn from a given pdf, as long as we know its kernel (and not necessarily a possible normalizing constant). For the FPN distribution, that kernel is given by:
φ * ( z ; α , δ ) ϕ ( | z | + δ ) { Φ ( z ) } α 1 , z , δ R , α R + .
The method requires a proposal distribution, for which we considered the N ( 0 , σ 2 ) model. The detail of the algorithm is as follows:
  • Define an initial value z 0 .
  • For i = 1 , , n , draw v i N ( 0 , σ 2 ) and U i U ( 0 , 1 ) . Do z i * = z i 1 + v i .
  • Define p i = φ * ( z i * ; α , δ ) / φ * ( z i 1 ; α , δ ) .
  • If U i p i , do z i = z i * . Otherwise, z i = z i 1 .
z 1 , , z n represent a sample of size n from the FPN distribution. In order to decrease the correlation of the values drawn, we draw b + t × n values. The first b values are discarded (the burn-in) and for t values we only consider 1 (the thin). In particular, we consider b = 1000, t = 10 and σ = 1 , showing a satisfactory performance of the method for all the combinations of α and δ considered in this work.

5. Simulation Studies

In this Section, we present three simulation studies. The first study illustrates the performance of the three simulation procedures in drawing values from the model discussed in Section 4. The second study is devoted to assessing the performance of the ML estimators in finite samples. The third study shows a model selection problem to select among the N, PN and FPN models when the data are generated under different scenarios.

5.1. Assessing the Simulation Procedures for the FPN Model

In this Section, we study the three methods discussed in Section 4 to simulate values from the FPN distribution. Figure 4 shows the histogram versus the theoretical curve for 10,000 values drawn from three combinations of parameters for the FPN model, using the three methods discussed previously. Note that, except for restrictions in the acceptance-rejection method given in the two ways (i.e., δ 0 and α 1 for way 1 and way 2, respectively) the three methods seem suitable for drawing values from the model.
On the other hand, we evaluate the execution times of the three ways of drawing values (when the comparison is possible). For this, we draw 100 samples for the FPN model of size 1000; 2000 and 5000 and compute the average of these execution times. We consider ξ = 0 , η = 1 , α ranging in { 0.1 , 0.2 , , 5.0 } and δ ranging in { 5.0 , 4.9 , , 5.0 } . The results for the three methods were very similar (with differences lower than 0.01 s). For instance, considering all the combinations for α and δ and n = 5000 (the case that took the longest), the maximum average of the execution times was 0.9134 s, suggesting that is relatively quick to simulate values from the model in all cases. As the Metropolis-Hastings algorithm can be applied for the FPN model in all situations, this method was used for data generation hereinafter.

5.2. Performance of ML Estimators in Finite Samples

In order to evaluate the properties of ML estimators in finite samples, the samples were generated based on the Metrópolis-Hastings algorithm discussed in the previous section.
In all cases, we consider ξ = 0 and η = 1 as true values. The sample sizes considered were n = 200 and n = 500 with three values for α (0.5, 1.0 and 1.5) and δ (−0.5, 0.0 and 0.5). The three values for δ represent the bimodal asymmetric, bimodal symmetric and unimodal cases respectively, totaling 18 different cases. For each, we drew 1000 replicates and we computed the ML estimators using the optim function in R. We present the mean of the estimates and the mean of the estimated standard errors for the 1000 replicates. Results are presented in Table 1, showing that the mean of the estimates converges to the true value, and the mean of the estimated standard errors is reduced for all the parameters when n is increased, suggesting that the ML estimators for the FPN model are consistent.

5.3. A Model Selection Study

In this Section, we consider a simulation study in order to assess two model selection criteria in different contexts based on the FPN model: the AIC (see Akaike [21]), namely
A I C = 2 ( θ ^ ; X ) + 2 k ,
where θ ^ is the ML estimator of θ and k is the number of parameters for the fitted model; and the Bayesian criterion (see Schwarz [22]), defined as
B I C = 2 ( θ ^ ; X ) + log ( n ) k .
Models with lower AIC and BIC are preferred. The data were drawn from the FPN ( ξ = 0 , η = 1 , α , δ ) model, with α varying in ( 0.5 , 0.8 , 1.0 , 1.5 , 3.0 ) and δ varying in ( 1.5 , 0.5 , 0.0 , 0.5 , 2.0 ) . Note that the FPN ( 0 , 1 , α = 1 , δ = 0 ) corresponds to the N distribution and FPN ( 0 , 1 , α 1 , δ = 0 ) corresponds to the PN model. Again, we consider two sample sizes: 200 and 500. For each simulated sample, we fitted the N, PN and FPN models and selected a model based on AIC and BIC criteria. Table 2 summarizes the percentage of times where each model is chosen based on the two criteria. Note that for α = 1 and δ = 0 (where the data are drawn from the N model), both criteria effectively chose the N model more frequently than the other models. However, for α 1 and δ = 0 (where the data are drawn from the PN model), both criteria continue to choose the N model more frequently (except for the case α = 3 , δ = 0 and n = 500 ), suggesting that AIC and BIC criteria choose the N model over the other models in scenarios where the asymmetry and the sample size are greater. For all other cases, we note that the BIC criterion tends to choose the N model—incorrectly—much more frequently than the AIC criterion, and the advantages of the FPN model are evidenced in cases where | δ | is increased.

6. Numerical Illustrations

In this Section, we illustrate with two real datasets the better performance of the FPN distribution compared with other models in the literature. Codes were developed in Core Team R [23] and are available as supplementary material for this manuscript.

6.1. Illustration 1

The first dataset corresponds to 481 observations of the variable “Crack” included in the dataset verb “Pollen5.Dat” available at http://lib.stat.cmu.edu/datasets/pollen.data, accessed on 15 October 2021. A descriptive summary of the data can be found in Table 3. Quantities b 1 and b 2 denote, respectively, the sample asymmetry and kurtosis coefficients.
Clearly, the values taken by the asymmetry and kurtosis coefficients indicate that an asymmetric model may be more adequate than a symmetric model for fitting the pollen data. Moreover, the data histogram presented in Figure 5a shows that a model with the ability to fit bimodal data may present better results than just the PN model. To quantify the findings we test the hypothesis
H 0 : δ = 0 against H 1 : δ 0 ,
by using the likelihood ratio statistic
Λ = P N ( θ ) F P N ( θ ) ,
leading to
2 log ( Λ ) = 11.80 ,
which is greater than the 5% critical value for the chi-square distribution with one degree of freedom, given by χ 1 2 = 3.8414 . Hence, there is a clear indication that the FPN model can be quite useful in fitting bimodal data such as the pollen data described above. Table 4 presents parameter estimates (standard errors in parentheses) for both the FPN and ordinary models, including the mixture of normals (MN). Finally, plots for the fitted PN, MN and FPN models are presented in Figure 5b. Likewise, we present the qq-plot that follows by using parameter estimates for the FPN model, suggesting a good fit of the model for this dataset.
To compare model fit, we consider the AIC and BIC criteria. Hence, we have that the FPN model presents the best fit for the pollen dataset, of all the models considered.

6.2. Illustration 2

The dataset consists of 1150 heights measured at 1 micron intervals along the drum of a roller (i.e., parallel to the axis of the roller). This was part of an extensive study of surface roughness of the rollers. The units of height are not given, because the data are automatically rescaled as they are recorded, and the scaling factor is imperfectly known. The zero reference height is arbitrary. Data are available for downloading at http://lib.stat.cmu.edu/jasadata/laslett, accessed on 15 October 2021. More details about the data can be found in Laslett [24]. Table 5 shows the summary statistics for the data. Note that the data have a large, negative sample asymmetry and sample kurtosis greater than three, indicating that the ordinary normal model may present a poor fit. Table 6 presents the fit for the N, SN, PN and FPN models. Note that the minimum AIC and BIC criteria are attached by the FPN distribution. Finally, Figure 6 presents the histogram for the data and the fitted pdf for the models, showing the better performance of the FPN distribution over the other models considered.

7. Conclusions

The main object of this paper is to propose a new asymmetric model that is more flexible than the generalized Gaussian model studied in Durrans [2]. This new model includes a parameter that makes it more flexible, because it is useful for unimodal or bimodal data and/or cases with skewness and kurtosis larger than those expected for the N and PN models. Given the flexibility of the model, further work could study the FPN distribution in different contexts: regression, measurement with error-in-variable models, random effect models, and so forth.

Author Contributions

Conceptualization, G.M.-F. and H.W.G.; methodology, H.W.G.; software, D.I.G. and G.M.-F.; validation, G.M.-F., H.W.G. and H.B.; formal analysis, G.M.-F., O.V. and H.W.G.; investigation, H.W.G., O.V. and G.M.-F.; writing—original draft preparation, G.M.-F. and D.I.G.; writing—review and editing, O.V. All authors have read and agreed to the published version of the manuscript.

Funding

Héctor W. Gómez’s research has been partially supported by SEMILLERO UA-2021.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are available for downloading at http://lib.stat.cmu.edu/datasets/pollen.data (accessed on 15 October 2021) and http://lib.stat.cmu.edu/jasadata/laslett (accessed on 15 October 2021).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Azzalini, A. A class of distributions which includes the normal ones. Scand. J. Stat. 1985, 12, 171–178. [Google Scholar]
  2. Durrans, S.R. Distributions of fractional order statistics in hydrology. Water Resour. Res. 1992, 28, 1649–1655. [Google Scholar] [CrossRef]
  3. McLachlan, G.; Peel, D. Finite Mixture Models; John Wiley & Sons, Inc.: New York, NY, USA, 2000. [Google Scholar]
  4. Marin, J.; Mengersen, K.; Robert, C.P. Bayesian Modeling and Inference for mixtures of distributions. In Handbook of Statistics; Dey, D., Rao, C., Eds.; Elsevier: Amsterdam, The Netherlands, 2005; pp. 454–508. [Google Scholar]
  5. Azzalini, A.; Capitanio, A. Distributions generate by perturbation of symmetry with emphasis on a multivariate skew-t distribution. J. R. Stat. Soc. Ser. B 2003, 65, 367–389. [Google Scholar] [CrossRef]
  6. Ma, Y.; Genton, M.G. Flexible class of skew-symmetric distributions. Scand. J. Stat. 2004, 31, 459–468. [Google Scholar] [CrossRef] [Green Version]
  7. Arellano-Valle, R.B.; Gómez, H.W.; Quintana, F.A. Statistical inference for a general class of asymmetric distributions. J. Stat. Plan. Inference 2005, 128, 427–443. [Google Scholar] [CrossRef]
  8. Kim, H.J. On a class of two-piece skew-normal distributions. Statistics 2005, 39, 537–553. [Google Scholar] [CrossRef]
  9. Lin, T.I.; Lee, J.C.; Hsieh, W.J. Robust mixture models using the skew-t distribution. Stat. Comput. 2007, 17, 81–92. [Google Scholar] [CrossRef]
  10. Lin, T.I.; Lee, J.C.; Yen, S.Y. Finite mixture modeling using the skew-normal distribution. Stat. Sin. 2007, 17, 909–927. [Google Scholar]
  11. Elal-Olivero, D.; Gómez, H.W.; Quintana, F.A. Bayesian Modeling using a class of Bimodal skew-Elliptical distributions. J. Stat. Plan. Inference 2009, 139, 1484–1492. [Google Scholar] [CrossRef]
  12. Arnold, B.C.; Gómez, H.W.; Salinas, H.S. On multiple constraint skewed models. Statistics 2009, 43, 279–293. [Google Scholar] [CrossRef]
  13. Arnold, B.C.; Gómez, H.W.; Salinas, H.S. A doubly skewed normal distribution. Statistics 2015, 49, 842–858. [Google Scholar] [CrossRef]
  14. Gómez, H.W.; Elal-Olivero, D.; Salinas, H.S.; Bolfarine, H. Bimodal extension based on the skew-normal distribution with application to pollen data. Environmetrics 2011, 22, 50–62. [Google Scholar] [CrossRef]
  15. Braga, A.D.S.; Cordeiro, G.M.; Ortega, E.M.M. A new skew-bimodal distribution with applications. Commun. Stat.-Theory Methods 2018, 47, 2950–2968. [Google Scholar] [CrossRef]
  16. Venegas, O.; Salinas, H.S.; Gallardo, D.I.; Bolfarine, B.; Gómez, H.W. Bimodality based on the generalized skew-normal distribution. J. Stat. Comput. Simul. 2018, 88, 156–181. [Google Scholar] [CrossRef]
  17. Gómez-Déniz, E.; Pérez-Rodríguez, J.V.; Reyes, J.; Gómez, H.W. A Bimodal Discrete Shifted Poisson Distribution. A Case Study of Tourists’ Length of Stay. Symmetry 2020, 12, 442. [Google Scholar] [CrossRef] [Green Version]
  18. Lehmann, E.L. The power of rank tests. Ann. Math. Stat. 1953, 24, 23–43. [Google Scholar] [CrossRef]
  19. Gupta, D.; Gupta, R.C. Analyzing skewed data by power normal model. Test 2008, 17, 197–210. [Google Scholar] [CrossRef]
  20. Pewsey, A.; Gómez, H.W.; Bolfarine, H. Likelihood-based inference for power distributions. Test 2012, 21, 775–789. [Google Scholar] [CrossRef]
  21. Akaike, H. A new look at statistical model identification. IEEE Trans. Autom. Control 1974, 19, 716–723. [Google Scholar] [CrossRef]
  22. Schwarz, G. Estimating the dimension of a model. Ann. Stat. 1978, 1, 461–464. [Google Scholar] [CrossRef]
  23. Core Team, R. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2021. [Google Scholar]
  24. Laslett, G.M. Kriging and Splines: An Empirical Comparison of Their Predictive Performance in Some Applications: Rejoinder. J. Am. Stat. Assoc. 1994, 89, 406–409. [Google Scholar] [CrossRef]
Figure 1. Pdf for FPN ( 0 , 1 , α , δ ) with different combinations of α and δ : (a) FPN ( 0 , 1 , α , δ = 1 ) and varying α ; (b) FPN ( 0 , 1 , α , δ = 1 ) and varying α ; (c) FPN ( 0 , 1 , α = 0.7 , δ ) and varying δ ; and (d) FPN ( 0 , 1 , α = 1.5 , δ ) and varying δ .
Figure 1. Pdf for FPN ( 0 , 1 , α , δ ) with different combinations of α and δ : (a) FPN ( 0 , 1 , α , δ = 1 ) and varying α ; (b) FPN ( 0 , 1 , α , δ = 1 ) and varying α ; (c) FPN ( 0 , 1 , α = 0.7 , δ ) and varying δ ; and (d) FPN ( 0 , 1 , α = 1.5 , δ ) and varying δ .
Mathematics 09 03183 g001
Figure 2. (a) Skewness and (b) kurtosis coefficients for the FPN ( 0 , 1 , α , δ ) model.
Figure 2. (a) Skewness and (b) kurtosis coefficients for the FPN ( 0 , 1 , α , δ ) model.
Mathematics 09 03183 g002
Figure 3. Constant C for the acceptance-rejection method to draw values from FPN model: (a) way 1 and (b) way 2.
Figure 3. Constant C for the acceptance-rejection method to draw values from FPN model: (a) way 1 and (b) way 2.
Mathematics 09 03183 g003
Figure 4. Ten thousand values simulated from the FPN ( ξ , η , α , δ ) model under different scenarios: (a) ξ = 2 , η = 3 , α = 0.2 , δ = 2.5 and acceptance-rejection method: way 1; (b) ξ = 8 , η = 5 , α = 2 , δ = 0.5 and acceptance-rejection method: way 2; (c) ξ = 100 , η = 50 , α = 0.8 , δ = 2.5 and Metropolis-Hastings method.
Figure 4. Ten thousand values simulated from the FPN ( ξ , η , α , δ ) model under different scenarios: (a) ξ = 2 , η = 3 , α = 0.2 , δ = 2.5 and acceptance-rejection method: way 1; (b) ξ = 8 , η = 5 , α = 2 , δ = 0.5 and acceptance-rejection method: way 2; (c) ξ = 100 , η = 50 , α = 0.8 , δ = 2.5 and Metropolis-Hastings method.
Mathematics 09 03183 g004
Figure 5. (a) Fitted distributions: SN (dotted line), MN (dashed line) and FPN (solid line) models. (b) Simulated QQ-plot for the fitted FPN model and the variable pollen.
Figure 5. (a) Fitted distributions: SN (dotted line), MN (dashed line) and FPN (solid line) models. (b) Simulated QQ-plot for the fitted FPN model and the variable pollen.
Mathematics 09 03183 g005
Figure 6. Histogram of heights dataset and fitted models N (dotted-dashed line), SN (dotted line), PN (dashed line) and FPN (solid line).
Figure 6. Histogram of heights dataset and fitted models N (dotted-dashed line), SN (dotted line), PN (dashed line) and FPN (solid line).
Mathematics 09 03183 g006
Table 1. Mean of the estimates and mean of the estimated standard errors (in parentheses) based on 1000 replicates for the FPN model. In all cases ξ = 0 , η = 1 are maintained and different sample sizes and values for α and δ are considered.
Table 1. Mean of the estimates and mean of the estimated standard errors (in parentheses) based on 1000 replicates for the FPN model. In all cases ξ = 0 , η = 1 are maintained and different sample sizes and values for α and δ are considered.
Parameter δ = 0.5 δ = 0 δ = 0.5
n = 200 n = 500 n = 200 n = 500 n = 200 n = 500
α = 0.1 ξ 0.4861 (4.4259)−0.2412 (2.0642)−0.1071 (1.5502)−0.0133 (1.2664)−0.0065 (1.0174)−0.0029 (0.8505)
η 0.9068 (0.5161)0.9280 (0.4248)0.9340 (0.3629)0.9258 (0.3173)0.9382 (0.2802)0.9469 (0.2468)
α 0.1195 (0.0990)0.1109 (0.0774)0.1136 (0.0719)0.1101 (0.0637)0.1093 (0.0640)0.1081 (0.0601)
δ −0.8799 (1.3637)−0.6915 (0.6524)−0.4955 (0.4797)−0.3877 (0.3809)−0.1621 (0.3485)−0.0117 (0.3129)
α = 0.8 ξ −0.022 (0.134)0.000 (0.085)0.054 (0.150)0.011 (0.124)0.000 (0.064)−0.007 (0.031)
η 0.971 (0.100)0.989 (0.065)0.923 (0.132)0.953 (0.090)0.977 (0.189)1.009 (0.118)
α 0.835 (0.096)0.809 (0.060)0.846 (0.150)0.870 (0.123)0.895 (0.155)0.833 (0.079)
δ −0.587 (0.225)−0.532 (0.145)−0.163 (0.281)−0.109 (0.181)0.450 (0.439)0.515 (0.277)
α = 1.0 ξ 0.006 (0.126)−0.007 (0.081)0.018 (0.129)0.017 (0.105)−0.003 (0.069)−0.013 (0.038)
η 0.965 (0.108)0.984 (0.070)0.928 (0.135)0.947 (0.088)0.991 (0.206)1.008 (0.126)
α 1.011 (0.112)1.009 (0.072)1.065 (0.178)1.058 (0.138)1.184 (0.352)1.060 (0.104)
δ −0.578 (0.243)−0.540 (0.156)−0.167 (0.309)−0.122 (0.197)0.493 (0.516)0.510 (0.298)
α = 1.5 ξ −0.003 (0.122)0.008 (0.079)0.050 (0.112)−0.016 (0.096)−0.016 (0.096)−0.018 (0.03)
η 0.970 (0.115)0.983 (0.074)0.921 (0.136)0.964 (0.092)0.963 (0.092)1.011 (0.126)
α 1.515 (0.190)1.498 (0.115)1.479 (0.241)1.504 (0.207)1.604 (0.207)1.501 (0.154)
δ −0.584 (0.273)−0.541 (0.173)−0.175 (0.343)−0.104 (0.228)0.545 (0.527)0.524 (0.330)
Table 2. Percentage of times where AIC and BIC choose the N, PN and FPN models based on 1000 replicates for different scenarios for the FPN model and sample size.
Table 2. Percentage of times where AIC and BIC choose the N, PN and FPN models based on 1000 replicates for different scenarios for the FPN model and sample size.
δ
−1.5−0.50.00.52.0
n α Fitted ModelAICBICAICBICAICBICAICBICAICBIC
2000.5N0.00.242.085.465.293.635.077.92.619.5
PN2.26.68.93.725.06.116.09.40.91.3
FPN97.893.249.110.99.80.349.012.796.579.2
0.8N0.00.041.490.276.097.552.091.85.335.1
PN0.10.19.31.812.72.19.02.11.61.3
FPN99.999.949.38.011.30.439.06.193.163.6
1.0N0.00.048.292.476.397.753.192.06.038.4
PN0.00.010.93.112.91.910.22.92.32.6
FPN100.0100.040.94.510.80.436.75.191.759.0
1.5N0.01.463.196.871.694.843.282.35.735.5
PN4.19.911.52.116.74.825.712.36.19.3
FPN95.988.725.41.111.70.431.15.488.255.2
3.0N50.188.071.394.049.683.326.663.61.713.2
PN19.311.120.56.037.715.648.233.825.748.7
FPN30.60.98.20.012.71.125.22.672.638.1
5000.5N0.00.011.869.247.987.210.752.80.10.4
PN0.10.44.21.839.012.19.811.20.00.0
FPN99.999.684.029.013.10.779.536.099.999.6
0.8N0.00.013.676.372.297.625.682.60.01.4
PN0.00.03.91.116.12.33.51.80.00.0
FPN100.0100.082.522.611.70.170.915.6100.098.6
1.0N0.00.017.480.877.498.425.484.00.02.2
PN0.00.05.71.713.71.64.61.90.00.0
FPN100.0100.076.917.58.90.070.014.1100.097.8
1.5N0.00.041.395.260.694.115.768.50.02.1
PN0.00.310.82.329.05.626.019.30.92.0
FPN100.099.747.92.510.40.358.312.299.195.9
3.0N27.691.353.193.518.361.13.125.50.00.3
PN4.41.027.56.466.638.557.070.98.725.8
FPN68.07.719.40.115.10.439.93.691.373.9
Table 3. Summary statistics for precipitation data.
Table 3. Summary statistics for precipitation data.
nMeanVariance b 1 b 2
481−0.048326.99800.23292.5944
Table 4. Parameter estimates (standard errors in parentheses) for N, SN, PN, MN and FPN models in the pollen dataset.
Table 4. Parameter estimates (standard errors in parentheses) for N, SN, PN, MN and FPN models in the pollen dataset.
ParameterNSNPNFPNParameterMN
ξ −0.0489 (0.2367)−4.9482 (0.8164)−11.8216 (7.2910)−2.0300 (0.2797) ξ 1 −3.5847 (0.8948)
η 5.1902 (0.1673)7.1379 (0.6058)8.4627 (1.8070)3.5192 (0.1982) η 1 3.3009 (0.3662)
α -1.6568 (0.4856)7.5132 (7.9838)0.7316 (0.0464) ξ 2 3.8531 (1.5545)
δ ---−0.6946 (0.1316) η 2 3.9516 (0.6768)
-----p0.5245 (0.1593)
Log-likelihood−1474.64−1472.08−1472.24−1466.33 −1466.30
AIC2953.282950.162950.472940.66 2942.60
BIC2961.632962.682963.002957.36 2963.48
Table 5. Summary statistics for roller data.
Table 5. Summary statistics for roller data.
nMeanVariance b 1 b 2
11503.5350.422−0.9864.855
Table 6. Parameter estimates (standard errors in parentheses) for N, SN, PN and FPN models in roller dataset.
Table 6. Parameter estimates (standard errors in parentheses) for N, SN, PN and FPN models in roller dataset.
ParameterNSNPNFPN
ξ 3.5347 (0.0192)4.2475 (0.0284)4.5494 (0.0570)3.8529 (0.0106)
η 0.6497 (0.0135)0.9644 (0.0304)0.1983 (0.0279)0.7589 (0.0634)
α -−2.7578 (0.2529)0.0479 (0.0155)0.2082 (0.0568)
δ ---1.3045 (0.2064)
Log-likelihood−1135.87−1071.35−1085.24−1065.92
AIC2275.732148.692176.842139.84
BIC2285.832163.842191.982160.03
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Martínez-Flórez, G.; Gallardo, D.I.; Venegas, O.; Bolfarine, H.; Gómez, H.W. Flexible Power-Normal Models with Applications. Mathematics 2021, 9, 3183. https://doi.org/10.3390/math9243183

AMA Style

Martínez-Flórez G, Gallardo DI, Venegas O, Bolfarine H, Gómez HW. Flexible Power-Normal Models with Applications. Mathematics. 2021; 9(24):3183. https://doi.org/10.3390/math9243183

Chicago/Turabian Style

Martínez-Flórez, Guillermo, Diego I. Gallardo, Osvaldo Venegas, Heleno Bolfarine, and Héctor W. Gómez. 2021. "Flexible Power-Normal Models with Applications" Mathematics 9, no. 24: 3183. https://doi.org/10.3390/math9243183

APA Style

Martínez-Flórez, G., Gallardo, D. I., Venegas, O., Bolfarine, H., & Gómez, H. W. (2021). Flexible Power-Normal Models with Applications. Mathematics, 9(24), 3183. https://doi.org/10.3390/math9243183

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop