Entropy

330 KiB

Open AccessArticle

The Differential Entropy of the Joint Distribution of Eigenvalues of Random Density Matrices

by Laizhen Luo, Jiamei Wang, Lin Zhang and Shifang Zhang

Entropy 2016, 18(9), 342; https://doi.org/10.3390/e18090342 - 21 Sep 2016

Cited by 3 | Viewed by 5028

We derive exactly the differential entropy of the joint distribution of eigenvalues of Wishart matrices. Based on this result, we calculate the differential entropy of the joint distribution of eigenvalues of random mixed quantum states, which is induced by taking the partial trace [...] Read more.

We derive exactly the differential entropy of the joint distribution of eigenvalues of Wishart matrices. Based on this result, we calculate the differential entropy of the joint distribution of eigenvalues of random mixed quantum states, which is induced by taking the partial trace over the environment of Haar-distributed bipartite pure states. Then, we investigate the differential entropy of the joint distribution of diagonal entries of random mixed quantum states. Finally, we investigate the relative entropy between these two kinds of distributions. Full article

(This article belongs to the Section Information Theory, Probability and Statistics)

5802 KiB

Open AccessArticle

Effects of Fatty Infiltration of the Liver on the Shannon Entropy of Ultrasound Backscattered Signals

by Po-Hsiang Tsui and Yung-Liang Wan

Entropy 2016, 18(9), 341; https://doi.org/10.3390/e18090341 - 21 Sep 2016

Cited by 38 | Viewed by 7716

Abstract

This study explored the effects of fatty infiltration on the signal uncertainty of ultrasound backscattered echoes from the liver. Standard ultrasound examinations were performed on 107 volunteers. For each participant, raw ultrasound image data of the right lobe of liver were acquired using [...] Read more.

This study explored the effects of fatty infiltration on the signal uncertainty of ultrasound backscattered echoes from the liver. Standard ultrasound examinations were performed on 107 volunteers. For each participant, raw ultrasound image data of the right lobe of liver were acquired using a clinical scanner equipped with a 3.5-MHz convex transducer. An algorithmic scheme was proposed for ultrasound B-mode and entropy imaging. Fatty liver stage was evaluated using a sonographic scoring system. Entropy values constructed using the ultrasound radiofrequency (RF) and uncompressed envelope signals (denoted by H_R and H_E, respectively) as a function of fatty liver stage were analyzed using the Pearson correlation coefficient. Data were expressed as the median and interquartile range (IQR). Receiver operating characteristic (ROC) curve analysis with 95% confidence intervals (CIs) was performed to obtain the area under the ROC curve (AUC). The brightness of the entropy image typically increased as the fatty stage varied from mild to severe. The median value of H_R monotonically increased from 4.69 (IQR: 4.60–4.79) to 4.90 (IQR: 4.87–4.92) as the severity of fatty liver increased (r = 0.63, p < 0.0001). Concurrently, the median value of H_E increased from 4.80 (IQR: 4.69–4.89) to 5.05 (IQR: 5.02–5.07) (r = 0.69, p < 0.0001). In particular, the AUCs obtained using H_E (95% CI) were 0.93 (0.87–0.99), 0.88 (0.82–0.94), and 0.76 (0.65–0.87) for fatty stages ≥mild, ≥moderate, and ≥severe, respectively. The sensitivity, specificity, and accuracy were 93.33%, 83.11%, and 86.00%, respectively (≥mild). Fatty infiltration increases the uncertainty of backscattered signals from livers. Ultrasound entropy imaging has potential for the routine examination of fatty liver disease. Full article

(This article belongs to the Special Issue Symbolic Entropy Analysis and Its Applications)

► Show Figures

Figure 1

180 KiB

Open AccessEditorial

Quantum Computation and Information: Multi-Particle Aspects

by Demosthenes Ellinas, Giorgio Kaniadakis, Jiannis K. Pachos and Antonio Maria Scarfone

Entropy 2016, 18(9), 339; https://doi.org/10.3390/e18090339 - 20 Sep 2016

Viewed by 4579

Abstract

This editorial explains the scope of the special issue and provides a thematic introduction to the contributed papers. Full article

(This article belongs to the Special Issue Quantum Computation and Information: Multi-Particle Aspects)

510 KiB

Open AccessArticle

The Constant Information Radar

by Bryan Paul and Daniel W. Bliss

Entropy 2016, 18(9), 338; https://doi.org/10.3390/e18090338 - 19 Sep 2016

Cited by 16 | Viewed by 8776

Abstract

The constant information radar, or CIR, is a tracking radar that modulates target revisit time by maintaining a fixed mutual information measure. For highly dynamic targets that deviate significantly from the path predicted by the tracking motion model, the CIR adjusts by illuminating [...] Read more.

The constant information radar, or CIR, is a tracking radar that modulates target revisit time by maintaining a fixed mutual information measure. For highly dynamic targets that deviate significantly from the path predicted by the tracking motion model, the CIR adjusts by illuminating the target more frequently than it would for well-modeled targets. If SNR is low, the radar delays revisit to the target until the state entropy overcomes noise uncertainty. As a result, we show that the information measure is highly dependent on target entropy and target measurement covariance. A constant information measure maintains a fixed spectral efficiency to support the RF convergence of radar and communications. The result is a radar implementing a novel target scheduling algorithm based on information instead of heuristic or ad hoc methods. The CIR mathematically ensures that spectral use is justified. Full article

(This article belongs to the Special Issue Radar and Information Theory)

► Show Figures

Figure 1

1018 KiB

Open AccessArticle

Entropy Minimizing Curves with Application to Flight Path Design and Clustering

by Stéphane Puechmorel and Florence Nicol

Entropy 2016, 18(9), 337; https://doi.org/10.3390/e18090337 - 15 Sep 2016

Cited by 5 | Viewed by 4982

Abstract

Air traffic management (ATM) aims at providing companies with a safe and ideally optimal aircraft trajectory planning. Air traffic controllers act on flight paths in such a way that no pair of aircraft come closer than the regulatory separation norms. With the increase [...] Read more.

Air traffic management (ATM) aims at providing companies with a safe and ideally optimal aircraft trajectory planning. Air traffic controllers act on flight paths in such a way that no pair of aircraft come closer than the regulatory separation norms. With the increase of traffic, it is expected that the system will reach its limits in the near future: a paradigm change in ATM is planned with the introduction of trajectory-based operations. In this context, sets of well-separated flight paths are computed in advance, tremendously reducing the number of unsafe situations that must be dealt with by controllers. Unfortunately, automated tools used to generate such planning generally issue trajectories not complying with operational practices or even flight dynamics. In this paper, a means of producing realistic air routes from the output of an automated trajectory design tool is investigated. For that purpose, the entropy of a system of curves is first defined, and a mean of iteratively minimizing it is presented. The resulting curves form a route network that is suitable for use in a semi-automated ATM system with human in the loop. The tool introduced in this work is quite versatile and may be applied also to unsupervised classification of curves: an example is given for French traffic. Full article

(This article belongs to the Special Issue Differential Geometrical Theory of Statistics)

► Show Figures

Figure 1

1893 KiB

Open AccessArticle

Combined Forecasting of Streamflow Based on Cross Entropy

by Baohui Men, Rishang Long and Jianhua Zhang

Entropy 2016, 18(9), 336; https://doi.org/10.3390/e18090336 - 15 Sep 2016

Cited by 9 | Viewed by 4784

Abstract

In this study, we developed a model of combined streamflow forecasting based on cross entropy to solve the problems of streamflow complexity and random hydrological processes. First, we analyzed the streamflow data obtained from Wudaogou station on the Huifa River, which is the [...] Read more.

In this study, we developed a model of combined streamflow forecasting based on cross entropy to solve the problems of streamflow complexity and random hydrological processes. First, we analyzed the streamflow data obtained from Wudaogou station on the Huifa River, which is the second tributary of the Songhua River, and found that the streamflow was characterized by fluctuations and periodicity, and it was closely related to rainfall. The proposed method involves selecting similar years based on the gray correlation degree. The forecasting results obtained by the time series model (autoregressive integrated moving average), improved grey forecasting model, and artificial neural network model (a radial basis function) were used as a single forecasting model, and from the viewpoint of the probability density, the method for determining weights was improved by using the cross entropy model. The numerical results showed that compared with the single forecasting model, the combined forecasting model improved the stability of the forecasting model, and the prediction accuracy was better than that of conventional combined forecasting models. Full article

► Show Figures

Figure 1

903 KiB

Open AccessArticle

Enhanced Energy Distribution for Quantum Information Heat Engines

by Jose M. Diaz de la Cruz and Miguel Angel Martin-Delgado

Entropy 2016, 18(9), 335; https://doi.org/10.3390/e18090335 - 14 Sep 2016

Cited by 8 | Viewed by 5134

Abstract

A new scenario for energy distribution, security and shareability is presented that assumes the availability of quantum information heat engines and a thermal bath. It is based on the convertibility between entropy and work in the presence of a thermal reservoir. Our approach [...] Read more.

A new scenario for energy distribution, security and shareability is presented that assumes the availability of quantum information heat engines and a thermal bath. It is based on the convertibility between entropy and work in the presence of a thermal reservoir. Our approach to the informational content of physical systems that are distributed between users is complementary to the conventional perspective of quantum communication. The latter places the value on the unpredictable content of the transmitted quantum states, while our interest focuses on their certainty. Some well-known results in quantum communication are reused in this context. Particularly, we describe a way to securely distribute quantum states to be used for unlocking energy from thermal sources. We also consider some multi-partite entangled and classically correlated states for a collaborative multi-user sharing of work extraction possibilities. In addition, the relation between the communication and work extraction capabilities is analyzed and written as an equation. Full article

(This article belongs to the Special Issue Quantum Information 2016)

► Show Figures

Figure 1

3512 KiB

Open AccessArticle

Study on the Inherent Complex Features and Chaos Control of IS–LM Fractional-Order Systems

by Junhai Ma, Wenbo Ren and Xueli Zhan

Entropy 2016, 18(9), 332; https://doi.org/10.3390/e18090332 - 14 Sep 2016

Cited by 3 | Viewed by 4592

Abstract

Based on the traditional IS–LM economic theory, which shows the relationship between interest rates and output in the goods and services market and the money market in macroeconomic. We established a four-dimensional IS–LM model involving four variables. With the Caputo fractional calculus theory, [...] Read more.

Based on the traditional IS–LM economic theory, which shows the relationship between interest rates and output in the goods and services market and the money market in macroeconomic. We established a four-dimensional IS–LM model involving four variables. With the Caputo fractional calculus theory, we improved it into a fractional order nonlinear model, analyzed the complexity and stability of the fractional order system. The existences conditions of attractors under different order conditions are compared, and obtain the orders when the system reaches a stable state. Have the detail analysis on the dynamic phenomena, such as the strange attractor, sensitivity to initial values through phase diagram and the power spectral. The order changes in two ways: orders changes synchronously or single order changes. The results show regardless of which the order situation is, the economic system will enter into multiple states, such as strong divergence, strange attractor and the convergence, finally, system will enter into the stable state under a certain order; parameter changes have similar effects on the economic system. Therefore, selecting an appropriate order is significant for an economic system, which guarantees a steady development. Furthermore, this paper construct the chaos control to IS–LM fractional-order macroeconomic model by means of linear feedback control method, by calculating and adjusting the feedback coefficient, we make the system return to the convergence state. Full article

(This article belongs to the Special Issue Wavelets, Fractals and Information Theory II)

► Show Figures

Figure 1

1965 KiB

Open AccessArticle

Sparse Trajectory Prediction Based on Multiple Entropy Measures

by Lei Zhang, Leijun Liu, Zhanguo Xia, Wen Li and Qingfu Fan

Entropy 2016, 18(9), 327; https://doi.org/10.3390/e18090327 - 14 Sep 2016

Cited by 11 | Viewed by 5437

Abstract

Trajectory prediction is an important problem that has a large number of applications. A common approach to trajectory prediction is based on historical trajectories. However, existing techniques suffer from the “data sparsity problem”. The available historical trajectories are far from enough to cover [...] Read more.

Trajectory prediction is an important problem that has a large number of applications. A common approach to trajectory prediction is based on historical trajectories. However, existing techniques suffer from the “data sparsity problem”. The available historical trajectories are far from enough to cover all possible query trajectories. We propose the sparsity trajectory prediction algorithm based on multiple entropy measures (STP-ME) to address the data sparsity problem. Firstly, the moving region is iteratively divided into a two-dimensional plane grid graph, and each trajectory is represented as a grid sequence with temporal information. Secondly, trajectory entropy is used to evaluate trajectory’s regularity, the L-Z entropy estimator is implemented to calculate trajectory entropy, and a new trajectory space is generated through trajectory synthesis. We define location entropy and time entropy to measure the popularity of locations and timeslots respectively. Finally, a second-order Markov model that contains a temporal dimension is adopted to perform sparse trajectory prediction. The experiments show that when trip completed percentage increases towards 90%, the coverage of the baseline algorithm decreases to almost 25%, while the STP-ME algorithm successfully copes with it as expected with only an unnoticeable drop in coverage, and can constantly answer almost 100% of query trajectories. It is found that the STP-ME algorithm improves the prediction accuracy generally by as much as 8%, 3%, and 4%, compared to the baseline algorithm, the second-order Markov model (2-MM), and sub-trajectory synthesis (SubSyn) algorithm, respectively. At the same time, the prediction time of STP-ME algorithm is negligible (10

μ s

), greatly outperforming the baseline algorithm (100

ms

). Full article

(This article belongs to the Special Issue Information Theoretic Learning)

► Show Figures

Figure 1

2310 KiB

Open AccessArticle

Fuzzy Adaptive Repetitive Control for Periodic Disturbance with Its Application to High Performance Permanent Magnet Synchronous Motor Speed Servo Systems

by Junxiao Wang

Entropy 2016, 18(9), 261; https://doi.org/10.3390/e18090261 - 14 Sep 2016

Cited by 9 | Viewed by 4842

Abstract

For reducing the steady state speed ripple, especially in high performance speed servo system applications, the steady state precision is more and more important for real servo systems. This paper investigates the steady state speed ripple periodic disturbance problem for a permanent magnet [...] Read more.

For reducing the steady state speed ripple, especially in high performance speed servo system applications, the steady state precision is more and more important for real servo systems. This paper investigates the steady state speed ripple periodic disturbance problem for a permanent magnet synchronous motor (PMSM) servo system; a fuzzy adaptive repetitive controller is designed in the speed loop based on repetitive control and fuzzy information theory for reducing periodic disturbance. Firstly, the various sources of the PMSM speed ripple problem are described and analyzed. Then, the mathematical model of PMSM is given. Subsequently, a fuzzy adaptive repetitive controller based on repetitive control and fuzzy logic control is designed for the PMSM speed servo system. In addition, the system stability analysis is also deduced. Finally, the simulation and experiment implementation are respectively based on the MATLAB/Simulink and TMS320F2808 of Texas instrument company, DSP (digital signal processor) hardware platform. Comparing to the proportional integral (PI) controller, simulation and experimental results show that the proposed fuzzy adaptive repetitive controller has better periodic disturbance rejection ability and higher steady state precision. Full article

► Show Figures

Figure 1

157 KiB

Open AccessEditorial

Special Issue on Entropy-Based Applied Cryptography and Enhanced Security for Ubiquitous Computing

by James (Jong Hyuk) Park and Wanlei Zhou

Entropy 2016, 18(9), 334; https://doi.org/10.3390/e18090334 - 13 Sep 2016

Viewed by 4618

Abstract

Entropy is a basic and important concept in information theory. It is also often used as a measure of the unpredictability of a cryptographic key in cryptography research areas. Ubiquitous computing (Ubi-comp) has emerged rapidly as an exciting new paradigm. In this special [...] Read more.

Entropy is a basic and important concept in information theory. It is also often used as a measure of the unpredictability of a cryptographic key in cryptography research areas. Ubiquitous computing (Ubi-comp) has emerged rapidly as an exciting new paradigm. In this special issue, we mainly selected and discussed papers related with ore theories based on the graph theory to solve computational problems on cryptography and security, practical technologies; applications and services for Ubi-comp including secure encryption techniques, identity and authentication; credential cloning attacks and countermeasures; switching generator with resistance against the algebraic and side channel attacks; entropy-based network anomaly detection; applied cryptography using chaos function, information hiding and watermark, secret sharing, message authentication, detection and modeling of cyber attacks with Petri Nets, and quantum flows for secret key distribution, etc. Full article

(This article belongs to the Special Issue Entropy-Based Applied Cryptography and Enhanced Security for Ubiquitous Computing)

4197 KiB

Open AccessArticle

Design of Light-Weight High-Entropy Alloys

by Rui Feng, Michael C. Gao, Chanho Lee, Michael Mathes, Tingting Zuo, Shuying Chen, Jeffrey A. Hawk, Yong Zhang and Peter K. Liaw

Entropy 2016, 18(9), 333; https://doi.org/10.3390/e18090333 - 13 Sep 2016

Cited by 199 | Viewed by 16167

Abstract

High-entropy alloys (HEAs) are a new class of solid-solution alloys that have attracted worldwide attention for their outstanding properties. Owing to the demand from transportation and defense industries, light-weight HEAs have also garnered widespread interest from scientists for use as potential structural materials. [...] Read more.

High-entropy alloys (HEAs) are a new class of solid-solution alloys that have attracted worldwide attention for their outstanding properties. Owing to the demand from transportation and defense industries, light-weight HEAs have also garnered widespread interest from scientists for use as potential structural materials. Great efforts have been made to study the phase-formation rules of HEAs to accelerate and refine the discovery process. In this paper, many proposed solid-solution phase-formation rules are assessed, based on a series of known and newly-designed light-weight HEAs. The results indicate that these empirical rules work for most compositions but also fail for several alloys. Light-weight HEAs often involve the additions of Al and/or Ti in great amounts, resulting in large negative enthalpies for forming solid-solution phases and/or intermetallic compounds. Accordingly, these empirical rules need to be modified with the new experimental data. In contrast, CALPHAD (acronym of the calculation of phase diagrams) method is demonstrated to be an effective approach to predict the phase formation in HEAs as a function of composition and temperature. Future perspectives on the design of light-weight HEAs are discussed in light of CALPHAD modeling and physical metallurgy principles. Full article

(This article belongs to the Special Issue High-Entropy Alloys and High-Entropy-Related Materials)

► Show Figures

Figure 1

1082 KiB

Open AccessArticle

Network Entropies of the Chinese Financial Market

by Shouwei Li, Jianmin He and Kai Song

Entropy 2016, 18(9), 331; https://doi.org/10.3390/e18090331 - 8 Sep 2016

Cited by 15 | Viewed by 5151

Abstract

Based on the data from the Chinese financial market, this paper focuses on analyzing three types of network entropies of the financial market, namely, Shannon, Renyi and Tsallis entropies. The findings suggest that Shannon entropy can reflect the volatility of the financial market, [...] Read more.

Based on the data from the Chinese financial market, this paper focuses on analyzing three types of network entropies of the financial market, namely, Shannon, Renyi and Tsallis entropies. The findings suggest that Shannon entropy can reflect the volatility of the financial market, that Renyi and Tsallis entropies also have this function when their parameter has a positive value, and that Renyi and Tsallis entropies can reflect the extreme case of the financial market when their parameter has a negative value. Full article

► Show Figures

Figure 1

2218 KiB

Open AccessArticle

Short Term Electrical Load Forecasting Using Mutual Information Based Feature Selection with Generalized Minimum-Redundancy and Maximum-Relevance Criteria

by Nantian Huang, Zhiqiang Hu, Guowei Cai and Dongfeng Yang

Entropy 2016, 18(9), 330; https://doi.org/10.3390/e18090330 - 8 Sep 2016

Cited by 35 | Viewed by 5181

Abstract

A feature selection method based on the generalized minimum redundancy and maximum relevance (G-mRMR) is proposed to improve the accuracy of short-term load forecasting (STLF). First, mutual information is calculated to analyze the relations between the original features and the load sequence, as [...] Read more.

A feature selection method based on the generalized minimum redundancy and maximum relevance (G-mRMR) is proposed to improve the accuracy of short-term load forecasting (STLF). First, mutual information is calculated to analyze the relations between the original features and the load sequence, as well as the redundancy among the original features. Second, a weighting factor selected by statistical experiments is used to balance the relevance and redundancy of features when using the G-mRMR. Third, each feature is ranked in a descending order according to its relevance and redundancy as computed by G-mRMR. A sequential forward selection method is utilized for choosing the optimal subset. Finally, a STLF predictor is constructed based on random forest with the obtained optimal subset. The effectiveness and improvement of the proposed method was tested with actual load data. Full article

(This article belongs to the Section Information Theory, Probability and Statistics)

► Show Figures

Figure 1

2008 KiB

Open AccessArticle

Solution of Higher Order Nonlinear Time-Fractional Reaction Diffusion Equation

by Neeraj Kumar Tripathi, Subir Das, Seng Huat Ong, Hossein Jafari and Maysaa Al Qurashi

Entropy 2016, 18(9), 329; https://doi.org/10.3390/e18090329 - 8 Sep 2016

Cited by 15 | Viewed by 7016

Abstract

The approximate analytical solution of fractional order, nonlinear, reaction differential equations, namely the nonlinear diffusion equations, with a given initial condition, is obtained by using the homotopy analysis method. As a demonstration of a good mathematical model, the present article gives graphical presentations [...] Read more.

The approximate analytical solution of fractional order, nonlinear, reaction differential equations, namely the nonlinear diffusion equations, with a given initial condition, is obtained by using the homotopy analysis method. As a demonstration of a good mathematical model, the present article gives graphical presentations of the effect of the reaction terms on the solution profile for various anomalous exponents of particular cases, to predict damping of the field variable. Numerical computations of the convergence control parameter, used to evaluate the convergence of approximate series solution through minimizing error, are also presented graphically for these cases. Full article

(This article belongs to the Special Issue Wavelets, Fractals and Information Theory II)

► Show Figures

Figure 1

2252 KiB

Open AccessArticle

Inferring Weighted Directed Association Networks from Multivariate Time Series with the Small-Shuffle Symbolic Transfer Entropy Spectrum Method

by Yanzhu Hu, Huiyang Zhao and Xinbo Ai

Entropy 2016, 18(9), 328; https://doi.org/10.3390/e18090328 - 7 Sep 2016

Cited by 5 | Viewed by 6096

Abstract

Complex network methodology is very useful for complex system exploration. However, the relationships among variables in complex systems are usually not clear. Therefore, inferring association networks among variables from their observed data has been a popular research topic. We propose a method, named [...] Read more.

Complex network methodology is very useful for complex system exploration. However, the relationships among variables in complex systems are usually not clear. Therefore, inferring association networks among variables from their observed data has been a popular research topic. We propose a method, named small-shuffle symbolic transfer entropy spectrum (SSSTES), for inferring association networks from multivariate time series. The method can solve four problems for inferring association networks, i.e., strong correlation identification, correlation quantification, direction identification and temporal relation identification. The method can be divided into four layers. The first layer is the so-called data layer. Data input and processing are the things to do in this layer. In the second layer, we symbolize the model data, original data and shuffled data, from the previous layer and calculate circularly transfer entropy with different time lags for each pair of time series variables. Thirdly, we compose transfer entropy spectrums for pairwise time series with the previous layer’s output, a list of transfer entropy matrix. We also identify the correlation level between variables in this layer. In the last layer, we build a weighted adjacency matrix, the value of each entry representing the correlation level between pairwise variables, and then get the weighted directed association network. Three sets of numerical simulated data from a linear system, a nonlinear system and a coupled Rossler system are used to show how the proposed approach works. Finally, we apply SSSTES to a real industrial system and get a better result than with two other methods. Full article

(This article belongs to the Special Issue Transfer Entropy II)

► Show Figures

Figure 1

296 KiB

Open AccessArticle

Paraconsistent Probabilities: Consistency, Contradictions and Bayes’ Theorem

by Juliana Bueno-Soler and Walter Carnielli

Entropy 2016, 18(9), 325; https://doi.org/10.3390/e18090325 - 7 Sep 2016

Cited by 11 | Viewed by 7197

Abstract

This paper represents the first steps towards constructing a paraconsistent theory of probability based on the Logics of Formal Inconsistency (LFIs). We show that LFIs encode very naturally an extension of the notion of probability able to express sophisticated probabilistic reasoning under contradictions [...] Read more.

This paper represents the first steps towards constructing a paraconsistent theory of probability based on the Logics of Formal Inconsistency (LFIs). We show that LFIs encode very naturally an extension of the notion of probability able to express sophisticated probabilistic reasoning under contradictions employing appropriate notions of conditional probability and paraconsistent updating, via a version of Bayes’ theorem for conditionalization. We argue that the dissimilarity between the notions of inconsistency and contradiction, one of the pillars of LFIs, plays a central role in our extended notion of probability. Some critical historical and conceptual points about probability theory are also reviewed. Full article

(This article belongs to the Special Issue Statistical Significance and the Logic of Hypothesis Testing)

931 KiB

Open AccessArticle

Market Sentiments Distribution Law

by Jorge Reyes-Molina

Entropy 2016, 18(9), 324; https://doi.org/10.3390/e18090324 - 7 Sep 2016

Viewed by 5930

Abstract

The Stock Exchange is basically ruled by the extreme market sentiments of euphoria and fear. The type of sentiment is given by the color of the candlestick (white = bullish sentiments, black = bearish sentiments), meanwhile the intensity of the sentiment is given [...] Read more.

The Stock Exchange is basically ruled by the extreme market sentiments of euphoria and fear. The type of sentiment is given by the color of the candlestick (white = bullish sentiments, black = bearish sentiments), meanwhile the intensity of the sentiment is given by the size of it. In this paper you will see that the intensity of any sentiment is astonishingly distributed in a robust, systematic and universal way, according to a law of exponential decay, the conclusion of which is supported by the analysis of the Lyapunov exponent, the information entropy and the frequency distribution of candlestick size. Full article

► Show Figures

Graphical abstract

6766 KiB

Open AccessArticle

Quantum Hysteresis in Coupled Light–Matter Systems

by Fernando J. Gómez-Ruiz, Oscar L. Acevedo, Luis Quiroga, Ferney J. Rodríguez and Neil F. Johnson

Entropy 2016, 18(9), 319; https://doi.org/10.3390/e18090319 - 7 Sep 2016

Cited by 8 | Viewed by 6047

Abstract

We investigate the non-equilibrium quantum dynamics of a canonical light–matter system—namely, the Dicke model—when the light–matter interaction is ramped up and down through a cycle across the quantum phase transition. Our calculations reveal a rich set of dynamical behaviors determined by the cycle [...] Read more.

We investigate the non-equilibrium quantum dynamics of a canonical light–matter system—namely, the Dicke model—when the light–matter interaction is ramped up and down through a cycle across the quantum phase transition. Our calculations reveal a rich set of dynamical behaviors determined by the cycle times, ranging from the slow, near adiabatic regime through to the fast, sudden quench regime. As the cycle time decreases, we uncover a crossover from an oscillatory exchange of quantum information between light and matter that approaches a reversible adiabatic process, to a dispersive regime that generates large values of light–matter entanglement. The phenomena uncovered in this work have implications in quantum control, quantum interferometry, as well as in quantum information theory. Full article

(This article belongs to the Special Issue Quantum Nonequilibrium Dynamics)

► Show Figures

Figure 1

1611 KiB

Open AccessArticle

Bayesian Dependence Tests for Continuous, Binary and Mixed Continuous-Binary Variables

by Alessio Benavoli and Cassio P. De Campos

Entropy 2016, 18(9), 326; https://doi.org/10.3390/e18090326 - 6 Sep 2016

Cited by 1 | Viewed by 5350

Abstract

Tests for dependence of continuous, discrete and mixed continuous-discrete variables are ubiquitous in science. The goal of this paper is to derive Bayesian alternatives to frequentist null hypothesis significance tests for dependence. In particular, we will present three Bayesian tests for dependence of [...] Read more.

Tests for dependence of continuous, discrete and mixed continuous-discrete variables are ubiquitous in science. The goal of this paper is to derive Bayesian alternatives to frequentist null hypothesis significance tests for dependence. In particular, we will present three Bayesian tests for dependence of binary, continuous and mixed variables. These tests are nonparametric and based on the Dirichlet Process, which allows us to use the same prior model for all of them. Therefore, the tests are “consistent” among each other, in the sense that the probabilities that variables are dependent computed with these tests are commensurable across the different types of variables being tested. By means of simulations with artificial data, we show the effectiveness of the new tests. Full article

(This article belongs to the Special Issue Statistical Significance and the Logic of Hypothesis Testing)

► Show Figures

Figure 1

1647 KiB

Open AccessArticle

Using Graph and Vertex Entropy to Compare Empirical Graphs with Theoretical Graph Models

by Tomasz Kajdanowicz and Mikołaj Morzy

Entropy 2016, 18(9), 320; https://doi.org/10.3390/e18090320 - 5 Sep 2016

Cited by 8 | Viewed by 7430

Abstract

Over the years, several theoretical graph generation models have been proposed. Among the most prominent are: the Erdős–Renyi random graph model, Watts–Strogatz small world model, Albert–Barabási preferential attachment model, Price citation model, and many more. Often, researchers working with real-world data are interested [...] Read more.

Over the years, several theoretical graph generation models have been proposed. Among the most prominent are: the Erdős–Renyi random graph model, Watts–Strogatz small world model, Albert–Barabási preferential attachment model, Price citation model, and many more. Often, researchers working with real-world data are interested in understanding the generative phenomena underlying their empirical graphs. They want to know which of the theoretical graph generation models would most probably generate a particular empirical graph. In other words, they expect some similarity assessment between the empirical graph and graphs artificially created from theoretical graph generation models. Usually, in order to assess the similarity of two graphs, centrality measure distributions are compared. For a theoretical graph model this means comparing the empirical graph to a single realization of a theoretical graph model, where the realization is generated from the given model using an arbitrary set of parameters. The similarity between centrality measure distributions can be measured using standard statistical tests, e.g., the Kolmogorov–Smirnov test of distances between cumulative distributions. However, this approach is both error-prone and leads to incorrect conclusions, as we show in our experiments. Therefore, we propose a new method for graph comparison and type classification by comparing the entropies of centrality measure distributions (degree centrality, betweenness centrality, closeness centrality). We demonstrate that our approach can help assign the empirical graph to the most similar theoretical model using a simple unsupervised learning method. Full article

(This article belongs to the Special Issue Selected Papers from 2nd International Electronic Conference on Entropy and Its Applications)

► Show Figures

Figure 1

14659 KiB

Open AccessArticle

Entropy Base Estimation of Moisture Content of the Top 10-m Unsaturated Soil for the Badain Jaran Desert in Northwestern China

by Xiangyang Zhou, Wenjuan Lei and Jinzhu Ma

Entropy 2016, 18(9), 323; https://doi.org/10.3390/e18090323 - 3 Sep 2016

Cited by 8 | Viewed by 5076

Abstract

Estimation of soil moisture distribution in desert regions is challenged by the deep unsaturated zone and the extreme natural environment. In this study, an entropy-based method, consisting of information entropy, principle of maximum entropy (PME), solutions to PME with constraints, and the determination [...] Read more.

Estimation of soil moisture distribution in desert regions is challenged by the deep unsaturated zone and the extreme natural environment. In this study, an entropy-based method, consisting of information entropy, principle of maximum entropy (PME), solutions to PME with constraints, and the determination of parameters, is used to estimate the soil moisture distribution in the 10 m deep vadose zone of a desert region. Firstly, the soil moisture distribution is described as a scaled probability density function (PDF), which is solved by PME with the constraints of normalization, known arithmetic mean and geometric mean, and the solution is the general form of gamma distribution. A constant arithmetic mean is determined by considering the stable average recharge rate at thousand year scale, and an approximate constant geometric mean is determined by the low flow rate (about 1 cm a year). Followed, the parameters of the scaled PDF of gamma distribution are determined by local environmental factors like terrain and vegetation: the multivariate linear equations are established to qualify the relationship between the parameters and the environmental factors on the basis of nineteen random soil moisture profiles about depth through the application of fuzzy mathematics. Finally, the accuracy is tested using correlation coefficient (CC) and relative error. This method performs with CC larger than 0.9 in more than a half profiles and most larger than 0.8, the relative errors are less than 30% in most of soil moisture profiles and can be as low as less than 15% when parameters fitted appropriately. Therefore, this study provides an alternative method to estimate soil moisture distribution in top 0–10 m layers of the Badain Jaran Desert based on local terrain and vegetation factors instead of drilling sand samples, this method would be useful in desert regions with extreme natural conditions since these environmental factors can be obtained by remote sensing data. Meanwhile, we should bear in mind that this method is challenged in humid regions since more intensive and frequent precipitation, and more vegetation cover make the system much more complex. Full article

(This article belongs to the Special Issue Applications of Information Theory in the Geosciences)

► Show Figures

Figure 1

2996 KiB

Open AccessArticle

Mechanical Fault Diagnosis of High Voltage Circuit Breakers with Unknown Fault Type Using Hybrid Classifier Based on LMD and Time Segmentation Energy Entropy

by Nantian Huang, Lihua Fang, Guowei Cai, Dianguo Xu, Huaijin Chen and Yonghui Nie

Entropy 2016, 18(9), 322; https://doi.org/10.3390/e18090322 - 3 Sep 2016

Cited by 46 | Viewed by 7057

Abstract

In order to improve the identification accuracy of the high voltage circuit breakers’ (HVCBs) mechanical fault types without training samples, a novel mechanical fault diagnosis method of HVCBs using a hybrid classifier constructed with Support Vector Data Description (SVDD) and fuzzy c-means (FCM) [...] Read more.

In order to improve the identification accuracy of the high voltage circuit breakers’ (HVCBs) mechanical fault types without training samples, a novel mechanical fault diagnosis method of HVCBs using a hybrid classifier constructed with Support Vector Data Description (SVDD) and fuzzy c-means (FCM) clustering method based on Local Mean Decomposition (LMD) and time segmentation energy entropy (TSEE) is proposed. Firstly, LMD is used to decompose nonlinear and non-stationary vibration signals of HVCBs into a series of product functions (PFs). Secondly, TSEE is chosen as feature vectors with the superiority of energy entropy and characteristics of time-delay faults of HVCBs. Then, SVDD trained with normal samples is applied to judge mechanical faults of HVCBs. If the mechanical fault is confirmed, the new fault sample and all known fault samples are clustered by FCM with the cluster number of known fault types. Finally, another SVDD trained by the specific fault samples is used to judge whether the fault sample belongs to an unknown type or not. The results of experiments carried on a real SF₆ HVCB validate that the proposed fault-detection method is effective for the known faults with training samples and unknown faults without training samples. Full article

(This article belongs to the Special Issue Information Theoretic Learning)

► Show Figures

Figure 1

1131 KiB

Open AccessArticle

Lattice Distortions in the FeCoNiCrMn High Entropy Alloy Studied by Theory and Experiment

by Hyun Seok Oh, Duancheng Ma, Gerard Paul Leyson, Blazej Grabowski, Eun Soo Park, Fritz Körmann and Dierk Raabe

Entropy 2016, 18(9), 321; https://doi.org/10.3390/e18090321 - 2 Sep 2016

Cited by 161 | Viewed by 14234

Abstract

Lattice distortions constitute one of the main features characterizing high entropy alloys. Local lattice distortions have, however, only rarely been investigated in these multi-component alloys. We, therefore, employ a combined theoretical electronic structure and experimental approach to study the atomistic distortions in the [...] Read more.

Lattice distortions constitute one of the main features characterizing high entropy alloys. Local lattice distortions have, however, only rarely been investigated in these multi-component alloys. We, therefore, employ a combined theoretical electronic structure and experimental approach to study the atomistic distortions in the FeCoNiCrMn high entropy (Cantor) alloy by means of density-functional theory and extended X-ray absorption fine structure spectroscopy. Particular attention is paid to element-resolved distortions for each constituent. The individual mean distortions are small on average, <1%, but their fluctuations (i.e., standard deviations) are an order of magnitude larger, in particular for Cr and Mn. Good agreement between theory and experiment is found. Full article

(This article belongs to the Special Issue High-Entropy Alloys and High-Entropy-Related Materials)

► Show Figures

Figure 1

1325 KiB

Open AccessArticle

Generalized Robustness of Contextuality

by Huixian Meng, Huaixin Cao, Wenhua Wang, Yajing Fan and Liang Chen

Entropy 2016, 18(9), 297; https://doi.org/10.3390/e18090297 - 1 Sep 2016

Cited by 6 | Viewed by 4385

Abstract

Motivated by the importance of contextuality and a work on the robustness of the entanglement of mixed quantum states, the robustness of contextuality (RoC)

R_{C} (e)

of an empirical model e against non-contextual noises was introduced and discussed in Science [...] Read more.

Motivated by the importance of contextuality and a work on the robustness of the entanglement of mixed quantum states, the robustness of contextuality (RoC)

R_{C} (e)

of an empirical model e against non-contextual noises was introduced and discussed in Science China Physics, Mechanics and Astronomy (59(4) and 59(9), 2016). Because noises are not always non-contextual, this paper introduces and discusses the generalized robustness of contextuality (GRoC)

R_{g} (e)

of an empirical model e against general noises. It is proven that

R_{g} (e) = 0

if and only if e is non-contextual. This means that the quantity

R_{g}

can be used to distinguish contextual empirical models from non-contextual ones. It is also shown that the function

R_{g}

is convex on the set of all empirical models and continuous on the set of all no-signaling empirical models. For any two empirical models e and f such that the generalized relative robustness of e with respect to f is finite, a fascinating relationship between the GRoCs of e and f is proven, which reads

R_{g} (e) R_{g} (f) \leq 1

. Lastly, for any n-cycle contextual box e, a relationship between the GRoC

R_{g} (e)

and the extent

Δ_{e}

of violating the non-contextual inequalities is established. Full article

(This article belongs to the Special Issue Quantum Information 2016)

► Show Figures

Figure 1

665 KiB

Open AccessArticle

Entropy-Based Modeling of Velocity Lag in Sediment-Laden Open Channel Turbulent Flow

by Manotosh Kumbhakar, Snehasis Kundu, Koeli Ghoshal and Vijay P. Singh

Entropy 2016, 18(9), 318; https://doi.org/10.3390/e18090318 - 30 Aug 2016

Cited by 10 | Viewed by 4450

Abstract

In the last few decades, a wide variety of instruments with laser-based techniques have been developed that enable experimentally measuring particle velocity and fluid velocity separately in particle-laden flow. Experiments have revealed that stream-wise particle velocity is different from fluid velocity, and this [...] Read more.

In the last few decades, a wide variety of instruments with laser-based techniques have been developed that enable experimentally measuring particle velocity and fluid velocity separately in particle-laden flow. Experiments have revealed that stream-wise particle velocity is different from fluid velocity, and this velocity difference is commonly known as “velocity lag” in the literature. A number of experimental, as well as theoretical investigations have been carried out to formulate deterministic mathematical models of velocity lag, based on several turbulent features. However, a probabilistic study of velocity lag does not seem to have been reported, to the best of our knowledge. The present study therefore focuses on the modeling of velocity lag in open channel turbulent flow laden with sediment using the entropy theory along with a hypothesis on the cumulative distribution function. This function contains a parameter η, which is shown to be a function of specific gravity, particle diameter and shear velocity. The velocity lag model is tested using a wide range of twenty-two experimental runs collected from the literature and is also compared with other models of velocity lag. Then, an error analysis is performed to further evaluate the prediction accuracy of the proposed model, especially in comparison to other models. The model is also able to explain the physical characteristics of velocity lag caused by the interaction between the particles and the fluid. Full article

(This article belongs to the Section Statistical Physics)

► Show Figures

Figure 1

3453 KiB

Open AccessArticle

Entropy Complexity and Stability of a Nonlinear Dynamic Game Model with Two Delays

by Zhihui Han, Junhai Ma, Fengshan Si and Wenbo Ren

Entropy 2016, 18(9), 317; https://doi.org/10.3390/e18090317 - 30 Aug 2016

Cited by 13 | Viewed by 4964

Abstract

In this paper, a duopoly game model with double delays in hydropower market is established, and the research focus on the influence of time delay parameter on the complexity of the system. Firstly, we established a game model for the enterprises considering both [...] Read more.

In this paper, a duopoly game model with double delays in hydropower market is established, and the research focus on the influence of time delay parameter on the complexity of the system. Firstly, we established a game model for the enterprises considering both the current and the historical output when making decisions. Secondly, the existence and stability of Hopf bifurcation are analyzed, and the conditions and main conclusions of Hopf bifurcation are given. Thirdly, numerical simulation and analysis are carried out to verify the conclusions of the theoretical analysis. The effect of delay parameter on the stability of the system is simulated by a bifurcation diagram, the Lyapunov exponent, and an entropic diagram; in addition, the stability region of the system is given by a 2D parameter bifurcation diagram and a 3D parameter bifurcation diagram. Finally, the method of delayed feedback control is used to control the chaotic system. The research results can provide a guideline for enterprise decision-making. Full article

(This article belongs to the Special Issue Computational Complexity)

► Show Figures

Figure 1

3619 KiB

Open AccessArticle

Stationary Stability for Evolutionary Dynamics in Finite Populations

by Marc Harper and Dashiell Fryer

Entropy 2016, 18(9), 316; https://doi.org/10.3390/e18090316 - 25 Aug 2016

Cited by 10 | Viewed by 6948

Abstract

We demonstrate a vast expansion of the theory of evolutionary stability to finite populations with mutation, connecting the theory of the stationary distribution of the Moran process with the Lyapunov theory of evolutionary stability. We define the notion of stationary stability for the [...] Read more.

We demonstrate a vast expansion of the theory of evolutionary stability to finite populations with mutation, connecting the theory of the stationary distribution of the Moran process with the Lyapunov theory of evolutionary stability. We define the notion of stationary stability for the Moran process with mutation and generalizations, as well as a generalized notion of evolutionary stability that includes mutation called an incentive stable state (ISS) candidate. For sufficiently large populations, extrema of the stationary distribution are ISS candidates and we give a family of Lyapunov quantities that are locally minimized at the stationary extrema and at ISS candidates. In various examples, including for the Moran and Wright–Fisher processes, we show that the local maxima of the stationary distribution capture the traditionally-defined evolutionarily stable states. The classical stability theory of the replicator dynamic is recovered in the large population limit. Finally we include descriptions of possible extensions to populations of variable size and populations evolving on graphs. Full article

(This article belongs to the Special Issue Information and Entropy in Biological Systems)

► Show Figures

Graphical abstract

3337 KiB

Open AccessArticle

Description of Seizure Process for Gas Dynamic Spray of Metal Powders from Non-Equilibrium Thermodynamics Standpoint

by Iosif S. Gershman, Eugeniy I. Gershman, German S. Fox-Rabinovich and Stephen C. Veldhuis

Entropy 2016, 18(9), 315; https://doi.org/10.3390/e18090315 - 25 Aug 2016

Cited by 11 | Viewed by 4016

Abstract

The seizure process has been considered from the non-equilibrium thermodynamics and self-organization theory standpoints. It has been testified that, for the intensification of powder mix particles seizing with the substrate during spraying, it is required that relatively light components of the powder mix [...] Read more.

The seizure process has been considered from the non-equilibrium thermodynamics and self-organization theory standpoints. It has been testified that, for the intensification of powder mix particles seizing with the substrate during spraying, it is required that relatively light components of the powder mix should be preferably transferred into the friction zone. The theory inferences have been experimentally confirmed, as exemplified by the gas dynamic spray of copper-zinc powders mix. Full article

(This article belongs to the Special Issue Entropy Application in Tribology)

► Show Figures

Figure 1

1293 KiB

Open AccessArticle

Exergy Analysis of a Syngas-Fueled Combined Cycle with Chemical-Looping Combustion and CO₂ Sequestration

by Álvaro Urdiales Montesino, Ángel Jiménez Álvaro, Javier Rodríguez Martín and Rafael Nieto Carlier

Entropy 2016, 18(9), 314; https://doi.org/10.3390/e18090314 - 25 Aug 2016

Cited by 5 | Viewed by 6456

Abstract

Fossil fuels are still widely used for power generation. Nevertheless, it is possible to attain a short- and medium-term substantial reduction of greenhouse gas emissions to the atmosphere through a sequestration of the CO₂ produced in fuels’ oxidation. The chemical-looping combustion (CLC) [...] Read more.

Fossil fuels are still widely used for power generation. Nevertheless, it is possible to attain a short- and medium-term substantial reduction of greenhouse gas emissions to the atmosphere through a sequestration of the CO₂ produced in fuels’ oxidation. The chemical-looping combustion (CLC) technique is based on a chemical intermediate agent, which gets oxidized in an air reactor and is then conducted to a separated fuel reactor, where it oxidizes the fuel in turn. Thus, the oxidation products CO₂ and H₂O are obtained in an output flow in which the only non-condensable gas is CO₂, allowing the subsequent sequestration of CO₂ without an energy penalty. Furthermore, with shrewd configurations, a lower exergy destruction in the combustion chemical transformation can be achieved. This paper focus on a second law analysis of a CLC combined cycle power plant with CO₂ sequestration using syngas from coal and biomass gasification as fuel. The key thermodynamic parameters are optimized via the exergy method. The proposed power plant configuration is compared with a similar gas turbine system with a conventional combustion, finding a notable increase of the power plant efficiency. Furthermore, the influence of syngas composition on the results is investigated by considering different H₂-content fuels. Full article

(This article belongs to the Special Issue Selected Papers from 2nd International Electronic Conference on Entropy and Its Applications)

► Show Figures

Figure 1

Journal Menu

Journal Browser

Entropy, Volume 18, Issue 9 (September 2016) – 34 articles

Further Information

Guidelines

MDPI Initiatives

Follow MDPI