entropy-logo

Journal Browser

Journal Browser

Information Theoretic Criteria: New Theoretical Developments and Applications, 2nd Edition

A special issue of Entropy (ISSN 1099-4300). This special issue belongs to the section "Information Theory, Probability and Statistics".

Deadline for manuscript submissions: closed (18 July 2024) | Viewed by 797

Special Issue Editor


E-Mail Website
Guest Editor
Department of Statistics, University of Auckland, Auckland 1142, New Zealand
Interests: statistical signal processing; time series; model selection; graphical models; dictionary learning; data compression
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

The Akaike Information Criterion and the Bayesian Information Criterion (sometimes called Schwarz Information Criterion) were introduced decades ago and are still extensively used in many areas of science and engineering. They are implemented in various software packages and deemed to be standard instruments for model selection. At the same time, there is a significant body of literature in which other information theoretic (IT) criteria have been proposed.

This Special Issue aims to be a forum for the presentation of new and improved IT criteria. Authors are encouraged to submit works that are focused on the following topics:

  1. Development of novel criteria;
  2. Theoretical analysis of the performance of the existing or newly proposed criteria;
  3. Computational aspects related to IT criteria;
  4. Use of the IT criteria in machine learning, especially in deep learning;
  5. Applications of the IT criteria in non-standard settings such as, for example, big data, data sets with missing values, and non-Gaussian noise;
  6. Use of the IT criteria in time series analysis and forecasting;
  7. Applications of the Minimum Description Length and of the Minimum Message Length;
  8. Other applications where IT criteria play the key role for improving the performance.

Dr. Ciprian Giurcaneanu
Guest Editor

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Entropy is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • information theoretic criteria
  • model selection
  • theoretical analysis
  • machine learning
  • signal processing
  • time series analysis and forecasting
  • applications

Benefits of Publishing in a Special Issue

  • Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
  • Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
  • Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
  • External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
  • e-Book format: Special Issues with more than 10 articles can be published as dedicated e-books, ensuring wide and rapid dissemination.

Further information on MDPI's Special Issue polices can be found here.

Related Special Issue

Published Papers (1 paper)

Order results
Result details
Select all
Export citation of selected articles as:

Research

14 pages, 342 KiB  
Article
Assessing Variable Importance for Best Subset Selection
by Jacob Seedorff and Joseph E. Cavanaugh
Entropy 2024, 26(9), 801; https://doi.org/10.3390/e26090801 - 19 Sep 2024
Viewed by 452
Abstract
One of the primary issues that arises in statistical modeling pertains to the assessment of the relative importance of each variable in the model. A variety of techniques have been proposed to quantify variable importance for regression models. However, in the context of [...] Read more.
One of the primary issues that arises in statistical modeling pertains to the assessment of the relative importance of each variable in the model. A variety of techniques have been proposed to quantify variable importance for regression models. However, in the context of best subset selection, fewer satisfactory methods are available. With this motivation, we here develop a variable importance measure expressly for this setting. We investigate and illustrate the properties of this measure, introduce algorithms for the efficient computation of its values, and propose a procedure for calculating p-values based on its sampling distributions. We present multiple simulation studies to examine the properties of the proposed methods, along with an application to demonstrate their practical utility. Full article
Show Figures

Figure 1

Back to TopTop