1. Introduction
Background: This study is an effort to advance our understanding of the thermodynamics of information processing in general, specifically focusing on living systems. Emerging fields in biological research, such as system biology, analyze cells and life through a holistic approach. According to this view, living forms and processes are considered too complex to be completely defined and, hence, are characterized as a whole, in order to gain significant knowledge on that living system [
1]. This perspective of the whole system is also at the base of statistical mechanics that enables characterization of thermodynamic macroscopic quantities in complex physical systems. One of the most indicative macroscopic whole-system thermodynamic measures is entropy, due to its consistent tendency to increase while the system is subjected to spontaneous processes. When applying the entropy measure to a living system, it could be analyzed at multiple levels, according to the field of perspective and the measurement system characteristics: genomic, transcriptomic, proteomic, network entropy, structural entropy, textural entropy, information entropy, thermodynamic entropy, etc. [
2,
3,
4,
5]. Entropy patterns of mRNA and protein expression could characterize cellular differentiation state [
6], while network entropy measures could follow tumor progression and anticancer drug responses [
7]. Entropy of population analysis reveals highly ordered cellular patterns that negatively relate to the degree of cell autonomy [
8]. Flow cytometry (FCM) large data set distributions of results in cell populations of leukemia patients and healthy donors were utilized for identification of malignancy by analyzing the differences in multidimensional distributions of FCM results as well as the differences of related entropies [
9]. The thermodynamics of biological data storage, transmission and interpretation is subject to intense discussion [
10]. These entropy formulations are based on determination of probabilities of essential biological factors such as mRNA variation, gene interactions, DNA coding, FCM results etc., while the expected relations between these forms of cellular entropy are not yet fully defined. From a complementary perspective, we strive in this work to explore the probabilities of intracellular energetic levels and the related thermodynamic generalized entropy state. Entropy production rate, which may challenge living-cell homeostasis, is typically elevated in malignant cells [
11].
Textural Information Entropy: When analyzing the fine microscopic texture of a medium (and not focusing on its structural macroscopic morphology), several entropy functions that reflect the micro scale image and medium complexity could be utilized [
12]. Insight into micro scale complexity and related entropy due to the narrow perspective will probably better reflect the medium’s basic thermodynamic entropy, while a wider perspective will reflect a combination of entropies: thermodynamic, structural/morphologic and multi-levels of information entropies.
Application of these textural entropy investigations to evaluate the homogeneity and randomness of gray values within the cell image are relatively easy to perform and could rely on digital image analysis of label-free or marked live or fixated cells [
13,
14,
15,
16].
In the field of digital image analysis, Gonzalez and Woods [
17] propose the utilization of information entropy formulation that measures the average information
in the pixels of an inspected image field in bit units:
, where
Pi stands for the frequency of pixels whose intensity values are within the range (
,
) and
is an intensity difference that depends on the resolution of the camera or the possible number of gray values in the dynamic range of the pixels. Their formulation could be used to investigate the complexity or textural entropy of various mediums, including living ones. Changing the microscope or camera settings (for example increasing camera’s possible number of gray values, exposure time or microscope light intensity) is expected to influence
values so that maintaining fixed microscope and camera settings is essential for comparing different media.
Wiedemann et al. [
18] performed label-free flow cytometry utilizing Gonzalez’s
E values of 25 pixel measurement units from a cell image acquired during flow. This was compared to the results of viability tests performed on the same cells during flow as well. Though sensitivity and specificity of
E values are not presented in their work, they indeed show that
E values of dead cells are higher than those of living cells, thus enabling the presentation of two distinct cell populations.
Fluctuations: Nonetheless, Wiedemann and others [
13,
14,
15,
16,
18] explored the steady state aspect of information or textural entropy, overlooking the fluctuating nature of these measures.
Motivated by the fact that living cells are not in a state of thermodynamic equilibrium, but rather in a metastable state [
4,
19], our studies [
20,
21] focus on the examination of the fluctuations of the measure Gray Level Information Entropy (GLIE) and its informative value.
For measurement of cellular GLIE fluctuation, we used a simple experimental system consisting of a user-friendly combination of common bright field microscopy and a unique imaging dish in which cells are individually held untethered, each within a picoliter volume optical chamber in an array, allowing repeatable spatiotemporal observation before, during and after bio-manipulation in situ, at single-cell resolution, while in a population.
GLIE fluctuation parameters, based on standard deviation (SD) of temporal GLIE value distributions or autocorrelation of GLIE temporal changes, could be utilized to successfully distinguish dead cells from live ones in multiple cell lines with sensitivity and specificity values between 92% and 100% [
20]. GLIE fluctuation parameters, based on discrete Fourier transform (DFT) analysis of the temporal GLIE changes enable evaluation of multiple cellular physiologic stimulations and mitochondrial dysfunction conditions [
21]. According to their power spectrum analysis, cellular GLIE fluctuations could be divided into two distinct types: (a) high power low frequency fluctuations (<0.1 Hz), attributed to periodic physiologic activity, i.e., intracellular translocations of proteins, vesicles and organelles, and (b) low power high frequency (>0.5 Hz) random fluctuations, attributed to dissipative random mechanical fluctuations of intracellular content [
21].
Low frequency periodic events are governed mainly by the biological processes that take place in the cell and particularly in the examined intracellular areas of the cell images. Intracellular oscillations of signaling molecules [
22] or pivotal intracellular mediators like Protein Kinase C and G translocations have been shown to take place in time periods of seconds [
23,
24,
25]. On the other hand, the high frequency random GLIE fluctuations were found, in previous work, to reflect physical properties of the intracellular medium, like mobility and diffusivity. In the current work, we present our assumption regarding the relation between GLIE fluctuations and thermodynamic generalized entropy [
26] of the observed intracellular system.
In addition, the physical and the physiological aspect of the proposed measures are discussed and examined experimentally, analytically and by computer simulation.
The SD of the information entropy function, when operating on image gray value fluctuation, was found to be indifferent to the microscope system “noise”. This was shown by experiments, simulation and theoretical examination.
Finally, we will demonstrate the applicability of GLIE fluctuation measures for discriminating between live, dead and malignant cells of the same kind, yet are known to have different thermodynamic states. In this regard, the morphology change common to all processes of cellular death is the increase in cellular inhomogeneity due to intracellular content condensation, shrinkage and defragmentation which lasts until the cell fragments [
18,
27]. The increase in inhomogeneity due to shrinkage and condensation of intracellular content which involves lower mobility [
28] is expected to lower the possible number of the cellular system microstates and accordingly, the generalized entropy at that stage of cellular death.
Malignant cellular conditions are characterized by increased disorganization at multiple cellular levels from the genome to transcriptome and proteome with increased “noise” (fluctuations of all cellular measures discussed above) that accompanies the high mechanical dissipation, high diffusivity and the increase in cellular system thermodynamic generalized entropy [
29,
30,
31].
Successful monitoring of cellular entropic conditions by a simple label-free cytometry based on analysis of image information entropy fluctuation could therefore be beneficial for investigation of pathophysiologic conditions such as malignant transformation.
3. Results and Discussion
3.1. GLIE Fluctuation and Thermodynamic Entropy—A Theoretical Aspect
For exploration of a possible theoretical relation between cellular image GLIE fluctuation and cellular thermodynamic generalized entropy state, we chose the simple case of a single intracellular vesicle or organelle and analyzed its random motion in one dimension. The intracellular medium is considered a non-equilibrium steady state viscoelastic medium. Incoherent fraction of motor protein activity on the cytoskeleton create active random forces that cause ”diffusive-like” motion of the cytoskeleton and associated membranous structures like vesicles and organelles [
31]. These active (ATP-dependent) random mechanical fluctuations dominate the particle random translocation fluctuations which are reflected by our measurement system (of GLIE temporal fluctuation) during a 1–2 s timescale of rates between 0.5–1 Hz which was chosen based on previous works [
31,
34,
35]. In this timescale, the contribution of thermic fluctuations to the intracellular and GLIE fluctuations is minor [
31,
36]. These active random mechanical fluctuations of the viscoelastic intracellular cytoskeleton and related content, as a consequence of dissipative mechanical-energetic processes, resemble thermal fluctuations in a typical viscous medium. For instance, the measured Mean Square Displacement (MSD) of an intracellular vesicle and the corresponding time lags have a clear linear relationship which obeys the relationship
[
31,
36], (though this diffusion is not thermally driven), where
n is the number of dimensions,
D is the diffusion coefficient (also called diffusivity),
t is the time lag and ∆
x is the translocation.
The practical meaning of the above is that the Probability Distribution Function (PDF) of translocations of the diffused particle obeys normal distribution, which has a variance of
Figure 3 further illustrates this explanation. It depicts a microscopic partially transparent intracellular element such as an intracellular organelle or vesicle (yellow circle) located between a light source and a single light detector (pixel). Based on the above section, this element conducts “thermic-like” diffusion, upon which the distribution of its translocations
around the origin (0,0) should obey one-dimensional Gaussian distribution. Possible distributions which may have different
D (diffusivity) values are depicted in the figure by different colors (see inset). Now, for the sake of simplicity, let’s assume an element with the same size of the pixel via which it is detected. Hence, due to its partial transparency, the amount of light detected by the pixel will depend on the position of the element in relation to the detecting area. Three representative situations are illustrated in
Figure 3. In the first, the element maximally prevents light from reaching the pixel (center) i.e., yielding the lowest detected gray value. In the second, the element is pushed/diffused to the right, where it doesn’t cover the pixel at all, a case where maximum light reaches the detector, yielding maximum gray value. In the third, the result of the element diffusion to the left, where it only partially covers the pixel detecting area, yields intermediate gray value. Obviously, the outcome of the pixel gray values and their SD must follow the behavior of the random time-dependent translocation of the element diffusing above the pixel.
Now, considering that intracellular mediums are viscoelastic mediums with a more dominant elastic component [
31,
36] and low Reynolds number flow [
37], this situation is likely to propose that said intracellular element experiences potential elastic forces rather than inertia. In other words, changes in energy should be attributed more to potential than kinetic energy. Thus, in that medium with negligible inertia, one may expect
to reflect the entire energy changes of the observed element [
38]. Consequently, for any practical use, the distribution of the total energy of the particle will reflect the distribution of its potential energy.
In conclusion, the element translocations are in good approximation correlated to the total energy level changes so that a particle PDF of translocations approximates the particle PDF of energy levels.
Accordingly, the energy level probabilities must be Gaussian distributed as well. On the other hand, the entropy of a given Gaussian is (Wolfram and Mathworld):
So, in such case where a Gaussian describes “thermic-like” diffusion process as in our case:
Inserting this expression into Equation (2) yields:
which explores the relation between particle thermodynamic generalized entropy and both the particle diffusivity in the hosting media and the time lag.
Figure 4 presents schematically, the dependency of the element-environment entropy on the element diffusivity. Calculations were made for time lags of 1 s, in accordance with the measurement timescale used in this study.
In summary:
Intracellular particle random motion and diffusivity in a time scale of 1–2 s is mostly not a result of thermal agitation but of random active mechanical fluctuations of the cytoskeleton and related intracellular content while in a thermodynamically non-equilibrium viscoelastic medium.
The resulting diffusion might be characterized as “thermic-like”, with an approximately linear correlation between the square of translocations and time lags.
Therefore, normal distribution describes the PDF of these intracellular particle translocations and the related energy levels as well.
The above normal distribution PDF of total energy or translocations represents the thermodynamic generalized entropy of this particle system and hence correlates between diffusivity and thermodynamic generalized entropy (Equation (3)).
In another of our studies (to be published) we showed that diffusivity negatively correlates to intracellular GLIE25 values. A short explanation of this negative correlation is given below. Having said that, it implies that an increase of the intracellular medium diffusivity will be correlated to a decrease in the 5 × 5 pixel measurement unit gray value heterogeneity and GLIE25 values, i.e., more homogeneity of gray values in the measurement unit results in lower GLIE25 values.
The intracellular medium is very heterogenic and cannot be considered a simple random solution composed of its elements [
39].
Intracellular heterogenic spatial distribution of macromolecules in various levels of macro and micro compartments has a crucial role in cellular organization, cellular metabolism and multi-enzyme complex functions [
39]. An important mechanism for this spatial heterogeneity is the association of the macromolecules with the actin cytoskeleton network [
39,
40].
An increase in active random dissipative fluctuations of cytoskeleton and associated intracellular content relates to high diffusivity (in this time scale) [
31], satisfactorily justifying the assumption that said fluctuations will probably lead to reduction of intracellular compartmentation of cytoskeletal-associated macromolecules. This, in turn, will lead to a more homogeneous intracellular media, and will result in a decrease of the related gray value heterogeneity and consequent GLIE values as well. According to this line of thought, the increase of dissipative energy and random fluctuations results in elevation of thermodynamic entropy which in turn augments the homogeneity of intracellular content and related image gray values. The latter will be reflected by lower image pixel informational entropy, i.e., by low GLIE values.
In that respect, HFAP and AGLIE values are negatively correlated as well. The source for this is fundamental, i.e., due to the logarithmic nature of GLIE and the fact that HFAP represents GLIE fluctuations.
The generality of this behavior, as well as the slopes of AGLIE-HFAP negative correlations being positively related to pixel gray value SD, were demonstrated by simulation as well (data not shown). As was discussed previously in this section, diffusivity and the SD of image pixel gray values are expected to be positively correlated (
Figure 3).
Figure 5 summarizes the proposed correlation between intracellular thermodynamic generalized entropy and GLIE fluctuation parameters within said time scale of about 1 s. As can be seen, high diffusivity correlates to low AGLIE values and to high SD of image gray values. Low AGLIE values contribute to high HFAP values due to the negative AGLIE-HFAP correlation. Finally, high SD of image gray values elevates the slope of the AGLIE-HFAP correlation, which further contributes to higher HFAP values in cellular conditions of high diffusivity.
In summary, theoretical analysis indicates that the thermodynamic generalized entropy of Intracellular particles is closely related to their diffusivity. The latter is (a) negatively correlated to AGLIE values probably due to decreased compartmentation and increased intracellular medium homogeneity and (b) positively correlated to the SD of image pixel gray values and HFAP values (the positive correlation between diffusivity and HFAP values is mainly due to the logarithm-based negative correlation between AGLIE and HFAP values).
3.2. Noise Due to Measurement System Fluctuations
In order to evaluate the influence of the measurement system fluctuation upon those which originated from the investigated sample, microscope gray level readings were measured with different light intensities in the absence of a sample. Identical measurement procedures and conditions were followed, as those used for sample measurement. Six measurement areas in each stack of images were evaluated at each of the light intensities. Each measurement area was divided into 10 × 10 calculation units, each of 5 × 5 pixels, for which the following were calculated: average number of gray values, its SD in a serial of 200 images (0.5 s intervals), the average GLIE and its SD. Characteristic results are shown in
Figure 6.
The results presented in
Figure 6b indicate that regarding the number of gray values, the higher the light intensity
N, the larger the corresponding fluctuation (SD), i.e., the photon noise
. On the other hand, for large
N, though the photon distribution per pixel is Poisson distribution, it tends to normal distribution. That is to say, the
[
41,
42]. Furthermore, since
(Equation (2)), the higher the
N, the higher GLIE is, as well. It should be emphasized that due to the ergodic principle [
43], the temporal (measured at single pixel) and the spatial intensity (measured at a field of 25 pixels) SDs can be considered to be equal, for any practical use.
According to
Figure 6d, the fluctuations of the measure GLIE seem to be indifferent to the intensity. This is an important result that is further analytically investigated in the
Supplementary Materials.
As for the practical aspect of GLIE fluctuation being indifferent to light intensity, it is believed to be a tremendous advantage when making a comparative evaluation between the inherent GLIE fluctuations of several media, each having a different transmitted light intensity.
3.3. The Immediate Applicative Aspect of GLIE Fluctuation-Based Measures
In this section, we present the results obtained in challenging GLIE fluctuation measured in three cardinal cellular states, each considered to have different thermodynamic generalized entropy: normal live, malignant and dead cells of the same type, i.e., normal human lymphocytes, Jurkat T lymphocytes and dead cells.
In short, as discussed in the Introduction, the GLIE fluctuation measures are expected to differ between these cells. For instance, apoptotic and other recently dead cells have low entropy and GLIE fluctuations [
18,
20,
27], while malignant cells have high entropy and GLIE fluctuation in comparison to matched normal healthy cells [
2,
29,
30].
Measurements were performed under the same conditions. Procedures of cell separation, preparation of malignant cell aliquots, staining and death induction, are all described in Materials and Methods.
Table 1 summarizes the GLIE fluctuation parameters: AGLIE and HFAP results in dead lymphocytes, dead Jurkat cells, live normal lymphocytes and live Jurkat cells.
As can be seen, AGLIE and HFAP values of dead Jurkat cells and dead lymphocytes are not significantly different (p = 0.20 for AGLIE and p = 0.31 for HFAP measures).
Table 1 clearly shows higher AGLIE values in dead lymphocytes and dead Jurkat cells when compared to those of normal live lymphocytes, which in turn, show higher AGLIE values when compared to those of malignant Jurkat cells. The opposite occurs with the HFAP parameter results: HFAP values are higher in malignant Jurkat lymphocytes when compared to normal live lymphocytes, which, in turn, are higher when compared to dead lymphocytes or dead Jurkat cells.
These outcomes are illustrated in
Figure 7, where the combination of low HFAP values coupled with high AGLIE values in dead cells consistently change, with HFAP values rising and AGLIE values decreasing, at higher cellular entropic states in normal live cells, and even more so in malignant cells.
4. Conclusions
It has been previously found that GLIE random fluctuation parameters are related to intracellular particle diffusivity, to which, in this study, cellular thermodynamic generalized entropy was theoretically related.
Measures based on the fluctuating nature of GLIE for evaluation of tested medium fluctuations have a prominent advantage over steady state measurement of GLIE. While steady state measurement of GLIE may reflect intracellular medium fluctuations by reflection of the medium composition’s homogeneity, analyzing the fluctuation of GLIE (HFAP parameter) could evaluate intracellular medium fluctuations in a more direct and efficient way.
Moreover, the finding that GLIE fluctuation is indifferent to the intensity of the light which passes through the investigated measurement unit quite ideally enables accurate evaluation and adequate comparison of various mediums, each with a different magnitude of fluctuation.
The applicative aspect of the proposed GLIE fluctuation measures was successfully utilized for distinguishing between normal cells and tumor cells, and between dead and live cells as well, and hence, after completion of investigation, might be considered a candidate procedure for use in relevant laboratories and/or clinics.
Utilization of information entropy fluctuation measures to analyze cells in multiple physiologic and pathophysiologic conditions has the advantage of unique reflection of biophysical characterization, such as diffusivity and entropy, of the tested cells, in a simple and illustrative way.
Lastly, this study is believed to advance our understanding of the thermodynamics of information processing, with a special focus on, but not limited to, living systems. It contains both experimental and theoretical aspects, and to some extent, illuminates the general thermodynamic limits of information processing.