Submitted:
23 March 2023
Posted:
23 March 2023
You are already at the latest version
Abstract
Keywords:
1. Introduction
- Cardiology: Used Approximated entropy based on Heart Rate Variability (HRV) for sudden cardiac death prognostication, evaluation of the effect of specific pharmacologic agents on HRV [8]; Used entropy based on Holter Electro-Cardiograms (ECG) and Heart Rate (HR) of normal cardiac dynamics and those with varying degrees of acute cardiac pathologies [9]; Consecutive post–myocardial infarction patients undergoing late gadolinium enhanced cardiac magnetic resonance (MR) with derived MR imaging tissue entropy. Patients were followed for appropriate implantable cardioverter-defibrillator therapy and mortality [10].
- Neurology: investigated the association of heart rate entropy (HRE) with mortality after intracerebral hemorrhage [11];
- Surgery (general anesthesia): Entropy monitoring involves using electroencephalography (EEG) to assess the depth of general anesthesia in surgical patients [12] ;
- Trauma: For the categorisation of injury using entropies it is necessary to consider the underlying entropy of the individuals morbidity to which is added the entropy of trauma, which then may result in death [13]; Shown integer heart rate (HR) multiscale entropy (MSE), an indicator of complexity, predicts death based on long duration. Heart rate MSE within hours of admission predicts death occurring days later [14]; In this study measured both Shannon and Tsallis entropy of temperature signals in a cohort of critically ill patients. The reduced wavelet Shannon and Tsallis entropies of temperature signals may complement with sequential organ failure assessment in mortality prediction [15];
- Oncology: used DNA copy number entropy (by array CGH DNA profile imaging) for survival analyzing of patients with esophageal adenocarcinoma [16]; used imaging texture analyzing entropy as predictive marker of promoter methylation status of the O6-methylguanine-DNA methyltransferase in glioblastomas [17]; nuclear texture analysis measures the spatial arrangement of the pixel gray levels in a digitized microscopic nuclear image and is a promising quantitative tool for prognosis of cancer. It was evaluated the prognostic value of entropy-based adaptive nuclear texture features for patients with uterine sarcomas [18]; used nuclear texture analysis for detection of high-chromatin entropy nuclei. Chromatin entropy supplemented existing prognostic markers in multivariable analyses of three gynecological cancer cohorts [19].
2. Materials and Methods
- insensitivity to changing nucleotide positions in DNA sequence. There is sensitivity to changing of base only;
- low accuracy for small number of points in a time series (e.g. N < 1000);
- slow descending to an accurate value with the increasing length of sequence.
| Distribution | Probability density function | Entropy (En, nats) |
|---|---|---|
| Normal Distribution | ||
| Uniform Distribution | ||
| Exponential Distribution | ||
| Lognormal Distribution | ||
| Pareto Distribution |
| Distribution | Length of sample | Empirical Entropy (EnImp) | Robust Entropy Estimator (EnRE) | ||
|---|---|---|---|---|---|
| Accuracy (Relative Error, %) | Correlation | Accuracy (Relative Error, %) | Correlation | ||
| Uniform Distribution (a = 0; b = 4) |
N=100 | 6.92 | 0.978 | 4.71 | 0.991 |
| N =500 | 4.11 | 0.988 | 0.57 | 0.997 | |
| N =1000 | 3.83 | 0.999 | 0.11 | 0.998 | |
| Normal Distribution ) |
N=100 | 7.74 | 0.994 | 1.95 | 0.995 |
| N =500 | 1.83 | 0.997 | 0.35 | 0.998 | |
| N =1000 | 0.91 | 0.999 | 0.16 | 0.999 | |
| Exponential Distribution ) |
N=100 | 46.24 | 0.452 | 0.77 | 0.993 |
| N =500 | 28.38 | 0.903 | 0.25 | 0.997 | |
| N =1000 | 19.31 | 0.950 | 0.06 | 0.999 | |
| Lognormal Distribution ) |
N=100 | 3.69 | 0.980 | 3.38 | 0.986 |
| N =500 | 1.17 | 0.997 | 0.49 | 0.997 | |
| N =1000 | 0.80 | 0.999 | 0.22 | 0.999 | |
| Pareto Distribution = 2; s = 1000 – 2000) |
N=100 | 32.68 | 0.589 | 1.01 | 0.997 |
| N =500 | 17.78 | 0.867 | 0.35 | 0.998 | |
| N =1000 | 14.75 | 0.946 | 0.12 | 0.999 | |
3. Results
3.1. Accuracy
3.2. Optimal DNA sequence coding
3.3. Leukemia patient’s surviving
3.3.1. Median groups
- Group ‘1’, 58 patients, EnRE below median;
- Group ‘2’, 59 patients, EnRE over median.
3.3.2. 1st and 4th quartiles groups
- 3.
- Group ‘1’, 29 patients, EnRE ≤ 1.448, that is below 1st quartile;
- 4.
- Group ‘4’, 29 patients, EnRE ≥ 1.490, that is over 4th quartile.
3.3.3. Immunoglobulin Variable Heavy Chain Gene (IgVH) mutated and unmutated subtypes
| IgVH subtype | Entropy of DNA sequences groups, number of patients | |||
|---|---|---|---|---|
| Below median | Over median | 1st quartile | 4th quartile | |
| Mutated (M-CLL) | 26 | 16 | 13 | 9 |
| Unmutated (U-CLL) | 32 | 43 | 16 | 20 |
3.3.4. Combined analyzing for median entropy groups and M-CLL, U-CLL subtypes
- EnRE below median (Low) and U-CLL;
- EnRE over median (High) and M-CLL.
| Groups | Number of patients | Average EnRE ± SE | Average time of surviving ± SE , months | Hazard | Significance | |
|---|---|---|---|---|---|---|
| Median | Below med. (Low) | 58 | 1.442 ± 0.003 | 76.4 ± 9 | 1.56 | p < 0.05 |
| Over med. (High) |
59 | 1.504 ± 0.003 | 114.3 ± 9 | 1 | ||
| Quarter | 1st quart. (Lowest) |
29 | 1.425 ± 0.003 | 78.6 ± 11 | 2.14 | p < 0.005 |
| 4rd quart. (Highest) | 29 | 1.519 ± 0.005 | 129.6 ± 11 | 1 | ||
| Median & IgVH subtypes | Low & U-CLL |
32 | 1.443 ± 0.003 | 78.2 ± 13 | 2.61 | p < 0.01 |
| High & M-CLL |
16 | 1.505 ± 0.005 | 154.3 ± 25 | 1 | ||
4. Discussion
- A
- Groups divided by median. Both, Kaplan-Meier survival analysis and Cox Regressions survival modelling, showed the statistically significant results for p < 0.05. The value of Exp(B) for Cox Regressions model variable shows that the death hazard for a patient with EnRE below median is 1.556 times that of a patient with EnRE over median. The relation of average time of death after diagnoses is 1.496 times more for patients with EnRE over median in compare with patients with EnRE below median.
- B
- Patients groups formed of 1st and 4th quarterlies. Both, Kaplan-Meier survival analysis and Cox Regressions survival modelling, showed the statistically significant results for p < 0.005. The value of Exp(B) for model variable shows that the death hazard for a patient of 1st entropy quartile (lowest EnRE) is 2.143 times that of a patient of 4th entropy quartile (highest EnRE). The relation of average time of death after diagnoses is 1.649 times more for patients of 4th entropy quartile in compare with patients of 1st entropy quartile.
- C
- Combined groups: Low&U-CLL and High&M-CLL. Both, Kaplan-Meier survival analysis and Cox Regressions survival modelling, showed the statistically significant results for p < 0.01. The value of Exp(B) for Cox Regressions model variable shows that the death hazard for a patient with EnRE below median & U-CLL is 2.611 times that of a patient with EnRE over median & M-CLL. The relation of average time of death after diagnoses is 1.973 times more for patients with EnRE over median & M-CLL in compare with patients with EnRE below median & U-CLL.
Author Contributions
Funding
Institutional Review Board Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Li, W.T. The study of correlation structures of DNA sequences: a critical review. Comput. Chem 1997, 21(4), 257–271.
- Damasevicius, R. Complexity estimation of genetic sequences using information-theoretic and frequency analysis methods. Informatica 2010, 21(1), 13–30.
- 3. Yang, Jae-Hyun et al. Loss of epigenetic information as a cause of mammalian aging. Cells 2023, 186, 1–22. [CrossRef]
- Rowe, G.W.; Trainor, L.E.H. On the informational content of viral DNA. J. Theoretical Biology 1983, 101, 151–170.
- Vopson, M.M.; Robson, S.C. A new method to study genome mutations using the information entropy. Physica A 2012, 1-9. [CrossRef]
- Sherwin, W.B. Entropy and Information Approaches to Genetic Diversity and its Expression: Genomic Geography. Entropy 2010, 12, 1765-1798;. [CrossRef]
- Chanda, P.; Costa, E.; Hu, J.; Sukumar, S.; Van Hemert, J.; Walia, R. Information Theory in Computational Biology: Where We Stand Today. Entropy 2020, 22, 627. [CrossRef]
- Villareal, R.P.; Liu, B.C; Massumi, A. Heart rate variability and cardiovascular mortality. Curr. Atheroscler Rep. 2002, 4, 120–127. https://doi-org.sire.ub.edu/10.1007/s11883-002-0035-18.
- Rodríguez, J.; Correa, C.; Ramírez, L. Heart dynamics diagnosis based on entropy proportions: Application to 550 dynamics. Revista Mexicana de Cardiología 2017, 28(1), 10-20.
- Androulakis, A.F.A.; Zeppenfeld, K.; Paiman, E.H.M.; Piers, S.R.D., Wijnmaalen, A.P.; Siebelink, H.J.; Sramko, M.; Lamb, H.J.; van der Geest, R.J.; de Riva, M.; Tao, Q. Entropy as a Novel Measure of Myocardial Tissue Heterogeneity for Prediction of Ventricular Arrhythmias and Mortality in Post-Infarct Patients. JACC Clin Electrophysiol 2019, 5(4), 480-489. [CrossRef]
- Sykora, M.; Szabo, J.; Siarnik, P.; Turcani, P.; Krebs, S.; Lang, W.; Czosnyka, M.; Smielewski, P. Heart rate entropy is associated with mortality after intracereberal hemorrhage, Journal of the Neurological Sciences 2020, 418, 1-5: . [CrossRef]
- Matsuda, E. Entropy Monitoring in Patients Undergoing General Anesthesia. Am J Nurs. 2017, 117(3), 62. [CrossRef]
- Neal-Sturgess, C. The Entropy of Morbidity Trauma and Mortality. Arxiv Cornell University 2010, Med. Physics, 1-20. [CrossRef]
- Norris, P.R.; Anderson, S.M.; Jenkins, J.M.; Williams, A.E.; Morris, J.A.Jr. Heart rate multiscale entropy at three hours predicts hospital mortality in 3,154 trauma patients. Shock 2008, 30(1),17-22. [CrossRef]
- Papaioannou, V.E.; Chouvarda, I.G.; Maglaveras, N.K.; Baltopoulos, G.I.; Pneumatikos, I.A. Temperature multiscale entropy analysis: a promising marker for early prediction of mortality in septic patients. Physiol Meas. 2013, 34(11), 1449-66. [CrossRef]
- Obulkasim, A.; et all. Reduced genomic tumor heterogeneity after neoadjuvant chemotherapy is related to favorable outcome in patients with esophageal adenocarcinoma. Oncotarget 2016, 7(28), 44084-44095. [CrossRef]
- Kanazawa,T.; Minami, Y.; Jinzaki, M.; Toda, M.; Yoshida, K.; Sasaki, H. Predictive markers for MGMT promoter methylation in glioblastomas. Neurosurg Rev. 2019, 42(4), 867-876. [CrossRef]
- Nielsen, B.; Hveem, T.S.; Kildal, W.; Abeler, V.M.; Kristensen, G.B.; Albregtsen, F.; Danielsen, H.E. Entropy-based adaptive nuclear texture features are independent prognostic markers in a total population of uterine sarcomas. Cytometry A. 2015, 87(4), 315-25. [CrossRef]
- Nielsen, B.; at all. Association Between Proportion of Nuclei With High Chromatin Entropy and Prognosis in Gynecological Cancers. J Natl Cancer Inst. 2018, 110(12), 1400-1408. [CrossRef]
- Weir, B.S. Statistical analysis of molecular genetic data. IMA J. of Math. Applied in Medicine and Biology 1985, 2, 1-39.
- Shannon, C.E. A Mathematical Theory of Communication. Bell System Technical Journal. 1948, 27 (3), 379–423. doi:10.1002/j.1538-7305.1948.tb01338.x.
- Lazo, A.; Rathie, P. On the entropy of continuous probability distributions. IEEE Transactions on Information Theory 1978, 24 (1). doi:10.1109/TIT.1978.1055832.
- Gini, C. Variabilità e mutabilità. Memorie di metodologica statistica. Reprinted in Pizetti, E.; Salvemini, T., eds. Libreria Eredi Virgilio Veschi: Rome, Italy, 1955.
- Sánchez-Hechavarría, M.E.; at all. Introduction of Application of Gini Coefficient to Heart Rate Variability Spectrum for Mental Stress Evaluation. Arq Bras Cardiol. 2019; [online].ahead print, PP.0-0. [CrossRef]
- Firebaugh, G. Empirics of World Income Inequality. American Journal of Sociology 1999, 104 (6), 1597–1630. doi:10.1086/210218.
- Shorrocks, A.F. The Class of Additively Decomposable Inequality Measures. Econometrica 1980, 48 (3), 613–625. [CrossRef]
- Martynenko, A.; Raimondi, G.; Budreiko, N. Robust Entropy Estimator for Heart Rate Variability. Klin. Inform. Telemed. 2019. 14(15), 67-73. [CrossRef]
- Ecker, S.; Pancaldi, V.; Ric, D.; Valencia, A. Higher gene expression variability in the more aggressive subtype of chronic lymphocytic leukemia. Genome Medicine 2015; 7(8), 12. [CrossRef]







| Integer DNA code | Average Entropy EnRE | Standard deviation of EnRE | Coefficient of Variation (CV) |
|---|---|---|---|
| A=1,C=2,G=3,T=4 or A=4,C=3,G=2,T=1 | 1.205 | 0.030 | 0.025 |
| A=2,C=1,G=3,T=4 or A=3,C=4,G=1,T=2 | 1.254 | 0.036 | 0.029 |
| A=3,C=4,G=2,T=1 | 1.241 | 0.034 | 0.027 |
| A=1,C=4,G=3,T=2 | 1.235 | 0.043 | 0.035 |
| A=1,C=3,G=4,T=2 | 1.221 | 0.040 | 0.033 |
| A=1,C=3,G=2,T=4 | 1.211 | 0.033 | 0.027 |
| A=1,C=2,G=4,T=3 | 1.223 | 0.039 | 0.032 |
|
A=-2, C=-1, G=1, T=2 (reflection symmetry by modulus ) |
1.430 | 0.023 | 0.016 |
|
A=-1, C=-2, G=1, T=2 (translation symmetry by modulus) |
1.470 | 0.022 | 0.015 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).