Conditional Tsallis Entropy

Sanei Tabass Manije; Mohtashami Borzadaran Gholamreza; Amini Mohammad

doi:10.2478/cait-2013-0012

.blurhash-client-img { display: none !important; }

Conditional Tsallis Entropy

Cybernetics and Information Technologies

Volume 13 (2013): Issue 2 (June 2013)

By: Sanei Tabass Manije, Mohtashami Borzadaran Gholamreza and Amini Mohammad

Open Access

|May 2013

Abstract

In this paper, the conditional Tsallis entropy is defined on the basis of the conditional Renyi entropy. Regarding the fact that Renyi entropy is the monotonically increasing function of Tsallis entropy, a relationship has also been presented between the joint Tsallis entropy and conditional Tsallis entropy.

References

1. Basseville, M. Divergence Measures for Statistical Data Processing. Publications Internes de l’IRISA, November 2010.
Search in Google Scholar
2. Bregman, L. M. The Relaxation Method of Finding the Common Point of Convex Sets and Its Application to the Solution of Problems in Convex Programming. - USSR Computational Mathematics and Mathematical Physics, Vol. 7, 1967, No 3, 200-217.
Open DOI Search in Google Scholar
3. Cover, T. M., A. J. Thomas. Elements of Information Theory. Wiley India Pvt. Ltd. New Delhi, 2009.
Search in Google Scholar
4. Csiszar, I. Eine Informations Theoretische Ungleichung und ihre Anwendung auf den Beweis der Ergodizitat von marko_schen ketten. Magyar. - Tud. Akad. Mat. Kutato Int. Kozl, Vol. 8, 1963, 85-108.
Search in Google Scholar
5. Csiszar, I. On Topological Properties of f-Divergences. - Studia Math. Hungarica, Vol. 2, 1967, 329-339.
Search in Google Scholar
6. Dragomir, S. S. Some Inequalities for the Csiszar’s ∅-Divergence. Inequalities for the Csizar’s f-Divergence in Information Theory, 2000. http://rgmia.vu.edu.au/monographs/ciszar.htm
Search in Google Scholar
7. Dragomir, S. S. Upper and Lower Bounds for Csiszar’s f-Divergence in Terms of the Kullback-Leibder Distance and Applications. Inequalities for the Csiszar’s f-divergence in Information Theory, 2000. http://rgmia.vu.edu.au/monographs/ciszar.htm
Search in Google Scholar
8. Dragomir, S. S. Upper and Lower Bounds for Csiszar’s f-Divergence in Terms of the Hellinger Discrimination and Applications. Inequalities for the Csiszar’s f-Divergence in Information Theory, 2000. http://rgmia.vu.edu.au/monographs/csiszar.htm
Search in Google Scholar
9. Dragomir, S. S. Other Inequalities for the Csiszar’s Divergence and Applications. Inequalities for the Csizar’s f-Divergence in Information Theory, 2000. http://rgmia.vu.edu.au/monographs/ciszar.htm
Search in Google Scholar
10. Esteban, M. D., D. Morale s. A Summary on Entropy Statistic. - Kybernetika, Vol. 31, 1995, No 4, 337-346.
Search in Google Scholar
11. Hellinger, E. Neue Berunduring der Theorie der Quadratischen Formen von Un endlichen Vieden Veran derliehen. - J. Reine Aug. Math., Vol. 136, 1909, 210-271.
Open DOI Search in Google Scholar
12. Kullback, S., R. A. Leible r. On Information and Sufficiency. - Ann. Math. Statist., Vol. 22, 1951, 79-86.
Open DOI Search in Google Scholar
13.Maji, P. f-Information Measures for Efficient Selection of Discriminative Genes From Microarray Data. - IEEE Transactions on Biomedical Engineering, Vol. 56, 2009, No 4, 1063-1069.
Open DOI Search in Google Scholar
14. Pearson, K. On the Criterion that a Given System of Deviations From the Probable in the Case of Correlated System of Variables is Such that it Can Be Reasonable Supposed to Have Arisen from Random Sampling. - Phil. Mag., Vol. 50, 1900, 157-172.
Open DOI Search in Google Scholar
15. Renyi, A. On Measures of Entropy and Information. - In: Proc. of 4th Berkeley Symp. Math. Stat. Probab., Vol. 1, 1961, 547-561.
Search in Google Scholar
16. Salicru, M. Measures of Information Associated with Csiszar’s Divergences. - Kybernetika, Vol. 50, 1994, No 5, 563-573.
Search in Google Scholar
17. Shannon, C. E. The Mathematical Theory of Communications. - Bell Syst. Tech. Journal, Vol. 27, 1948, 423-467.
Open DOI Search in Google Scholar
18. Taneja, I. J. Generalized Information Maeasures and their Applications. - On-Line Book, 2001. http://www.mtm.ufsc.br/∼taneja/book/book.html
Search in Google Scholar
19. Taneja, I. J. Generalized Arithmetic and Geometric Mean Divergence Measure and Their Statistical Aspects. Available at: arXiv:math/0501297v1[math.ST] 19 Jan 2005.
Search in Google Scholar
20. Taneja, I. J. On Mean Divergence Measure. Available at: arXiv:math/0501298v2[math.ST] 13 June 2005.
Search in Google Scholar
21.Wang,Y. Generelized Information Theory: A Review and Outlook. - Information Technology Journal, Vol. 10, 2011, No 3, 461-469.
Open DOI Search in Google Scholar

Articles in this issue

DOI: https://doi.org/10.2478/cait-2013-0012 | Journal eISSN: 1314-4081 | Journal ISSN: 1311-9702 (formerly 1314-4081)

Journal RSS Feed

Language: English

Page range: 37 - 42

Published on: May 21, 2013

Published by: Bulgarian Academy of Sciences, Institute of Information and Communication Technologies

In partnership with: Paradigm Publishing Services

Keywords:

Shannon entropy,

Conditional Shannon entropy,

Conditional Tsallis entropy,

Conditional Renyi entropy,

Chain rule

Related subjects:

Computer sciences,

Information technology

© 2013 Sanei Tabass Manije, Mohtashami Borzadaran Gholamreza, Amini Mohammad, published by Bulgarian Academy of Sciences, Institute of Information and Communication Technologies
This work is licensed under the Creative Commons License.

Volume 13 (2013): Issue 2 (June 2013)