Novel Lossless Compression Method Based on the Fourier Transform to Approximate the Kolmogorov Complexity of Elementary Cellular Automata — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Novel Lossless Compression Method Based on the Fourier Transform to Approximate the Kolmogorov Complexity of Elementary Cellular Automata
Department of Computer Science, University of York, York, UK
1 Department of Computer Science, University of York, York, UK
We propose a novel, lossless compression algorithm, based on the 2D Discrete Fast Fourier Transform, to approximate the Algorithmic (Kolmogorov) Complexity of Elementary Cellular Automata. Fast Fourier transforms are widely used in image compression but their lossy nature exclude them as viable candidates for Kolmogorov Complexity approximations. For the first time, we present a way to adapt fourier transforms for lossless image compression. The proposed method has a very strong Pearsons correlation to existing complexity metrics and we further establish its consistency as a complexity metric by confirming its measurements never exceed the complexity of nothingness and randomness (representing the lower and upper limits of complexity). Surprisingly, many of the other methods tested fail this simple sanity check. A final symmetry-based test also demonstrates our method’s superiority over existing lossless compression metrics. All complexity metrics tested, as well as the code used to generate and augment the original dataset, can be found in our github repository: ECA complexity metrics 1 .
KeywordsFast Fourier TransformLossless CompressionElementary Cellular AutomataAlgorithmic Information TheoryKolmogorov Complexity
Dubacq, J.-C., Durand, B. and Formenti, E. (2001) Kolmogorov Complexity and Cellular Automata Classification. Theoretical Computer Science, 259, 271-285. https://doi.org/10.1016/S0304-3975(00)00012-8
Baetens, J. and De Baets, B. (2011) Towards the Full Lyapunov Spectrum of Elementary Cellular Automata. AIP Conference Proceedings, 1389, 981-986. https://doi.org/10.1063/1.3637774
Zenil, H. (2009) Compression-Based Investigation of the Dynamical Properties of Cellular Automata and Other Systems. arXiv preprint arXiv:0910.4042. https://doi.org/10.1142/S0218127413501599
Zenil, H. and Villarreal-Zapata, E. (2013) Asymptotic Behavior and Ratios of Complexity in Cellular Automata. International Journal of Bifurcation and Chaos, 23, Article ID: 1350159. https://doi.org/10.1115/1.1553433
Wolfram, S. and Gad-el Hak, M. (2003) A New Kind of Science. Applied Mechanics Reviews, 56, B18-B19.
Gomathi and Santhanam (2018) Performance Analysis of Lossless and Lossy Image Compression Techniques for Human Object. International Journal of Applied Engineering Research, 13, 11715-11723.
Allis, N., Dumont, J.P., Heiss, F.J. and Reiter, C.A. (2000) Fast Fourier Transforms, Diffraction Patterns, and J. The Journal of the British APL Association, 16, 111-116.
Zenil, H., Soler-Toscano, F., Delahaye, J.-P. and Gauvrit, N. (2015) Two-Dimensional Kolmogorov Complexity and an Empirical Validation of the Coding Theorem Method by Compressibility. PeerJ Computer Science, 1, e23. https://doi.org/10.7717/peerj-cs.23
Rasheed, M.H., Salih, O.M., Siddeq, M.M. and Rodrigues, M.A. (2020) Image Compression Based on 2D Discrete Fourier Transform and Matrix Minimization Algorithm. Array, 6, Article ID: 100024. https://doi.org/10.1016/j.array.2020.100024
Brunton, S. (2000) Image Compression and the FFT. https://www.youtube.com/watch?v=gGEBUdM0PVc
Adamatzky, A. and Martinez, G.J. (2010) On Generative Morphological Diversity of Elementary Cellular Automata. Kybernetes, 39, 72-82. https://doi.org/10.1108/03684921011021282
Dürr, C., Rapaport, I. and Theyssier, G. (2004) Cellular Automata and Communication Complexity. Theoretical Computer Science, 322, 355-368. https://doi.org/10.1016/j.tcs.2004.03.017
Culik II, K., Hurd, L.P. and Yu, S. (1990) Computation Theoretic Aspects of Cellular Automata. Physica D: Nonlinear Phenomena, 45, 357-378. https://doi.org/10.1016/0167-2789(90)90194-T
Li, W. and Packard, N. (1990) The Structure of the Elementary Cellular Automata Rule Space. Complex Systems, 4, 281-297.
Wuensche, A. (1994) Complexity in One-D Cellular Automata: Gliders, Basins of Attraction and the Z Parameter. University of Sussex, School of Cognitive and Computing Sciences, Brighton.
Sutner, K. (2009) Classification of Cellular Automata. In: Meyers, R., Ed., Encyclopedia of Complexity and Systems Science, Springer, New York, 755-768. https://doi.org/10.1007/978-0-387-30440-3_50
Cattaneo, G. and Vogliotti, C.Q. (1997) The “Magic” Rule Spaces of Neural-Like Elementary Cellular Automata. Theoretical Computer Science, 178, 77-102. https://doi.org/10.1016/S0304-3975(96)00053-9
Borriello, E. and Imari Walker S. (2017) An Information-Based Classification of Elementary Cellular Automata. Complexity, 2017, Article ID: 1280351. https://doi.org/10.1155/2017/1280351
Powley, E.J. and Stepney, S. (2009) Automorphisms of Transition Graphs for Elementary Cellular Automata. Journal of Cellular Automata, 4, 125-136.
De Sales, J., Martins, M. and Moreira, J. (1997) One-Dimensional Cellular Automata Characterization by the Roughness Exponent. Physica A: Statistical Mechanics and Its Applications, 245, 461-471. https://doi.org/10.1016/S0378-4371(97)00320-8
Ruivo E.L. and de Oliveira P.P. (2012) Spectral Similarity among Elementary Cellular Automata. In: Formenti, E., Ed., Proceeding of the 18th International Workshop on Cellular Automata and Discrete Complex Systems: Exploratory Papers Proceedings, Rapport de Recherche I3S-ISRN: I3S/RR-2012-04-FR, 89-98.
Ewert, T. (2019) A Measure for the Complexity of Elementary Cellular Automata. Complex Systems, 28, Article No. 219. https://doi.org/10.25088/ComplexSystems.28.2.219
Li, W. (1991) On the Relationship between Complexity and Entropy for Markov Chains and Regular Languages. Complex Systems, 5, 381-399.
Teixeira, A., Matos, A., Souto, A. and Antunes, L. (2011) Entropy Measures vs. Kolmogorov Complexity. Entropy, 13, 595-611. https://doi.org/10.3390/e13030595
Albantakis, L. and Tononi, G. (2015) The Intrinsic Cause-Effect Power of Discrete Dynamical Systems—From Elementary Cellular Automata to Adapting Animats. Entropy, 17, 5472-5502. https://doi.org/10.3390/e17085472
Lei, Q., Lee, J., Huang, X. and Kawasaki, S. (2021) Entropy-Based Classification of Elementary Cellular Automata under Asynchronous Updating: An Experimental Study. Entropy, 23, 209. https://doi.org/10.3390/e23020209
Chua, L.O., Yoon, S. and Dogaru, R. (2002) A Nonlinear Dynamics Perspective of Wolfram’s New Kind of Science Part I: Threshold of Complexity. International Journal of Bifurcation and Chaos, 12, 2655-2766. https://doi.org/10.1142/S0218127402006333
Machicao, J., Ribas, L.C., Scabini, L.F. and Bruno, O.M. (2018) Cellular Automata Rule Characterization and Classification Using Texture Descriptors. Physica A: Statistical Mechanics and Its Applications, 497, 109-117. https://doi.org/10.1016/j.physa.2017.12.072
Freire, J.G., Brison, O.J. and Gallas, J.A. (2010) Complete Sets of Initial Vectors for Pattern Growth with Elementary Cellular Automata. Computer Physics Communications, 181, 750-755. https://doi.org/10.1016/j.cpc.2009.12.007
J.G. Freire, Brison, O.J. and Gallas, J.A. (2009) Exact Quantification of the Complexity of Spacewise Pattern Growth in Cellular Automata. Journal of Physics A: Mathematical and Theoretical, 42, Article ID: 395003. https://doi.org/10.1088/1751-8113/42/39/395003
Grunwald, P. and Vitányi, P. (2004) Shannon Information and Kolmogorov Complexity. arXiv preprint: cs/0410002.
Ali Javaheri Javid, M., Blackwell, T., Zimmer, R. and Majid al Rifaie, M. (2016) Analysis of Information Gain and Kolmogorov Complexity for Structural Evaluation of Cellular Automata Configurations. Connection Science, 28, 155-170. https://doi.org/10.1080/09540091.2016.1151861
Shalizi, C.R., Haslinger, R., Rouquier, J.-B., Klinkner, K.L. and Moore, C. (2006) Automatic Filters for the Detection of Coherent Structure in Spatiotemporal Systems. Physical Review E, 73, Article ID: 036104. https://doi.org/10.1103/PhysRevE.73.036104
Rajeswaran, K. and Winberg, S. (2013) Lossless Compression of Ska Data Sets. Communications and Network, 5, 369-378. https://doi.org/10.4236/cn.2013.54046
Alarabeyyat, A., Al-Hashemi, S., Khdour, T., Btoush, M.H., Bani-Ahmad S., Al-Hashemi R., Bani-Ahmad, S., et al. (2012) Lossless Image Compression Technique Using Combination Methods. Journal of Software Engineering and Applications, 5, 752-763. https://doi.org/10.4236/jsea.2012.510088
Krawczyk, M.J. (2015) New Aspects of Symmetry of Elementary Cellular Automata. Chaos, Solitons & Fractals, 78, 86-94. https://doi.org/10.1016/j.chaos.2015.07.012
Martinez, G.J. (2013) A Note on Elementary Cellular Automata Classification. arXiv preprint arXiv: 1306.5577.