Algorithmic entropy, phase transition, and smart systems
Pages 333 - 342
Abstract
A smart system exhibits the three important properties: (i) interactive, collective, coordinated and parallel operation (ii) self-organization through emergent properties (iii) adaptive and flexible operation. A hierarchy based on metric entropy is suggested among the computational systems that transcend from the unsmart to the smart system through a phase transition like phenomenon. Understanding smart systems is useful to solve hard-optimization problem inspired by the self-organizing processes found in nature. Such systems will be valuable to create artificial systems made up of exotic matter to solve specific problems in particular domains of interest with a high efficiency.
References
[1]
Bak, P.: How Nature works: The Science of self-organized criticality, Springer Verlag, New York (1996).
[2]
Boettcher, S.: Extremal Optimization of graph partitioning at the percolation threshold, J.Phys A.: Math.Gen 32, (1999) pp. 5201-5211.
[3]
Boettcher. S and A. Percus, A.: Nature's way of Optimizing, Artificial Intelligence, 119 (2000) 275-286.
[4]
Brooks, R.: The relationship between matter and life, Nature, 409 (2001) 409-411.
[5]
Brooks, R.: Steps towards living machines, pp. 72-94, in Lecture Notes in Computer Science, Vol. 2217, Springer Verlag, New York (2001) 72-94.
[6]
Chaitin, G. "Algorithmic Information Theory, M.I.T Press, Cambridge, Mass (1987).
[7]
Conrad, M.: Molecular Computing, Advances in Computers, 31, Academic Press, New York (1990). 235-325.
[8]
Dorigo, M. et al.: Antalgorithms, Lecture Notes in Computer Science, 2463 Springer Verlag, New York (2002).
[9]
Emch, G and Liu, C: The Logic of Thermostatistical Physics, Springer, New York, (2002).
[10]
Faisal, F.H.M: Quantum Chaos, Algorithmic Paradigm and Irreversibility, in Quantum Future, Ph. Blanchard and A. Jadczyk (ed), Springer Verlag, New York (1997), 47-57.
[11]
Gal-Or, B: Cosmology, physics and philosophy, Springer Verlag, New York (1981).
[12]
Gell-Mann, M: The Quark and the Jaguar, W.H. Freeman, New York (1994).
[13]
Gent, I and Walsh, T: Phase transitions from real computational problems, Proc. 8th Symposium on AI, (1996) 356-364.
[14]
Gomes, C.P and Selman, B., Satisfied with Physics, Science, 297 (2002) 784-785.
[15]
Haken, H.: Synergetic Computers and Cognition, Springer Verlag, New York (1991).
[16]
Hameroff, S.R,: Ultimate Computing, North Holland, Amsterdam (1987).
[17]
Hogg, T. and Kephart, J.O.: Phase transitions in higher dimensional pattern classification, Computer Systems Science and Engineering, 5 (1990) 223-232.
[18]
Hogg, T and Williams, C.P : The hardest constraint problem: a double phase transition, Artificial Intelligence, 69 (1994) 359-377.
[19]
Holland, J.H.: Emergence-chaos to order, Addison Wesley, Reading, Mass. (1998).
[20]
Hopfield, J: Physics, Biological Computation and Complementarity, in The lesson of quantum theory, North Holland, Amsterdam (1986) 295-314.
[21]
Hubermann, B.A. and Hogg T .: Phase transitions in Artificial Intelligence Systems, Artificial Intelligence, 33 (1987) 155-171.
[22]
Korkin, M.: Self-organized Evolutionary Process in sets of interdependent variables near the mid point of phase transitions in K-satisfiability, Lecture Notes in Computer Science, 2210, Springer Verlag, New York (2001), 225-235.
[23]
Krishnamurthy, E.V and Krishnamurthy, V.: Rule-based Programming paradigm: A formal basis for biological, chemical and Physical computation, Biosystems. 49 (1999) 205- 228.
[24]
Langton, C.E et al: Life at the Edge of chaos, in Artificial Life II, Addison Wesley, Reading, Mass., (1992) 41-91.
[25]
Lau, M and Okagaki, T.: Applications of Phase transition theory in visual recognition and classification, Journal of visual communication and Image representation, 59(1994) 88- 94.
[26]
Lebowitz, J.L.: Microscopic Origins of irreversible Macroscopic Behaviour, Physica A 263 (1999). 516-527.
[27]
Makishima, S.: Pattern Dynamics: A theory of Self-Organization, Kodansha Scientific, Tokyo (2001).
[28]
Mezard, M., Parisi, G., and Zecchina, R.:Analytic and algorithmic solution of random satisfiability problems, Science, 297 (2002) 812-815.
[29]
Pemberton, J and Zhang, W (1996); Epsilon Transformation: Exploiting phase transitions to solve combinatorial optimization problems, Artificial Intelligence, 81 (1996) 297-325.
[30]
Prigogine, I: From being to becoming, W.H. Freeman and Co, San Fransisco, (1980).
[31]
Prigogine, I.: Laws of Nature, Probability and time symmetry breaking, Physica A 263 (1999). 528-539.
[32]
Sneppen, K and Bak, P,: Evolution as a self-organized critical phenomena, Proc. Natl. Acad. Sci., 92 (1995) 5209-5213.
[33]
Stauffer, D and Aharony, A: Introduction to Percolation theory, Taylor & Francis, London (1993).
[34]
Walsh, T.: The constrainedness in knife edge, Proc. AAAI-98, (1996) 406-411.
[35]
Wegner, P.: Why Interaction is more powerful than algorithms, Comm. ACM 50, (1997) 81-91.
[36]
Wolfram, S.: A new kind of science, Wolfram Media, Inc, Champaign, Ill (2002).
[37]
Zak, M, Zbilut, J.P and Meyers, R.E.: From Instability to Intelligence, Springer Verlag, New York (1997).
[38]
Zhang, W and Korf, R.: A study of complexity transitions on the asymmetric travelling salesman problem, Artificial Intelligence, 81 (1996) 223-239.
Recommendations
Systems and technologies for Smart Homes/Smart Phones: A study and comparison
ICEMIS '18: Proceedings of the Fourth International Conference on Engineering & MIS 2018This paper provides a comparative study of the advancements in technologies and devices for Smart Home/Smart phone and it explains the design and implementation procedure of embedded Smart Systems. A smart home is a home that is equipped with technology ...
Some properties of Rényi entropy and Rényi entropy rate
In this paper, we define the conditional Renyi entropy and show that the so-called chain rule holds for the Renyi entropy. Then, we introduce a relation for the rate of Renyi entropy and use it to derive the rate of the Renyi entropy for an irreducible-...
Transition of phase locking modes in a minimal neuronal network
We investigate the dynamics of phase locking in a minimal neuronal network, which is composed of two Morris-Lecar neurons that are coupled by inhibitory and excitatory synapses as the synaptic strength is varied. Studies show that the synaptic strength ...
Comments
Information & Contributors
Information
Published In
June 2003
1165 pages
ISBN:3540401962
Sponsors
- ceanet
- St. Petersburg State Technical University
- Etnus
- Pallas GmbH
- University of Amsterdam: University of Amsterdam
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 02 June 2003
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 13 Sep 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in