Math
Math
Math
c
MATHEMATICS
POWERFUL PATTERNS IN NATURE AND SOCIETY
Harry Henderson
MATHEMATICS: Powerful Patterns in Nature and Society Copyright 2007 by Harry Henderson All rights reserved. No part of this book may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage or retrieval systems, without permission in writing from the publisher. For information contact: Chelsea House An imprint of Infobase Publishing 132 West 31st Street New York NY 10001 ISBN-10: 0-8160-5750-8 ISBN-13: 978-0-8160-5750-4 Library of Congress Cataloging-in-Publication Data Henderson, Harry, 1951 Mathematics : powerful patterns in nature and society / Harry Henderson. p. cm. (Milestones in discovery and invention) Includes bibliographical reference and index. ISBN 0-8160-5750-8 1. Mathematics. 2. MathematicsHistory. 3. MathematicsSocial aspects. I. Title. QA21.H46 2007 510dc22 2006024680 Chelsea House books are available at special discounts when purchased in bulk quantities for businesses, associations, institutions, or sales promotions. Please call our Special Sales Department in New York at (212) 967-8800 or (800) 322-8755. You can find Chelsea House on the World Wide Web at http://www.chelseahouse.com Text design by James Scotto-Lavino Cover design by Dorothy M. Preston Illustrations by Sholto Ainslie and Melissa Ericksen Printed in the United States of America MP FOF 10 9 8 7 6 5 4 3 2 1 This book is printed on acid-free paper.
e
PREFACE ACKNOWLEDGMENTS INTRODUCTION
CONTENTS
ix xiii xv
26 26
4 A DELICATE EQUILIBRIUM:
JOHN NASH AND GAME THEORY A Different Child A Wayward Path to Math Life at Princeton Game Theory and the Nash Equilibrium Falling Short I Was There: Infuriating but So Brilliant Breakdown In the Shadowlands Connections: Math and Madness? The Long Climb Back Nobel Triumph Chronology Further Reading 44 44 46 47 48 50 51 51 52 53 54 54 56 57
The Mandelbrot Set Finding Applications Connections: Generating and Applying Fractals Other Scientists: Christopher Scholz Popularizing Fractals I Was There: Ego or Necessity? Achievements Chronology Further Reading
64 67 67 68 69 70 71 71 72
6 ON BUTTERFLY WINGS:
EDWARD LORENZ AND CHAOS THEORY Clouds and Calculations Forecasting and Meteorology A New Approach to Weather A Berserk Computer? The Limits of Forecasting Trends: Weather Forecasting Today Demonstrations of Chaos Strange Attractors Other Scientists: Mitchell Feigenbaum Chaos: A New Paradigm? Achieving Recognition Issues: Theories and Fads Chronology Further Reading 74 74 75 76 77 78 79 79 82 82 83 86 87 88 88
Mathematica A Shortcut to Complexity? Connections: Applying Wolframs Ideas Universal Automaton A New Kind of Science? Issues: Is Wolframs Work Pseudoscience? Assessing Wolframs Science Chronology Further Reading CHRONOLOGY GLOSSARY FURTHER RESOURCES INDEX
139 140 142 142 143 146 147 148 150 152 154 159 163
e
T
PREFACE
he Milestones in Discovery and Invention set is based on a simple but powerful ideathat science and technology are not separate from peoples daily lives. Rather, they are part of seeking to understand and reshape the world, an activity that virtually defines being human. More than a million years ago, the ancestors of modern humans began to shape stones into tools that helped them compete with the specialized predators around them. Starting about 35,000 years ago, the modern type of human, Homo sapiens, also created elaborate cave paintings and finely crafted art objects, showing that technology had been joined with imagination and language to compose a new and vibrant world of culture. Humans were not only shaping their world but representing it in art and thinking about its nature and meaning. Technology is a basic part of that culture. The mythologies of many peoples include a trickster figure, who upsets the settled order of things and brings forth new creative and destructive possibilities. In many myths, for instance, a trickster such as the Native Americans Coyote or Raven steals fire from the gods and gives it to human beings. All technology, whether it harnesses fire, electricity, or the energy locked in the heart of atoms or genes, partakes of the double-edged gift of the trickster, providing power to both hurt and heal. An inventor of technology is often inspired by the discoveries of scientists. Science as we know it today is younger than technology, dating back about 500 years to a period called the Renaissance. During the Renaissance, artists and thinkers began to explore nature systematically, and the first modern scientists, such as Leonardo da Vinci (14521519) and Galileo Galilei (15641642),
ix
x Mathematics
used instruments and experiments to develop and test ideas about how objects in the universe behaved. A succession of revolutions followed, often introduced by individual geniuses: Isaac Newton (16431727) in mechanics and mathematics, Charles Darwin (18091882) in biological evolution, Albert Einstein (18791955) in relativity and quantum physics, James Watson (1928 ) and Francis Crick (19162004) in modern genetics. Todays emerging fields of science and technology, such as genetic engineering, nanotechnology, and artificial intelligence, have their own inspiring leaders. The fact that particular names such as Newton, Darwin, and Einstein can be so easily associated with these revolutions suggests the importance of the individual in modern science and technology. Each book in this set thus focuses on the lives and achievements of eight to 10 individuals who together have revolutionized an aspect of science or technology. Each book presents a different field: marine science, genetics, astronomy and space science, forensic science, communications technology, robotics, artificial intelligence, and mathematical simulation. Although early pioneers are included where appropriate, the emphasis is generally on researchers who worked in the 20th century or are still working today. The biographies in each volume are placed in an order that reflects the flow of the individuals major achievements, but these life stories are often intertwined. The achievements of particular men and women cannot be understood without some knowledge of the times they lived in, the people they worked with, and developments that preceded their research. Newton famously remarked, If I have seen further [than others], it is by standing on the shoulders of giants. Each scientist or inventor builds uponor wrestles withthe work that has come before. Individual scientists and inventors also interact with others in their own laboratories and elsewhere, sometimes even partaking in vast collective efforts, such as the government and private projects that raced at the end of the 20th century to complete the description of the human genome. Scientists and inventors affect, and are affected by, economic, political, and social forces as well. The relationship between scientific and technical creativity and developments in social institutions is another important facet of this series.
PREFACE xi
A number of additional features provide further context for the biographies in these books. Each chapter includes a chronology and suggestions for further reading. In addition, a glossary and a general bibliography (including organizations and Web resources) appear at the end of each book. Several types of sidebars are also used in the text to explore particular aspects of the profiled scientists and inventors work: Connections Describes the relationship between the featured work and other scientific or technical developments. I Was There Presents first-hand accounts of discoveries or inventions. Issues Discusses scientific or ethical issues raised by the discovery or invention. Other Scientists (or Inventors) Describes other individuals who played an important part in the work being discussed. Parallels Shows parallel or related discoveries. Social Impact Suggests how the discovery or invention affects or might affect society and daily life. Solving Problems Explains how a scientist or inventor dealt with a particular technical problem or challenge. Trends Presents data or statistics showing how developments in a field changed over time. Our hope is that readers will be intrigued and inspired by these stories of the human quest for understanding, exploration, and innovation. We have tried to provide the context and tools to enable readers to forge their own connections and to further pursue their fields of interest.
e
I
ACKNOWLEDGMENTS
would like to acknowledge the help of numerous people who helped me obtain photos of the people and subjects discussed in this book. And as always, I would like to thank Frank K. Darmstadt, executive editor; Amy L. Conver, copy editor; and the rest of the editorial and production staff for their help in making this project a reality.
xiii
e
T
INTRODUCTION
he essence of mathematics is the search for patterns in observing the world and for tools that let one find or create new patterns. Some patterns people find can be usefulsuch as for predicting the weather. In other cases, the sheer pleasure of finding how things fit together may be enough. Prehistoric humans were acting as mathematicians when they noticed the relationship between the length of an animals coat and the coming of winter. With the coming of the first citiesof civilizationcame the development of new tools for finding and using patterns. These included new ways to count, the development of number systems, procedures for calculation, and tools for measurement. The lore that became geometry could tell a farmer where his farm should be in relation to the nearest river. The priests in the local temple could observe the stars and determine when the time for planting had come. Kings and priests, of course, were also interested in collecting taxes, while traders had to be able to figure the comparative value of goods and of various forms of money. About 2,500 years ago, some Greeks such as Pythagoras and Euclid began to pursue mathematics in a purer form. They did not ask what one could do with mathematics but believed that it was a discipline that could bring the mind to the understanding of the ideal reality that was only revealed imperfectly in the flawed world. And although the Greeks were not particularly practical, they did believe that their architecture and art should reflect the beauty revealed by mathematics, and so they embodied the golden ratio in their designs for buildings such as the Parthenon. The mathematicians in this book mainly worked in the 20th century. However, what we call modern mathematics and science owed much to a flourishing Islamic civilization that stretched from
xv
xvi Mathematics
the Middle East across Africa and both enticed and challenged medieval Europe. The book begins with Leonardo of Pisa, better known as Fibonacci. This 13th-century mathematical traveler brought what are known today as Arabic numerals to Europe, along with the work of Arabic mathematicians who were translating and improving on the geometry of the ancient Greeks, while inventing algebra and exploring number theory. Fibonaccis bestknown achievement, though, was his exploration of the properties of a number series that has turned out to correspond to many structures found in nature, including those of many leaves and flowers. Leonardo thus provided a first gift of tools and patterns to European mathematicians. The book then jumps to the 19th and early 20th centuries, where new techniques were being born. By then, powerful new mathematics, such as the calculus of Newton and Leibniz, was transforming natural science, particularly physics. With the industrial age in full swing and modern states looking for ways to manage a growing population and economy, vast amounts of data were being collected. What was needed, though, were the mathematical techniques that could find correlations in that data and express the degree of certainty that one might have in conclusions. The next featured mathematician, Karl Pearson, developed many of the tools used by statisticians today, even as he perhaps overreached in coming to conclusions about evolution and the perfection of society. Around the time Pearsons career was ending, a new tool was being developedthe digital computer. John von Neumann was one of the key designers of the computer, and the essential features of his design still sit on desktops today. But von Neumann did more than develop the computer as an essential data-processing tool. He also recognized its potential as a tool for the imagination, for simulating the processes of nature as well as human interactions. Human interactions were the main mathematical interest of John Nash, who made key discoveries in what became known as game theory. This weighing of options and searching for optimal strategy is used every day behind the scenes in labor negotiations, corporate mergers, and foreign policy. Nash, however, may have won his most important game when he used his logical skills to disarm the phantasms of schizophrenia.
INTRODUCTION xvii
The next two mathematicians opened a new portal into understanding the complexity of nature. Benot Mandelbrot discovered the world of fractal geometry, with its intricately nested, ever-varying patterns. Today fractals are used in computer graphics, data compression, and even more esoteric applications. Around the same time, a meteorologist named Edward Lorenz was hoping to use computer models to create more reliable weather forecasts. One day, he discovered by accident that slight changes in variables could produce wildly different results. Lorenz became the first of a generation of researchers who explored the nature of chaotic phenomena that were determined by natural laws but could not be predicted. Chaos theory has become an essential tool of modern science. Another way to generate patterns was popularized by mathematician and puzzle master John H. Conway, who around 1970 invented a game that he called Life. In it, simple rules are used to generate complex patterns in what is called cellular automation. The fascination of watching complexity emerge from simplicity hinted at yet another way of looking at the processes of nature. Two more researchers took that hint in different directions. Christopher Langton developed and popularized the field of artificial life, where simulated organisms interact with each other and the environment while they are subjected to Darwinian natural selection, with their computer codes serving the functions of genes. This research has now found its way into sophisticated robots and software agents. Stephen Wolfram has undertaken an even more ambitious project. A brilliant young physicist, he turned his attention to mathematical computing and cellular automation in the 1980s, and in the 1990s, he worked secretively on a theory of everything. His 2002 book, A New Kind of Science, makes bold claims that nature can be better understood by identifying patterns and their underlying rules rather than through the traditional method of fitting equations to observations. Only time will tell whether Wolframs work represents a true scientific revolution. Finally, there is Roger Penrose, the mathematical physicist who worked with Stephen Hawking to understand the nature of black holes and their interaction with energy and information. Penrose has
xviii Mathematics
also tried to sketch out possible connections between the tiny world of quanta and the sweeping arena of relativity. Within this vast pattern, Penrose speculates on the nature of the human mind and consciousness and suggests that they can exploit quantum processes to understand the world in a way that cannot be matched by the brute force of ever more powerful computer chips. It should be said that the selection of mathematicians for this volume is necessarily a bit arbitrary. There are many other significant pattern-finders and pattern-makers in the history of modern mathematicsthough not all may be equally accessible to the nonmathematician. The author has therefore emphasized mathematical thinkers whose ideas are provocative, intriguing, and continuing to resonate in todays science and technology.
1
HOW NATURE COUNTS
LEONARDO OF PISA DISCOVERS FIBONACCI NUMBERS
round the year 1170, a boy named Leonardo was born near the town of Pisa in northern Italy. Following the usage of the time, he was usually called Leonardo Pisano, or Leonardo of Pisa. However, his father, Guglielmo (William), had been given the nickname Bonacci, meaning good-natured. In his later writings, Leonardo would become best known by the nickname Fibonacci, meaning filio Bonacci, or son of Bonacci. Leonardo would play a key role in taking European mathematics from the Middle Ages to the Renaissance, and his lasting legacy would be a remarkable series of numbers. When Leonardo was 12, his father was appointed as a representative of Italian merchants in the port of Bugia (now Bougie) on the north coast of what is now
1
Leonardo of Pisa, nicknamed Fibonacci, brought state-of-theart Arab mathematics to medieval Europe. He also discovered and popularized a remarkable series of numbers that have many correspondences in nature. (SPL/
Photo Researchers, Inc.)
2 Mathematics
Algeria. The expansion of a vigorous and sophisticated Arabic culture in North Africa brought trading opportunities for the growing Italian merchant class. It also offered the opportunity for Europeans to learn from Arab mathematicians who had preserved much ancient knowledge that had been lost in Europe since the fall of the Roman Empire hundreds of years earlier. Young Leonardos source of instruction was only a local schoolmaster, but that was apparently sufficient to provide him with a good background in mathematics and a love of the discipline.
when I had been introduced to the art of the Indians nine symbols through remarkable teaching, knowledge of the art very soon pleased me above all else and I came to understand it, for whatever was studied by the art in Egypt, Syria, Greece, Sicily and Provence [a region in France], in all its various forms.
Originally developed in India, this system of 10 numerals (including the essential placeholder, zero) greatly simplified calculation. In Liber Abaci, Leonardo publicized what came to be known as Arabic numerals: These are the nine figures of the Indians: 9, 8, 7, 6, 5, 4, 3, 2, 1. With these nine figures, and the sign 0 . . . any number may be written, as will be demonstrated. Because it used a system of places (tens, hundreds, and so on), the system was well suited to performing arithmetic by moving beads or counters, carrying one over to the left for each group of 10. This positional system (and its revolutionary use of a placeholder zero) took some getting used to. With his second edition of Liber Abaci in 1228, Leonardo made a substantial contribution to the gradual adoption of the new system, particularly by businesses, over the next two centuries.
Practical Mathematics
Leonardos book also introduced Europeans to a number of developments in Arab mathematics, including methods for solving simultaneous linear equations, where the value of a variable can be determined through its relationships to other variables. The wide-ranging Liber Abaci also included methods for solving practical business problems. For example, as businesses grew, it became important to keep track of all expenses in order to determine how much profit one was actually making in a given transaction. Leonardo provided procedures for calculating profits. Another common problem Leonardo dealt with was the conversion of one currency to another, an essential task at a time when pocket change might include coins from a dozen different nations or city-states. Similarly, systems of weights and measures were also
4 Mathematics
Number Theory
Leonardos book Liber Quadratorum (The book of squares) is his most important work in terms of pure mathematics. It deals pri-
marily with what today is called number theory, or the properties and patterns of numbers. In particular, Leonardo looked at square numbers (numbers such as 4 and 9 that are the product of a smaller
6 Mathematics
number multiplied by itself.) Leonardo presented a way to construct sets of square numbers called Pythagorean triples. Many people will remember from geometry class that the ancient Greek mathematician and mystic Pythagoras proved that in a triangle containing a right (90-degree) angle, the square of the length of the hypotenuse (the long diagonal side) is equal to the sum of the squares of the other two sides. A Pythagorean triple is simply a set of three numbers that have that same relationship (the first such triple is 3, 4, 5 since their squares are 9, 16, and 25, respectively). In Liber Quadratorum, Leonardo notes how he discovered the secret to constructing square numbers:
I thought about the origin of all square numbers and discovered that they arose from the regular ascent of odd numbers. For unity [one] is a square and from it is produced the first square, namely 1; adding 3 to this makes the second square, namely 4, whose root is 2; if to this sum is added a third odd number, namely 5, the third square will be produced, namely 9, whose root is 3; and so the sequence and series of square numbers always rise through the regular addition of odd numbers.
Leonardo also proved other number theorems, such as the impossibility of there being an X and Y such that both X 2 + Y2 and X 2 - Y2 are themselves squares.
Start with one pair of adult (breeding) rabbits. For the sake of argument, assume that each adult pair produces one pair of baby bunnies each month. The babies take one month to reach breeding age. The resulting count of pairs of adult and baby rabbits turns out to match the Fibonacci series.
8 Mathematics
Although this number series was apparently known in India since around the ninth century, Leonardo placed it in a larger context and publicized it in the wider mathematical world.
moves, getting progressively larger, following a fixed ratio. This same structure can be seen in starfish, sand dollars, and even many types of spiderwebs. (While not all such structures yield Fibonacci numbered ratios, many do.)
10 Mathematics
The golden ratio (denoted by the Greek letter ) seems to be aesthetically and psychologically pleasing. Here it shows up in several parts of the Parthenon of ancient Greece.
cated classical and contemporary music uses a chromatic (13-note) scale (5, 8, and 13 are of course Fibonacci numbers).
An Inner Harmony?
In the late 19th century, Gustav Fechner, a German psychologist, measured many rectangles found in common signs, labels, and other uses. The majority of them approximated the golden ratio. Fechner also tested the reactions of hundreds of people to golden and random rectangles and found a strong preference for the former. Modern designers of signs, labels, and even Web sites have taken note. Why do people prefer the golden ratio and golden rectangle? Perhaps it is because they see so much of it in nature that it feels comfortable and natural. It could be that the nervous system is somehow hard-wired to respond favorably to such ratios. Much
PARALLELS: MATHEMATICS
AND
GREEK PHILOSOPHY
The discovery of number patterns and geometric ratios in nature would not have surprised ancient Greek thinkers such as Pythagoras and Plato. Pythagoras (582 B.C.507 B.C.) founded a school of mystical philosophy based on his idea that every aspect of nature was based on mathematics. Indeed, to the Pythagoreans, it was mathematics that was the true reality. Nature was perceived as simply a reflection and approximation of mathematical truth. As a young man, Pythagoras went to Egypt, where he probably learned some of the basic principles of geometry on which he would build conclusions such as the famous Pythagorean theorem, which states that in a right triangle the square of the length of the hypotenuse is equal to the sum of the squares of the other two sides. When Pythagoras returned to the Greek city of Crotone and founded his school, his students called themselves mathematikoi (disciples), from which the word mathematics is derived. The Pythagoreans mixed their mathematical knowledge with meditation, arcane rituals, and strange prohibitions (such as not eating beans, which they believed contained tiny human embryos). The Pythagoreans also placed much value on music, having discovered the relationship between musical intervals and the ratios between whole numbers. The Greek philosopher Plato (c. 427 B.C.347 B.C.) was likely influenced by the ideas of Pythagoras. Just as Pythagoras taught that true reality was mathematical, Plato distinguished between perfect ideas and their imperfect realization in the perceived forms in nature. This type of philosophy is sometimes called dualism because of its division between the thinking intellect and the sensing body. By his exploration of numeric series and his conscious application of the golden ratio, Leonardo of Pisa helped point European thinkers toward the Pythagorean and Platonic idea that mathematics underlay the structures of nature and human artifice. However, while many of the ancient Greek thinkers believed that mathematics was to be pursued only within the mind (with the minimal assistance of a few geometrical tools), in the centuries following Leonardo of Pisa, scientists would begin to marry mathematics to a systematic process of observing the details of natural phenomena.
12 Mathematics
research remains to be done, but it is clear that ancient architects and medieval mathematicians such as Leonardo of Pisa recognized the power of numbers and their relationships to describe nature to enhance art and architecture.
Leonardos Legacy
Leonardo of Pisa, the Fibonacci numbers, and the golden ratios were a sort of mathematical bridge from ancient times to the modern world. Although little is known of the details of the life of this mathematical pioneer, the circulation of his writings helped foster a new interest in both mathematics and the observation and exploration of nature. This curiosity about the structures of the world (including the human world) would define the period called the Renaissance (roughly, the 14th and 15th centuries, beginning in Italy and spreading throughout Europe and England). The structural beauty and explanatory power of mathematics would play a key role in the evolution of new understanding in art, architecture, engineering, the physical sciences, and medicine. The simple patterns and ratios found by Leonardo of Pisa were only a taste of mathematical realms to come.
Chronology
582 B.C. 507 B.C. 427 B.C. 347 B.C. Pythagoras founds a school of mathematics and mystical philosophy based on the idea that true reality is embodied in numbers The philosopher Plato bases his dualistic philosophy on the distinction between perfect ideas, akin to geometrical gures, and their imperfect forms, as perceived in the world The Greek Parthenon, built at about this time, embodies the geometrical golden ratio 780850 The Persian mathematician al-Khwarizmi introduces Indian numerals into the Islamic world and develops algebra (named for one of his works)
Approximate birth date of Leonardo in Pisa, Italy Leonardo travels with his father to Algeria, where he is tutored in Arabic mathematics by a schoolmaster Having returned to Italy, Leonardo publishes Liber Abaci, introducing Indian numerals (now called Arabic numerals) to Europe Leonardo publishes Liber Quadratorum, the rst major European work in number theory Leonardo publishes a second, expanded edition of Liber Abaci Approximate death date of Leonardo of Pisa
1300s and The Renaissance brings mathematics into art, architecture, and 1400s the beginnings of modern science
Further Reading
Books
Garland, Trudi Hammel. Fascinating Fibonaccis: Mystery and Magic in Numbers. Parsippany, N.J.: Dale Seymour Publications (Pearson Learning Group), 1987.
A very accessible and well-illustrated account of many aspects of Fibonacci numbers.
Gies, Joseph, and Frances Gies. Leonard of Pisa and the New Mathematics of the Middle Ages. Gainesville, Ga.: New Classics Library, 1983.
Describes the life and work of Leonardo of Pisa and its influence on the development of Western mathematics.
Livio, Mario. The Golden Ratio: The Story of Phi, the Worlds Most Astonishing Number. New York: Broadway Books, 2003.
An engaging account of the discovery and prolific appearances of phi, the golden ratio in nature, architecture, and symbolism.
14 Mathematics
Articles
OConnor, J.J., and E. F. Robertson. Arabic Mathematics: Forgotten Brilliance? University of St. Andrews, Scotland. School of Mathematics and Statistics. Available online. URL: http://www. history.mcs.st-andrews.ac.uk/HistTopics/Arabic_mathematics. html. Posted in January 2004.
Describes Arabic mathematicians and their work from the eighth to the 15th centuries.
Web Sites
Fibonacci Association. Available online. URL: http://www.mscs.dal. ca/Fibonacci. Accessed on July 24, 2006.
Provides links to background and research on Fibonacci numbers and related math.
Fibonacci Numbers and the Golden Section. Dr. Ron Knott. Available online. URL: http://www.mcs.surrey.ac.uk/Personal/ R.Knott/Fibonacci/fib.html. Accessed July 2, 2006.
An award-winning Web site with numerous links to explanations, illustrations, applications, and puzzles involving Fibonacci numbers and phi (the golden section).
2
TOOLS FOR PATTERNFINDERS
KARL PEARSON AND STATISTICS
ccording to a biographical sketch by Helen M. Walker, the first thing Karl Pearson recalled from his early childhood was someone telling him that he better stop sucking his thumb or it would wither away. Sitting in his high chair, little Karl put his thumbs alongside each other and studied them carefully. He concluded that the thumb he had been sucking was no shorter than its companion. The boy decided that the evidence did not support the adults claim. Karl Pearson would grow up to become one of the founders of modern statistics, the tool scientists use to determine the significance of observations and experiments.
A Roving Mind
Karl Pearson was born in London, England, on March 27, 1857. His father, William, was a barrister (attorney), and the family was relatively prosperous. Pearsons father was a fierce believer in the power of education, urging Karl and his older brother Arthur to study hard, saying that it was the only sure road to success later in life. However, William and his wife, Fanny, had a stormy relationship, with the boys taking the side of their more vulnerable mother.
15
16 Mathematics
Young Pearson was a bright student, though his health was delicate. As a teenager, he spent a lonely season in a country school where he had been sent to be prepared for university. In 1875, however, Pearson had the opportunity to study with E. J. Routh, one of the foremost mathematical coaches of the day. Pearson was not well prepared for tutoring by someone who normally taught advanced college students, but he did acquire from Routh an interest in the mathematics of elasticity, a topic in physics that would prove to be Pearsons main mathematical interest until he Karl Pearson developed many of became involved with statistics. the basic statistical methods used Although he failed the entrance in modern physical and social sciexam for Trinity College at ence. However, his involvement in Cambridge University, Pearson perthe eugenics movement was consevered and won admission to the troversial. ( Topham/Fotomas/The Image Works) universitys Kings College, his second choice. There Pearson majored in mathematics and came in third highest in the arduous series of examinations called the Tripos. However, Kings College actually featured literature and the humanities more than math and science, and Pearson became increasingly interested in philosophyparticularly German philosophy. Pearsons academic performance resulted in a fellowship to pay for further studies in Germany, but he did not limit his interests to mathematics. Besides qualifying to practice law in 1881, Pearson also studied physics, biology, history, classic German literature, art, social and political science, and philosophy. He also encountered the work of Karl Marx, whose economic theories impressed Pearson so much that he changed his first name from Carl to Karl. All in all, Pearsons wide-ranging intellect showed him to be a renaissance
person whose curiosity was accompanied by the discipline needed to master one field after another. After returning to London with his doctorate, the enthusiastic Pearson organized a Young Mens and Womens Discussion Club. Rather like the fashionable intellectual salons of Paris, the club allowed young men and women to discuss the political and philosophical issues of the day without being hindered by the chaperones upon which the Victorian Age usually insisted. Pearson lectured on topics ranging from Martin Luther to the philosophy of Spinoza to the socialism of Karl Marx. Pearson also benefited from the salons abundant social opportunities; through the salon, he met and married his wife, Maria Sharpe, in 1890. Pearsons broad foundations in the humanities as well as science would also be seen in his varied writings. He wrote a novel, a play, and a number of essays that appeared in collections with titles such as Ethic of Freethought (1888) and Chances of Death and Other Studies of Evolution (1897).
18 Mathematics
orderly classification of facts followed by the recognition of their relationship and recurring sequences. Pearsons Grammar of Science would inspire many young scientists and students of scientific method in the first half of the 20th century. However, the book was rather shocking at a time when much of science involved citing and giving great respect to past authorities. In 1915, Russian student and future statistician Jerzy Neyman and his fellow students were reading Pearsons book in translation. As recounted in an article by Richard Williams, Neyman recalled that
Standard deviation is a key concept in modern statistics. It measures the dispersion or consistency of data or measurements. In the normal distribution or bell curve, about 95 percent of data will fall within two standard deviations of the mean.
The reading of The Grammar of Science was striking because . . . it attacked in an uncompromising manner all sorts of authorities. . . . At the first reading it was this aspect that struck us. What could it mean? We had been unused to this tone in any scientific book. Was the work . . . [something of a hoax] and the author a . . . [scoundrel] on a grand scale?
Pearsons focus on scientific method would also shape his later mathematical work. The process of finding and testing patterns and relationships is a statisticians job. As a mathematician, Pearson would develop some of the most important tools used by statisticians in every field of science and technology today.
Statistical Tools
Although Pearsons interests were many and varied, he gradually began to focus on the mathematical approach to biology and, particularly, to evolution and the emerging science of genetics. Over the course of his career, he would write more than 300 publications.
20 Mathematics
Of these, his 18 papers for the Transactions of the Royal Society on various aspects of Mathematical Contributions to the Theory of Evolution would contain Pearsons most important contributions to statistical methodology. Galton and other pioneer statisticians had begun to discover that there were often patterns in how (and how much) measurements varied. As scientific experiments became more elaborate (and observations in the biological and social sciences became more extensive), it was increasingly important to determine just how much one could learn from those experiments and measurements. Unlike the ideal world of mathematical plotting, the real world was filled with measurements that might be approximations of the true value or freakish outliers that might have to be discarded. Pearson developed a way to plot curves that expressed the probability that a given value might turn up in a measurement. Put another way, he developed a way to bridge between ideal and reality, showing the pattern within the seeming randomness of even the most careful measurements. Pearson was thus able to measure the measurements. In doing so, he was able to determine four key parameters: The mean, or the central or most common value around which all the others scatter (this is the fattest part of the bell curve) The standard deviation, or a measurement of the degree to which measurements scatter at various distances from the mean The amount of symmetry, or the degree to which measurements are either evenly distributed or tend to pile up on one side or the other of the mean Kurtosis, or the distance of the occasional far-off outliers from the mean While later researchers found that there were limitations to Pearsons system and a number of situations to which it could not be applied, Pearsons analysis of distribution allowed for the development of the basic tools of modern statistics. In addition to studying the distribution of measurements, Pearson made a key contribution to the problem of determining how well the observed results of an experiment corresponded to the values predicted by theory. (This was an essential part of showing whether a given
experiment had yielded evidence for a particular theory or hypothesis.) Pearsons goodness of fit test became known as chi squared, from the Greek letter used as a symbol of the value. This and more sophisticated tests are what modern statisticians use in order to determine whether a result is significant and unlikely to be due to chance. In 1900, Pearson, together with Francis Galton and Walter Weldon, founded the journal Biometrika. This title consists of two Greek words: bios (life, as in biology) and metric, or measurement. The journals purpose was to promote the statistical study of biology, particularly evolution and heredity. However, the influence of this work would extend not only to the biological sciences but also to the physical and social sciences. Pearson realized that the statistical tools he was developing could be applied to any field involving observation and experimentation.
Pearsons correlation formula shows the relationship between variables. A value of 1 indicates perfect correlation (the variables rise or fall together). A value of -1 indicates inverse correlation (one goes up as the other goes down). Finally, a value of 0 would mean that there is no correlation at all between the variables in question.
22 Mathematics
Laboratory of National Eugenics. Eugenics (meaning good or happy birth) has a long but controversial history. By the early 20th century, Darwins theory of evolution had become well accepted by scientists. Darwins central idea was that
those members of a species who were best able to survive predators and environmental hazards would be the ones who reproduced, passing their characteristics on to the next generation. Although scientists of the time did not yet understand the biochemical basis of heredity (particularly the role of the DNA
OF
SCIENCE
In making measurements for their eugenics studies, Galton and Pearson tried to be very careful in evaluating evidence. Indeed, they established standards for significance that are still used routinely today. Nevertheless, their measurements were shaped by their theories about intelligence and other human capabilities, and many of these theories would be considered wrong or at least overly simplistic today. As practiced by Galton and Pearson, eugenics was intended to be a humane project that would lead to a steady improvement in the health, capabilities, and happiness of humankind. However, many of the assumptions used to judge human fitness were questionable. Further, the terms used to describe human characteristics tended to value qualities supposedly associated with Europeans over those identified with other racial groups. Beyond the issue of scientific validity, there was also the question of ethics and rights. Does any government or agency have the right to tell people whether or not they could have children? This question became far more than academic when policies encouraging birth control or even sterilization were applied to racial and ethnic minorities. Ultimately, the Nazis carried eugenics to a horrific conclusion through programs in which they forcibly sterilized the mentally and physically unfit, and then went on to so-called euthanasia and, ultimately, genocide. Scientific findings often become part of political discourse. When that happens, there are often claims that go well beyond what the scientific evidence may justify. At other times, however, strong scientific evidence may be ignored or minimized, as has been argued by critics of government policies toward global warming and climate change.
24 Mathematics
molecule), they did know that organisms carried genes that were associated with various characteristics (such as the color of the eyes or a pattern of fur). The little-known work of the monk Gregor Mendel on plant genetics had been rediscovered, allowing for basic calculations of the chance that a given characteristic of one or both parents would be passed to the offspring. Mathematical genetics was also accompanied by the experience of farmers and ranchers who had developed rough but useful methods for culling out defective plants or animals and trying to ensure that only the highest-quality ones were used for breeding. Darwin had shown that human beings, despite their unique intellectual achievements, were animals subject to the same laws of natural selection as other creatures. The founder of the science of eugenics, Francis Galton, and successors such as Pearson set out to measure precisely hundreds of peoples physical characteristics and to observe how they were transmitted from generation to generation. Where this attempt at a descriptive science became most controversial was when it was adopted as a form of social activism. Many eugenicists advocated policies such as screening people for inherited diseases or defects, encouraging so-called genetically superior people to procreate, while reducing the reproduction of so-called genetically inferior people through birth control or, in extreme cases, sterilization. Pearson believed that his role as a scientist was to try to determine the facts about human heredity, not to formulate social policy. He did not live to see the worst of the Nazi racist atrocities. However, toward the end of his life, Pearson did write a paper in which he demolished the idea of race as used by the Nazis and some of the more extreme eugenicists.
Later Life
In his later career, Pearsons prickly personality began to have a negative effect on the development of new statistical research. As editor of Biometrika, Pearson was the key gatekeeper who controlled access to publicity and thus to career advancement for young researchers. Pearson had strong opinions about what kinds of research were
worthwhile and who should get credit. As the science writer J. B. S. Haldane noted in a lecture about Pearsons work:
All power corrupts! It is impossible to be a professor in charge of an important department, and the editor of an important journal, without being somewhat corrupted. We can now see that in both capacities Pearson made mistakes. He rejected lines of research which later turned out to be fruitful. He used his own energy and that of his subordinates in research which turned out to be much less important than he believed.
Pearsons stultifying impact on the later development of statistics is perhaps most clearly seen in his relations with R. A. Fisher, one of the most prominent statisticians of the early 20th century. Despite the fact that Fisher had done much original work on topics that were close to Pearsons heart, the older scientist snubbed him. Finally, Pearson offered Fisher a post at the Galton Laboratory, but only on the condition that he could control the topics that Fisher researched and lectured on. When Fisher rejected the offer and separately published an important paper on the distribution and correlation of measurements, Pearson rashly rejected it. Later, he pressured the editors of The Journal of the Royal Statistical Society to reject another paper by Fisher. At the same time, Pearson could be polite and magnanimous when entertaining colleagues such as mathematician Jerzy Neyman. Pearsons harsh behavior seemed to arise only when he thought he was being challenged intellectually. As new researchers (including Pearsons son Egon) began to move into the forefront, Pearson began to slip out of the mainstream. He died in 1936, just a few years before computers would revolutionize the calculation and display of statistics. For many modern students, Pearson has been known only for chi squared and some footnotes for distribution formulas in textbooks. However, in recent years, there has been renewed interest in this paradoxical thinker. Biographers such as Theodore Porter have highlighted the complexities of a humanist and philosophical romantic who ended up spending his career in the world of measurements and formulas.
26 Mathematics
Chronology
1857 1879 1881 1882 Karl Pearson is born in London on March 27 Pearson graduates from Kings College, Cambridge, with high honors in mathematics Pearson completes his law studies and is admitted to the bar Pearson travels in Germany and studies a variety of subjects, including philosophy, physics, and German literature; he receives a masters degree Pearson becomes Professor of Applied Mathematics and Mechanics at University College, London Pearson begins work on biometrics, or statistical biology Pearson publishes The Grammar of Science Pearson is elected to the Royal Society Pearson, Francis Galton, and W. F. R. Weldon found the journal Biometrika to study biology and evolution using statistical methods Pearson establishes the Biometric Laboratory Pearson reconstitutes Galtons laboratory as the Francis Galton Laboratory of National Eugenices Pearson becomes Galton Professor of Eugenics, a post he will hold until his retirement Pearson retires Pearson dies on April 27
Further Reading
Books
Gigerenzer, Gerd [and others], eds. The Empire of Chance: How Probability Changed Science and Everyday Life. New York: Cambridge University Press, 1990.
Describes the revolution in science, technology, and society brought about by the understanding of probability and statistical methods.
Salsburg, David. The Lady Tasting Tea: How Statistics Revolutionized Science in the Twentieth Century. New York: W. H. Freeman, 2001.
Contains engaging biographical sketches and stories featuring the surprising implications of statistical techniques.
Articles
Aldrich, John. Karl Pearson: A Readers Guide. University of Southampton (UK). Available online. URL: http://www.economics.soton.ac.uk/staff/aldrich/kpreader.htm. Accessed on July 10, 2006.
A rich source of biographical and bibliographical information about Karl Pearson, his work, and his legacy.
Walker, Helen M. The Contributions of Karl Pearson. Journal of the American Statistical Association 53 (March 1958): 1122.
Assesses the significance of Pearsons work at the centennial of his birth.
Williams, Richard H. On the Intellectual Versatility of Karl Pearson. Human Nature Review 3 (May 14, 2003): 296301.
Describes both the remarkable range and power of Pearsons intellect and the personality flaws that had a destructive effect on the later development of research.
Web Sites
Karl Pearson: A Readers Guide. URL: http://www.economics.soton. ac.uk/staff/aldrich/kpreader.htm. Accessed on June 12, 2006.
A large collection of links to background material on Pearson and his statistical concepts, compiled by John Aldrich of the University of Southampton, England.
28 Mathematics
Sir Francis Galton F.R.S. 18221911. URL: http://galton.org. Accessed on July 21, 2006.
Presents overviews of Galtons work in statistics, genetics, psychology, and other areas.
Materials for the History of Statistics. The University of York. URL: http://www.york.ac.uk/depts/maths/histstat. Accessed on July 10, 2006.
Offers a variety of links to biographies and background ideas in statistics and general mathematics.
3
SURMISES AND SIMULATIONS
JOHN VON NEUMANN PUTS THE COMPUTER IN PLAY
y the 1930s, the field of mathematics had become in various ways disturbing, exciting, promising, and tumultuous. Mathematics had turned inward, in an attempt to discover its own limitations. Kurt Gdel, for example, had assigned special numbers to mathematical assertions and created a sort of algebra by which he could prove that any comprehensive mathematical system contained assertions that could not be proven using the rules of that system. Meanwhile, working independently, Alonzo Church and Alan Turing had developed the theory of computability, showing that a theoretical universal computer could in principle compute anything that could be computed. Computers, indeed, were on the way. And one of the first mathematicians to design them and embrace their possibilities was John von Neumann. Von Neumann would also make significant contributions in fields as diverse as pure logic, simulation, game theory, and quantum physics.
30 Mathematics
cultivated intellectual activity. (His original name was actually Jnos Lajos Neumann.) When he was six years old, von Neumann was already displaying genius-level performance in a number of areas. He could multiply or divide two eight-digit numbers in his head, and he evidently thought everyone else could too. According to numerous biographies, one day, when he saw his mother apparently staring off into space, von Neumann asked her, What are you calculating? The boys evident genius was not John von Neumann was a multilimited to mathematics. At about talented mathematician and pioneer computer scientist. Besides the same age that he was acting specifying the architecture of the as a human calculating machine, modern computer, von Neumann von Neumann was also conversing made important contributions to with his classically minded father quantum physics, game theory, in ancient Greek. His learning was and simulated automata. (LANL/ Photo Researchers, Inc.) aided by his photographic memory, and his reading was prodigious when he was eight, he began to read the familys 44-volume set of Universal History. Budapest was a good place for a young genius to grow up. By the turn of the 20th century, it had become a great center of science and culture. Von Neumanns biographer, Norman Macrae, suggests that the city was about to produce one of the most glittering single generations of scientists, writers, artists, musicians, and useful expatriate millionaires to come from one small community since the city-states of the Italian Renaissance. Such a place would provide ample stimulation for a boy who often seemed to be lost in a fascinating world of numbers and logic. Young von Neumann was also fortunate in that unlike other child geniuses such as Norbert Wiener, he was not put under constant parental pressure to master every subject quickly and perfectly.
Finding a Career
In 1911, von Neumann entered the Lutheran Gymnasium, essentially an elite college preparatory school. However, even there he was soon far ahead of his fellow students and even most of his teachers, doing math at the college graduate level. Despite the young mans prodigious talent in the field, von Neumanns father opposed his pursuing a career in pure mathematics. Therefore, when von Neumann entered the University of Berlin in 1921 and then the prestigious University of Technology in Zurich in 1923, he ended up with an undergraduate degree in chemical engineering, a field that offered secure professional employment. At the same time, von Neumann continued to pursue his first love, mathematics. After leaving Berlin but before enrolling at Zurich, he also enrolled at Budapest University as a candidate for a doctoral degree in mathematics. Amazingly, he managed to get near-perfect grades in his chemical engineering courses while working on his mathematics thesis in set theory and passing his final exams with highest honors, earning his Ph.D. in mathematics in 1926. He then served for several years as a private lecturer (a sort of unpaid associate professor) at Berlin and the University of Hamburg.
32 Mathematics
Since the 1920s, the physics of the atom had been a dramatic arena of scientific controversy. Competing mathematical descriptions of the behavior of atomic particles were being offered by Erwin Schrdingers wave equations and Werner Heisenbergs matrix approach. Von Neumann showed that the two theories were mathematically equivalent. His 1932 book, The Mathematical Foundations of Quantum Mechanics, remains a standard textbook to this day. Von Neumann also developed a new form of algebra, where rings of operators could be used to describe the kind of dimensional space encountered in quantum mechanics. Other early mathematical contributions by von Neumann included his 1925 doctoral thesis on a paradox in set theory. Bertrand Russell had proposed a famous paradox: Is the set of all sets that are not members of themselves a member of itself? Whether one says the set is a member of itself or that it is not, one ends up in a contradiction. Von Neumann, however, showed (in two different ways) that no mathematical set could be a member of itself, offering a way out of the paradox. Von Neumann was able to further develop this idea in relation to Kurt Gdels 1930 incompleteness theorem by suggesting that it also meant that a system of mathematical axioms could not be used to prove its own consistency.
By the late 1930s, von Neumann had also become involved in military consulting, particularly with regard to the physics and design of high explosives. When the Manhattan Project (the effort to build the first nuclear bomb) came along in the early 1940s von Neumann applied his knowledge to contribute to the design of the explosive lens, in which conventional explosives were used to compress the plutonium core of the bomb in order to create an almost instantaneous critical mass and resulting nuclear explosion. Von Neumann also calculated that having bombs (conventional or nuclear) burst above the ground would maximize their destructive force. Von Neumann then made early suggestions that helped lead to the development of the hydrogen bomb. He would later be criticized, because, unlike many other nuclear scientists of the time, he never expressed regret at the development of such weapons. The question of how much responsibility scientists have for the destructive use of their discoveries and inventions is a complex one. In a democracy, at least, it is the representatives of the people, not scientists themselves, who make the ultimate decisionbut how can a public that is ignorant of science and technology make good decisions about its use? Other scientists of the time, such as Norbert Wiener, a mathematical genius comparable to von Neumann, came to quite a different conclusion. These scientists eventually refused to do military-related work and instead used their writings to try to educate the public about what they saw as the danger of technology being controlled by people who did not understand or care about its devastating consequences. In 1954, von Neumann was appointed by President Dwight D. Eisenhower to join the Atomic Energy Commission, the body that would be in charge of controlling access to nuclear materials as well as developing a civilian nuclear power industry. In accepting the position, von Neumann did express the belief that scientists working in the nuclear field had a responsibility to help in the administration of that technology. Von Neumann also testified before Congress, urging that the government not confuse a technical opinion [of a scientist] with a political intention and to not remove vital security clearances from dissident scientists arbitrarily.
34 Mathematics
He considered a particular type of game or competition that was zero sum (that is, for every winner there was a loser) and in which both players knew all the possible strategies and their consequences. (In theory, this would be like a game of tic-tac-toe or, to an extent, a game of chess between two equally matched grandmasters). Von Neumann showed that, for this sort of competition, each player can find a minimax strategy that is guaranteed to minimize his or her losses regardless of the strategy chosen by the opponent. There is thus an optimal strategy that would be chosen by knowledgeable, rational players. Working together with mathematician Oskar Morgenstern, von Neumann later generalized the theory to allow for more than two players and to account for players not having complete information about possible strategies. Their 1944 book, The Theory of Games and Economic Behavior, essentially defined the modern field of game theory.
A key feature of von Neumanns architecture for the modern computer is the storing of programs in memory. This also allows programs to modify their own instructions.
A little later, von Neumann learned that two engineers at the University of Pennsylvania, J. Presper Eckert and John Mauchly, were working on a new kind of machinean electronic digital computer called ENIAC that used vacuum tubes for its switching and memory, making it about a thousand times faster than the Mark I. Although the first version of ENIAC had already been built by the time von Neumann came on board, he served as a consultant to the project at the University of Pennsylvanias Moore School.
36 Mathematics
meant, for example, that to program a loop for repeating instructions, an actual loop of tape would have to be mounted and run over and over. The electronic ENIAC was too fast for tape readers to keep up, so it had to be programmed by setting thousands of switches to store instructions and constant values. This tedious procedure meant that it was not practical to use the machine for anything other than massive problems that would run for many days. Von Neumann then contributed a key insight: The computers working memory should not only be used to store each batch of data needed during processing; it should also be used to store the program instructions themselves. With programs in memory, looping or other decision making could be accomplished simply by jumping from one memory location to another. All modern computers would therefore have two forms of memory: relatively fast memory for holding instructions and a slower form of storage that could hold large amounts of data and the results of processing. (In todays PCs, these functions are provided by the random access memory [RAM] and hard drive, respectively.) In general, von Neumann took the hybrid electronic and mechanical design of ENIAC and The U.S. Army built EDVAC as the next conceived of a design that generation of digital computer after the would be all-electronic in wartime ENIAC. Beginning operation in its internal operations and 1951, EDVAC embodied von Neumanns store data in the most natideas about computer architecture and processing. (U.S. Army) ural form possible for an
electronic machinebinary, with 1 and 0 representing the on-andoff switching states and, in memory, two possible marks indicated by magnetism, voltage levels, or some other phenomenon. This logical design would be consistent and largely independent of the particular type of hardware used, which would repeatedly change as computers went from vacuum tubes to transistors and integrated circuits. In his First Draft of a Report on the EDVAC (1945) and his more comprehensive Preliminary Discussion of the Logical Design of an Electronic Computing Instrument (1946), von Neumann would establish the basic architecture and design principles of the modern electronic digital computer. They would soon be used in successive computers that featured whimsical names such as MANIAC. Eckert and Mauchly and some of their supporters would later claim that they had already conceived of the idea of storing programs in memory, and in fact, they had already designed a form of internal memory called a mercury delay line. Whatever the truth in this assertion, the fact remains that von Neumann provided the comprehensive theoretical architecture for the modern computer, and it became known as the von Neumann architecture. Von Neumanns reports would be distributed widely and would guide the beginnings of computer science research in many parts of the world. Looking beyond the EDVAC project, von Neumann, together with Herman Goldstine and Arthur Burks, designed a new computer for the Institute for Advanced Study (IAS) that would embody the von Neumann principles. The IAS machines design would in turn lead to the development of research computers for the RAND Corporation, the Los Alamos National Laboratory, and in several countries, including Australia, Israel, and even the Soviet Union. The design would eventually be commercialized by IBM in the form of the IBM 701. In his later years, von Neumann would continue to explore the theory of computing. He studied ways to design computers that could automatically maintain reliability despite the loss of certain components.
38 Mathematics
grow, and even reproduce. If so, von Neumann argued, one might have to call such a machine alive. In one of his lectures, he described the machine in terms of a robot consisting of a small number of standardized parts:
I will introduce as elementary units neurons, a muscle, entities which make and cut fixed contacts, and entities which supply energy, all defined with about that degree of superficiality with which [the theory of neural networks] describes an actual neuron. If you describe muscles, connective tissues, disconnecting tissues, and means of providing metabolic energy . . . you probably wind up with something like 10 or 12 or 15 elementary parts.
Von Neumann decided that it would not be possible to build a real, functioning machine with the available technology. Instead, he designed a sort of virtual machine showing the kind of logic a machine might use to carry out its life processes. As he worked on it, the design grew more and more complicated. It became difficult to keep track of the activities of the machines hundreds of separate parts. Meanwhile, another great mathematician, Stanisaw Ulam, had been doing pioneering work in computer simulations. Ulam programmed sets of rules that the computer could use to draw patterns on a grid of squares. The patterns often turned out to be surprisingly complex and beautiful (one set of rules produced a delicate, coral-like growth from a single square). Ulam worked with von Neumann to translate his living machine concepts into a set of rules that could be used to manipulate patterns on the computer. Ulam and von Neumann hoped that one day they
A schematic for von Neumanns idea of a self-reproducing machine. It assumes that the machine receives its instructions by interacting with data on a very long tape. Following precise rules, the machine gradually builds a copy of itself from data cells in the simulated environment.
could at least simulate a living machine in the computer, leaving the actual construction of the machine to a future generation. Ulam put von Neumanns machine into a world that consisted of an endless grid of squares that he called cells. The cells would behave according to a set of rules that would determine their new state according to the conditions of their surrounding cells. For example, a cell that was surrounded by enough food cells might change from one state, where the cell is surviving but not growing, to another state, where one of its neighbors is added to the growing organism. Von Neumann further refined Ulams work. His final design for the living automaton was very complex. There were 200,000 cells that, like the cells in the human body, had different specialties (such as copying information, growing, or reproducing). Cells could have any one of 29 possible statesrepresented by different colors. Because of its use of many individual cells governed by
40 Mathematics
automatic rules, the simulated organism became known as a cellular automaton. Although von Neumann was able to prove mathematically that such an automaton would work (if the parts could actually be made), his health failed before he could develop the ideas further. However later researchers would develop many other types of cellular automata (see chapter 7, Games of Emergence and chapter 10, A New Kind of Science?).
A Difficult Fate
In many ways, John von Neumann was larger than life. In addition to his bold intellectual speculations and his dominating presence in academic politics, he enjoyed food, drink, and attending parties where ribald commentary was the order of the day. On February 8, 1957, however, von Neumann died of bone cancer, which had become excruciatingly painful and had spread to his brain. Von Neumann seems to have undergone a psychological and spiritual crisis in his last days as he faced death (which he viewed as an end to the exquisite possibilities of thought) and as he was robbed of the intellect that he had so highly prized. Von Neumann received many awards reflecting his diverse contributions to American science and technology. These include the Distinguished Civilian Service Award (1947), the Presidential Medal of Freedom (1956), and the Enrico Fermi Award (1956). To some critics of cold-war nuclear policy, von Neumann was at least a partial accomplice in the unleashing of the nuclear demon. However, mathematicians and physicists continue to turn to him as an example of creative, original ideas. For computer scientists, von Neumann was perhaps the person who did the most to shape the design of the marvelous machines that sit today on so many desktopsand to introduce the computer as a universal tool for simulation.
Chronology
1903 John von Neumann is born on December 28 in Budapest, Hungary
Von Neumann enters high school but is soon doing collegelevel mathematics Von Neumann attends the University of Berlin to study chemical engineering Von Neumann moves to the University of Technology in Zurich and earns an undergraduate degree in chemical engineering Having periodically returned to Hungary to pursue his mathematics studies, von Neumann earns his doctorate in mathematics at the University of Budapest Von Neumann serves as a lecturer in Berlin and Hamburg Von Neumann becomes a professor of mathematical physics at Princeton University
192630 1931
42 Mathematics
Von Neumann and Oskar Morgenstern publish The Theory of Games and Economic Behavior Von Neumanns draft report on the EDVAC begins his design for the architecture of modern electronic digital computing Von Neumann begins his work on cellular automata Von Neumann is appointed to the United States Atomic Energy Commission Von Neumann dies on February 8 of bone cancer
Further Reading
Books
Aspray, William. John von Neumann and the Origins of Modern Computing. Cambridge, Mass.: MIT Press, 1990.
Describes the key ideas that von Neumann contributed to the architecture that is found in nearly all computers today.
Heims, S. J. John von Neumann and Norbert Wiener: From Mathematics to the Technologies of Life and Death. Cambridge, Mass.: MIT Press, 1980.
A study of how two geniuses were influenced by (and in turn dealt with) the implications of technology at the service of the militaryindustrial complex.
MacRae, Norman. John von Neumann: The Scientific Genius Who Pioneered the Modern Computer, Game Theory, Nuclear Deterrence, and Much More. 2nd ed. Providence, R.I.: American Mathematical Society, 1999.
A readable, detailed modern biography of von Neumann that includes previously unpublished information from interviews with colleagues.
von Neumann, John. The Computer and the Brain. New Haven, Conn.: Yale University Press, 1958.
Includes some of von Neumanns predictions about the future development of computers.
Articles
Lee, J. A. N. John Louis von Neumann Available online. URL: http://ei.cs.vt.edu/~history/VonNeumann.html. Accessed on July 3, 2006.
Biographical sketch focusing on von Neumanns contributions to computer design.
Ulam, Stanisaw. Tribute to John von Neumann. Bulletin of the American Mathematical Society 64 (May 1958): 149.
4
A DELICATE EQUILIBRIUM
JOHN NASH AND GAME THEORY
uring the 1970s, Princeton students would sometimes enter their classrooms in the morning to find that someone had filled the blackboard with a mysterious mixture of abstruse mathematical formulas and unknown codes. According to campus lore, there was a phantom who roamed the halls at night, sometimes shoving papers filled with numerological calculations under a professors office door. Unknown to the students (and even most of the faculty), the phantom was a mathematician named John Forbes Nash. Two decades earlier, Nash had revolutionized the understanding of how players in a gameor participants in a business transaction or a labor conflictformulate strategies and reach a particular result. This game theory was now revolutionizing economics, but its originator was lost in a world of delusion, painfully groping for a way back to the life he had known as one of the worlds great mathematical thinkers.
A Different Child
John Nash was born on June 13, 1928, in the Appalachian town of Bluefield, West Virginia. His father (of the same name) was an
44
A DELICATE EQUILIBRIUM 45
electrical engineer who worked for the local utility company, and his mother, Margaret, had been a schoolteacher. Both parents were intelligent, disciplined, and energetic. As Nash noted in his Nobel Prize autobiography, Bluefield, a small city in a comparatively remote geographical location in the Appalachians, was not a community of scholars or of high technology. However, the town had become an important regional business center. The local schools could be described as sound but limited in their curricula. Young Nash, John Forbes Nash blazed like a however, did have access in his meteor in the mathematical sky of parents and grandparents homes the 1950s, particularly in his discovto a good encyclopedia and some ery of the Nash equilibrium in game theory. Nash then descended into a other books of interest. He was decades-long struggle with schizoalso tutored by his mother, an phrenia, gradually emerging and experienced teacher who took a sharing the Nobel Prize in economlively interest in his education all ics in 1994. (Photo by Fred Prouser, the way through high school. That Reuters/CORBIS) interest was shared by Nashs father, who answered his numerous questions but also handed him science books. In school, however, young Nash was socially awkward and tended to ignore the rules, regularly earning bad marks for deportment. He could not wait to go home, where he had turned his room into a laboratory. He tinkered with radios and other electrical gadgets and did chemistry experiments. The latter eventually became rather dangerous, as he and two other boys turned to making and detonating various sorts of explosives. Nash later recalled in the PBS documentary A Brilliant Madness that
46 Mathematics
One time, somebody suggested that I was a prodigy. Another time it was suggested that I should be called bug brains because I had ideas, but they were sort of buggy or not perfectly sound.
Nashs parents tried to make him well rounded by enrolling him in activities such as Boy Scout camp, Sunday Bible classes, a dancing school, and a youth club. They even enlisted Nashs younger sister to try to get him involved with after-school social activities. Nash did not openly rebel against being forced to participate in these activities, but he endured them until he could return to his lab. When classmates made fun of the tall but awkward boy, he responded by demonstrating his intellectual superiority and, sometimes, by playing nasty practical jokes involving electricity. Years later, many of Nashs colleagues would encounter the same mixture of awkwardness and arrogance.
A DELICATE EQUILIBRIUM 47
Nashs excellent record brought him offers of graduate fellowships from both Harvard and Princeton. Nash decided on the latter because it offered more generous terms and because Princeton was closer to the family home in Bluefield.
Life at Princeton
Nash stood out sharply from the other students, often in uncomfortable ways. Mel Hausner, a colleague from Nashs Princeton days, recounts in the documentary A Brilliant Madness that
when John walked into the room you knew that John walked into the room. I think he thought of himself as superior, intellectually, mathematically superior. We thought highly of ourselves and each other, but with John it was double. John was just very clearly above it.
Nash frequently cut classes, claiming that what really counted was original work. He deliberately avoided learning what other people were doing about a particular problem. And he wanted to tackle only the toughest problems, the ones that had defeated the best mathematicians. On the other hand, Nashs undeniable brilliance and imagination greatly impressed many of the students. Games were very popular among the Princeton mathematics students. They played chess, Kriegspiel (a variant form of chess with hidden pieces), and an Asian strategy game called Go that was very popular. Shortly after Nashs arrival at Princeton, he invented and introduced a strategy game that came to be called Nash. The game was played on a rhombus-shaped board of hexagons with pairs of black and white sides, with the winner being the first player to play a row of stones from one of his sides to the other. (It turned out later that a Danish person named Piet Hein had independently invented the game a few years earlier and later marketed it under the name Hex.) Nash proved mathematically that on any size board the player with the first move could always win.
48 Mathematics
A payoff matrix in game theory shows the resulting score for each player based on the moves chosen by each. Here the matrix represents a version of the wellknown game Prisoners Dilemma. The Nash equilibrium for this game occurs when both players confess, giving each a sentence of two years.
A DELICATE EQUILIBRIUM 49
Extensive form is another way to diagram games in game theory. This treelike structure branches out for the possible combinations of moves by each player. (This diagram uses the same version of the Prisoners Dilemma as the preceding figure did.)
Zero sum games were relatively easy to describe because there was normally a winner and a loser. Nash wanted to consider games with more than two players and in which there were moves or strategies that were better or worsebut not necessarily producing a clear winner. In his first game theory paper, The Bargaining Problem, Nash looked at transactions, the fundamental basis of economics, where people make agreements to exchange money, goods, or services. Nash said the essential feature of bargaining is that two individuals [have] the opportunity to collaborate for mutual benefit in more than one way. The individuals may have different goals and expectations, and they will each offer terms to the other based on them. To be successful, both sides final demands have to be met from the total amount of utility (such as money or goods) available. Instead of starting with axioms and trying to derive a solution (the most common approach in traditional mathematics), Nash turned the process around. He defined the conditions that had to be satisfied by a successful bargain, formalized them mathematically, and then showed that there was a unique solution that maximized the utility value to both bargainers.
50 Mathematics
In the more general language of games, Nash showed that in a game each player will have a particular strategy that best counters the strategies chosen by all the other players. At this point, the game can be said to have reached equilibriumnow called a Nash equilibrium. Nashs mathematical proof that such an equilibrium must exist revolutionized game theory and made it suddenly applicable to many real-world economic situations. However, it would take many years before most economists realized the power of the tools they had been given. In part this was because not all mathematicians were interested in Nashs work in game theory, unlike his world-class proofs in algebraic geometry and differential equations. But in part the delay would come because in a few years Nash himself would virtually disappear from the mathematical scene.
Falling Short
Nash secured a position as an instructor at the Massachusetts Institute of Technology (MIT), but his abrasive personality worked against him. Besides having difficult relations with colleagues, Nash also had difficulty with intimate relationships. He met and dated a nurse named Eleanor Stier. When he discovered that she was pregnant with their child, Nash refused to support the baby or even pay for its delivery. Nash kept the affair secret, and his son John would grow up without any contact with his father for many years. Nash then became involved with 21-year-old Alicia LopezHarrison de Lard, a physics major and one of Nashs students. Alicia was attractive, exotic, and interested in a serious scientific career of her own. Nash and Lard were married in February 1957. As 1958 began, Nash seemed to be at the top of the world. Fortune magazine listed him as one of the brightest stars in the current mathematical firmament, and he had a wife who shared many of his interests. But Nash had just turned 30, and as biographer Sylvia Nasar noted, For a mathematician turning 30 is a lot like for a ballet dancer or an athlete. Age is your enemy. Always setting the highest hurdles for his race with himself, Nash decided that he had fallen short. After a decade of brilliant work, he had failed to win the prestigious Fields medal, pretty much the closest thing
A DELICATE EQUILIBRIUM 51
BUT
SO BRILLIANT
When biographers and interviewers asked Nashs MIT colleagues to recount their experiences with him, a number of adjectives kept popping up. In A Brilliant Madness, Felix Browder calls Nash [an] out and out and uninhibited and shameless elitist. Zipporah Levinson says that Nash was very brash, very boastful, very selfish, very egocentric. His colleagues did not like him especially, but they tolerated him because his mathematics were so brilliant. Indeed, Nash was viewed with awe. Donald Newman recalled that
I was thinking about a problem, trying to get somewhere with it, and I couldnt and I couldnt and I couldnt. And I went to sleep one night and I dreamt. I did not dream directly of the solution to that problem. Rather, I dreamt that I met Nash and I asked him the problem, and he told me the answer. When I did finally write the paper, I gave him credit. It was not my solution; I could not have done it myself.
mathematics had to a Nobel Prize. He tried to redouble his efforts by seeking to prove the Riemann Hypothesis, a fiendishly difficult conjecture about complex and prime numbers that remains unproven today.
Breakdown
Although a solution sometimes seemed tantalizingly close, Nash failed to prove the Riemann Hypothesis. His efforts left him physically exhausted and mentally depressed. Such conditions can precipitate a psychotic breakdown in a person who has certain underlying mental conditions such as schizophrenia. On New Years Eve 1958, Nash went to a costume party at the home of a colleague. He dressed as a baby, wearing a diaper. Although the baby is a traditional symbol of the New Year, Nashs actual behavior seemed even more eccentric and disturbing than usual. A few weeks later, Nash went into the MIT common room and announced that space aliens were sending him coded messages via the New York Times. The strange declarations continued: Nash
52 Mathematics
said that he was on the cover of Life magazine, disguised as Pope John XXIII23 being his favorite prime number. Nash then noticed that there were many men on the MIT campus who were wearing red tiesthey must be part of a communist conspiracy! The strange ideas seemed to come one after another, without seeming connection. One time Nash turned down a prestigious position offered by the University of Chicago because, as he explained, he was already scheduled to become emperor of Antarctica. The head of the math department, hoping that Nash was only having a temporary nervous breakdown, gave him a month off from teaching. Nash drove to Washington, D.C., and tried to deliver letters to various foreign governments by dropping them into embassy mail slots. Increasingly worried and even desperate, Alicia consulted with psychiatrists who advised that Nash be hospitalized. Nash was taken against his will to McClean Hospital, a private psychiatric facility outside of Boston. The doctors there diagnosed Nash as a paranoid schizophrenic, sedated him, and put him into psychoanalysis. Schizophrenia is a mental disorder whose cause is uncertain (although many researchers suspect an organic or biochemical origin). Even today, treatment and management of the condition is difficult, although a variety of medications can help control symptoms. Some patients gradually improve or even completely recover.
In the Shadowlands
After 50 days, Nash was able to secure his release from the hospital. He went to Europe, eventually leaving Alicia and embarking on a surrealistic journey where he tried to dodge supposed communist and anticommunist plotters. After nine months, American embassy officials were able to have Nash deported and returned to the United States. Nashs condition failed to improve. The next time he was hospitalized, it was in Trenton State Hospital in New Jersey, where conditions were much less comfortable than they had been at the private facility. Doctors there treated Nash with insulin shock therapy, a controversial attempt to reset the metabolic foundation of the brain that had already been abandoned by many hospitals by that time.
A DELICATE EQUILIBRIUM 53
CONNECTIONS: MATH
AND
MADNESS?
It has long been a common belief that people who engage in high-level intellectual work are at higher risk of mental illness. The 17th-century poet John Dryden put it this way in his poem Absalom and Achitophel
Great wits are sure to madness near allied, And thin partitions do their bounds divide.
Anecdotally, some evidence for this assertion is reflected in stories of two world chess champions, Paul Morphy and Wilhelm Steinitz, who ended their careers in the mental asylum, not to mention the erratic trajectory of Bobby Fischer. Of course, popular culture has contributed the stereotypical image of the cackling mad scientistperhaps the closest real-life example being the electrical wizard Nikola Tesla. Among mathematicians, perhaps the best known for psychological problems is Georg Cantor, the German mathematician who pioneered set theory and showed that there was more than one kind of infinity. Cantor suffered from recurring bouts of depression in his later years. But while a number of mathematicians (such as Paul Erdos) are known for their eccentricity, there seems to be little evidence that mathematicians are more prone to madness than other types of intellectuals. A recent study by Connie M. Strong and Terence A. Ketter of Stanford University suggests that one particular form of mental illness called bipolar disorder (which is characterized by extreme mood swings) may involve certain traits such as openness and imaginativeness that are also shared by creative people such as the best mathematicians. John Nash, however, suffered from schizophrenia, a different condition. Nashs mathematical skill seemed to both serve and betray him in his battle with his illness. On the one hand, his skill may have initially strengthened his sense of identity and mental coherence, staving off his first schizophrenic break. When Nash did have a breakdown and suffered delusions, however, mathematics, in the form of numerology, served to buttress his elaborate conspiracy theories. Finally, though, Nash turned his mathematical logic against his delusions, apparently weaning himself from them by revealing their inconsistencies.
54 Mathematics
Again, the pattern of seeming improvement was followed by a new bout of delusion. Feeling she could no longer cope with Nashs condition, Alicia filed for divorce in 1962.
Nobel Triumph
As the 1990s began and word of Nashs recovery was spreading, the Nobel committee made its decision. On December 10, 1994,
A DELICATE EQUILIBRIUM 55
Nash, now 66 years old, received the Nobel Prize in economics in Stockholm, sharing it with two other game theoreticians. In 2001, Nash and Alicia were remarried. Today Nash has returned to MIT to work in mathematics. That same year, the film A Beautiful Mind, loosely based on Sylvia Nasars 1998 biography of Nash, introduced the mathematicians strange life and poignant struggle to the general public. Although the film movingly portrayed Nashs battle with mental illness, it oversimplified or omitted many details and had difficulty conveying the nature and significance of Nashs work. In his Nobel autobiography, Nash seems to suggest that some aspect of his creativity might have been left behind along with his madness:
At the present time I seem to be thinking again in the style that is characteristic of scientists. However this is not entirely a matter of joy as if someone returned from physical disability to good physical health. One aspect of this is that rationality of thought imposes a limit on a persons concept of his relation to the cosmos.
Nash also acknowledged that, being 66 years old (at the time), it was perhaps unlikely that he would be able to add another major mathematical discovery to his achievements. Still, he suggested that perhaps the decades of partially deluded thinking might have provided a sort of vacation for his brain. In recent years, Nash has undertaken a project to develop computer programs to perform calculations based on his work in game theory. One of the tools he is using is Steven Wolframs program Mathematica (see chapter 10, A New Kind of Science). Regardless of what the future might bring for Nash, his legacy is secure. Nashs work, by revealing the dynamics of competition, has also given negotiators and even rivals the ability to find the best solutionthe equilibrium where each player can feel that he or she has gotten the best practicable result. And Nashs struggle to restore his own inner equilibrium represents an inspiring victory over the destructive forces of irrationality.
56 Mathematics
Chronology
1928 1940 1948 1950 John Forbes Nash is born on June 13 in Blueeld, West Virginia The brilliant but socially awkward young Nash performs scientic experiments in his room at home Nash receives simultaneous bachelors and masters degrees from the Carnegie Institute of Technology Nash earns his Ph.D. in mathematics at Princeton University and joins the MIT faculty Nashs doctoral dissertation on noncooperative games introduces what will be called the Nash equilibrium; he develops further work on game theory in his paper The Bargaining Problem 1952 1953 1957 1959 1960s Nash makes a signicant contribution to algebraic geometry with his paper Real Algebraic Manifolds Nash publishes his paper Two-Person Cooperative Games Nash marries Alicia Lopez-Harrison de Lard, a physics student from El Salvador Nash is admitted to a mental hospital and is diagnosed with paranoid schizophrenia Nash undergoes periodic psychiatric treatments, including insulin shock therapy Nash becomes the phantom of Fine Hall at Princeton, writing complex equations on classroom blackboards at night 1970s 1980s Nash begins to emerge from mental illness, working on computer programs at Princeton and making contacts Late in the decade, Nash begins to do new original mathematical work Some mathematicians begin to lobby the Nobel Prize committee to recognize Nashs work
A DELICATE EQUILIBRIUM 57
1994 2001
Nash receives the Nobel Prize in economics Nash and Alicia remarry; the lm version of A Beautiful Mind popularizes Nashs story of recovery from mental illness
Further Reading
Books
Nasar, Sylvia. A Beautiful Mind. New York: Simon & Schuster, 1998.
A vivid and moving biography of John Nash, including many anecdotes and recollections of colleagues.
Nash, John. The Essential John Nash. Princeton, N.J.: Princeton University Press, 2002.
Contains Nashs Nobel Prize autobiography and his most important papers, as well as a description of his game of Nash (Hex) and an afterword.
Articles
Nash, John F. John F. Nash, Jr.: Autobiography. Nobelprize. org. Available online. URL: http://nobelprize.org/nobel_prizes/ economics/laureates/1994/nash-autobio.html. Accessed on July 15, 2006.
Official autobiography by Nash for his 1994 Nobel Prize in economics.
Web Sites
A Beautiful Mind. URL: http://www.abeautifulmind.com. Accessed on June 10, 2006.
The Web site for the Hollywood film on Nashs life starring Russell Crow and directed by Ron Howard. Includes background materials and interactive activities.
A Brilliant Madness. PBS. URL: http://www.pbs.org/wgbh/amex/ nash. Accessed on July 16, 2006.
Web site for a PBS documentary that conveys a more accurate account of Nashs life than is found in the movie A Beautiful Mind.
5
ENDLESS STRUCTURE
BENOT MANDELBROT OPENS THE FRACTAL PORTAL
he remarkable story of a new kind of geometry begins with a deceptively simple question: How long is the coastline of England? Get a map, note the scale, and try to get an approximate measurement with a ruler. Get a map with a smaller scale, try again, and get a still larger number. Fly along the coast and do a photographic aerial survey, and the ins and outs of shoals and shores become even longer. Finally, go to the beach and start measuring at a human scale. It turns out that whether it is England or California, coastlines are just one of many things that have a peculiar property. There is no end to the levels of detail as one zooms in. The length of a coastline turns out to be infinite, at least until one gets down to the atomic level. The mathematics that describes such infinitely detailed objects is called fractal geometry. In discovering this new geometry, with its endless layers of similar but unique patterns, Benot Mandelbrot found the hidden order inside the seeming chaos of nature.
ENDLESS STRUCTURE 59
The boy was taught at home for his first years because his mother was afraid of epidemics. He quickly mastered reading and also showed himself to be a strong chess player, winning the championship for his age group. In 1936, when young Mandelbrot was 12 years old and Hitler was beginning to threaten Europe, the family moved to Paris. The boys uncle Szolem Mandelbrojt taught mathematics as a university professor, and the youngster thus met many mathematicians and heard plenty of mathematical talk. Young Mandelbrot became especially Benot Mandelbrot is shown interested in geometry. His uncle, against a background of fractals, who worked in advanced analysis the endlessly unfolding structures (calculus), did not approve of this that he made famous. (Hank interest. He shared the opinion of Morgan/Photo Researchers, Inc.) many mathematicians of the time that geometry had reached a dead end and was suitable only for beginning students. In September 1939, Germany started World War II by invading Poland. The next spring the Germans invaded and quickly occupied much of France, including Paris. The Mandelbrot family moved into the French countryside and had to move again frequently to avoid the Nazi police. It was thus impossible for Mandelbrot to attend any sort of regular school. As he recalled in an interview in Mathematical People,
For awhile, I was moving around with a younger brother, toting around a few obsolete books and learning things my way, guessing a number of things myself, doing nothing in any rational or even half-reasonable way, and acquiring a great deal of independence and self-confidence.
60 Mathematics
Young Mandelbrot was aided in his self-directed study by his memory for shapes and his ability to recognize patterns. He later noted that
Faced with some complicated integral [in calculus], I instantly related it to a familiar shape . . . I knew an army of shapes that Id encountered once in some book or some problem, and remembered forever with their properties and their peculiarities.
ENDLESS STRUCTURE 61
of the cultural atmosphere to read widely in many different subjects and to listen to classical music. Mandelbrots career took a brief turn toward practicality. He went to the California Institute of Technology (Caltech) in Pasadena and earned masters and professional degrees in aeronautical engineering. Returning to France, he joined the French air force for a year, then returned to academic studies in Paris. In 1952, Mandelbrot received his Ph.D. from the University of Paris. His doctoral thesis, Mathematical Theories of Games of Communication, brought together ideas from thermodynamics, cybernetics (the science of communication and control pioneered by Norbert Wiener), and the game theory of John von Neumann. Mandelbrot said later that the thesis was poorly written and badly organized, but it included an idea that would be very important in his later workstructures that replicated themselves over and over again on smaller and smaller scales, such as a tree with a trunk, branches, and twigs. During 1953 and 1954, Mandelbrot continued his mathematical explorations by being sponsored by John von Neumann for a fellowship at the Institute for Advanced Studies at Princeton, the home of many of Europes mathematical refugees. There he first encountered another key idea that would greatly figure in his later work: the so-called Hausdorff-Besicovitch dimension, where a sort of mathematical perspective reveals two-dimensional motion around a one-dimensional line. (The particular example he studied was the tiny but frenetic Brownian motion of molecules in a fluid.) In 1955, Mandelbrot returned to Europe, teaching in Geneva, Switzerland, and Lille, France.
Mysterious Clumps
The work that would finally bring together all of Mandelbrots interests began in 1958, when he accepted an open-ended position in the research department of IBM. IBM was becoming the leader of the computer industry, and it, like Bell Telephone, had a policy of giving selected cutting-edge scientists some money and a laboratory and turning them loose to pursue their interests. Although the
62 Mathematics
work they funded often had no immediate or direct connection with computers or telephones, such research often ended up resulting in important technical advances. In 1961, IBM asked Mandelbrot to analyze mysterious noise that was causing problems in telephone circuits. IBM thought that the noise might be caused by workmens tools as they made repairs to the system. However, Mandelbrot realized that the noise had a peculiar structure similar to the paths of Brownian motion. There were big bursts of noise that when analyzed more closely proved to consist of a clump of smaller bursts. The noise was inherent in the structure of the circuits themselves. Based on Mandelbrots work, IBM canceled an expensive but futile antinoise project. Meanwhile, Mandelbrot had turned to studying noise or seemingly random values in other types of data. Although he had no background in the field, Mandelbrot realized that economics is a good source of random data because there were often records of prices that went back hundreds of years. Most economists believed that the price of a commodity (such as cotton) usually moved in two ways. One kind of move had some reasonable cause, such as bad weather reducing the amount of the product available and increasing the price. The other kind of movement seemed to be erratic or randomthe prices jiggled up and down by small amounts from hour to hour or day to day. Economists had assumed that if the random price fluctuations were plotted on a graph, they would form the well-known bell curve pattern (see chapter 2, Tools for Pattern-Finders). When a class is graded on a curve, there are only a few As and Fs, more Bs and Ds, and the largest group of grades are Cs. The curve bulges in the middle at C and tapers off as you move toward the F or A ends. In other words, Mandelbrot expected that most prices would hover near the average value. Mandelbrot had been invited by Hendrick Houthakker, a Harvard economics professor, to give a talk to his students. When Mandelbrot arrived at Houthakkers office, the graph he saw on the blackboard there looked strangely familiar. Mandelbrot had been graphing the distribution of incomes in a group of people. He had been finding that the incomes did not fall neatly into a bell curve. They tended to make a longer, flatter curve with clumps of incomes
ENDLESS STRUCTURE 63
Mandelbrot began his famous paper on fractals by asking, How long is the coastline of England? The map shows a first approximation developed by placing sticks of a fixed length along the edges. However, any region of the coast can be blown up and remeasured. Mandelbrot showed that coastlines are fractal structures that are actually infinitely long!
64 Mathematics
scattered throughout. Houthakkers graph looked very similar although it turned out to represent not incomes but cotton prices.
(See chapter 6, The Richness of the Random, for a different path to this discovery.) The erratic behavior that had showed up in incomes and cotton prices had also appeared in physics in Brownian motion and other forms of behavior of fluids and gasesand in Mandelbrots earlier work with the telephone circuits. In geometry, it showed up in patterns that were made of tiny clumps that were distributed seemingly randomly. The patterns lacked the neatness of the straight lines and smooth curves of Euclidean geometry, but the patterns were self-similar, that is, if one magnified the pattern, each part looked like a miniature copy of the whole. This could be done indefinitely, moving to a smaller and smaller scale. Mandelbrot used the word fractal (meaning fractured or broken up) to describe these geometric patterns.
ENDLESS STRUCTURE 65
The most intricate and beautiful discovery of Mandelbrots research was the object that came to be known as the Mandelbrot set. The first hints had been sketched by hand years earlier, based on the work of two early 20th-century French mathematicians: Gaston Julia and
This Mandelbrot set was generated using the program Fractint for Windows. A variety of software packages (many free) allow for generating and exploring fractals.
66 Mathematics
Shown above is a simple method of constructing fractal structures by repeatedly creating rectangles each a third the size of the previous level. In figure 2, the inner rectangles have been removed to reveal the structure.
Pierre Fatou. Mandelbrot had read their paper in his college days, when it represented only an obscure mathematical curiosity. Now the computer made it possible to see the actual realization of the mathematics that described a vast array of Julia sets. Mandelbrots program plotted on a grid similar to the Cartesian coordinates used in high school geometry, except it included complex numbers with their imaginary component. As the first crude version of his program ran, it created a symmetrical array of disks. However, after refining the program to calculate in finer increments, Mandelbrot seemed to see what appeared to be fuzzy clumps of tiny dots. At first he thought that there was a problem with the computers numeric routines, but when he got some time on a bigger IBM machine, the fuzzy dots, like a distant galaxy in a more powerful telescope, resolved into an intricate array of spiral tendrils! The Mandelbrot sets prickly spirals and glowing filaments (on a graphics screen) provide endless vistas at any level of detail. Yet the whole object results from the iterative, or repeated, solving of a single, not terribly difficult, equation. It is a child of the computer age, one of the first signs that the increasingly powerful machines
ENDLESS STRUCTURE 67
were making it possible to generate endless complex patterns from simple rules. By the 1980s, Mandelbrot had become a popular lecturer. Since introducing it in a 1967 paper, he often used the ever-unfolding zooming in on the coastline of Britain as an easy-to-grasp visualization of fractal geometry. The coastline is a fractal. Instead of having only one dimension (as a line on a map), it has a fractional dimension of about 1.2. Put another way, it stuffs many extra zigs and zags into its single dimension of space.
Finding Applications
Even as colorful fractal images began to be seen in the media, many scientists were slow to realize and accept the general applicability
CONNECTIONS: GENERATING
AND
APPLYING FRACTALS
Since the 1960s, many different types of fractals have been discovered. Each has an equation that generates a series of complex numbersnumbers that contain both normal values and imaginary numbers, such as the square root of 1. Imaginary numbers were developed in order to make the system of mathematics consistent and complete, but they turned out to also correspond to many natural phenomena. When Mandelbrot first started generating fractals, he had to use IBM mainframe computers that had to be fed with punch cards. Today any desktop PC can generate fractal images with ease and show them on the screen in full color. There are a variety of free or low-cost software programs that allow PC users to experiment with fractals on their own. More sophisticated programs (including filters for Adobe Photoshop) can generate fractals from images or textures. Because of their deep but constantly varying structure, fractals have often been used to generate terrain for science fiction movies and video games as well as in digital art.
68 Mathematics
of Mandelbrots ideas. After all, the existing statistical methods worked pretty well for most applications and resulted in neat and comprehensible charts and graphs. Fractals and chaos theory involved strange shapes and distributions that were determined yet unpredictableand a new kind of mathematics. People trained in classical geometry sometimes lacked Mandelbrots intuitive ability to make sense of strange-yet-familiar shapes.
ENDLESS STRUCTURE 69
By the 1970s, Mandelbrot and other researchers had applied their theories of fractal geometry and chaotic behavior to many aspects of nature. In biology, for example, fractals have been shown to be related to such things as the structure of a fern, the growth of bacterial cultures, and even the branchings of the human circulatory system. Astronomers found fractal structures in the rings of This head of Romanesco broccoli reveals a very clear fractal structure in three dimenSaturn and in clusters of sions. Note how each smaller level repeats galaxies. the same general type of structure. (Public Practical technologies domain photo, www.pdphoto.org) have also been based on fractals. Photos can be analyzed to distinguish natural from artificial structures, because the former have fractal structures. Fractal techniques can also be used to compress digital images by replacing repeated structures with appropriate formulas.
Popularizing Fractals
Mandelbrot made a considerable contribution to the popularization of fractals with his books Fractals: Form, Chance, and Dimension (1977) and The Fractal Geometry of Nature (1982), which included examples such as snowflakes, mountains, and of course, coastlines. In the latter book, Mandelbrot explained how he had persevered in his search for new phenomena:
I started looking in the trash cans of science for such phenomena, because I suspected that what I was observing was not an exception but perhaps very widespread. I attended lectures and looked in
70 Mathematics
OR
NECESSITY?
Mandelbrots efforts may have been hampered by what some other mathematicians saw as his egotism and interest in self-promotion. Some believed that by claiming his discovery to be revolutionary he was overreaching. (This would also be said of Stephen Wolfram; see chapter 10, A New Kind of Science.) In his book Chaos, science writer James Gleick suggests that Mandelbrot saw himself as an outsider in the mathematical world and perhaps insecure about his position:
Unquestionably, in his years as a professional heretic, he honed an appreciation for the tactics as well as the substance of scientific achievement. Sometimes when articles appeared using ideas from fractal geometry he would call or write the authors to complain that no reference was made to him or his book.
Gleick quotes Mandelbrots colleague David Mumfords admission that of course [Mandelbrot] is a bit of a megalomaniac, he has this terrible ego, but its beautiful stuff he does, so most people let him get away with it. But another colleague provides some justification for Mandelbrots behavior:
He had so many difficulties with his fellow mathematicians that simply in order to survive he had to develop this strategy of boosting his own ego. If he hadnt done that, if he hadnt been so convinced that he had the right visions, then he would never have succeeded.
In his entry for Whos Who, Mandelbrot provided his own justification:
Science would be ruined if (like sports) it were to put competition above everything else, and if it were to clarify the rules of competition by withdrawing entirely into narrowly defined specialties. The rare scholars who are nomads by choice are essential to the intellectual welfare of the settled disciplines.
ENDLESS STRUCTURE 71
unfashionable periodicals, most of them of little or no yield, but once in awhile finding some interesting things. In a way it was a naturalists approach, not a theoreticians approach. But my gamble paid off.
Achievements
As people working in different fields of science began to acknowledge the importance of Mandelbrots work, he received a number of awards (including the Barnard Medal in 1985) as well as being elected to the American Academy of Arts and Sciences (1982) and the National Academy of Sciences (1987). Mandelbrot retired from IBM in 1987, joining the mathematics faculty at Yale University. He retired from Yale in 2005 but later that year was appointed Battelle Fellow at the Pacific Northwest National Laboratory. In his later years, he received new honors, including the Wolf Prize for Physics (1993), the Japan Prize (2003), and the Einstein Lectureship of the American Mathematical Society (2006). Through his long career, Mandelbrot has continued to seek out new ways to apply fractal analysis to phenomena, both natural and economic. When considered as part of the larger context of chaos theory, there is much to justify Mandelbrots claims to have achieved a revolutionary breakthrough in understanding the dynamic world around us.
Chronology
1924 1936 1940 1944 1947 Benot Mandelbrot is born in Warsaw, Poland, on November 20 The threat of Nazism leads the Mandelbrot family to move to France Germany invades France; the Mandelbrot family becomes war refugees The Allies liberate France; Mandelbrot begins university studies Mandelbrot receives his bachelors degree in mathematics from the Polytechnique School of Paris
72 Mathematics
194748
Mandelbrot studies aeronautics at the California Institute of Technology in Pasadena and earns masters and professional degrees Mandelbrot returns to France and serves a year in the French air force Mandelbrot receives his doctorate from the University of Paris Mandelbrot visits the United States and is a fellow at the Institute for Advanced Study at Princeton University Mandelbrot becomes an IBM researcher and is given freedom to pursue wide-ranging mathematical interests Mandelbrot studies data in economics and discovers chaotic clumping patterns Mandelbrot coins the term fractal to describe his new kind of geometry Mandelbrot discovers the fractal that will become known as the Mandelbrot set Mandelbrots work becomes popular, and he wins numerous awards Mandelbrot publishes The Fractal Geometry of Nature Mandelbrot retires from IBM; he joins the mathematics faculty at Yale University Mandelbrot retires from Yale and becomes a fellow at the Pacic Northwest National Laboratory
1949 1952 195354 1958 196062 1975 1979 1980s 1982 1987 2005
Further Reading
Books
Albers, Donald J., and G. L. Alexanderson, eds. Mathematical People: Profiles and Interviews. Chicago: Contemporary Books, 1985.
Includes a chapter with background and an interview with Mandelbrot.
ENDLESS STRUCTURE 73
Gleick, James. Chaos: Making a New Science. New York: Penguin Books, 1987.
Has a chapter about Mandelbrots work, placing it in the larger setting of chaos theory, the branch of mathematics that finds patterns within apparently random phenomena.
Mandelbrot, Benot. The Fractal Geometry of Nature. San Francisco, Calif.: W. H. Freeman, 1982.
The more technical and comprehensive of Mandelbrots two books on fractals.
. Fractals: Form, Chance, and Dimension. San Francisco, Calif.: W. H. Freeman, 1977.
Mandels introduction of fractals for the general reader, including illustrations and applications.
Article
Benot Mandelbrot: Mathematician. Peoples Archive. Available online. URL: http://www.peoplesarchive.com/browse/movies/2930. Accessed on July 18, 2006.
Video and transcript of an interview with Mandelbrot covering his life and work.
Web Site
Fractint Homepage. URL: http://spanky.triumf.ca/www/fractint/fractint.html. Accessed on May 18, 2006.
Contains documentation, tutorials, data libraries, and downloadable software for Fractint, an extremely versatile fractal generating program that runs on PC-compatible computers.
6
ON BUTTERFLY WINGS
EDWARD LORENZ AND CHAOS THEORY
n everyday language, chaos is something most people want to avoid. It can refer to a young persons untidy bedroom, a crowd that panics when a fire breaks out in an auditorium, or, for a scientist, a seemingly random and meaningless collection of data. Starting in the 1970s, however, a group of mathematicians and scientists began to speak of chaos in a different way. Struggling to develop computerized weather predictions, a meteorologist named Edward Lorenz had discovered that supposedly orderly calculations were breaking down and spewing out wildly varying numbers. At the same time chaos was bursting out of order, a new kind of order was being found in chaos. This chaos theory would revolutionize the way scientists looked at many different phenomena and would have an impact as timely as todays concerns about global warming.
ON BUTTERFLY WINGS 75
It was not surprising, then, that Lorenz majored in mathematics at Dartmouth College, where he received his bachelors degree in 1938. He then went to Harvard University, earning a masters degree in mathematics in 1940.
76 Mathematics
in Flagstaff, Arizona; the University of California at Los Angeles (UCLA), the Norwegian Meteorological Institute in Oslo, and the National Center for Atmospheric Research in Boulder, Colorado. While serving as a visiting scientist at Harvard in 1950, Lorenz did research on atmospheric energy balance. Upon his return to MIT, his research would be expanded to create a joint effort between MIT and UCLA to develop a statistical weather forecasting model.
ON BUTTERFLY WINGS 77
Because computer-processing time was still expensive and memorylimited, Lorenz had to simplify his computer weather model drastically, incorporating only 12 equations. Nevertheless, things started out pretty well: The wind direction and speed, temperature, and other variables generated by the computer seemed to more or less match what an experienced meteorologist would expect, given the input data. Lorenz rigged a crude graphics systemdots printed on an unwinding roll of paper to show the trends and fluctuations in the weather variables.
A Berserk Computer?
Science is full of surprising moments, like the time when Alexander Fleming discovered what a mold called penicillium had accidentally done to his bacterial culture. For Lorenz, the surprise came one winter day in 1961 when he wanted to run a weather simulation over again to see the effects of some tweaks. Not wanting to wait for the computer to recalculate everything from the initial data, however, Lorenz grabbed a printout that had been made about halfway through the past run. He reasoned that if he typed the values of the variables from the printout and started the computer, it would simply duplicate the rest of the previous run and leave him in a position to continue on from there. Lorenz typed in the numbers, started the machine, and took a coffee break. When he returned and looked at the paper rolling out of the printer, however, he saw that the output hardly resembled the printout from the original run at all! Had the computer gone haywire? No, the machine was all right. When Lorenz compared the original numbers from those he had input the second time, he realized that while for the original run he had input numbers with six decimal places, the printout he had used to type the numbers the second time had shown only three places (to save precious computer memory). It should not have made that much difference. If, as meteorologists had assumed, weather was a linear system, a small change of a 10-thousandth or less in the input variable should have made only a tiny change in the output from the weather model. But upon closer
78 Mathematics
examination, Lorenz found that the new and old output started out the same, but then one curve slowly began to lag behind the other then suddenly they diverged completely, no longer resembling each other at all. In 1972, Lorenz explained this phenomenon by giving the world one of todays most popular metaphors. Speaking before the American Association for the Advancement of Science, Lorenz titled his lecture Does the Flap of a Butterflys Wings in Brazil Set off a Tornado in Texas? Technically, the phenomenon would be called sensitive dependence on initial conditionsbut soon everyone was calling it the butterfly effect.
ON BUTTERFLY WINGS 79
Demonstrations of Chaos
Lorenz carried on, however. He looked beyond weather models to try to find other phenomena that might exhibit this lack of regularity or periodicity. He found three relatively simple equations that modeled an aspect of convection, the process by which a hot liquid or gas rises. Lorenz found an even simpler version of such a system: an old-fashioned waterwheel in which water falls into a series of buckets. At first the wheel turns smoothly, with each bucket being filled, traveling downward by the pull of gravity and emptying its contents at the bottom. But if the speed of the water flow is increased past a certain point, the wheel is turning so fast that the
80 Mathematics
A pendulum is a simple example of an attractorhowever, when it is first put into motion, the pendulums paths converge on the origin.
buckets do not have enough time to either fill or empty completely. The wheel begins turning erratically and unpredictablypossibly even reversing its direction for a time. Another tool for chaos research was the pendulum, a very simple device more likely to be found in a childrens science kit than a real laboratory. About 400 years ago, Galileo explained the overall motion of a pendulum. For example, he asserted that the period of a
ON BUTTERFLY WINGS 81
pendulum (the time it takes for a swing) is independent of the length of the cord by which the pendulum is suspended. Another thing about pendulums is that their motion converges gradually toward a perpendicular point. Pendulums seem to be quite well-behaved, predictable beasts. However, Lorenz and other chaos theorists began to look at double pendulums. A double pendulum is essentially a small pendulum that moves around from the end of a larger pendulum. One might think the two motions would combine to form a complex but regular path, but that is not what happens. Instead, a double pendulum shows chaotic, unpredictable motion.
A double pendulum behaves deterministically when given a small motion, but a large initial motion produces varying, chaotic paths.
82 Mathematics
Strange Attractors
There is a popular misconception that chaos is the same thing as randomness. However, as Lorenz points out in his book The Essence of Chaos, there are many processes such as the tumbling of a rock down the mountainside, or the breaking of waves on an
ON BUTTERFLY WINGS 83
ocean shore . . . whose variations are not random but look random. This is why the term deterministic chaos is used: At any given point, the result (the position of an object, the value of an output variable) is determined by specific forces and can be calculated. One cannot, however, simply predict the next position or value on the basis of what has gone before, because the process is nonlinear. Literally, one cannot draw a line (or a curve) and say that because the input is X more, the output will be Y farther along. However, this does not mean that there is no pattern or structure that appears as one plots point after point. Mandelbrot found with his fractals (see chapter 5, Endless Structure) that while each layer of detail is different, the same general structures keep recurring at each level. Similarly, Lorenz found that while chaotic dynamic systems seem to behave wildly, if one plotted the solutions to the equations on a kind of grid called phase space, the pattern of dots approached or converged upon a particular shape, which he dubbed a strange attractor. (Regular attractors were already known, of course. For example, with a single pendulum, the attractor is the point perpendicularly below the pendulum, toward which the pendulum converges in a spiral motion.) When Lorenz plotted his convection equations, he found that they converged upon an attractor that had a remarkable butterflylike shape (not to be confused with the butterfly effect). Also called the Lorenz attractor, this system also emerges in models of certain waterwheels and even electric dynamos.
84 Mathematics
theory. When enough anomalies arise, a few scientists begin to explore radically different theories. If a new theory is shown to fit the evidence better than the old one, it will eventually be accepted. Often, however, acceptance comes only after decades of resistance, and sometimes only after the innovators have risked their professional future. By the 1980s, a growing number of scientists in meteorology, physics, biology, chemistry, and other fields were coming to believe that chaos theory was just such a new model of the world, or paradigm. Part of the justification for this claim was that chaos theory seemed to address a whole variety of phenomena that could not be
This Fractint for Windows simulation shows the Lorenz attractor. Its butterflylike shape seems appropriate, since the flapping of that insects wings is often used as a metaphor for the tiny initial changes that can lead to large, unexpected results.
ON BUTTERFLY WINGS 85
This photo shows a cloud system filled with roiling, chaotic motion. (Photo from
the U.S. National Oceanic and Atmospheric Administration)
quite captured by the traditional methods of probability, statistics, and linear calculation. Indeed, science writer James Gleick quotes an administrator as remarking to his audience of scientists that Fifteen years ago, science was heading for a crisis of increasing specialization. Dramatically, that specialization has reversed because of chaos. In other words, the universal applicability of chaos theory was enabling scientists to make new and broader connections between various scientific fields. Gleick quotes a physicist as suggesting that chaos theory might amount to a third revolution in physicsin other words, a new
86 Mathematics
paradigm: Relativity eliminated the Newtonian illusion of absolute space and time; quantum theory eliminated the Newtonian dream of a controllable measurement process; and chaos eliminates the Laplacian fantasy of deterministic probability. At the same time, chaos was removing a last bastion of certainty from physics, however, it was also making an exciting new kind of physics available for scientists who could not afford giant particle accelerators and the other tools of contemporary big science. As Gleick noted: Of the three [revolutions in physics], the revolution in chaos applies to the universe we see and touch, to objects at a human scale. Everyday experience and real pictures of the world have become legitimate targets for inquiry. By the 1990s, chaos had become a trendy if not always accurate way to speak of how the new science was different from the old. Gleicks book Chaos had brought the fascinating story of chaos and fractal geometry to many nonscientists. Lorenzs own 1993 book The Essence of Chaos also offered a guide to his work.
Achieving Recognition
By the late 1980s, Lorenz, like Mandelbrot, had moved from an obscure, specialized corner of science into the mainstream and even the popular imagination. The affirmation of Lorenzs work by his peers gradually arrived in the form of a number of awards, including the Carl-Gustaf Rossby Research Medal of the American Meteorological Society (1969), election to the National Academy of Sciences (1975), and the Crafoord Prize of the Royal Swedish Academy of Sciences (1983). In 1991, Lorenz was awarded the Kyoto Prize for his work in establishing the theoretical basis of weather and climate predictability, as well as the basis for computer-aided atmospheric physics and meteorology. The Kyoto committee went on to cite Lorenzs best-known achievement: in discovering deterministic chaos, a principle which has profoundly influenced a wide range of basic sciences and brought about one of the most dramatic changes in mankinds view of nature since Sir Isaac Newton. Even though he is now in his late eighties, Lorenz still works in his office at MIT several days a week. In 2005, he published two
ON BUTTERFLY WINGS 87
ISSUES: THEORIES
AND
FADS
There is a tendency for any theory that is both original and farreaching to expand to fill the available space in scientific and popular discourse. For example, Norbert Wieners cybernetics and Claude Shannons information theory (both developed in the 1940s) had become popular buzzwords by the 1950s, being applied not only within the engineering field where they had originated but also in psychology, social science, and even business management. In order to become a fad, a theory must offer intriguing but graspable ideas that look like they can be applied widely. In the process of applying the ideas, however, they tend to become less concrete and more metaphorical. For example, Shannon used the term information in a specific technical sense that did not refer to the actual content of a message. In popular discussion, however, information theory became associated with general ideas such as information is power or later the Information Age. By the time a new theory is in general circulation, the question is not whether it is right or wrong but whether it is being distorted. In the book Introducing Chaos, mathematician Ian Stewart suggests that
The term chaos has escaped its original bounds, and in doing so has to some extent become devalued. To many people, it is no more than a new and trendy term for random. Take some system with no obvious pattern, declare it to be an example of chaos, and suddenly it is living on the intellectual frontier instead of being boring old statistics again. Chaos has become a metaphor, but far too often the wrong metaphor.
Another mathematician, Peter Allen, is quoted as suggesting that the chaotic aspect of complex systems is being overemphasized: In reality, the important aspect is the origin and evolution of structure and organization in complex systemsnot the trivial occurrence of sensitivity in strange attractors. However, Allen goes on to suggest that chaos may be used in nature to provide noise with which to maintain adaptability and surprise. There is no doubt, however, that ideas from chaos theory (and the larger field of complex emergent systems) continue to provide important tools for research in a variety of fields.
88 Mathematics
scientific papers, Designing Chaotic Models and A Look at Some Details of the Growth of Initial Uncertainties.
Chronology
1917 1938 1940 1943 194246 1948 194855 Edward Lorenz is born on May 23 in West Hartford, Connecticut Lorenz receives his bachelors degree in math from Dartmouth College Lorenz receives his masters degree in math from Harvard University Lorenz earns a masters degree in meteorology at MIT Lorenz serves as a weather forecaster for the U.S. Army Air Corps during World War II Having returned to MIT, Lorenz receives a doctorate in meteorology Lorenz is on the staff of the MIT department of meteorology; he also takes leaves of absence for research or teaching at Lowell Observatory in Flagstaff, Arizona, and at various meteorological research institutes Lorenz publishes his paper on Deterministic Nonperiodic Flow, formulating what came to be known as chaos theory Lorenzs talk at the American Association for the Advancement of Science coins the term buttery effect Lorenz publishes his popular book The Essence of Chaos
Further Reading
Books
Gleick, James. Chaos: Making a New Science. New York: Penguin Books, 1987.
ON BUTTERFLY WINGS 89
A very readable and engaging account of the development of chaos theory, including its development from Lorenzs work with weather and its relationship to Mandelbrots fractals.
Lorenz, Edward. The Essence of Chaos. Seattle: University of Washington Press, 1993.
A popular book that expands on three of Lorenzs lectures. Lorenz explained how he discovered chaotic phenomena (particularly in weather) and developed his theories.
Sardar, Ziauddin, and Iwona Abrams. Introducing Chaos. New York: Totem Books, 1999.
An artistically illustrated guide to the key persons and concepts in the development of chaos theory, including numerous quotes from mathematicians and scientists.
Article
Lorenz, Edward. Deterministic Nonperiodic Flow. Journal of Atmospheric Science 20 (1963): 130141.
Key paper describing systems that are sensitively dependent on initial conditions and that converge on certain attractors.
Web Site
Miguel de Campos, Antnio. Lorenz Atractor. URL: http://tocampos.planetaclix.pt/fractal/lorenz_eng.html. Accessed on June 22, 2006.
Interactive Java applet that generates Lorenz atractors based on the users clicks.
7
GAMES OF EMERGENCE
JOHN H. CONWAY, LIFE, AND OTHER PASTIMES
visitor to the common room of the mathematics department at the University of Cambridge in the 1960s would have beheld a strange sight. He or she might well have wondered if everyone had gone crazy. Tables and floors were covered with ruled graph paper. Bunches of shells, counters, coins, and especially black-andwhite Go stones were arranged in intricate patterns on hundreds of squares. A student might stare at a particular pattern and then, in a sudden burst of activity, move its pieces to form a different pattern. Other students would be arguing earnestly about things called blinkers, honey farms, and glider guns. What on Earth was going on? The students were playing something called the Game of Life. This was no ordinary game. Its rules were much simpler than those of chess. The game had no winners or losers. Yet its inventor, John Horton Conway, would use it to show how the most complex things, perhaps even living creatures, might arise from a simple set of rules.
I Want to Be a Mathematician
John H. Conway was born on December 26, 1937, in Liverpool, England. Conways father was a laboratory assistant at the Liverpool Institute for Boys, so John was exposed to science and mathematics from an early age. Young Conway quickly showed
90
GAMES OF EMERGENCE 91
John Conway has made many contributions to both serious and recreational mathematics. Perhaps his best-known discovery is the simple but intriguing cellular automation called the Game of Life. (Photo by Carol Baxter)
a talent for doing complex calculations in his head. His mother later claimed that he was reciting powers of 2 (2, 4, 8, 16, 32, and so on) when he was only four years old. (In later years, Conway regularly had his computer quiz him on the day of the week for 10 randomly selected dates from the past or future.) When he was interviewed for entry into high school (at age 11), he was asked what he wanted to be when he grew up. His answer was a mathematician at Cambridge. In an interview with New York Times reporter Gina Kolata, Conway reflected on why mathematics had appealed to him so strongly from his earliest years, even while challenging him to always look further: What turned me on was this mysterious relationship between things. There is this wonderful world of logic and connections that is very difficult to see. I can see trees and cats and people, but there is this other world and its very, very powerful.
92 Mathematics
Packed in 24 Dimensions
In 1968, Conway, by then married and with four daughters, was seeking to establish a firm place for himself in the world of mathematics. He would later say in the interview with Gina Kolata that I knew that I was a good mathematician, but the world didnt. Conway was also suffering from depression, a condition that would recur throughout his career. Conway learned that a few years earlier another mathematician had discovered an intriguingly symmetrical mathematical object that existed in a space of 24 dimensions. (Although people can actually only see three dimensions, physicists often find it useful to treat time as a fourth dimension, and mathematicians can extend their coordinate systems to include as many as they wish.) Mathematicians who heard about this work hoped that it would lead to an advance in group theory and a better understanding of symmetry (the way in which objects have parts that mirror each
GAMES OF EMERGENCE 93
other along certain dimensions.) However, there was still a great gap between the preliminary sketch of the object and the mathematical description that would make it useful. Conway was intrigued by the mathematical possibilities and wished he could take a crack at them. With a small income and four children to raise, however, Conway at first thought it would be years before he could find the time to devote to such abstruse mathematical speculation. Nevertheless, Conway decided to devote Wednesday evening and most of Saturday of each week to developing the 24-dimensional group theory. The first Saturday, he sat down and did not quit until 12 hours later, when he had the theory for the 24-dimensional object all worked out. The resulting structure became known as a Conway group, and it suddenly thrust him into the circle of worldclass mathematicians. As he recalled to Kolata: It catapulted me into the jet set. I remember flying to New York to give a 20-minute lecture and then flying back again. However, unlike the case with John Nash (see chapter 4, A Delicate Equilibrium), Conways great initial success did not make him anxious about maintaining his status and staying at the top of the profession. Rather, Conway told Kolata that his discovery of the Conway group . . . had a great psychological effect. It cured my depression and it also totally removed my ambition. Ive been totally successful [since], but at some level I couldnt care less. . . . I decided I that I might as well enjoy myself instead.
94 Mathematics
that Im much more interested in the theory behind a game than the game itself. Conway often folded bits of paper into elaborate shapes and challenged bystanders to figure them out. He created games involving geometry or topology. One game, which Conway coinvented with Michael Stewart Patterson, was called Sprouts. The rules were simple. The game starts out with a piece of paper with two spots marked on it. A player can join any two spots (or join a spot to itself) by drawing a curve, provided that the curve does not cross any curve already drawn. The player then must put a spot somewhere on the curve that was just drawn. Play ends when one player cannot draw a curve without crossing another curve or crossing a spot that is already connected to three curves. Another one of Conways favorite games was Philosophers Football, or phutball. The game used a Go board and stones. A black stone placed at the center of the board represents the ball. Players take turns either placing a white stone at any intersection on the board (to block opponents possible moves) or jumping the ball over one or more stones in a way similar to jumping in checkers. The winner is the person who can jump the ball over the opponents edge of the board (the goal line). Conways seemingly never-ending inventiveness has been coupled with a great deal of curiosity about facts, lists, and patternseverything from the names of all the visible stars (which he learned in a year) to the first thousand digits of the endless decimal pi.
GAMES OF EMERGENCE 95
Conway decided to see what could be done with a much simpler virtual world, in which the cells can have only two states, which can be called on and off or living and dead. Each cell would evaluate its eight surrounding cells and respond according to a set of simple rules. As a result, the cell would live or die. As the pattern was stepped through many generations, the patterns would grow, die, become fixed, or shift around on the grid of squares.
Rules for the Game of Life. The diagrams show what happens to the central cell depending on whether two, three, or some other number of neighbors are alive.
96 Mathematics
Conway tried several different sets of rules for life and death, seeking the rules that would result in the most interesting patterns. His final rules were as follows: Start with a grid of cells (like a piece of graph paper). Mark certain cells as being on or alive. For convenience, objects such as coins or Go stones can be used to mark the initial pattern of cells. Look at each cell on the grid. Count the number of surrounding cells that are alive. If exactly two neighbors are alive, the state of the current cell does not change. (That is, if it is alive, it stays alive. If it is dead, it remains dead.) If there are three neighbors alive, the current cell will be alive, even if it had been dead. If the number of living neighbors is neither 2 nor 3, the cell will be dead, even if it had been alive. Each round of checking all the cells in the pattern to see if they live or die is called a generation. The pattern that emerges from each generation becomes the starting point for the next generation. Conway and his students found that these simple rules produced a startling variety of patterns, depending on what kind of pattern one started the game with. A row of three living cells, which Conway called a blinker, would alternate between vertical and horizontal. An L-shaped pattern of three cells turned into a four-cell blockand after that, stayed the same forever. Some patterns, such as a T-shaped pattern of four cells, took on a bewildering variety of forms as the generations passed. Conway called his pattern generator the Game of Life, and it was first publicized in two articles in Scientific American magazine in 1970 and 1971. Soon people were mailing in their own newly discovered Life patterns. As the 1970s moved on, more and more students and hobbyists were getting access to computers. The Game of Life could be easily translated into a computer program that could plot the grid cells on the computer screen or print them out on paper. By 1974, Time magazine was noting that millions of dollars in valuable computer time may already have been wasted by the games growing horde of fanatics.
GAMES OF EMERGENCE 97
A simple life-form consisting of four cells in a row generates two quite different forms each time the rules are applied to it. Each such application is called a generation.
98 Mathematics
Here are a variety of different life-forms as generated by the Winlife program. The figure, of course, represents just a single snapshot of the ever-changing patterns.
One day one of Conways colleagues, Richard Guy, pointed at a Life board and said in surprise Oh, look. My bits walking. This object, consisting of five cells, went through a series of transformations that resulted in the whole object moving one space diagonally on the grid. This object became known as a glider. The glider, in theory, might move forever. Conway believed that if a continually growing Life pattern could be designed, it would be a major step toward simplifying von Neumanns model for a living machine. Conway challenged the readers of Martin Gardners columns on mathematical games in Scientific American to demonstrate such a growing Life pattern. One reader of this column, William Gosper, took up Conways challenge. Gosper, a well-known computer expert at the Massachusetts Institute of Technologys Artificial Intelligence Laboratory, had already become hooked on the Game of Life, running thousands of generations on the labs computers. Gosper and his MIT colleagues went to work, and in a month, they had come up with a glider gun, a pattern that produced and ejected one glider after another. Unfortunately, the gliders eventually collided with other objects or created objects that destroyed the gun. However, by placing appropriate objects to kill stray fragments, Gosper was finally able to create a glider gun setup that amounted to a perpetually growing Life pattern.
GAMES OF EMERGENCE 99
Eventually, Gosper was able to show that a large, complex Game of Life pattern could actually be used as a computer, performing additions. While still nowhere as complicated as von Neumanns virtual machine, the seemingly simple Game of Life had demonstrated a new field of cellular automation and paved the way to new experiments in artificial life (see chapter 9, Artificial Evolution) and to a comprehensive theory of emergent behavior (see chapter 10, A New Kind of Science?).
This diagram shows an interesting Game of Life structure called a glider gun. The ability of the structure to generate a stream of moving gliders depends on the precise placement of certain structures that prevent debris from destroying the mechanism.
100 Mathematics
Seriously Weird?
A stream of interviewers have marveled at Conways odd and unworldly quirks. In 1993, for example, well-known New York Times journalist Gina Kolata discovered that Conway (who had moved from Cambridge to Princeton in the mid-1980s) had recently purchased his first pair of shoes since 1969he had worn only sandals for years, even in the rain or snow. Similarly, Conway had recently seen a barber, having decided to abandon his usual practice of keeping his hair in a ponytail and hacking off the end periodically. Conways work habits are also rather unconventional. As he admitted to Mark Alpert, Its impossible for me to go into the office and say Today Ill write a theorem. I usually have half a dozen things
running through my head, including games and puzzles. And every so often, when I feel guilty, Ill work on something useful. Richard Guy, a professor of mathematics at the University of Calgary who would coauthor several books with Conway, described the latters Cambridge office as follows in Mathematical People:
Conway is incredibly untidy. The tables in his room at the Department of Pure Mathematics and Mathematical Statistics in Cambridge are heaped high with papers, books, unanswered letters, notes, models, charts, tables, diagrams, dead cups of coffee and an amazing assortment of bric--brac, which has overflowed most of the floor and all
102 Mathematics
of the chairs, so that it is hard to take more than a pace or two into the room and impossible to sit down. If you can reach the blackboard there is a wide range of coloured chalk, but no space to write. His room in College is in a similar state. In spite of his excellent memory he often fails to find the piece of paper with the important result that he discovered some days before, and which is recorded nowhere else.
Of course Conways quirks and habits would be of little interest if he did not continue to produce strikingly creative mathematics. Dr. Ronald L. Graham of AT&T Bell Laboratories described Conway in Kolatas article as . . . one of the most original mathematicians . . . Hes definitely world class, yet has this kind of childlike enthusiasm. Hes confident enough to work on any crazy thing he wants to. Conway continues to explore new frontiers of mathematics. In recent years, he has been trying to figure out the best way to pack a bunch of spheres into a particular spacein eight dimensions! It turns out that this seemingly abstract problem has practical uses in encoding computer data in eight-bit chunks. The eight data bits can be represented by one point in the eight-dimensional universe, given in terms of the center of the nearest sphere. Conway exclaimed that I find it lovely that this purely geometrical thing that Im interested in is actually useful to quite practical people. But as many other mathematicians have found, the most abstract sorts of mathematics often turn out to be mirrors of the way nature works. In 1996, Conway coauthored The Book of Numbers, a sort of bestiary of unusual and strange numbers and number patterns. It is just the kind of book that might lead a young person today into a career in number theory, while enlightening and entertaining anyone who has ever wondered about hidden numeric patterns. Although the general public knows him mainly for Life and other mathematical games, Conway has received some of the highest plaudits of the mathematical world. In 1981, he became a fellow of Great Britains prestigious Royal Society. In 1987, the electronic engineering society IEEE gave Conway its award for outstanding paper and the London Mathematical Society awarded him its Polya Prize. In 2000, Conway received the Leroy P. Steele Prize for Mathematical Exposition from the American Mathematical Society.
Chronology
1937 1959 1964 1968 1970 John H. Conway is born in Liverpool, England Conway receives his B.A. in mathematics from the University of Cambridge; he does research in number theory Conway receives his doctorate from the University of Cambridge Conway develops the theory of Conway groups in 21 dimensions Conway introduces the Game of Life on the pages of Scientic American; he develops his theory of surreal numbers, helping to unify number theory
mid-1970s Thousands of users program their computers to play the Game of Life 1981 1982 Conway becomes a fellow of the Royal Society Conway and coauthors offer a compendium of mathematical puzzles and games in Winning Ways for Your Mathematical Plays Conway moves to Princeton University, becoming the John von Neumann Professor of Mathematics Conway wins the IEEE award for outstanding paper and the Polya Prize of the London Mathematical Society Conway and Richard Guy publish The Book of Numbers
Further Reading
Books
Albers, Donald J., and G. L. Alexanderson, eds. Mathematical People: Profiles and Interviews. Chicago: Contemporary Books, 1985.
A collection of interesting interviews that includes a chapter on John H. Conway.
104 Mathematics
Berlekamp, Elwyn R., John H. Conway, and Richard K. Guy. Winning Ways for Your Mathematical Plays. 2nd ed. 2 vols. Natick, Mass.: A. K. Peters, 200104.
A compendium that includes many of Conways best-known mathematical puzzles and games.
Conway, John H., and Richard K. Guy. The Book of Numbers. New York: Copernicus Books, 1996.
Conway and another prolific mathematics professor offer stories and puzzles involving many famous and lesser-known types of numbers and number series.
Poundstone, William. The Recursive Universe: Cosmic Complexity and the Limits of Scientific Knowledge. New York: William Morrow, 1985.
Introduces the Game of Life and relates it to larger questions about how cellular automata may relate to the structure of the universe.
Articles
Albers, Donald J. Conway: Talking a Good Game. Math Horizons (Spring 1994): 69.
A good introduction to Conways approach to mathematics; includes a sidebar on the Game of Life.
Alpert, Mark. Not Just Fun and Games. Scientific American 280 (April 1999): 40 ff.
Describes how Conways playful approach and insight into apparently simple things enables him to uncover profound mathematical truths.
Kolata, Gina. John Conway: At Home in the Elusive World of Mathematics. New York Times, October 12, 1993, C1, C10.
Interview in which Conway describes how he explores mathematics.
Web Site
Conways Game of Life. URL: http://www.ibiblio.org/lifepatterns. Accessed on July 12, 2006.
The Web site includes links to background material and sample Life patterns, as well as an applet that allows users to experiment with Life within their Web browser.
8
FROM COSMOS TO MIND
ROGER PENROSE SUGGESTS HIDDEN CONNECTIONS
y the 20th century, the power of mathematics to discern patterns in nature had expanded vastly, entering realms that would have amazed and perplexed the ancient geometers. At the scale of the very large, astronomers discovered strange cosmic structures whose elements were entire galaxies. At the extremely tiny end of things, quantum physics talked of symmetries and families of particles that spun and resonated to the tune of integers and fractions. The world as experienced by human beings sits roughly in the center of the scale of size between subatomic particles and megagalaxies. Nevertheless, one of the greatest mysteries in all science is found on the human scalethe mystery of consciousness. How did people come to be aware, and then to become aware of their awareness? If mathematical physicist Roger Penrose is right, there is a subtle connection between the quantum world and the patterns of neurons that make up the human brain. The human mind may be the ultimate quantum computer.
A Talented Family
Roger Penrose was born on August 8, 1931, in Colchester, England. His parents were both scientifically trained: Penroses mother was
105
106 Mathematics
Physicist Roger Penrose is shown in front of a blackboard showing a cosmic twistor. Besides his work in cosmology, Penrose has created elaborate mathematical tiling structures and explored the possible relationship of quantum effects to the human experience of consciousness. (Photo by Anthony Howarth/
Photo Researchers, Inc.)
a medical doctor and his father a geneticist. To the extent scientific talent might be inherited, the Penrose children seemed to be in good shape. Penroses older brother, Oliver, would become a physicist and mathematician, while his younger brother, Jonathan, would lecture in psychology as well as becoming the British national chess champion. In 1939, the Penrose family visited the United States. As the threat of war in Europe began to loom, Penroses father decided to accept an appointment at a hospital in the city of London in Ontario, Canada. Penroses father and mother were both quite interested in mathematics, particularly geometry. Along with older brother Oliver, young Roger, not surprisingly, became interested in mathematics as well. In an interview that appeared in Mathematics Today he remembered making various polyhedra [geometrical solids with many sides] when I was about ten. . . .
Turning to Mathematics
When the war ended in 1945, the family returned to England. While his father accepted an appointment as professor of human genetics at University College London, Roger attended the associated University College School. Although his interest in mathematics continued to grow, Penroses parents wanted him to follow them into the medical profession. Because of the way the schools curriculum was organized, Penrose had to choose between biology (needed for preparation for medicine) and his first love, mathematics. As he recalled in the Mathematics Today interview:
. . . I remember an occasion when we had to decide which subjects to do in the final two years. Each of us would go up to see the headmaster, one after the other, and he said Well, what subjects do you want to do when you specialize next year. I said Id like to do biology, chemistry and mathematics and he said No, thats impossibleyou cant do biology and mathematics at the same time, we just dont have that option. Since I had no desire to lose my mathematics I said Mathematics, physics and chemistry. My parents were rather annoyed when I got home; my medical career had disappeared in one stroke.
Since Penroses father was a professor at University College London, Roger was able to attend that institution without paying tuition. After earning his bachelors degree in mathematics (with first-class honors), he went to the University of Cambridge to study advanced mathematics.
Mathematical Physics
By this time, Penrose had become strongly drawn to mathematical physics. There are several reasons for this shift in interest. His older brother, Oliver, was already working in physics. Penrose had also become intrigued by various physics problems after taking a course in general relativity and one in quantum mechanics. Finally, a course in mathematical logic introduced Penrose to topics that would greatly
108 Mathematics
interest him later, including the work of Alan Turing on computability and Kurt Gdels theorem on the limits of mathematical systems. Dennis Sciama, a friend of Penroses brother, also conveyed to him much of the excitement of the new developments in physics. Penrose received his Ph.D. from the University of Cambridge in 1958, after having written several important papers on matrix equations. The following year, however, he would begin the work that would make him one of the worlds foremost mathematical physicists. The early papers would deal with the peculiar geometry of shapes traveling at relativistic (near-light) speeds and for visualizing gravity in geometric terms.
would fall into the hole, while the other would escape, transferring some rotational energy from the black hole.
110 Mathematics
started with a mathematical construct called a twistora massless object that had both linear and angular momentum and that moved in a special form of twistor space. Penrose tried to show how the laws of modern physics could be expressed in terms of twistors. His book Spinors and Space-Time (coauthored with W. Windler and published in two volumes in 1984 and 1986) gave the fullest account of the theory. Most physicists today do not believe that the twistor theory is the most useful for describing the universe, being more inclined to look toward various forms of string theory. Meanwhile, in 1974, Penrose introduced an innovation in tiling, or the process of trying to fill a space completely by a suitable arrangement of repeated, regular figures. Mathematicians knew that triangles, squares, and hexagons could fill an area without leaving any spaces between them (consider, for example, the arrangement of hexagonal cells in a honeycomb.) However five-sided figures (pentagons) inevitably left a crack when three were fit together. Scientists who studied crystals also knew that no crystals had fivefold symmetry. Penrose, however, developed a new form of tiling. He began by constructing two rhombuses from a regular parallelogram, dividing the diagonal by a golden section (thus harkening back to the Greeks; see chapter 1, How Nature Counts). The rhombuses could then be arranged so that no configuration was exactly repeated, but the whole plane was covered. These tiles had almost perfect fivefold symmetry. At first Penrose tiling was just an interesting topic for recreational mathematics columns such as the one edited by Martin Gardner in Scientific American. However, in 1984, Israeli crystallographer Dany Schechtman and his colleagues (working at the U.S. Bureau of Standards) discovered that a rapidly cooled aluminum-manganese alloy formed crystals that had a fivefold symmetry! These so-called quasicrystals were in effect a natural form of Penrose tiling, and they spawned a considerable amount of scientific interest.
A cartwheel Penrose tiling featuring decagons (10-sided figures). Every point in every tiling is surrounded by its own decagon.
physicists and biologists tend to shy away from such questions, but they are hard to escape. In his 1989 book The Emperors New Mind, Penrose notes that Consciousness . . . is the phenomenon whereby the universes very existence is made known. Decades earlier, quantum physicists such as Erwin Schrdinger had shown that the role of an observer could not be removed from the description of reality. But what physical processes underlie the observing mind? By the 1980s, there was one scientific field where many practitioners thought they had the answer to that question. Artificial intelligence (AI) researchers such as John McCarthy and Marvin Minsky believed that the abilities that seemed to make the human
112 Mathematics
brain unique could be replicated by a sufficiently powerful computer that was provided with the appropriate types of procedures, or algorithms. In principle, then, there was no important difference between how a humana mathematician, for exampleand some future computer might solve a problem. In The Emperors New Mind, however, Penrose argued that the view of the AI researchers was fundamentally wrong. He pointed
out that Gdel had already shown that it was not possible for there to be one universally formal system . . . equivalent to all the mathematicians algorithms for judging mathematical truth. This meant that understanding a mathematical truth involved something beyond what was in the mathematical system itself. Penrose suggested that the mind sees the truth of a mathematical proposition as a whole, not simply by applying a series of algorithms to draw an ultimate conclusion. Penrose also echoes the thought of the ancient Greek philosopher Plato. While many people today assume that mathematics represents an abstract or idealized representation of reality, Plato believed that perceived reality was an imperfect, distorted manifestation of the perfect truths of mathematics. Like Plato, Penrose might say that humans perceive mathematical truth because the very structure of their minds necessarily reflects it.
114 Mathematics
If so, the brain, like the quantum computers that researchers are beginning to design, has a whole additional level of power. Unlike the case of a normal computer memory location that can hold only one data value at a time, each bit of storage in a quantum computer can simultaneously store many bits. Because even a tiny neuron is orders of magnitude larger than the subatomic particles studied by quantum physicists, many scientists do not believe that quantum effects could have any significance for the operation of the brain. Penrose, however, has focused on structures called microtubules located within the neurons. Working with medical researcher Stuart Hameroff, Penrose has tried to sketch out a model where the quantum coherence could be maintained even in this relatively large structure, allowing the brain to maintain multiple states at the same time.
ISSUES: PENROSE
AND
HIS CRITICS
Roger Penroses provocative theories about the nature of consciousness and its possible connection to quantum physics have sparked a considerable debate. One critic, physicist Max Tegmark, calculated that the time it takes for neurons to fire and communicate in microtubules is at least 10,000,000,000 times slower than the time it would take any set of quantum data in the brain to decohere and be lost. Penroses colleague Stuart Hamerhoff in turn has argued that there are flaws in Tegmarks analysis, and the debate continues in the pages of various physics journals. Meanwhile, artificial intelligence (AI) researchers have attacked the other leg of Penroses argumentthe assertion that computers cannot replicate the thought processes of the brain. Although most do not believe the brain can do quantum computing, if it can, then there is no reason to suppose some future electronic computer will not have the same capabilities. Further, inventor and futurist Ray Kurzweil notes that the rate of growth in computing capability is exponential such that if the brain turns out to be thousands of times more complex than is currently believed, it would only delay by a few decades the time when the computer overtakes the brain in terms of sheer capacity.
Major Achievements
Penrose has received many prestigious science awards. In 1972, he was elected a fellow of the Royal Society of London. In 1988, he shared the Wolf Foundation Prize for Physics with Stephen Hawking. In 1990, Penrose received the Albert Einstein Medal for outstanding work relating to relativity. Later awards include the Naylor Prize of the London Mathematical Society (1991) and the De Morgan Medal in mathematical physics (2004). Also, Penrose became Sir Roger in 1994 when he was knighted by Queen Elizabeth II. The London Mathematical Society accompanied its award with a citation of Penrose for his major contributions to general relativity and the understanding of black holes, as well as for
Other AI researchers believe that by focusing on logic and algorithms, Penrose is ignoring many other techniques that are showing promise. These include bottom-up designs where sophisticated behaviors emerge from relatively simple rules, and genetic or evolutionary programming (see chapter 9, Artificial Evolution). These techniques, in principle, do not require that the human designer truly understand the intelligence he or she is trying to model, but only create the conditions for the process of machine evolution to begin. Finally, Penroses old colleague Stephen Hawking has weighed in, contributing the chapter The Objections of an Unashamed Reductionist to Penroses book The Large, the Small, and the Human Mind. In terms of philosophical approach, Hawking says that Penrose is a Platonist (believing physical reality is an approximation of ideal reality), while he is a positivist who believes that the ideas found in theories are only approximations of reality hopefully ones good enough to allow for the making of predictions. Hawking goes on to say that Penrose has not given any real evidence for his novel interpretation of quantum mechanics in relation to consciousness. For his part, Penrose has not backed down in the face of criticism. The debate continues, perhaps awaiting more experimental data.
116 Mathematics
Penrose has suggested that structures called microtubules might serve as a sort of quantum computer switching unit within the brain. Penrose believes that this capability may account for consciousness, a phenomenon that has so far not been replicated in a computer or robot.
his Twistor theory and his unique and surprisingly productive approach to tiling.
Chronology
1931 193945 1957 1965 Penrose is born on August 8 in Colchester, Essex, England The Penrose family stays in Canada for the duration of the war Penrose receives his Ph.D. in mathematics from the University of Cambridge Working with physicist Stephen Hawking, Penrose proves that a collapsing star could produce a singularity, or black hole
1967 1970s
Penrose devises the twistor theory to map objects in fourdimensional space-time Penrose develops censorship conjectures to suggest how the universe in effect protects itself from the effects of black holes Penrose describes spin networks, which later develop into a theory of space-time with loop quantum gravity
Penrose is elected a fellow of the Royal Society Penrose accepts a professorship at Oxford University Penrose discovers Penrose tilings Penrose and Wolfgang Rindler began to publish a theory explaining space-time geometry using structures called spinors and twisters Penroses book The Emperors New Mind argues that existing physics cannot explain human consciousness; his views are updated in subsequent publications through the 1990s Penrose offers a comprehensive book on the laws of physics called the Road to Reality
1989
2004
Further Reading
Books
Penrose, Roger. The Emperors New Mind: Concerning Computers, Minds, and the Laws of Physics. New York: Oxford University Press, 1989.
Penrose argues that human consciousness cannot be explained by current physics or truly emulated by current computers.
. The Large, the Small, and the Human Mind. New York: Cambridge University Press, 1997.
Continues Penroses arguments for the uniqueness of consciousness, with replies by Stephen Hawking and other critics.
. The Road to Reality: A Complete Guide to the Laws of the Universe. London: Jonathan Cape, 2004.
A comprehensive but rather formidable exposition of the framework of physics.
118 Mathematics
Article
Penrose, Roger. Science and the Mind. Available online. URL: http://online.kitp.ucsb.edu/online/plecture/penrose. Accessed on July 20, 2006.
Include slides and streaming or downloadable audio.
Web Site
Dutch, Steven. Penrose Tiles. University of WisconsinGreen Bay. URL: http://www.uwgb.edu/dutchs/symmetry/penrose.htm.
Illustrates and describes a variety of Penrose tilings and their remarkable properties.
9
ARTIFICIAL EVOLUTION
CHRISTOPHER LANGTON CREATES VIRTUAL LIFE
cientists face a fundamental handicap when it comes to determining the essential characteristics that distinguish living organisms from other types of systems. The Earth is home to an incredible
Computer scientist Christopher Langton popularized a field of research called artificial life. It involves the creation or simulation of organisms that can compete, evolve, and cooperate. (Photo Jill Fineberg)
119
120 Mathematics
variety of organisms ranging from worms to birds to whales to peoplenot to mention strange life-forms such as slime molds and viruses that are sort of alive. In defining what it means to be alive, one can say that all the organisms on the list respond to their environment, grow, reproduce, and eventually die. But how did the first living systems emerge? The problem with life is that scientists thus far have only one environmentEarthand one evolutionary history to examine. Perhaps someday spacefarers (or automated probes) will bring back examples of life-forms that are strikingly different from those on Earthor perhaps reassuringly similar. But until then, is science doomed to have a limited perspective on life? Not necessarily. With the development of the computer in the mid-20th century came a tool that can not only calculate to specifications but also simulate any system that can be adequately defined. Starting in the 1980s, a group of researchers led by mathematician and computer programmer Christopher Langton began an ambitious project to create artificial life in the virtual environment of the computer. As Langton says in a paper quoted in science writer Steven Levys fascinating book Artificial Life:
The ultimate goal of the study of artificial life would be to create life in some other medium, ideally a virtual medium where the essence of life has been abstracted from the details of its implementation in any particular model. We would like to build models that are so life-like that they cease to become models of life and become examples of life themselves.
Although Langtons family and their location (not far from the Massachusetts Institute of Technology) would seem to predispose him toward a scientific career, by the time he had to choose a college, the 1960s were in full stride, and rebellion was in the air. Nevertheless, Langton had enjoyed sneaking some time on the computer at his fathers workplace. He also listened when his high school counselor told him that Rockford College in Illinois was about to buy an expensive computer. Deciding that it was the place to be, Langton entered Rockford, only to find that it was a very conservative institution, while Langton was long-haired and strongly against the war that was raging in Vietnam. When Langton dropped out of Rockford, he found that he was about to be drafted. Fortunately, he obtained conscientious objector status and began to perform his alternative service at the Massachusetts General Hospital in Boston. Langton started out as a morgue assistant, but when after a week a corpse he was wheeling into the autopsy room suddenly sat up, he asked for a different assignment. Langton ended up in the computer room of the Stanley Cobb Laboratory for Psychiatric Research. Langton thrived as he learned to program a DEC PDP minicomputer to interpret brain scans and analyze other data. He reveled in the machines ability to organize data and transform it into insights. Langtons computing experience soon reached a new level when he was assigned to create a virtual machinea simulation that would allow the PDP to run programs that had been written for a different model of computer.
Discovering Life
A little later, some visiting MIT programmers brought a program that played John Conways Game of Life (see chapter 7, Games of Emergence). Langton was fascinated by the blinkers and gliders and other Life-forms evolving on the screen. Late one night when Langton was alone in the lab, he left Life running on the machine and went about some other work. Suddenly, he felt a strange presence in the room. Looking at the screen, he saw a new
122 Mathematics
and unexpected configuration of glowing cells. As he later told author Steven Levy:
It was the first hint that there was a distinction between hardware and the behavior it could support. . . . You had the feeling that there was really something very deep here in this little artificial life universe and its evolution through time. We had a lot of discussion about whether the [Life] program could be open-endedcould you have a universe in which life could evolve?
In 1972, the hospital computer lab closed. Langton drifted for a while and then ended up in Puerto Rico, where he programmed a computer for the Caribbean Primate Research Center. There he found the animals at least as fascinating as the machine, and he lingered awhile to observe their behavior. Langton had begun to realize that he needed more formal scientific training if he were to develop his still rather vague ideas about artificial life. He took a few mathematics and physics courses at Boston University and then decided to enroll at the University of Arizona. Along the way, however, he and some friends stopped to indulge in one of their favorite sportshang gliding. Unfortunately, Langton ran into a wind shear while making a landing. He was smashed into the ground, sustaining broken arms and legs, a crushed face, and a collapsed lung. Forced to spend months in a hospital bed, Langton began to devour texts on just about every field, including evolution, genetics, and philosophy. He was enthralled by the complexity of living organisms and other natural phenomenaand by the fact that each field knew a lot about something pertaining to life but that there seemed to be no overall grasp of how life emerged and operated as a system. When Langton was finally able to complete his journey to Tucson and enroll in the University of Arizona, he knew what he wanted to do: create and study computer simulations of life. This would have to be an interdisciplinary project drawing from the life sciences (biology and molecular biology, evolution, genetics, and ecology)
and from computer science, as well as requiring a fair amount of math, some physics, and a dash of philosophy.
Genetic Programming
One of the key aspects of Langtons project would be to figure out how to simulate evolution in a computer. Cellular automatons such as those used in Conways Game of Life follow fixed, unchanging rules. Patterns change or die according to those rules. Life, on the other hand, carries within it a description of itselfa collection of genes. As Charles Darwin first showed, life is constantly tossing up new variations, and the environment, in turn, is constantly selecting the best-fitting organismsthose that can exploit food sources or avoid predators, for example. The first genetic programming began in the 1960s with the work of a computer scientist named John Holland. The program started with a collection of program codes that represented alternative ways to do something, such as sort text or recognize a picture. The program would let each bit of code run for awhile and then evaluate how well it did its job. Like organisms in nature, the most fit codes were allowed to reproduce, while those that were less efficient would die out. Langtons first attempt at simulating evolution in a computer was designed along similar lines. In his Third Edge essay, A Dynamical Pattern, Langton explains that while this form of genetic programming could be useful for specific applications, it was not a very useful tool for studying biological evolution. Langton points out that:
As genetic algorithms have been traditionally implemented, they clearly involve artificial selection: some human being provides explicit, algorithmic criteria for which of the entities is to survive to mate and reproduce. The real world, however, makes use of natural selection, in which it is the nature of the interactions among all the organismsboth with one another and with the physical environmentthat determines which entities will survive to mate and reproduce. It required a bit of experimentation to work out how to
124 Mathematics
bring about natural selection within the artificial worlds we create in computers.
patterns in Conways Game of Life), the organism consisted of cells that had certain values, or states, embedded in an environment of adjacent cells. The loop consisted of an outer layer of insulation (cells that had a state that would not be changed by surrounding cells) and an inner layer where the patterns responded to rules that caused them to transmit the information needed to construct the organism.
This self-reproducing cellular automaton is known as the Langton loop. The little numbers represent one of eight possible states of each cell, with state 8 being blank (quiet). The time numbers represent the generation or number of iterations of the rules.
126 Mathematics
The states were defined according to a table that might say, for example: If the current cell is in state 3 and its immediate neighbor is state 5, then change to state 7. The result of the rules and interactions would be that the loop would create another loop with the same shape and then pump the information needed for construction into it. Finally, the new loop would interpret the commands it had received and use them to complete the process of reproduction. Sitting in front of the screen, Langton started the program and watched as the initial loop activated. Levy reproduced some of Langtons notes about what happened next:
Im watching it now. It looks like it will also reproduce itself and Im hoping that [the] construction arm is long enough. . . . The daughter reproduced perfectly, the construction arm is OK! Exactly the right length! The daughter reproduces too! Were off!
While what was happening in Langtons Apple II may not have looked like much to a biologist, it was quite analogous to how living cells reproduce. The information within the loop corresponded to the sequence of instructions in the cells DNA. The copying of that information into a new cell (the daughter) corresponded to the splitting and copying of chromosomes. Finally, the execution of the copied instructions was like the directed synthesis of proteins that resulted in a complete new organism. Once Langton had self-reproducing artificial organisms, the next step was to let a bunch of them reproduce and interact. In other words, he began to simulate a natural environment, or virtual ecosystem. Rather than give the simulated computer code organisms a specific task, they were left free to interact, seeking simulated food, dealing with predators and other stresses, and if they survived, creating the gene pool for the next generation.
would give him a fellowship to enable him to study a field that no one had heard of. Finally, a program called the Logic of Computers Group at the University of Michigan offered to set up a special graduate curriculum for him. Langton had to cope with the academic turmoil that was gradually disassembling the Logic of Computers Group. The focus of the group was changing to supposedly more practical computer applications, but Langton kept pursuing artificial life experiments, aided by John Holland, a computer scientist who had pioneered genetic (evolutionary) programming back in the 1960s.
AND
COMPUTER ANIMATION
Starting in the 1980s, computer workstations became powerful enough to be used to create realistic animation (called CGI) that would revolutionize the production of movies such as the various Star Wars sequels. The problem was that it was very difficult to create detailed top-down algorithms to specify how a character should behaveand executing the algorithms could heavily tax the resources of the computer. In 1987, computer animation programmer Craig Reynolds designed a program called Boids. It used three simple rules of interaction to create a flock of virtual birds that, like a real flock, could maintain its coherence while going around obstacles. Techniques using what was in effect a type of cellular automation proved to be ideal for movie animators who needed, for example, to create realistic-looking armies of aliens or spectacular space battles. Similar techniques could be used on a more subtle level to create human characters who reacted with realistic body language in movies or training simulators.
128 Mathematics
were very simple: If the cell in front of the V was blank, the ant continued moving forward. If the square was blue, the ant set it to yellow, then turned right. If it encountered a yellow cell, it set it to blue, then turned left. The vant thus left a trail of colored squares behind it. A single vant was not very interesting. When more than one was added, however, some interesting behavior emerged. Vants would start to follow each others trails, much as real ants leave trails of chemical pheromones. Sometimes two vants would begin weaving around each other, creating a spiral trail. Langton could not help but wonder whether actual social insects like ants were really living cellular automata that followed a few simple rules to construct their elaborate colonies. At any rate, Langton believed that he had proven the power of an artificial life simulation to create natural behavior that was worthy of further study.
Information Is Life
Meanwhile, though, Langton still had not gotten his doctorate. The now practically minded computer science department at the University of Michigan was not inclined to let Langton write a doctoral thesis based on his artificial life experiments. Langton had read a paper by Stephen Wolfram (see chapter 10, A New Kind of Science?) that categorized cellular automata according to their ability to generate interesting new forms. In turn, Langton was inspired to apply Wolframs ideas to his artificial life experiments, asking the question What characteristics lead life artificial or naturalto thrive? Langton believed that the flow of information was at least one of the keys to the success of life. He devised experiments where he could use a mathematical function to control how readily information flowed from one generation of the system to the next. Langton found that this lambda parameter needed to be fine-tuned. If it is too low, the system was stable but unchanging, like a crystal. Set too high, the information moved too freely, becoming chaotic and losing the context needed to interpret it. One could think of this as an information gas. An intermediate value of lambda,
however, provided both variety and stability, allowing the most lifelike phenomena. This was the liquid state. Langton would coin a famous phrase to describe this vital state: life on the edge of chaos. Somehow, after millions of years, conditions on Earth must have reached a state like this, allowing for an explosion of living forms.
Finally, Langton was able to organize the first conference in the field, an Interdisciplinary Workshop on the Synthesis and Simulation of Living Systems. Taking place in September 1987, the conference inspired its participants to begin an ambitious variety of projects, much as the 1956 Dartmouth conference had launched the field of artificial intelligence. Proceedings, papers, and journals would follow in the coming decadeartificial life had become a recognized field. Although it would take time, the world of evolutionary biology began to pay attention to the rather grandiose-sounding claims of Langton and his colleagues. Richard Dawkins, one of the worlds
130 Mathematics
premier experts on evolution, even wrote an evolution simulator on his Macintosh, hoping to illustrate some of the ideas for his book The Blind Watchmaker. Dawkins hoped that the program would provide examples of how evolution can generate amazing complexity without the need for any external designer. He deliberately kept things simple, offering the program some simple shapes that he hoped would evolve to resemble plants. But Dawkins was in for quite a surprise. As he recounted in the book:
When I wrote the program I never thought that it would evolve anything more than a variety of tree-like shapes. . . . Nothing in my biologists intuition, nothing in my 20 years experience in programming computers, and nothing in my wildest dreams, prepared me for what actually appeared on the screen. I cant remember exactly when in the sequence it first began to dawn on me that an evolved resemblance to something like an insect was possible. With a wild surmise, I began to breed, generation after generation, from whatever child most looked like an insect. My incredulity grew in parallel with the evolving resemblance. . . . I still cannot conceal to you my feeling of Artificial life in a digital environment. The selfreplicating computer programs are represented exultation as I first by small geometric objects in various colors watched these exquior shades. The roads represent computer site creatures emergmemory for which the programs compete, ing before my eyes. I while the lightning indicates a source of distinctly heard the mutations. The skull is the Grim Reaper that eliminates programs that have become too triumphal opening old or defective. (Anti-Gravity Workshop) chords of Also sprach
AND
ARTIFICIAL LIFE
In his Third Edge essay, Christopher Langton talks about the relationship between two of the most fascinating projects in computer science, artificial intelligence (AI) and artificial life (AL). He points out that the two pursuits have similarities and differences:
I dont see artificial intelligence and artificial life as two distinct enterprises in principle; however, theyre quite different in practice. Both endeavors involve attempts to synthesizein computersnatural processes that depend vitally on information processing. I find it hard to draw a dividing line between life and intelligence. Both AI and AL study systems that determine their own behavior in the context of the information processes inside them.
Langton goes on to point out that AI tended to aim at the most complex goal, replicating human intelligence. After some initial success, AI ran into difficulties with some seemingly simpler things, such as how to recognize a face, walk, or catch a ball. Artificial life, on the other hand, starts with relatively simple systems and rules and tries to see how more complex behaviors might arise from them. In practice, AI researchers, too, have often taken this bottom-up approach. For example, robot designers Rodney Brooks and Cynthia Breazeal at MIT designed robots in the 1980s and 1990s whose behavior emerged from layers of relatively simple systems that interacted with the environment and each other.
Zarathustra (the 2001 theme) in my mind. I couldnt eat, and that night my insects swarmed behind my eyelids as I tried to sleep.
132 Mathematics
and allow new forms of behavior to emerge. Consciousness may have a connection to quantum mechanics (see chapter 8, From Cosmos to Mind), or it may simply emerge from the complex interactions of relatively simple systems. In his Third Edge essay, Langton asks:
What trick is it that nature capitalized on in order to create consciousness? We dont yet understand it, and the reason is that we dont understand what very distributed, massively parallel networks of simple interacting agents are capable of doing. We dont have a good feel for what the spectrum of possible behaviors is. We need to chart them, and once we do we may very well discover that there are some phenomena we didnt know about beforephenomena that turn out to be critical to understanding intelligence.
Like artificial intelligence, artificial life has had its times of popularity and optimism and its times of difficulty and obscurity. When Steven Levy wrote his book Artificial Life in 1992, the field was only about a decade old and seemed poised (like fractals, chaos, and other mathematical and scientific movements) to transform technology and the understanding of nature. On the one hand, the term artificial life is not seen in the media nearly as much in the first decade of the 21st century as it was two decades earlier. But this does not mean that the work of Christopher Langton and other researchers was in vain. Techniques from artificial life research are found today in everything from sophisticated characters for online role-playing games to software agents that can help people find information or shop, to simulations that researchers at the Centers for Disease Control and Prevention hope might help the world deal with the next big flu epidemic. On a negative note, some of the most effective examples of artificial life are found today in the form of computer viruses and worms. Meanwhile, the search to understand life where mathematics meets biology goes on.
Chronology
1948 Christopher Langton is born in Cambridge, Massachusetts; around this time, John von Neumann and Stanisaw Ulam begin to design self-reproducing automata After dropping out of college and getting a job in a computer lab, Langton is exposed to John Conways Game of Life Langton begins to design virtual life-forms, creating a selfreproducing Langton loop Langton begins graduate study at the University of Michigan Langton organizes the rst International Conference on the Synthesis and Simulation of Living Systems at the Los Alamos National Laboratory Articial life activities grow through conferences and journals; Rodney Brooks and his colleagues apply similar techniques to the design of robots at MIT; development of software agents by Pattie Maes and others draws on articial life techniques Langton nally completes his doctorate at the University of Michigan Simulation of life at a detailed molecular level is under way
1990s
1992 2000s
Further Reading
Books
Dawkins, Richard. The Blind Watchmaker. New York: W. W. Norton, 1996.
A tour de force explanation of how evolution works and how complexity emerges without the necessity of an external designer.
Langton, Christopher G., ed. Artificial Life: An Overview. Cambridge, Mass.: MIT Press, 1995.
A collection of papers on a variety of topics relating to artificial life.
134 Mathematics
Levy, Steven. Artificial Life: The Quest for a New Creation. New York: Pantheon Books, 1992.
A vivid account of the development of evolutionary software and artificial life during the 1980s, including the work of Christopher Langton and Stephen Wolfram.
Web Site
Welcome to Zooland: The Artificial Life Resource. URL: http:// zooland.alife.org. Accessed on July 18, 2006.
This site provides a huge variety of links to background materials and simulations for exploring artificial life. They range from the classic Core Wars to Langtons Vants to Thomas Rays rich and sophisticated simulated ecology Tierra.
10
A NEW KIND OF SCIENCE?
STEPHEN WOLFRAM AND THE UNIVERSAL AUTOMATON
ver since the time of Galileo (and particularly, since Newton), mathematics has been used as a tool to describe the dynamics of natureeverything from the simple effects of gravity on moving objects to extremely complex phenomena of turbulent flow and the generation of weather. The discovery of chaotic systems (see chapter 6, On Butterfly Wings) showed that there were many phenomena that could not be precisely predicted by equations. Chaos, however, did not overturn the basic paradigm where equations were fitted to observed phenomena in order to describe and perhaps manipulate them. Mathematicians acquired new tools and understandings, but they still approached nature in basically the same way.
135
Stephen Wolfram created the Mathematica program, bringing the power of symbolic mathematics to the desktop. His extensive study of cellular automation has led him to propose a controversial new scientific paradigm. (Photo
David Reiss/Wolfram Research, Inc.)
136 Mathematics
A mathematical physicist turned software developer, Stephen Wolfram has issued a bold challenge to scientists. Through his extensive study of cellular automata (see chapter 7, Games of Emergence), Wolfram came to believe that the way to approach the phenomena of nature was not to fit calculations to observed data but to find simple sets of rules that generate the complexity one sees in nature, particularly in biology. Ultimately, Wolfram believes that nature is in effect a computer that uses many simple but powerful programs, and that his approach to studying them amounts to a new scientific revolution.
Teenage Physicist
Stephen Wolfram was born on August 29, 1959, in London, England. Wolframs father was a modestly successful novelist, while his mother was a philosophy professor at the University of Oxford. Like many children of the Space Age of the 1960s, he was intrigued by space exploration, astronomy, and physics. Unlike most preteens, however, Wolfram began to read physics textbooks, bicycling back and forth to the local university library. When he was 13, Wolfram won a scholarship to Eton College. This famous institution is known for sports and the preparation of the sons of the wealthy for their future place in society. Young Wolfram had neither the social background nor the interest to fit into the world of Eton. Instead, he pursued his interest in science and ignored most of his other schoolwork, although he made some spending money by doing math and physics homework for his wealthier and less academically inclined classmates. At the age of only 15, Wolfram, apparently quite confident in his ability, wrote a paper on high-energy particle physics and sent it to professors at Oxford and Cambridge. They not only responded just as they would to professional colleagues, they reviewed that paper, and it was published in a physics journal. When he turned 16, Wolfram went to Oxford to see what the world of physics was like. As he recalled later to author Steven Levy:
I went to the first-year lectures and found them awful. The second day I went to the second-year lectures and found them correspondingly awful. On the third day I went to one third-year lecture and decided that it was all too horrible. I wasnt going to go to any more lectures.
Oxford had a very casual attitude toward lectures and classes: As long as a student passed the examination given at the end of the first year, it did not really matter what else he or she did. Wolfram did not think much of the famed Oxford dons and told them so. When the examination came, Wolfram passed it at the top of his class. Working at a level far beyond that of most graduate students, Wolfram had produced more than 25 scientific papers in little more than two years, and he earned his doctorate in theoretical physics at age 20.
Computers at Caltech
Wolfram was then invited to study at the California Institute of Technology by famed physicist Murray Gell-Mann. In 1981, Wolfram received a coveted MacArthur Foundation genius grant. The purpose of these awards is to give unusually creative individuals in science and the arts enough money to give them the means and time to pursue the project of their choice. With $120,000 in hand, Wolfram decided that what he wanted to do was use computers to generate and explore the many intriguing patterns that were starting to emerge from simple algorithms. He now believed that the sheer complexity of the structures he had been studying in physics and cosmology could not be adequately addressed by creating ever more complicated equations. Perhaps his computer could lead him to a different path. Many of Wolframs colleagues expressed dismay at the thought of a very promising young physicist studying some sort of simplistic computer program that would appear to have little to do with the pressing problems of physics. But Wolfram believed that a new
138 Mathematics
approach to using the computer to understand natural systems was well worth his essentially abandoning his physics career. Wolfram found that existing tools for doing symbolic mathematics on the computer were inadequate, so he wrote his own program, called SMP. However when Wolfram sought to market the program, Caltech said that it owned the rights because he had created the program while working as a researcher there. Wolfram took Caltech to court but lost the case. He left Caltech in 1982.
Wolfram used a set of 256 possible rules to generate a variety of types of cellular automation patterns. Each rule is numbered by converting the resulting colors to a binary number.
Mathematica
In 1987, Wolfram left academia and founded the company Wolfram Research, Inc. to develop mathematics software. At the time, the computer was widely used for calculation (spreadsheets alone had sold many a PC to businesses). There were also thousands of custom programs designed to help scientists and engineers with their work. However, contrary to popular belief, mathematicians spend little of their time actually calculating. What they really do is manipulate
140 Mathematics
symbols, using the procedures of algebra, calculus, and more esoteric branches of mathematics. Their blackboards are filled with x, y, n, and other letters. They simplify or transform expressions and equations. A computer program that did for symbolic math what had already been done for calculation and word processing would be a powerful tool indeed. In 1988, Wolfram and his development team of computer scientists and mathematicians released the first version of Mathematica. The program has been steadily expanded and improved ever since. The system includes a kernel that actually applies rules for transformation and computation, and a choice of front ends that communicate with the user and provide printing and graphing functions. Wolfram later developed versions of the software that could run on a Web server and be accessed by Web browsers, including those in handheld devices.
A Shortcut to Complexity?
Meanwhile, the more cellular automation rules he tried and the more patterns he saw, the more Wolfram became convinced that he was observing a phenomenon that was applicable . . . everywhere. As he would say later in A New Kind of Science, It will turn out that every detail of our universe does indeed follow rules that can be represented by a very simple programand that everything we see will ultimately emerge just from running this program. One of the key features Wolfram observed is that the complex patterns arising from cellular automation are computationally irreducible. This means that there is no way to create an equation, plug in a few values, and see what the automation will look like after 2,000 generations. The only way to find that out is to actually run the automaton and apply the rules 2,000 times. Wolfram has suggested that many phenomena in nature are similarly computationally irreducible. If so, the proper approach to them would not be to try to come up with an equation but to find the relevant rules. Some scientists disagree with Wolframs conclusion, however. Nigel Goldenfeld, is a physicist at the University of Illinois at Urbana-Champaign who has studied the formation of snowflakes
and the deposition of limestone in hot springs. He and his colleagues developed an approach to complex systems that identifies the broader patterns and ignores the more incidental details. Goldenfeld and a colleague, Navot Israeli, then applied this coarsegrained approach to the 256 types of one-dimensional cellular automata that Wolfram had studied. They found that by grouping the cells of the system together into supercells of eight or 10, they could then derive an overall pattern. In turn, they found they could
These photos of mollusk shells show how biochemical interactions in nature follow rules and yield results very similar to the cellular automatons that Wolfram and other researchers have developed. (Photo courtesy of Wolfram Research, Inc.)
142 Mathematics
predict the changes in these patterns even if they could not precisely specify the future state of the automaton. This approach has been used by other researchers to simplify complex, chaotic systems such as financial markets.
Universal Automaton
In trying out many kinds of rules for cellular automata, Wolfram found that there were distinct types of rules. (Christopher Langton had also discovered this; see chapter 9, Artificial Evolution.) Some rules resulted in fixed, unchanging (and ultimately boring) patterns.
Others produced periodic or cyclic behavior (interesting at first, but then boring). Chaotic cellular automata changed endlessly, but not very meaningfully. Finally, the mother lode was found in the form of complex rules that have enough structure to be meaningful and enough variety to remain interesting. The ultimate cellular automaton, however, is a universal one that can simulate any form of calculation, including another cellular automaton. This idea goes back to von Neumann, and John Conways Game of Life provides a simpler example. However, Wolfram designed a universal cellular automaton that was particularly easy to understand and use with any sort of rules.
Researchers have classified cellular automation systems into four categories. Fixed systems are unchanging, thus dead and uninteresting. Periodic systems cycle between various forms, showing energy but little novelty. Chaotic systems are unpredictable and can produce occasional beautiful patterns, but there is little to learn from them. Finally, the category of complex systems produce the combination of novelty and structure that seems most lifelike.
144 Mathematics
A representation of Wolframs Universal Cellular Automaton. This automaton can, given suitable starting conditions, emulate any definable system of rules. (Wolfram Research, Inc.)
most superficial level, the hefty volume serves as a kind of coffee table book of the varieties of complex structure that can be generated from cellular automation rules. In the preface to the book, Wolfram makes some bold statements and predictions. He begins with a claim that his work amounts to a new scientific revolution:
Three centuries ago science was transformed by the dramatic new idea that rules based on mathematical equations could be used to describe the natural world. My purpose in this book is to initiate another such transformation, and to introduce a new kind of science that is based on the much more general types of rules that can be embodied in simple computer programs.
Wolfram goes on to insist that this new kind of science touches almost every existing area of science, and quite a bit besides. Although he anticipates that there will be resistance to his ideas, Wolfram believes that they will eventually play a central role in science, technology, and other fields. If one opens the book and looks at the details, one certainly finds a variety of provocative suggestions about how the phenomena of physics, biology, and other sciences can be reinterpreted as the behavior of automata that follow as-yet-unknown rules. These discussions can lead interested readers (whether scientists or laypeople) to think for themselves about whether Wolframs ideas may be useful for a particular problem or application. Reactions to the book have been mixed. On the one hand, in an interview with Scientist magazine, Wolfram said that many biologists have sent him e-mails that took this general form: Heres a process in biology. It seems that your methods would allow us to understand it. What kind of comments do you have? Wolfram then elaborated on how he thought his work might aid biologists:
I think theres a tremendous awareness in that community that the next big steps have to involve theoretical modeling, and trying to
146 Mathematics
understand global mechanisms. Questions about evolution theory often loom large in public discussions of biology. But a much greater interest among practicing biologists is to take what Ive done and use it as a framework for new basic models and theories. People recognize that the genome contains some kind of program; the question is, what does that program actually do? And that is the kind of question my book gives one general methods to address.
On the other hand, participants in symposium on the book at Caltech agreed that Wolframs book did not represent a true paradigm shift or fundamental change in the understanding of the universe, let alone a change in the ground rules of science itself. Wolfram suggested that the reactions of these scientists were in fact typical of the response to a paradigm shift that threatened entrenched ideas. However, moderator physicist Steven Koonin quipped in return that the reaction was also typical when the idea was not a paradigm shift.
Wolfram, however, has said that he wanted to wait until his work was complete and coherent rather than publishing it piecemeal where it was likely to be misunderstood. Wolfram has given similar reasons for publishing his own book even though his reputation would probably have brought interest from scientific publishers. Wolfram can therefore make good arguments that these criteria of pseudoscience do not apply to him. However, other criteria given by Naiditch suggest that a pseudoscientist tends to not give proper credit to other scientists, instead claiming to be the originator of every relevant discovery. Wolframs A New Kind of Science contributes to this impression by not having footnotes or a bibliography that would enable readers to see where his work fits into that of others. Although certain characteristics might make one suspicious that a new idea is pseudoscience, ultimately the only real test is whether the idea actually enables scientists to obtain useful new information about how the world works. On this, for Wolfram, the jury is probably still out.
148 Mathematics
other hand, if one wants to know where the Moon will be tomorrow, simple formulas based on Newtons laws (with perhaps a slight tweak from Einstein) will give a good enough answer. Equations also provide ways to understand more general concepts such as force, friction, or oscillation. They thus help scientists think about new problems in terms of phenomena they already understand. Wolframs approach, on the other hand, seems to work more on a case-by-case basis. While it is probably possible to develop general concepts by finding different cellular automata to relate to different phenomena, there simply has not been enough experience to determine how best to use Wolframs ideas. Thus to the extent Wolframs work flourishes, it will probably flourish alongside conventional science, offering if not a new science, a new tool for scientists. Meanwhile, Wolfram seems not to be bothered by critics of his work or of his personality. When asked by an interviewer from Scientist, Are you modest? he replied:
Different people have different opinions on that. Its hard to see from the inside. Certainly I am a person who values truth over modesty. For example, in my book I chose to talk quite explicitly about the importance of some of my ideas and discoveries, because without that, it would be much more difficult for people to get a correct handle on where these fit in. My situation in life has let me really be an independent scientist. And that means I can optimize communicating ideas, rather than having my colleagues applaud my humility.
Chronology
1959 196772 1972 1973 Stephen Wolfram is born on August 29 in London, England Wolfram becomes interested in science and reads physics textbooks Wolfram earns a scholarship to Eton College at age 13 Wolfram begins to write computer simulations
Wolfram writes his rst scientic paper (on high-energy physics) Wolfram graduates from Eton College with honors and goes to Oxford University Wolfram does research in quantum physics and cosmology Wolfram receives his Ph.D. in theoretical physics from the California Institute of Technology; he continues physics research Wolfram receives a MacArthur genius grant Wolfram begins research on cellular automata; the rst version of Wolframs SMP math manipulation software is released Wolfram leaves Caltech after a dispute over the rights to SMP and goes to the Institute for Advanced Study at Princeton Wolfram establishes a classification system for cellular automata Wolfram applies cellular automata to applications such as cryptography and uid dynamics Wolfram moves to the University of Illinois to teach physics, math, and computer science; the development of Mathematica software begins; Wolfram publishes the journal Complex Systems Wolfram founds Wolfram Research, Inc.; he begins move from academia to the private sector The rst version of Mathematica is released; Wolfram also writes a book to explain the software Wolfram begins work on A New Kind of Science Wolframs collected papers on Cellular Automata and Complexity are released Wolframs Calculation Center and Mathematical Explorer software is released An Internet-based version of Mathematica is released
150 Mathematics
2002 2003
Wolfram self-publishes A New Kind of Science Wolfram organizes conferences and classes on A New Kind of Science
Further Reading
Books
Wolfram, Stephen. Cellular Automata and Complexity: Collected Papers. Reading, Mass.: Addison-Wesley, 1994.
Collects Wolframs papers on a variety of aspects of cellular automata.
Articles
Buchanan, Mark. Too Much Information: See the World in a Blur and the Future Comes into Focus. New Scientist 185 (February 2006): 32 ff.
Describes work that suggests that a coarse-grained approach can predict the future patterns in cellular automata, challenging Stephen Wolframs argument that such automata are computationally irreversible.
Hayes, Brian. The World According to Wolfram. American Scientist. Available online. URL: http://www.americanscientist. org/template/AssetDetail/assetid/13168/page/1;jsessionid=aaa6Wt PSM0X7hi. Accessed on July 10, 2006.
A detailed critical review of Wolframs A New Kind of Science.
Naiditch, David. Divine Secrets of the Ya-Ya Universe: Stephen Wolfram: A New Kind of Scienceor a Not-So-New Kind of Computer Program? Skeptic 10 (Summer 2003): 30 ff.
An in-depth critical look at Wolframs work that argues that he is making too many broad claims about the value of modestly interesting software and phenomena.
Wolfram, Stephen. Stephen Wolfram. The Scientist, 17, no. 7 (April 2003): 11.
Brief interview in which Wolfram describes what motivates his work and responds to the reaction of other scientists to it.
Web Sites
A New Kind of Science. URL: http://www.wolframscience.com. Accessed on July 5, 2006.
The official Web site for Stephen Wolframs book of the same name, including supplemental material and news.
e
sixth century B.C. fourth century B.C. eighth and ninth centuries 1202 14th and 15th centuries 17th century 1892 1900 193945 1944 1945
CHRONOLOGY
Pythagoras and his school teach that true reality is revealed by mathematics The Greek Parthenon is built using the golden ratio
Arab mathematicians adopt Indian numerals (19 and 0) and develop algebra Leonardo of Pisa introduces Arabic numerals to Europe with his book Liber Abaci The Renaissance leads to application of mathematics to art and architecture Galileo Galilei and Kepler apply mathematics to physics and astronomy; Newton and Leibniz invent calculus Karl Pearson publishes The Grammar of Science Pearson founds the journal Biometrika to promote modern statistical techniques in biology and other sciences World War II stimulates the development of the computer John von Neumann and Oskar Morgenstern publish their book on The Theory of Games and Economic Behavior Von Neumanns draft report on EDVAC outlines the features of the modern electronic digital computer 152
CHRONOLOGY 153
Von Neumann and Stanisaw Ulam begin to work on cellular automata John Nash publishes a key game-theory paper, The Bargaining Problem Nash publishes a paper, Two Person Cooperative Games Edward Lorenzs paper Deterministic Nonperiodic Flow introduces chaos theory but is largely ignored Roger Penrose and Stephen Hawking describe the singularity in black holes John H. Conways Game of Life is introduced in the pages of Scientic American Lorenz coins the term buttery effect to suggest how tiny changes in initial conditions can create drastically different results Penrose discovers a new way to tile objects on a surface Benot Mandelbrot coins the term fractal to describe a new kind of nested structure Fractals are popularized in many books, including Mandelbrots The Fractal Geometry of Nature; James Gleick and other writers popularize chaos theory Christopher Langton organizes the rst conference on articial life at Los Alamos Stephen Wolfram releases his Mathematica software Penrose takes on the articial intelligence community in his book The Emperors New Mind The eld of articial life ourishes Having largely recovered from mental illness, John Nash receives the Nobel Prize in economics for his work in game theory Wolfram publishes his massive and provocative book A New Kind of Science
2002
GLOSSARY
algebra The branch of mathematics that uses letters and symbols to represent known and unknown values algorithm A detailed procedure for performing a calculation or other task on a computer Arabic numerals The familiar numerals 1 to 9, plus 0. They were actually invented in India artificial intelligence The effort to create intelligent behavior in computers or robots artificial life The effort to simulate biological organisms and ecosystems on the computer. See also genetic programming attractor A point or curve toward which a dynamic or chaotic system eventually converges bell curve See normal distribution black hole An object (such as that resulting from a large collapsed star) that forms a singularity with infinite density and that has intense gravity and a boundary called an event horizon blinker A pattern in the Game of Life that alternates between two forms Brownian motion Random movement of small particles in a fluid, caused by jostling of adjacent molecules butterfly effect Term coined by Edward Lorenz for chaotic systems whose final form varies widely with slight changes in initial conditions. The metaphorical example is the flapping of a butterflys wings eventually creating a tornado calculus The branch of mathematics that deals with the relationship between changing quantities, using differentiation or integration cellular automaton A system where a pattern on a grid is operated on according to certain rules to create a new pattern. Many possible rules exist, and behavior can vary widely
154
GLOSSARY 155
chaos theory The study of dynamic systems that are deterministic but very sensitive to initial conditions computer model A program that incorporates equations describing a process (such as weather) and that can be used to simulate or predict the phenomenon cooperative game In game theory, a game in which groups of players are free to form coalitions for their mutual advantage correlation In statistics, the degree to which a change in one variable is related to a change in another. The range typically goes from -1 (a perfect inverse relationship) to 0 (no relationship) to 1 (a perfect direct relationship) dualism The split (associated with the thought of Plato) between the mind with its ideal forms and the body with its imperfect senses edge of chaos Christopher Langtons analysis that interesting, lifelike behavior depends on a flow of information that is novel but not chaotic emergence The process by which complex structure or behavior arises from a simpler predecessor. This is a key concept for much research in cellular automation and artificial life eugenics A theory, popular in the late 19th and early 20th centuries, that tried to apply evolutionary and genetic principles to identify superior human genes and encourage their reproduction, while discouraging reproduction by persons deemed to have inferior genes Fibonacci numbers A series of numbers introduced to Europe by Leonardo of Pisa. Each number in the series is the sum of the two preceding numbers. The series begins 1, 1, 2, 3, 5, 8 . . . fractal A shape that consists of endless layers that appear to have the same structure at every scale. A fractal has a fractional dimension greater than its apparent dimension Game of Life A cellular automaton invented by John H. Conway. Thousands of interesting patterns have been discovered game theory The branch of mathematics that analyzes strategic choices made by participants in a game, conflict, or bargaining situation general relativity The theory developed by Albert Einstein that explains the relationship between mass, energy, and gravity in terms of the shape of space-time
156 Mathematics
genetic programming A programming technique where competing programs are selected for fitness to perform a task, much as animals are subject to natural selection. Successful programs can have their code combined (simulating sexual reproduction) glider gun A pattern in the Game of Life that ejects an endless series of objects called gliders. It was discovered by William Gosper golden ratio A relationship where the smaller part has the same ratio to the larger part as the larger part has to the sum of the two parts. It is frequently found in the dimensions of rectangles, such as in the ancient Greek Parthenon. Numerically, the golden ratio (or golden section) is approximately 0.618 goodness of fit A measure that measures how well a statistical model fits a set of observations. Pearsons chi-square test is a commonly used method to calculate goodness of fit group theory The branch of mathematics concerned with groups and their possible symmetries. Groups can be used to classify phenomena, such as in physics and chemistry Incompleteness theorem A theorem proven by Kurt Gdel stating that for any consistent mathematical system, it is possible to construct assertions that are true but not provable using only the rules of that system kurtosis In statistics, a measure of how far outlying values are from the mean linear Having an output that varies smoothly and predictably according to the input Lorenz attractor A particular attractor for a chaotic system that has a butterfly-like shape. See also attractor Mandelbrot set A famous and complex fractal discovered by Benot Mandelbrot. See also fractal Mathematica Software developed by Stephen Wolfram to allow for manipulation of mathematical symbols using methods familiar to mathematicians matrix A two-dimensional array of numbers that can be manipulated as a unit (such as multiplication) mean In statistics, the average of a group of values microtubule A cylindrical protein structure in cells. Roger Penrose believes that microtubules in neurons may be able to use quantum effects to store multiple states or information
GLOSSARY 157
Nash equilibrium In game theory, the state in which each player has selected the best strategy in the light of the others choices. John Nash proved that at least one equilibrium must exist in any finite game with any number of players natural selection In evolution, the process by which those organisms that have the most suitable traits for survival in a given environment will reproduce and pass the traits to offspring normal distribution In statistics, the distribution of essentially random data (such as variations in data) is plotted along a bell curve where values cluster near the middle and taper off symmetrically to either side number theory The study of the properties and relationships of numbers, particularly integers Penrose tiles A pattern of tiles discovered by Roger Penrose that can cover a space completely but without repeating Pythagorean theorem The theorem identified with the ancient Greek mathematician Pythagoras. It states that in a rightangled triangle, the square of the length of the hypotenuse (diagonal) is equal to the sum of the squares of the lengths of the other two sides quantum computer A computer in which each memory location can hold many values at the same time because of a quantum superposition. In theory, quantum computers would be vastly more powerful than conventional machines quantum theory The branch of physics that deals with the behavior of objects at the level of atoms and subatomic particles Renaissance A period in European history characterized by a revival and flourishing of art and architecture and a focus on human nature and capabilities; roughly the 15th and 16th centuries Roman numerals The ancient Roman system where numbers were assigned to certain letters of the alphabet (such as L = 50 and C = 100). Numbers were aggregated through addition or subtraction rather than using a place value system. See also Arabic numerals schizophrenia A mental disorder characterized usually by disorganized thinking (the word means roughly shattered mind) and often by delusions or hallucinations set theory The branch of mathematics that deals with defining and manipulating groups of abstract objects
158 Mathematics
singularity In mathematics, a point where a function becomes infinite or undefined. In physics, a point of infinite density where gravity causes infinite curvature, as in a black hole standard deviation In statistics, a measure of how dispersed a set of data points are; specifically, the standard deviation is the square root of the variance statistics Collection, organization, and analysis of data using mathematical tools stored program computer A computer that, like all modern computers, holds program instructions as well as data in memory. John von Neumann is often credited with the concept strange attractor An attractor in a chaotic system, or that has fractal dimension. See attractor and fractal Turing machine See universal computer twistor A mathematical construct developed by Roger Penrose to describe the behavior of objects or fields in four-dimensional space-time universal computer A computer that is capable of performing any possible calculation (and thus, of simulating any other type of computer). Alan Turing first conceptualized a universal computer, so it is often called a Turing machine Vants Simulated ants created by Christopher Langton; they are an example of artificial life zero-sum game In game theory, a game in which any gain by one player involves a corresponding loss by the other player. Most traditional games (such as chess) fall into this category
e
Books
FURTHER RESOURCES
Albers, Donald J., and G. I. Alexanderson. Mathematical People: Profiles and Interviews. Boston: Birkhauser, 1985.
A collection of biographical sketches and interviews that bring out interesting aspects of mathematicians life and work.
Albers, Donald J., G. I. Alexanderson, and Constance Reid. More Mathematical People: Contemporary Conversations. Boston: Harcourt, Brace, Jovanovich, 1990.
Additional interviews focusing on mathematicians who are currently active.
Berlinski, David. Infinite Ascent: A Short History of Mathematics. New York: Modern Library, 2005.
Clearly explains 10 breakthroughs in the history of mathematics, from Pythagoras to Gdel.
Dainitith, John, and Richard Rennie, eds. The Facts On File Dictionary of Mathematics. 4th ed. New York: Facts On File, 2005.
An up-to-date dictionary of mathematical terms and concepts.
Gleick, James. Chaos: Making a New Science. New York: Viking, 1987.
Probably the best single account of the development of fractal geometry and the science of chaos, including the work of Mandelbrot and Lorenz.
Levy, Steven. Artificial Life: The Quest for a New Creation. New York: Pantheon Books, 1992.
An engaging account of the researchers who created the field of artificial life in the 1980s and early 1990s.
159
160 Mathematics
Mathematicians and Computer Wizards. (Macmillan Profiles) New York: Macmillan, 2001.
Provides biographical sketches of many mathematicians and people in the computer field.
Poundstone, William. The Recursive Universe. New York: William Morrow, 1985.
A classic account of developments in mathematics, computer science, and physics, with an emphasis on cellular automata and Conways Game of Life.
Yount, Lisa. A to Z of Women in Science and Math. New York: Facts On File, 1999.
A biographical dictionary covering many women who made important contributions to mathematics.
Internet Resources
Convergence. Available online. URL: http://mathdl.maa.org/convergence/1/ convergence/1. Accessed on July 24, 2006.
An online magazine focusing on providing resources for the history of mathematics; particularly geared toward teachers.
The MacTutor History of Mathematics Archive. Available online. URL: http://www-groups.dcs.st-and.ac.uk/~history/index.html. Accessed on May 5, 2006.
Provides extensive biographies and other background material on the history of mathematics.
Math Archives. University of Tennessee, Knoxville. Available online. URL: http://archives.math.utk.edu. Accessed on July 22, 2006.
Includes extensive links organized by mathematical topic.
Math Forum. Drexel University. Available online. URL: http://mathforum. org. Accessed on July 24, 2006.
Provides resources for math students and teachers (through high school).
Mathworld. Wolfram Research. Available online. URL: http://mathworld. wolfram.com. Accessed on July 18, 2006.
An extensive site with encyclopedia coverage of mathematical topics.
Periodicals
Journal of Recreational Mathematics
Published by Baywood Publishing Company 26 Austin Avenue Box 337
Amityville, NY 11701 Telephone: (800) 638-7819 Focuses on puzzles and other kinds of fun mathematics
Mathematical Connections
Steve Whittle or Keith Luoma University College Augusta State University Augusta, GA 30904-2200 Telephone: (706) 737-1685 Explores the relationship between mathematics and the humanities
Math Horizons
Published by the Mathematical Association of America 1529 Eighteenth Street, NW Washington, DC 20036-1385 Telephone: (800) 741-9415 A general-interest mathematics publication
Scientific American
415 Madison Avenue New York, NY 10017 Telephone: (212) 451-8200 Has coverage of mathematics, including regular columns on recreational mathematics
162 Mathematics
e
Note: Italic page numbers indicate illustrations.
INDEX
development of xvii recognition as field 129 Artificial Life (Levy) 132 astronomy, fractals in 69 Atomic Energy Commission, Neumann in 33 attractors 83, 84 automaton, cellular applications of 142 Conways work on 94 development of 3940 in Game of Life 94 Neumanns work on 3940 universality of 140, 141, 142, 144 Wolframs work on 138, 139, 140142 automaton, self-reproducing development of 3740 Langton loop 124126 Langtons work on 124126 Neumanns work on 3740, 39 states of 124 automaton rules, cellular in nature 140142, 141 as scientific paradigm 143146 types of 142143, 143 Wolframs work on 138, 139, 140146 Bargaining Problem, The (Nash) 49 Beautiful Mind, A (film) 55 Bell, E. T. 46 bifurcation behavior 82 binary, in data storage 3637 biology cellular automaton rules applied to 142, 145146 fractals in 69, 69 Biometrika (journal) 21, 2425 bipolar disorder 53 Bjerknes, Vilhelm 75 black holes Hawkings work in 109 Penroses work in 108 Blind Watchmaker, The (Dawkins) 130131 Boids (program) 127 Book of Numbers, The (Conway) 3637 brain holistic connectivity in 113 as quantum computer 113114, 116 quantum effects in 114 Breazeal, Cynthia 131 Brief History of Time, A (Hawking) 109 Brooks, Rodney 131 Browder, Felix 51 Budapest 30 Bugia (Algeria) 12 Burks, Arthur 37
A
Aiken, Howard 34 algebra, origin of term 5 algorithm 5 animals, Fibonacci numbers in 89 animation, computer 127 anomalies, in development of science 8384 Arabic numerals, calculating with, v. Roman numerals 23 Arab mathematicians 5 architecture, golden ratio used in 9, 10 art, cellular automaton rules applied to 142 artificial evolution 115, 123, 129131 artificial intelligence (AI) artificial life and 131 cellular automaton rules applied to 142 consciousness and 111113, 114115 artificial life applications of 132 artificial intelligence and 131 cellular automaton rules applied to 142 computer as environment for 120, 130 computer-simulated 122123 consciousness and 131132
B
bargaining, game theory in 49
163
164 Mathematics
C
California Institute of Technology (Caltech) Mandelbrot at 61 Wolfram at 137138 Cambridge, University of Conway at 92 Game of Life at 90 Pearson at 16 Cantor, Georg 53 Carnegie Institute of Technology, Nash at 46 cartography, fractal geometry in 82 cellular automaton applications of 142 Conways work on 94 development of 3940 in Game of Life 94 Neumanns work on 3940 universality of 140, 141, 142, 144 Wolframs work on 138, 139, 140142 cellular automaton rules in nature 140142, 141 as scientific paradigm 143146 types of 142143, 143 Wolframs work on 138, 139, 140143 cellular automaton systems 143 CGI 127 chaos in convection 79 deterministic 83 v. randomness 8283 in waterwheel 7981 in weather forecasting 7781 in weather systems 85 Chaos (Gleick) 70, 86 chaos theory development of xvii as fad 87
Mandelbrot and 71 as paradigm 8486 universality of 8485 chaotic automaton systems 143 chaotic behavior in geometry 64 in physics 64 chess mental illness and 53 at Princeton 47 chi squared 2021 Church, Alonzo 29, 34 climate, forecasting 79 coastlines, length of 58, 63 Codd, E. F. 124 coefficient of correlation 18 Common Sense in the Exact Sciences (Pearson) 17 complex automaton systems 143 compression, digital, fractals in 69 computer (digital) architecture for 35, 37 as artificial life environment 120, 130 development of xvi fractal patterns generated by 64, 65, 6667 Game of Life on 96 need for 3435 Neumanns work in 3537 storage in 3637 in weather forecasting models 7677, 78 Wolframs work with 137138 computer (quantum), brain as 113114, 116 computer (universal) self-reproducing automata as 124 in theory of computability 29, 34 computer animation 127
computer data binary storage of 3637 encoding in eight bits 102 in quantum computer 114 computer memory brain structure and 113 for program storage 36 computer programming Langtons work in 121 mathematics and 101 computer programs for fractal generation 67 for mathematics 139 140 storage of 3536 for symbolic mathematics 138 computer science, cellular automaton rules applied to 142 computer simulations 38 computer viruses and worms, as artificial life 132 consciousness artificial intelligence and 111113 artificial life and 131132 physical nature of 110113 quantum mechanics in xviii, 113114, 116 consistency, measuring 19 convection, chaos in 79 Conway, John H. 90104, 91. See also Game of Life achievements and legacy of 102 background of 9091 chronology on 103 education of 92 games and puzzles of 9394 group theory work of 9293
INDEX 165
in history of mathematics xvii personality of 100102 success of 93 symmetry work of 9293 work habits of 100 102 Conway group 93 correlation, measuring 21 cosmic censorship 108 cybernetics, as fad 87
D
data storage in binary 3637 encoding in eight bits 102 in quantum computer 114 Dawkins, Richard 129 131 D-day landing, weather during 75 deterministic chaos 83 Deterministic Nonperiodic Flow (Lorenz) 78 digital compression, fractals in 69 digital computer. See computer (digital) double pendulum, chaos in 81, 81 dualism, of Plato 11 Dynamical Pattern, A (Langton) 123
ecosystems, virtual 126 EDVAC 36, 37 Emperors New Mind, The (Penrose) 111 England, coastline of 58, 63 ENIAC 3536 equations, v. rules 140, 147148 Essence of Chaos, The (Lorenz) 82 eugenics Galton on 18 Pearsons work on 1925 politics and 23, 24 statistics in 1921 event horizon, singularities and 108 evolution artificial 115, 123, 129131 genetic programming and 123124 genetics in 2224 experimental science, statistical tools for 22 extensive form 49
F
Fads and Fallacies in the Name of Science (Gardner) 100 Farmer, Don 129 Fatou, Pierre 6566 Fechner, Gustav 10 Feigenbaum, Mitchell 82 Fibonacci, Leonardo 1, 114. See also Fibonacci numbers achievements and legacy of 12 Arabic numbers used by 23 background of 12 chronology on 1213 in history of mathematics xvi influence in Europe 4 number theory of 46
E
Earth, fractal nature of 68 earthquakes, distribution of 68 Eckert, J. Presper 35 economics game theory and 32 34, 4850 Nashs work in 4850 Neumanns work in 3234 random values in 6264
practical mathematics of 34 Fibonacci numbers discovery of 7, 78 in nature 8, 89 fingerprinting, use of 18 First Draft of a Report on the EDVAC (Neumann) 37 Fischer, Bobby 53 Fisher, R. A. 25 fivefold symmetry 110, 111 fixed automaton systems 143 Flos (Fibonacci) 4 fluid turbulence 82 fractal geometry applications of 6769 in cartography 82 development of xvii, 6467 Mandelbrots work in 6471 Fractal Geometry of Nature, The (Mandelbrot) 69 fractal patterns computer generation of 64, 65, 6667 construction of 66 in nature 69, 69 popularizing 6971 Fractals: Form, Chance, and Dimension (Mandelbrot) 68, 69 Francis Galton Laboratory of National Eugenics 2124 Frederick II (Holy Roman Emperor) 4
G
Galton, Francis 1719, 2124 Galton Laboratory 2124 Game of Life 98 at Cambridge University 90 continually growing pattern in 9799
166 Mathematics
Game of Life (continued) development of 9496 generations in 96, 97 glider in 98 glider gun in 9899, 99, 101 Gosper and 9899, 101 Langton influenced by 121122 rules of 95, 96 games of Conway 9394 diagramming 49 of Gardner 100 at Princeton 47 zero sum 49 game theory development of xvi economics and 3234, 4850 Nashs work in 48, 4850, 49 Neumanns work in 3234 Nobel Prize and 54 Gardner, Martin 100 general relativity, quantum mechanics and 112 genetic programming 123124 geometry chaotic behavior in 64 Mandelbrots study of 5960 geometry, fractal applications of 6769 in cartography 82 development of xvi, 6467 Mandelbrots work in 6471 Gleick, James on chaos 8586 on Mandelbrot 70 glider 98 glider gun 9899, 99, 101 global warming, forecasting 79 Go (game), at Princeton 47
Gdel, Kurt 29, 32 Goldenfeld, Nigel 140 142 golden ratio in architecture 9, 10 Fibonacci numbers in 910 Greek use of xv in musical scales 910 preference for 1012 Goldstine, Herman 37 goodness of fit test 2021 Gosper, William glider gun of 9899, 99, 101 in mathematics and computer programming 101 Grammar of Science (Pearson) 1719 gravity, in unified theory 112 Greeks Arab mathematicians influenced by 5 mathematics of xv, 11 philosophy of 11 group theory, Conways work in 9293 Guy, Richard 98, 101
I
IBM 701 (computer) 37 IBM Corporation, Mandelbrot at 6162 imaginary numbers 67 incompleteness theorem 32 information flow, in life 128129 information theory, as fad 87 insulin shock therapy 52 Interdisciplinary Workshop on the Synthesis and Simulation of Living Systems (conference) 129 Introducing Chaos (Stewart) 87 Islamic civilization influence on mathematics xv mathematicians of 5 in North Africa 12 Israeli, Navot 141142
J
Johann of Palermo 4 Julia, Gaston 6566 Julia sets 66
H
Hameroff, Stuart 114 Hausdorff-Besicovitch dimension, Mandelbrots work on 61 Hawking, Stephen 109 black hole work of 108 Penrose and 108, 115 Hein, Piet 47 Heisenberg, Werner 32 heredity, in evolution 2224 Hex (game) 47, 100 Holland, John 123 Houthakker, Hendrick 62 humans, patterns used by xv hydrogen bomb, Neumann and 33
K
Khwarizmi, al- 5 Kings College (Cambridge), Pearson at 16 Kitab al-jabr wa al-muqabalah (al-Khwarizmi) 5 Knuth, Donald 92 Kriegspiel (game), at Princeton 47 kurtosis, Pearsons work on 20 Kurzweil, Ray 114115 Kyoto Prize, for Lorenz 86
L
Langton, Christopher 119, 119134 artificial life work of 126132
INDEX 167
background of 120 121 chronology on 133 computer programming work of 121 education of 121, 122, 127 Game of Life work of 121122 genetic programming work of 123 in history of mathematics xvii life simulations by 122123 self-reproducing automata of 124126, 125 virtual ants of 127 128 Langton loop 124126, 125 Leonardo of Pisa. See Fibonacci, Leonardo Levinson, Zipporah 51 Lvy, Paul-Pierre 60 Levy, Steven 132 Liber Abaci (Fibonacci) 23 Liber Quadratorum (Fibonacci) 46 life artificial. See artificial life flow of information in 128129 Life (game), development of xvii living organisms, essential characteristics of 119120 Logic of Computers Group (University of Michigan) 127 Lorenz, Edward 7489, 75 achievements and legacy of 8688 background of 7475 chaos work of 7786 chronology on 88 education of 75
in history of mathematics xvii weather forecasting models of 7578 Lorenz attractor 83, 84 Los Alamos National Laboratory Feigenbaum at 82 Langton at 129
M
MacArthur Foundation genius grant, for Wolfram 137 Mandelbrojt, Szolem 59, 60 Mandelbrot, Benot 58 73, 59 achievements and legacy of 71 background of 5860 chaos theory and 71 chronology on 7172 economics work of 6264 education of 5961 fractal geometry work of 6471 in history of mathematics xvii personality of 70 Mandelbrot set 65, 6567 Manhattan Project, Neumann in 33 Mark I (calculator) 34 Massachusetts Institute of Technology (MIT) Gosper at 98 Lorenz at 7576 Nash at 50 Mathematica (program) 55, 140 Mathematical Foundations of Quantum Mechanics, The (Neumann) 32 mathematical physics, Penrose and 107108 Mathematical Theories of Games of Communication (Mandelbrot) 61
mathematicians mental illness and 53 work of 139140 mathematics business uses of 34 cellular automaton rules applied to 142 computer programs for 139140 computers and 101 in describing nature 135136 origin of term 11 patterns in xv recreational 100 symbolic, computer program for 138 Mauchly, John 35 McCarthy, John 111 mean, statistical Pearsons work on 20 regression to the 18 measurement, distribution of 20 mechanics, Pearsons work in 17 memory (computer) brain structure and 113 for program storage 36 Mendel, Gregor 24 Men of Mathematics (Bell) 46 mental illness mathematicians and 53 of Nash 5154 Michigan, University of 127 microtubules 114, 116 military, scientific work with 33 mind. See brain; consciousness Minsky, Marvin 111 Morgenstern, Oskar 34 Morphy, Paul 53 musical scales, Fibonacci numbers in 910
N
Naiditch, David 146147 Nash (game) 47, 100
168 Mathematics
Nash, Alicia 50, 52, 54, 55 Nash, John 4457, 45 background of 4446 bargaining work of 49 chronology on 5657 education of 4547 game theory work of 48, 4850, 49 in history of mathematics xvi Nobel Prize of 5455 personality of 47 psychotic breakdown of 5152 schizophrenia of 5154 software used by 55 transactions work of 49 Nash equilibrium 48, 50 nature cellular automaton rules in 140142, 141 fractals in 69, 69 mathematics in describing 135136 Plato on 11 Pythagoras on 11 Neumann, John von 30 achievements and legacy of 40 background of 2930 chronology on 4042 computer architecture of 35, 3637 computer work of 3537 economics work of 3234 education of 31 game theory work of 3234 in history of mathematics xvi Mandelbrot and 61 Nash and 48 quantum mechanics and 3132 self-reproducing automaton of 3740, 124
set theory paradox and 32 neurons, quantum effects in 114 New Kind of Science, A (Wolfram) xvii, 140, 143146 Newman, Donald 51 Neyman, Jerzy 1819 Nobel Prize game theory and 54 for Nash 5455 number, comprehensive definition of 92 number theory, Fibonacci on 46 numerology, in Nashs schizophrenia 53
O
Objections of an Unashamed Reductionist, The (Hawking) 115 observer, in description of reality 111 Oxford University, Wolfram at 136137
P
paradigms chaos theory as 8486 Wolframs rules as 143146 paradox, in set theory 32 patterns, in mathematics xv Patterson, Michael Stewart 94 payoff matrix 48 Pearson, Karl 16 achievements and legacy of 2425 background of 1517 chronology on 26 education of 1617 eugenics work of 1924 Grammar of Science 1719 in history of mathematics xvi
on scientific method 1719 statistics work of 1925 peer review 22 pendulum, chaos and 80, 8081, 81 Penrose, Roger 105118 achievements and legacy of 115116 background of 105 108 on brain as quantum computer 113114 chronology on 116 117 critics of 114 education of 107 in history of mathematics xviixviii on physics of consciousness 110113 tiling work of 110 Penrose tiling 110, 111 pentagons, tiling with 110 periodic automaton systems 143 Philosophers Football (game) 94 photography, fractals and 69 phyllotactic ratios 8, 8 physics cellular automaton rules applied to 142 chaos theory in 8586 chaotic behavior in 64 mathematical, Penrose and 107108 Neumanns work in 3132 places, system of, in Arabic numeral system 3 plants, Fibonacci numbers in 8, 8 Plato philosophy of 11 on reality 11, 113 politics, science used in 23 Polytechnique School of Paris, Mandelbrot at 60
INDEX 169
Practica geometriae (Fibonacci) 4 Preliminary Discussion of the Logical Design of an Electronic Computing Instrument (Neumann) 37 prices, random fluctuations in 6264 Princeton University games at 47 Mandelbrot at 61 Nash at 44, 47 Neumann at 31, 48 Wolfram at 139 Prisoners Dilemma (game) 48, 49 programs (computer) storage of 3536 for symbolic mathematics 138 pseudoscience 100, 146147 puzzles of Conway 9394 of Gardner 100 Pythagoras, philosophy of 11 Pythagorean theorem 6, 11 Pythagorean triples 56
Plato on 11, 113 Pythagoras on 11 Schrdinger on 111 recreational mathematics 100 regression to the mean 18 relativity, quantum mechanics and 112 research, scientific, measurement in 22 Reynolds, Craig 127 Riemann Hypothesis, Nash and 51 Rockford College, Langton at 121 Roman numerals, calculating with 2 Rossby, Carl-Gustaf 75 Routh, E. J. 16 rules for cellular automaton. See cellular automaton rules v. equations 140, 147148 Russell, Bertrand 32
S
scales, musical, Fibonacci numbers in 910 Schechtman, Dany 110 schizophrenia 5154 Scholz, Christopher 68 Schrdinger, Erwin 32, 111 science destructive uses of 33 experimental, statistical tools for 22 political use of 23 processes in development of 8384 theories as fads 87 scientific method, Pearson on 1719 scientific research, measurement in 22 seismology 68 self-reproducing automaton development of 3740 Langton loop 124 126, 125
Q
quantum computer brain as 113114, 116 storage in 114 quantum mechanics in consciousness xviii, 113114, 116 general relativity and 112 Neumanns work in 32
R
rabbits, breeding of, and Fibonacci numbers 7, 7 race, eugenics and 24 randomness, v. chaos 8283 reality observer in description of 111
Langtons work on 124126, 125 Neumanns work on 3740, 39 states of 124 set theory, Neumanns work in 32 Shadows of the Mind (Penrose) 113 simulations (computer) 38 singularity, in black holes 108, 109 SMP (program) 138 Spinors and Space-Time (Windler and Penrose) 110 Sprouts (game) 94 square numbers, Fibonaccis work with 56 standard deviation 19, 20 states, for self-reproducing automata 124, 126 statistics 1528 coefficient of correlation in 18 development of xvi in eugenics 1921 Galton in 18 measuring consistency with 19 Pearsons work on 1925 peer review of 22 regression to the mean in 18 standard deviation in 19 Steinitz, Wilhelm 53 Stewart, Ian 87 Stier, Eleanor 50 strange attractor 83 string theory, as unifying principle 112 Surreal Numbers (Knuth) 92 symbolic mathematics, computer program for 138
170 Mathematics
symmetry Conways work in 9293 fivefold 110, 111 statistical, Pearsons work on 20 in 24-dimensional object 9293
in theory of computability 29, 34 University of Cambridge Conway at 92 Game of Life at 90 Pearson at 16 University of Michigan 127
T
Tegmark, Max 114 telephone circuits, noise in 62 Tesla, Nikola 53 theory of everything, development of xvii Theory of Games and Economic Behavior, The (Neumann) 34 tiling 110, 111 transactions, Nashs work with 49 Turing, Alan 29, 34 24-dimensional group theory 9293 twistor 110
V
Vants 127128 virtual ants 127128
W
waterwheel, chaos in 7980 weather forecasting chaos in 7781 computer models for 7677, 78 limits to accuracy of 78 today 79 in World War II 75 weather systems, chaos in 85 Weldon, Walter 2124 Wiener, Norbert 33 Winning Ways for Your Mathematical Plays (Conway, Berlekamp, and Guy) 93 Wolfram, Stephen 135, 135151
background of 136137 cellular automaton rules work of 138, 139, 140143 cellular automaton work of 138, 139, 140142 chronology on 148 150 computer work of 137138 education of 136137 in history of mathematics xvii Langton influenced by 128 personality of 148 science of, assessment of 146148 Wolfram Research, Inc. 139 World War II Lorenz during 75 Mandelbrot during 5960 weather forecasting in 75
U
/ Ulam, Stanislaw 3839 unified theory 112 universal computer self-reproducing automata as 124
Y
Young Mens and Womens Discussion Club 17
Z
zero sum games 49