History of probability

Probability has a dual aspect: on the one hand the likelihood of hypotheses given the evidence for them, and on the other hand the behavior of stochastic processes such as the throwing of dice or coins. The study of the former is historically older in, for example, the law of evidence, while the mathematical treatment of dice began with the work of Cardano, Pascal, Fermat and Christiaan Huygens between the 16th and 17th century.

Probability deals with random experiments with a known distribution, Statistics deals with inference from the data about the unknown distribution.

Etymology

Probable and probability and their cognates in other modern languages derive from medieval learned Latin probabilis, deriving from Cicero and generally applied to an opinion to mean plausible or generally approved.^[1] The form probability is from Old French probabilite (14 c.) and directly from Latin probabilitatem (nominative probabilitas) "credibility, probability," from probabilis (see probable). The mathematical sense of the term is from 1718. In the 18th century, the term chance was also used in the mathematical sense of "probability" (and probability theory was called Doctrine of Chances). This word is ultimately from Latin cadentia, i.e. "a fall, case". The English adjective likely is of Germanic origin, most likely from Old Norse likligr (Old English had geliclic with the same sense), originally meaning "having the appearance of being strong or able" "having the similar appearance or qualities", with a meaning of "probably" recorded mid-15 c. The derived noun likelihood had a meaning of "similarity, resemblance" but took on a meaning of "probability" from the mid 15th century. The meaning "something likely to be true" is from 1570s.

Origins

Ancient and medieval law of evidence developed a grading of degrees of proof, credibility, presumptions and half-proof to deal with the uncertainties of evidence in court.^[2]

In Renaissance times, betting was discussed in terms of odds such as "ten to one" and maritime insurance premiums were estimated based on intuitive risks, but there was no theory on how to calculate such odds or premiums.^[3]

The mathematical methods of probability arose in the investigations first of Gerolamo Cardano in the 1560s (not published until 100 years later), and then in the correspondence Pierre de Fermat and Blaise Pascal (1654) on such questions as the fair division of the stake in an interrupted game of chance. Christiaan Huygens (1657) gave a comprehensive treatment of the subject.^[4]^[5]

In ancient times there were games played using astragali, or talus bone.^[6] The pottery of ancient Greece provides evidence to show that the astragali were tossed into a circle drawn on the floor, much like playing marbles. In Egypt, excavators of tombs found a game they called "Hounds and Jackals", which closely resembles the modern game snakes and ladders. According to Pausanias,^[7] Palamedes invented dice during the Trojan wars, although their true origin is uncertain. The first dice game mentioned in literature of the Christian era was called hazard. Played with two or three dice, it was probably brought to Europe by the knights returning from the Crusades. Dante Alighieri (1265–1321) mentions this game. A commenter of Dante puts further thought into this game: the thought was that with three dice, the lowest number you can get is three, an ace for every die. Achieving a four can be done with three dice by having a two on one die and aces on the other two dice.^[8]

Cardano also thought about the sum of three dice. At face value there are the same number of combinations that sum to 9 as those that sum to 10. For a 9:(621) (531) (522) (441) (432) (333) and for 10: (631) (622) (541) (532) (442) (433). However, there are more ways of obtaining some of these combinations than others. For example, if we consider the order of results there are six ways to obtain (621): (1,2,6), (1,6,2), (2,1,6), (2,6,1), (6,1,2), (6,2,1), but there is only one way to obtain (333), where the first, second and third dice all roll 3. There are a total of 27 permutations that sum to 10 but only 25 that sum to 9. From this, Cardano found that the probability of throwing a 9 is less than that of throwing a 10. He also demonstrated the efficacy of defining odds as the ratio of favourable to unfavourable outcomes (which implies that the probability of an event is given by the ratio of favourable outcomes to the total number of possible outcomes).^[9]^[10]

In addition, Galileo wrote about die-throwing sometime between 1613 and 1623. Unknowingly considering what is essentially the same problem as Cardano's, Galileo had said that certain numbers have the ability to be thrown because there are more ways to create that number.^[11]

Eighteenth century

Jacob Bernoulli's Ars Conjectandi (posthumous, 1713) and Abraham De Moivre's The Doctrine of Chances (1718) put probability on a sound mathematical footing, showing how to calculate a wide range of complex probabilities. Bernoulli proved a version of the fundamental law of large numbers, which states that in a large number of trials, the average of the outcomes is likely to be very close to the expected value - for example, in 1000 throws of a fair coin, it is likely that there are close to 500 heads (and the larger the number of throws, the closer to half-and-half the proportion is likely to be).

Nineteenth century

The power of probabilistic methods in dealing with uncertainty was shown by Gauss's determination of the orbit of Ceres from a few observations. The theory of errors used the method of least squares to correct error-prone observations, especially in astronomy, based on the assumption of a normal distribution of errors to determine the most likely true value. In 1812, Laplace issued his Théorie analytique des probabilités in which he consolidated and laid down many fundamental results in probability and statistics such as the moment-generating function, method of least squares, inductive probability, and hypothesis testing.

Towards the end of the nineteenth century, a major success of explanation in terms of probabilities was the statistical mechanics of Ludwig Boltzmann and J. Willard Gibbs which explained properties of gases such as temperature in terms of the random motions of large numbers of particles.

The field of the history of probability itself was established by Isaac Todhunter's monumental A History of the Mathematical Theory of Probability from the Time of Pascal to that of Laplace (1865).

Twentieth century

Probability and statistics became closely connected through the work on hypothesis testing of R. A. Fisher and Jerzy Neyman, which is now widely applied in biological and psychological experiments and in clinical trials of drugs, as well as in economics and elsewhere. A hypothesis, for example that a drug is usually effective, gives rise to a probability distribution that would be observed if the hypothesis is true. If observations approximately agree with the hypothesis, it is confirmed, if not, the hypothesis is rejected.^[12]

The theory of stochastic processes broadened into such areas as Markov processes and Brownian motion, the random movement of tiny particles suspended in a fluid. That provided a model for the study of random fluctuations in stock markets, leading to the use of sophisticated probability models in mathematical finance, including such successes as the widely used Black–Scholes formula for the valuation of options.^[13]

The twentieth century also saw long-running disputes on the interpretations of probability. In the mid-century frequentism was dominant, holding that probability means long-run relative frequency in a large number of trials. At the end of the century there was some revival of the Bayesian view, according to which the fundamental notion of probability is how well a proposition is supported by the evidence for it.

The mathematical treatment of probabilities, especially when there are infinitely many possible outcomes, was facilitated by Kolmogorov's axioms (1933).

References

^ Franklin (2001), pp. 113, 126.
^ Franklin (2001).
^ Franklin (2001), pp. 278–288.
^ Hacking (2006). For Cardano, see p. 54; for Fermat and Pascal, see pp. 59–61; for Huygens, see pp. 92–94
^ Franklin (2001), pp. 296–316.
^ David, F. N. (1969). Games, gods and gambling: the origins and history of probability and statistical ideas from the earliest times to the Newtonian era. London: Griffin. ISBN 978-0-85264-171-2.
^ Pausanias (2007). Description of Greece. 1: Books I and II. The Loeb classical library (Repr. ed.). Cambridge, Mass.: Harvard Univ. Press. ISBN 978-0-674-99104-0.
^ Franklin (2001), pp. 293–294.
^ Some laws and problems in classical probability and how Cardano anticipated them Gorrochum, P. Chance magazine 2012
^ Franklin (2001), pp. 296–300.
^ Franklin (2001), p. 302.
^ Salsburg (2001).
^ Bernstein (1996), Chapter 18.

Sources

Bernstein, Peter L. (1996). Against the Gods: The Remarkable Story of Risk. New York: Wiley. ISBN 0-471-12104-5.
Campe, Rüdiger (2012). The Game of Probability. Literature and Calculation from Pascal and Kleist. Stanford University Press. ISBN 9780804768641.
Daston, Lorraine (1988). Classical Probability in the Enlightenment. Princeton: Princeton University Press. ISBN 0-691-08497-1.
Franklin, James (2001). The Science of Conjecture: Evidence and Probability Before Pascal. Baltimore, MD: Johns Hopkins University Press. ISBN 0-8018-6569-7.
Hacking, Ian (2006). The Emergence of Probability (2nd ed.). New York: Cambridge University Press. ISBN 978-0-521-86655-2.
Hald, Anders (2003). A History of Probability and Statistics and Their Applications before 1750. Hoboken, NJ: Wiley. ISBN 0-471-47129-1.
Hald, Anders (1998). A History of Mathematical Statistics from 1750 to 1930. New York: Wiley. ISBN 0-471-17912-4.
Heyde, C. C.; Seneta, E., eds. (2001). Statisticians of the Centuries. New York: Springer. ISBN 0-387-95329-9.
McGrayne, Sharon Bertsch (2011). The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy. New Haven: Yale University Press. ISBN 9780300169690.
von Plato, Jan (1994). Creating Modern Probability: Its Mathematics, Physics and Philosophy in Historical Perspective. New York: Cambridge University Press. ISBN 978-0-521-59735-7.
Salsburg, David (2001). The Lady Tasting Tea: How Statistics Revolutionized Science in the Twentieth Century. Henry Holt and Company. ISBN 0-7167-4106-7.
Stigler, Stephen M. (1990). The History of Statistics: The Measurement of Uncertainty before 1900. Belknap Press/Harvard University Press. ISBN 0-674-40341-X.

External links

[FOOTNOTEFranklin2001113,_126-1] Franklin (2001), pp. 113, 126.

[FOOTNOTEFranklin2001-2] Franklin (2001).

[FOOTNOTEFranklin2001278–288-3] Franklin (2001), pp. 278–288.

[4] Hacking (2006). For Cardano, see p. 54; for Fermat and Pascal, see pp. 59–61; for Huygens, see pp. 92–94

[FOOTNOTEFranklin2001296–316-5] Franklin (2001), pp. 296–316.

[6] David, F. N. (1969). Games, gods and gambling: the origins and history of probability and statistical ideas from the earliest times to the Newtonian era. London: Griffin. ISBN 978-0-85264-171-2.

[7] Pausanias (2007). Description of Greece. 1: Books I and II. The Loeb classical library (Repr. ed.). Cambridge, Mass.: Harvard Univ. Press. ISBN 978-0-674-99104-0.

[FOOTNOTEFranklin2001293–294-8] Franklin (2001), pp. 293–294.

[9] Some laws and problems in classical probability and how Cardano anticipated them Gorrochum, P. Chance magazine 2012

[FOOTNOTEFranklin2001296–300-10] Franklin (2001), pp. 296–300.

[FOOTNOTEFranklin2001302-11] Franklin (2001), p. 302.

[FOOTNOTESalsburg2001-12] Salsburg (2001).

[FOOTNOTEBernstein1996Chapter_18-13] Bernstein (1996), Chapter 18.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

[13]