text:
History of statistics
From Wikipedia, the free encyclopedia
Jump to navigation Jump to search
The history of statistics in the modern sense dates from the mid-17th century, with the term statistics itself coined in 1749 in German, although there have been changes to the interpretation of the word over time. The development of statistics is intimately connected on the one hand with the development of sovereign states, particularly European states following the Peace of Westphalia (1648); and the other hand with the development of probability theory, which put statistics on a firm theoretical basis; see History of probability.
In early times, the meaning was restricted to information about states, particularly demographics such as population. This was later extended to include all collections of information of all types, and later still it was extended to include the analysis and interpretation of such data. In modern terms, "statistics" means both sets of collected information, as in national accounts and temperature records, and analytical work which requires statistical inference. Statistical activities are often associated with models expressed using probabilities, hence the connection with probability theory. The large requirements of data processing have made statistics a key application of computing; see history of computing hardware. A number of statistical concepts have an important impact on a wide range of sciences. These include the design of experiments and approaches to statistical inference such as Bayesian inference, each of which can be considered to have their own sequence in the development of the ideas underlying modern statistics.
Contents
1 Introduction
2 Etymology
3 Origins in probability theory
3.1 Development of modern statistics
4 Design of experiments
5 Bayesian statistics
6 Important contributors to statistics
7 References
8 Bibliography
9 External links
Introduction[edit]
By the 18th century, the term "statistics" designated the systematic collection of demographic and economic data by states. For at least two millennia, these data were mainly tabulations of human and material resources that might be taxed or put to military use. In the early 19th century, collection intensified, and the meaning of "statistics" broadened to include the discipline concerned with the collection, summary, and analysis of data. Today, data is collected and statistics are computed and widely distributed in government, business, most of the sciences and sports, and even for many pastimes. Electronic computers have expedited more elaborate statistical computation even as they have facilitated the collection and aggregation of data. A single data analyst may have available a set of data-files with millions of records, each with dozens or hundreds of separate measurements. These were collected over time from computer activity (for example, a stock exchange) or from computerized sensors, point-of-sale registers, and so on. Computers then produce simple, accurate summaries, and allow more tedious analyses, such as those that require inverting a large matrix or perform hundreds of steps of iteration, that would never be attempted by hand. Faster computing has allowed statisticians to develop "computer-intensive" methods which may look at all permutations, or use randomization to look at 10,000 permutations of a problem, to estimate answers that are not easy to quantify by theory alone..
The term "mathematical statistics" designates the mathematical theories of probability and statistical inference, which are used in statistical practice. The relation between statistics and probability theory developed rather late, however. In the 19th century, statistics increasingly used probability theory, whose initial results were found in the 17th and 18th centuries, particularly in the analysis of games of chance (gambling). By 1800, astronomy used probability models and statistical theories, particularly the method of least squares. Early probability theory and statistics was systematized in the 19th century and statistical reasoning and probability models were used by social scientists to advance the new sciences of experimental psychology and sociology, and by physical scientists in thermodynamics and statistical mechanics. The development of statistical reasoning was closely associated with the development of inductive logic and the scientific method, which are concerns that move statisticians away from the narrower area of mathematical statistics. Much of the theoretical work was readily available by the time computers were available to exploit them. By the 1970s, Johnson and Kotz produced a four-volume Compendium on Statistical Distributions (First Edition 1969-1972), which is still an invaluable resource.
Applied statistics can be regarded as not a field of mathematics but an autonomous mathematical science, like computer science and operations research. Unlike mathematics, statistics had its origins in public administration. Applications arose early in demography and economics; large areas of micro- and macro-economics today are "statistics" with an emphasis on time-series analyses. With its emphasis on learning from data and making best predictions, statistics also has been shaped by areas of academic research including psychological testing, medicine and epidemiology. The ideas of statistical testing have considerable overlap with decision science. With its concerns with searching and effectively presenting data, statistics has overlap with information science and computer science.
Etymology[edit]
Look up statistics in Wiktionary, the free dictionary.
The term statistics is ultimately derived from the New Latin statisticum collegium ("council of state") and the Italian word statista ("statesman" or "politician"). The German Statistik, first introduced by Gottfried Achenwall (1749), originally designated the analysis of data about the state, signifying the "science of state" (then called political arithmetic in English). It acquired the meaning of the collection and classification of data generally in the early 19th century. It was introduced into English in 1791 by Sir John Sinclair when he published the first of 21 volumes titled Statistical Account of Scotland.[1]
Thus, the original principal purpose of Statistik was data to be used by governmental and (often centralized) administrative bodies. The collection of data about states and localities continues, largely through national and international statistical services. In particular, censuses provide frequently updated information about the population.
The first book to have 'statistics' in its title was "Contributions to Vital Statistics" (1845) by Francis GP Neison, actuary to the Medical Invalid and General Life Office.[citation needed]
Origins in probability theory[edit]
Main article: History of probability
See also: Timeline of probability and statistics
Basic forms of statistics have been used since the beginning of civilization. Early empires often collated censuses of the population or recorded the trade in various commodities. The Roman Empire was one of the first states to extensively gather data on the size of the empire's population, geographical area and wealth.
The use of statistical methods dates back to least to the 5th century BCE. The historian Thucydides in his History of the Peloponnesian War [2] describes how the Athenians calculated the height of the wall of Platea by counting the number of bricks in an unplastered section of the wall sufficiently near them to be able to count them. The count was repeated several times by a number of soldiers. The most frequent value (in modern terminology - the mode ) so determined was taken to be the most likely value of the number of bricks. Multiplying this value by the height of the bricks used in the wall allowed the Athenians to determine the height of the ladders necessary to scale the walls.
In the Indian epic - the Mahabharata (Book 3: The Story of Nala) - King Rtuparna estimated the number of fruit and leaves (2095 fruit and 50,000,000 - five crores - leaves) on two great branches of a Vibhitaka tree by counting them on a single twig. This number was then multiplied by the number of twigs on the branches. This estimate was later checked and found to be very close to the actual number. With knowledge of this method Nala was subsequently able to regain his kingdom.
The earliest writing on statistics was found in a 9th-century book entitled: "Manuscript on Deciphering Cryptographic Messages", written by Al-Kindi (801–873 CE). In his book, Al-Kindi gave a detailed description of how to use statistics and frequency analysis to decipher encrypted messages. This text arguably gave rise to the birth of both statistics and cryptanalysis.[3][4]
The Trial of the Pyx is a test of the purity of the coinage of the Royal Mint which has been held on a regular basis since the 12th century. The Trial itself is based on statistical sampling methods. After minting a series of coins - originally from ten pounds of silver - a single coin was placed in the Pyx - a box in Westminster Abbey. After a given period - now once a year - the coins are removed and weighed. A sample of coins removed from the box are then tested for purity.
The Nuova Cronica, a 14th-century history of Florence by the Florentine banker and official Giovanni Villani, includes much statistical information on population, ordinances, commerce and trade, education, and religious facilities and has been described as the first introduction of statistics as a positive element in history,[5] though neither the term nor the concept of statistics as a specific field yet existed. But this was proven to be incorrect after the rediscovery of Al-Kindi's book on frequency analysis.[3][4]
The arithmetic mean, although a concept known to the Greeks, was not generalised to more than two values until the 16th century. The invention of the decimal system by Simon Stevin in 1585 seems likely to have facilitated these calculations. This method was first adopted in astronomy by Tycho Brahe who was attempting to reduce the errors in his estimates of the locations of various celestial bodies.
The idea of the median originated in Edward Wright's book on navigation (Certaine Errors in Navigation) in 1599 in a section concerning the determination of location with a compass. Wright felt that this value was the most likely to be the correct value in a series of observations.
Sir William Petty, a 17th-century economist who used early statistical methods to analyse demographic data.
The birth of statistics is often dated to 1662, when John Graunt, along with William Petty, developed early human statistical and census methods that provided a framework for modern demography. He produced the first life table, giving probabilities of survival to each age. His book Natural and Political Observations Made upon the Bills of Mortality used analysis of the mortality rolls to make the first statistically based estimation of the population of London. He knew that there were around 13,000 funerals per year in London and that three people died per eleven families per year. He estimated from the parish records that the average family size was 8 and calculated that the population of London was about 384,000; this is the first known use of a ratio estimator. Laplace in 1802 estimated the population of France with a similar method; see Ratio estimator § History for details.
Although the original scope of statistics was limited to data useful for governance, the approach was extended to many fields of a scientific or commercial nature during the 19th century. The mathematical foundations for the subject heavily drew on the new probability theory, pioneered in the 16th century by Gerolamo Cardano, Pierre de Fermat and Blaise Pascal. Christiaan Huygens (1657) gave the earliest known scientific treatment of the subject. Jakob Bernoulli's Ars Conjectandi (posthumous, 1713) and Abraham de Moivre's The Doctrine of Chances (1718) treated the subject as a branch of mathematics. In his book Bernoulli introduced the idea of representing complete certainty as one and probability as a number between zero and one.
A key early application of statistics in the 18th century was to the human sex ratio at birth.[6] John Arbuthnot studied this question in 1710.[7][8][9][10] Arbuthnot examined birth records in London for each of the 82 years from 1629 to 1710. In every year, the number of males born in London exceeded the number of females. Considering more male or more female births as equally likely, the probability of the observed outcome is 0.5^82, or about 1 in 4,8360,0000,0000,0000,0000,0000; in modern terms, the p-value. This is vanishingly small, leading Arbuthnot that this was not due to chance, but to divine providence: "From whence it follows, that it is Art, not Chance, that governs." This is and other work by Arbuthnot is credited as "… the first use of significance tests …"[11] the first example of reasoning about statistical significance and moral certainty,[12] and "… perhaps the first published report of a nonparametric test …",[8] specifically the sign test; see details at Sign test § History.
The formal study of theory of errors may be traced back to Roger Cotes' Opera Miscellanea (posthumous, 1722), but a memoir prepared by Thomas Simpson in 1755 (printed 1756) first applied the theory to the discussion of errors of observation. The reprint (1757) of this memoir lays down the axioms that positive and negative errors are equally probable, and that there are certain assignable limits within which all errors may be supposed to fall; continuous errors are discussed and a probability curve is given. Simpson discussed several possible distributions of error. He first considered the uniform distribution and then the discrete symmetric triangular distribution followed by the continuous symmetric triangle distribution. Tobias Mayer, in his study of the libration of the moon (Kosmographische Nachrichten, Nuremberg, 1750), invented the first formal method for estimating the unknown quantities by generalized the averaging of observations under identical circumstances to the averaging of groups of similar equations.
Ruder Boškovic in 1755 based in his work on the shape of the earth proposed in his book De Litteraria expeditione per pontificiam ditionem ad dimetiendos duos meridiani gradus a PP. Maire et Boscovicli that the true value of a series of observations would be that which minimises the sum of absolute errors. In modern terminology this value is the median. The first example of what later became known as the normal curve was studied by Abraham de Moivre who plotted this curve on November 12, 1733.[13] de Moivre was studying the number of heads that occurred when a 'fair' coin was tossed.
In 1761 Thomas Bayes proved Bayes' theorem and in 1765 Joseph Priestley invented the first timeline charts.
Johann Heinrich Lambert in his 1765 book Anlage zur Architectonic proposed the semicircle as a distribution of errors:
f ( x ) = 1 2 ( 1 − x 2 ) {\displaystyle f(x)={\frac {1}{2}}{\sqrt {(1-x^{2})}}}
with -1 < x < 1.
Probability density plots for the Laplace distribution.
Pierre-Simon Laplace (1774) made the first attempt to deduce a rule for the combination of observations from the principles of the theory of probabilities. He represented the law of probability of errors by a curve and deduced a formula for the mean of three observations.
Laplace in 1774 noted that the frequency of an error could be expressed as an exponential function of its magnitude once its sign was disregarded.[14][15] This distribution is now known as the Laplace distribution. Lagrange proposed a parabolic distribution of errors in 1776.
Laplace in 1778 published his second law of errors wherein he noted that the frequency of an error was proportional to the exponential of the square of its magnitude. This was subsequently rediscovered by Gauss (possibly in 1795) and is now best known as the normal distribution which is of central importance in statistics.[16] This distribution was first referred to as the normal distribution by Pierce in 1873 who was studying measurement errors when an object was dropped onto a wooden base.[17] He chose the term normal because of its frequent occurrence in naturally occurring variables.
Lagrange also suggested in 1781 two other distributions for errors - a raised cosine distribution and a logarithmic distribution.
Laplace gave (1781) a formula for the law of facility of error (a term due to Joseph Louis Lagrange, 1774), but one which led to unmanageable equations. Daniel Bernoulli (1778) introduced the principle of the maximum product of the probabilities of a system of concurrent errors.
In 1786 William Playfair (1759-1823) introduced the idea of graphical representation into statistics. He invented the line chart, bar chart and histogram and incorporated them into his works on economics, the Commercial and Political Atlas. This was followed in 1795 by his invention of the pie chart and circle chart which he used to display the evolution of England's imports and exports. These latter charts came to general attention when he published examples in his Statistical Breviary in 1801.
Laplace, in an investigation of the motions of Saturn and Jupiter in 1787, generalized Mayer's method by using different linear combinations of a single group of equations.
In 1791 Sir John Sinclair introduced the term 'statistics' into English in his Statistical Accounts of Scotland.
In 1802 Laplace estimated the population of France to be 28,328,612.[18] He calculated this figure using the number of births in the previous year and census data for three communities. The census data of these communities showed that they had 2,037,615 persons and that the number of births were 71,866. Assuming that these samples were representative of France, Laplace produced his estimate for the entire population.
Carl Friedrich Gauss, mathematician who developed the method of least squares in 1809.
The method of least squares, which was used to minimize errors in data measurement, was published independently by Adrien-Marie Legendre (1805), Robert Adrain (1808), and Carl Friedrich Gauss (1809). Gauss had used the method in his famous 1801 prediction of the location of the dwarf planet Ceres. The observations that Gauss based his calculations on were made by the Italian monk Piazzi.
The term probable error (der wahrscheinliche Fehler) - the median deviation from the mean - was introduced in 1815 by the German astronomer Frederik Wilhelm Bessel. Antoine Augustin Cournot in 1843 was the first to use the term median (valeur médiane) for the value that divides a probability distribution into two equal halves.
Other contributors to the theory of errors were Ellis (1844), De Morgan (1864), Glaisher (1872), and Giovanni Schiaparelli (1875).[citation needed] Peters's (1856) formula for r {\displaystyle r} , the "probable error" of a single observation was widely used and inspired early robust statistics (resistant to outliers: see Peirce's criterion).
In the 19th century authors on statistical theory included Laplace, S. Lacroix (1816), Littrow (1833), Dedekind (1860), Helmert (1872), Laurent (1873), Liagre, Didion, De Morgan and Boole.
Gustav Theodor Fechner used the median (Centralwerth) in sociological and psychological phenomena.[19] It had earlier been used only in astronomy and related fields. Francis Galton used the English term median for the first time in 1881 having earlier used the terms middle-most value in 1869 and the medium in 1880.[20]
Adolphe Quetelet (1796–1874), another important founder of statistics, introduced the notion of the "average man" (l'homme moyen) as a means of understanding complex social phenomena such as crime rates, marriage rates, and suicide rates.[21]
The first tests of the normal distribution were invented by the German statistician Wilhelm Lexis in the 1870s. The only data sets available to him that he was able to show were normally distributed were birth rates.
Development of modern statistics[edit]
Although the origins of statistical theory lie in the 18th-century advances in probability, the modern field of statistics only emerged in the late-19th and early-20th century in three stages. The first wave, at the turn of the century, was led by the work of Francis Galton and Karl Pearson, who transformed statistics into a rigorous mathematical discipline used for analysis, not just in science, but in industry and politics as well. The second wave of the 1910s and 20s was initiated by William Gosset, and reached its culmination in the insights of Ronald Fisher. This involved the development of better design of experiments models, hypothesis testing and techniques for use with small data samples. The final wave, which mainly saw the refinement and expansion of earlier developments, emerged from the collaborative work between Egon Pearson and Jerzy Neyman in the 1930s.[22] Today, statistical methods are applied in all fields that involve decision making, for making accurate inferences from a collated body of data and for making decisions in the face of uncertainty based on statistical methodology.
The original logo of the Royal Statistical Society, founded in 1834.
The first statistical bodies were established in the early 19th century. The Royal Statistical Society was founded in 1834 and Florence Nightingale, its first female member, pioneered the application of statistical analysis to health problems for the furtherance of epidemiological understanding and public health practice. However, the methods then used would not be considered as modern statistics today.
The Oxford scholar Francis Ysidro Edgeworth's book, Metretike: or The Method of Measuring Probability and Utility (1887) dealt with probability as the basis of inductive reasoning, and his later works focused on the 'philosophy of chance'.[23] His first paper on statistics (1883) explored the law of error (normal distribution), and his Methods of Statistics (1885) introduced an early version of the t distribution, the Edgeworth expansion, the Edgeworth series, the method of variate transformation and the asymptotic theory of maximum likelihood estimates.
The Norwegian Anders Nicolai Kiær introduced the concept of stratified sampling in 1895.[24] Arthur Lyon Bowley introduced new methods of data sampling in 1906 when working on social statistics. Although statistical surveys of social conditions had started with Charles Booth's "Life and Labour of the People in London" (1889-1903) and Seebohm Rowntree's "Poverty, A Study of Town Life" (1901), Bowley's, key innovation consisted of the use of random sampling techniques. His efforts culminated in his New Survey of London Life and Labour.[25]
Francis Galton is credited as one of the principal founders of statistical theory. His contributions to the field included introducing the concepts of standard deviation, correlation, regression and the application of these methods to the study of the variety of human characteristics - height, weight, eyelash length among others. He found that many of these could be fitted to a normal curve distribution.[26]
Galton submitted a paper to Nature in 1907 on the usefulness of the median.[27] He examined the accuracy of 787 guesses of the weight of an ox at a country fair. The actual weight was 1208 pounds: the median guess was 1198. The guesses were markedly non-normally distributed.
Karl Pearson, the founder of mathematical statistics.
Galton's publication of Natural Inheritance in 1889 sparked the interest of a brilliant mathematician, Karl Pearson,[28] then working at University College London, and he went on to found the discipline of mathematical statistics.[29] He emphasised the statistical foundation of scientific laws and promoted its study and his laboratory attracted students from around the world attracted by his new methods of analysis, including Udny Yule. His work grew to encompass the fields of biology, epidemiology, anthropometry, medicine and social history. In 1901, with Walter Weldon, founder of biometry, and Galton, he founded the journal Biometrika as the first journal of mathematical statistics and biometry.
His work, and that of Galton's, underpins many of the 'classical' statistical methods which are in common use today, including the Correlation coefficient, defined as a product-moment;[30] the method of moments for the fitting of distributions to samples; Pearson's system of continuous curves that forms the basis of the now conventional continuous probability distributions; Chi distance a precursor and special case of the Mahalanobis distance[31] and P-value, defined as the probability measure of the complement of the ball with the hypothesized value as center point and chi distance as radius.[31] He also introduced the term 'standard deviation'.
He also founded the statistical hypothesis testing theory,[31] Pearson's chi-squared test and principal component analysis.[32][33] In 1911 he founded the world's first university statistics department at University College London.
Ronald Fisher, "A genius who almost single-handedly created the foundations for modern statistical science",[34]
The second wave of mathematical statistics was pioneered by Ronald Fisher who wrote two textbooks, Statistical Methods for Research Workers, published in 1925 and The Design of Experiments in 1935, that were to define the academic discipline in universities around the world. He also systematized previous results, putting them on a firm mathematical footing. In his 1918 seminal paper The Correlation between Relatives on the Supposition of Mendelian Inheritance, the first use to use the statistical term, variance. In 1919, at Rothamsted Experimental Station he started a major study of the extensive collections of data recorded over many years. This resulted in a series of reports under the general title Studies in Crop Variation. In 1930 he published The Genetical Theory of Natural Selection where he applied statistics to evolution.
Over the next seven years, he pioneered the principles of the design of experiments (see below) and elaborated his studies of analysis of variance. He furthered his studies of the statistics of small samples. Perhaps even more important, he began his systematic approach of the analysis of real data as the springboard for the development of new statistical methods. He developed computational algorithms for analyzing data from his balanced experimental designs. In 1925, this work resulted in the publication of his first book, Statistical Methods for Research Workers.[35] This book went through many editions and translations in later years, and it became the standard reference work for scientists in many disciplines. In 1935, this book was followed by The Design of Experiments, which was also widely used.
In addition to analysis of variance, Fisher named and promoted the method of maximum likelihood estimation. Fisher also originated the concepts of sufficiency, ancillary statistics, Fisher's linear discriminator and Fisher information. His article On a distribution yielding the error functions of several well known statistics (1924) presented Pearson's chi-squared test and William Gosset's t in the same framework as the Gaussian distribution, and his own parameter in the analysis of variance Fisher's z-distribution (more commonly used decades later in the form of the F distribution).[36] The 5% level of significance appears to have been introduced by Fisher in 1925.[37] Fisher stated that deviations exceeding twice the standard deviation are regarded as significant. Before this deviations exceeding three times the probable error were considered significant. For a symmetrical distribution the probable error is half the interquartile range. For a normal distribution the probable error is approximately 2/3 the standard deviation. It appears that Fisher's 5% criterion was rooted in previous practice.
Other important contributions at this time included Charles Spearman's rank correlation coefficient that was a useful extension of the Pearson correlation coefficient. William Sealy Gosset, the English statistician better known under his pseudonym of Student, introduced Student's t-distribution, a continuous probability distribution useful in situations where the sample size is small and population standard deviation is unknown.
Egon Pearson (Karl's son) and Jerzy Neyman introduced the concepts of "Type II" error, power of a test and confidence intervals. Jerzy Neyman in 1934 showed that stratified random sampling was in general a better method of estimation than purposive (quota) sampling.[38]
Design of experiments[edit]
This section relies too much on references to primary sources. Please improve this section by adding secondary or tertiary sources. (February 2012) (Learn how and when to remove this template message)
James Lind carried out the first ever clinical trial in 1747, in an effort to find a treatment for scurvy.
In 1747, while serving as surgeon on HM Bark Salisbury, James Lind carried out a controlled experiment to develop a cure for scurvy.[39] In this study his subjects' cases "were as similar as I could have them", that is he provided strict entry requirements to reduce extraneous variation. The men were paired, which provided blocking. From a modern perspective, the main thing that is missing is randomized allocation of subjects to treatments.
Lind is today often described as a one-factor-at-a-time experimenter.[40] Similar one-factor-at-a-time (OFAT) experimentation was performed at the Rothamsted Research Station in the 1840s by Sir John Lawes to determine the optimal inorganic fertilizer for use on wheat.[40]
A theory of statistical inference was developed by Charles S. Peirce in "Illustrations of the Logic of Science" (1877–1878) and "A Theory of Probable Inference" (1883), two publications that emphasized the importance of randomization-based inference in statistics. In another study, Peirce randomly assigned volunteers to a blinded, repeated-measures design to evaluate their ability to discriminate weights.[41][42][43][44]
Peirce's experiment inspired other researchers in psychology and education, which developed a research tradition of randomized experiments in laboratories and specialized textbooks in the 1800s.[41][42][43][44] Peirce also contributed the first English-language publication on an optimal design for regression-models in 1876.[45] A pioneering optimal design for polynomial regression was suggested by Gergonne in 1815.[citation needed] In 1918 Kirstine Smith published optimal designs for polynomials of degree six (and less).[46]
The use of a sequence of experiments, where the design of each may depend on the results of previous experiments, including the possible decision to stop experimenting, was pioneered[47] by Abraham Wald in the context of sequential tests of statistical hypotheses.[48] Surveys are available of optimal sequential designs,[49] and of adaptive designs.[50] One specific type of sequential design is the "two-armed bandit", generalized to the multi-armed bandit, on which early work was done by Herbert Robbins in 1952.[51]
The term "design of experiments" (DOE) derives from early statistical work performed by Sir Ronald Fisher. He was described by Anders Hald as "a genius who almost single-handedly created the foundations for modern statistical science."[52] Fisher initiated the principles of design of experiments and elaborated on his studies of "analysis of variance". Perhaps even more important, Fisher began his systematic approach to the analysis of real data as the springboard for the development of new statistical methods. He began to pay particular attention to the labour involved in the necessary computations performed by hand, and developed methods that were as practical as they were founded in rigour. In 1925, this work culminated in the publication of his first book, Statistical Methods for Research Workers.[53] This went into many editions and translations in later years, and became a standard reference work for scientists in many disciplines.[54]
A methodology for designing experiments was proposed by Ronald A. Fisher, in his innovative book The Design of Experiments (1935) which also became a standard.[55][56][57][58] As an example, he described how to test the hypothesis that a certain lady could distinguish by flavour alone whether the milk or the tea was first placed in the cup. While this sounds like a frivolous application, it allowed him to illustrate the most important ideas of experimental design: see Lady tasting tea.
Agricultural science advances served to meet the combination of larger city populations and fewer farms. But for crop scientists to take due account of widely differing geographical growing climates and needs, it was important to differentiate local growing conditions. To extrapolate experiments on local crops to a national scale, they had to extend crop sample testing economically to overall populations. As statistical methods advanced (primarily the efficacy of designed experiments instead of one-factor-at-a-time experimentation), representative factorial design of experiments began to enable the meaningful extension, by inference, of experimental sampling results to the population as a whole.[citation needed] But it was hard to decide how representative was the crop sample chosen.[citation needed] Factorial design methodology showed how to estimate and correct for any random variation within the sample and also in the data collection procedures.
Bayesian statistics[edit]
Pierre-Simon, marquis de Laplace, one of the main early developers of Bayesian statistics.
The term Bayesian refers to Thomas Bayes (1702–1761), who proved a special case of what is now called Bayes' theorem. However it was Pierre-Simon Laplace (1749–1827) who introduced a general version of the theorem and applied it to celestial mechanics, medical statistics, reliability, and jurisprudence.[59] When insufficient knowledge was available to specify an informed prior, Laplace used uniform priors, according to his "principle of insufficient reason".[59][60] Laplace assumed uniform priors for mathematical simplicity rather than for philosophical reasons.[59] Laplace also introduced[citation needed] primitive versions of conjugate priors and the theorem of von Mises and Bernstein, according to which the posteriors corresponding to initially differing priors ultimately agree, as the number of observations increases.[61] This early Bayesian inference, which used uniform priors following Laplace's principle of insufficient reason, was called "inverse probability" (because it infers backwards from observations to parameters, or from effects to causes[62]).
After the 1920s, inverse probability was largely supplanted[citation needed] by a collection of methods that were developed by Ronald A. Fisher, Jerzy Neyman and Egon Pearson. Their methods came to be called frequentist statistics.[62] Fisher rejected the Bayesian view, writing that "the theory of inverse probability is founded upon an error, and must be wholly rejected".[63] At the end of his life, however, Fisher expressed greater respect for the essay of Bayes, which Fisher believed to have anticipated his own, fiducial approach to probability; Fisher still maintained that Laplace's views on probability were "fallacious rubbish".[63] Neyman started out as a "quasi-Bayesian", but subsequently developed confidence intervals (a key method in frequentist statistics) because "the whole theory would look nicer if it were built from the start without reference to Bayesianism and priors".[64] The word Bayesian appeared around 1950, and by the 1960s it became the term preferred by those dissatisfied with the limitations of frequentist statistics.[62][65]
In the 20th century, the ideas of Laplace were further developed in two different directions, giving rise to objective and subjective currents in Bayesian practice. In the objectivist stream, the statistical analysis depends on only the model assumed and the data analysed.[66] No subjective decisions need to be involved. In contrast, "subjectivist" statisticians deny the possibility of fully objective analysis for the general case.
In the further development of Laplace's ideas, subjective ideas predate objectivist positions. The idea that 'probability' should be interpreted as 'subjective degree of belief in a proposition' was proposed, for example, by John Maynard Keynes in the early 1920s.[citation needed] This idea was taken further by Bruno de Finetti in Italy (Fondamenti Logici del Ragionamento Probabilistico, 1930) and Frank Ramsey in Cambridge (The Foundations of Mathematics, 1931).[67] The approach was devised to solve problems with the frequentist definition of probability but also with the earlier, objectivist approach of Laplace.[66] The subjective Bayesian methods were further developed and popularized in the 1950s by L.J. Savage.[citation needed]
Objective Bayesian inference was further developed by Harold Jeffreys at the University of Cambridge. His seminal book "Theory of probability" first appeared in 1939 and played an important role in the revival of the Bayesian view of probability.[68][69] In 1957, Edwin Jaynes promoted the concept of maximum entropy for constructing priors, which is an important principle in the formulation of objective methods, mainly for discrete problems. In 1965, Dennis Lindley's 2-volume work "Introduction to Probability and Statistics from a Bayesian Viewpoint" brought Bayesian methods to a wide audience. In 1979, José-Miguel Bernardo introduced reference analysis,[66] which offers a general applicable framework for objective analysis.[70] Other well-known proponents of Bayesian probability theory include I.J. Good, B.O. Koopman, Howard Raiffa, Robert Schlaifer and Alan Turing.
In the 1980s, there was a dramatic growth in research and applications of Bayesian methods, mostly attributed to the discovery of Markov chain Monte Carlo methods, which removed many of the computational problems, and an increasing interest in nonstandard, complex applications.[71] Despite growth of Bayesian research, most undergraduate teaching is still based on frequentist statistics.[72] Nonetheless, Bayesian methods are widely accepted and used, such as for example in the field of machine learning.[73]
Important contributors to statistics[edit]
See also: List of statisticians and Founders of statistics
Thomas Bayes
George E. P. Box
Pafnuty Chebyshev
David R. Cox
Gertrude Cox
Harald Cramér
Francis Ysidro Edgeworth
Bradley Efron
Bruno de Finetti
Ronald A. Fisher
Francis Galton
Carl Friedrich Gauss
William Sealey Gosset ("Student")
Andrey Kolmogorov
Pierre-Simon Laplace
Erich L. Lehmann
Aleksandr Lyapunov
Anil Kumar Gain
Prasanta Chandra Mahalanobis
Abraham De Moivre
Jerzy Neyman
Florence Nightingale
Blaise Pascal
Karl Pearson
Charles S. Peirce
Adolphe Quetelet
C. R. Rao
Walter A. Shewhart
Charles Spearman
Charles Stein
Thorvald N. Thiele
John Tukey
Abraham Wald
References[edit]
Jump up ^ Ball, Philip (2004). Critical Mass. Farrar, Straus and Giroux. p. 53. ISBN 0-374-53041-6.
Jump up ^ Thucydides (1985). History of the Peloponnesian War. New York: Penguin Books, Ltd. p. 204.
^ Jump up to: a b Singh, Simon (2000). The code book : the science of secrecy from ancient Egypt to quantum cryptography (1st Anchor Books ed.). New York: Anchor Books. ISBN 0-385-49532-3.
^ Jump up to: a b Ibrahim A. Al-Kadi "The origins of cryptology: The Arab contributions", Cryptologia, 16(2) (April 1992) pp. 97–126.
Jump up ^ Villani, Giovanni. Encyclopædia Britannica. Encyclopædia Britannica 2006 Ultimate Reference Suite DVD. Retrieved on 2008-03-04.
Jump up ^ Brian, Éric; Jaisson, Marie (2007). "Physico-Theology and Mathematics (1710–1794)". The Descent of Human Sex Ratio at Birth. Springer Science & Business Media. pp. 1–25. ISBN 978-1-4020-6036-6.
Jump up ^ John Arbuthnot (1710). "An argument for Divine Providence, taken from the constant regularity observed in the births of both sexes" (PDF). Philosophical Transactions of the Royal Society of London. 27 (325–336): 186–190. doi:10.1098/rstl.1710.0011.
^ Jump up to: a b Conover, W.J. (1999), "Chapter 3.4: The Sign Test", Practical Nonparametric Statistics (Third ed.), Wiley, pp. 157–176, ISBN 0-471-16068-7
Jump up ^ Sprent, P. (1989), Applied Nonparametric Statistical Methods (Second ed.), Chapman & Hall, ISBN 0-412-44980-3
Jump up ^ Stigler, Stephen M. (1986). The History of Statistics: The Measurement of Uncertainty Before 1900. Harvard University Press. pp. 225–226. ISBN 0-67440341-X.
Jump up ^ Bellhouse, P. (2001), "John Arbuthnot", in Statisticians of the Centuries by C.C. Heyde and E. Seneta, Springer, pp. 39–42, ISBN 0-387-95329-9
Jump up ^ Hald, Anders (1998), "Chapter 4. Chance or Design: Tests of Significance", A History of Mathematical Statistics from 1750 to 1930, Wiley, p. 65
Jump up ^ de Moivre, A. (1738) The doctrine of chances. Woodfall
Jump up ^ Laplace, P-S. (1774). "Mémoire sur la probabilité des causes par les évènements". Mémoires de l'Académie Royale des Sciences Présentés par Divers Savants, 6, 621–656
Jump up ^ Wilson, Edwin Bidwell (1923) "First and second laws of error", Journal of the American Statistical Association, 18 (143), 841-851 JSTOR 2965467
Jump up ^ Havil J (2003) Gamma: Exploring Euler's Constant. Princeton, NJ: Princeton University Press, p. 157
Jump up ^ Peirce CS (1873) Theory of errors of observations. Report of the Superintendent US Coast Survey, Washington, Government Printing Office. Appendix no. 21: 200-224
Jump up ^ Cochran W.G. (1978) "Laplace's ratio estimators". pp 3-10. In David H.A., (ed). Contributions to Survey Sampling and Applied Statistics: papers in honor of H. O. Hartley. Academic Press, New York ISBN 978-1483237930
Jump up ^ Keynes, JM (1921) A treatise on probability. Pt II Ch XVII §5 (p 201)
Jump up ^ Galton F (1881) Report of the Anthropometric Committee pp 245-260. Report of the 51st Meeting of the British Association for the Advancement of Science
Jump up ^ Stigler (1986, Chapter 5: Quetelet's Two Attempts)
Jump up ^ Helen Mary Walker (1975). Studies in the history of statistical method. Arno Press.
Jump up ^ (Stigler 1986, Chapter 9: The Next Generation: Edgeworth)
Jump up ^ Bellhouse DR (1988) A brief history of random sampling methods. Handbook of statistics. Vol 6 pp 1-14 Elsevier
Jump up ^ Bowley AL (1906) Address to the Economic Science and Statistics Section of the British Association for the Advancement of Science. J Roy Stat Soc 69: 548-557
Jump up ^ Galton F (1877) Typical laws of heredity. Nature 15: 492-553
Jump up ^ Galton F (1907) One Vote, One Value. Nature 75: 414
Jump up ^ Stigler (1986, Chapter 10: Pearson and Yule)
Jump up ^ "The development of modern statistics". JSTOR 27956805. Missing or empty |url= (help)
Jump up ^ Stigler, S. M. (1989). "Francis Galton's Account of the Invention of Correlation". Statistical Science. 4 (2): 73–79. doi:10.1214/ss/1177012580.
^ Jump up to: a b c Pearson, K. (1900). "On the Criterion that a given System of Deviations from the Probable in the Case of a Correlated System of Variables is such that it can be reasonably supposed to have arisen from Random Sampling". Philosophical Magazine. Series 5. 50 (302): 157–175. doi:10.1080/14786440009463897.
Jump up ^ Pearson, K. (1901). "On Lines and Planes of Closest Fit to Systems of Points is Space". Philosophical Magazine. Series 6. 2 (11): 559–572. doi:10.1080/14786440109462720.
Jump up ^ Jolliffe, I. T. (2002). Principal Component Analysis, 2nd ed. New York: Springer-Verlag.
Jump up ^ Hald, Anders (1998). A History of Mathematical Statistics. New York: Wiley. ISBN 0-471-17912-4.
Jump up ^ Box, R. A. Fisher, pp 93–166
Jump up ^ Agresti, Alan; David B. Hichcock (2005). "Bayesian Inference for Categorical Data Analysis" (PDF). Statistical Methods & Applications. 14 (14): 298. doi:10.1007/s10260-005-0121-y.
Jump up ^ Fisher RA (1925) Statistical methods for research workers, Edinburgh: Oliver & Boyd
Jump up ^ Neyman, J (1934) On the two different aspects of the representative method: The method of stratified sampling and the method of purposive selection. Journal of the Royal Statistical Society 97 (4) 557-625 JSTOR 2342192
Jump up ^ Dunn, Peter (January 1997). "James Lind (1716-94) of Edinburgh and the treatment of scurvy". Archives of Disease in Childhood: Fetal and Neonatal Edition. United Kingdom: British Medical Journal Publishing Group. 76 (1): 64–65. doi:10.1136/fn.76.1.F64. PMC 1720613  . PMID 9059193. Retrieved 2009-01-17.
^ Jump up to: a b Klaus Hinkelmann (2012). Design and Analysis of Experiments, Special Designs and Applications. John Wiley & Sons. p. xvii.
^ Jump up to: a b Charles Sanders Peirce and Joseph Jastrow (1885). "On Small Differences in Sensation". Memoirs of the National Academy of Sciences. 3: 73–83.
^ Jump up to: a b Hacking, Ian (September 1988). "Telepathy: Origins of Randomization in Experimental Design". Isis. 79 (A Special Issue on Artifact and Experiment, number 3): 427–451. doi:10.1086/354775. JSTOR 234674. MR 1013489.
^ Jump up to: a b Stephen M. Stigler (November 1992). "A Historical View of Statistical Concepts in Psychology and Educational Research". American Journal of Education. 101 (1): 60–70. doi:10.1086/444032.
^ Jump up to: a b Trudy Dehue (December 1997). "Deception, Efficiency, and Random Groups: Psychology and the Gradual Origination of the Random Group Design". Isis. 88 (4): 653–673. doi:10.1086/383850. PMID 9519574.
Jump up ^ Peirce, C. S. (1876). "Note on the Theory of the Economy of Research". Coast Survey Report: 197–201. , actually published 1879, NOAA PDF Eprint.
Reprinted in Collected Papers 7, paragraphs 139–157, also in Writings 4, pp. 72–78, and in Peirce, C.S. (July–August 1967). "Note on the Theory of the Economy of Research". Operations Research. 15 (4): 643–648. doi:10.1287/opre.15.4.643. JSTOR 168276.
Jump up ^ Smith, Kirstine (1918). "On the Standard Deviations of Adjusted and Interpolated Values of an Observed Polynomial Function and its Constants and the Guidance they give Towards a Proper Choice of the Distribution of Observations". Biometrika. 12 (1/2): 1–85. doi:10.2307/2331929.
Jump up ^ Johnson, N.L. (1961). "Sequential analysis: a survey." Journal of the Royal Statistical Society, Series A. Vol. 124 (3), 372–411. (pages 375–376)
Jump up ^ Wald, A. (1945) "Sequential Tests of Statistical Hypotheses", Annals of Mathematical Statistics, 16 (2), 117–186.
Jump up ^ Chernoff, H. (1972) Sequential Analysis and Optimal Design, SIAM Monograph. ISBN 978-0898710069
Jump up ^ Zacks, S. (1996) "Adaptive Designs for Parametric Models". In: Ghosh, S. and Rao, C. R., (Eds) (1996). "Design and Analysis of Experiments," Handbook of Statistics, Volume 13. North-Holland. ISBN 0-444-82061-2. (pages 151–180)
Jump up ^ Robbins, H. (1952). "Some Aspects of the Sequential Design of Experiments". Bulletin of the American Mathematical Society. 58 (5): 527–535. doi:10.1090/S0002-9904-1952-09620-8.
Jump up ^ Hald, Anders (1998) A History of Mathematical Statistics. New York: Wiley.[page needed]
Jump up ^ Box, Joan Fisher (1978) R. A. Fisher: The Life of a Scientist, Wiley. ISBN 0-471-09300-9 (pp 93–166)
Jump up ^ Edwards, A.W.F. (2005). "R. A. Fisher, Statistical Methods for Research Workers, 1925". In Grattan-Guinness, Ivor. Landmark writings in Western mathematics 1640-1940. Amsterdam Boston: Elsevier. ISBN 9780444508713.
Jump up ^ Stanley, J. C. (1966). "The Influence of Fisher's "The Design of Experiments" on Educational Research Thirty Years Later". American Educational Research Journal. 3 (3): 223. doi:10.3102/00028312003003223.
Jump up ^ Box, JF (February 1980). "R. A. Fisher and the Design of Experiments, 1922-1926". The American Statistician. 34 (1): 1–7. doi:10.2307/2682986. JSTOR 2682986.
Jump up ^ Yates, Frank (June 1964). "Sir Ronald Fisher and the Design of Experiments". Biometrics. 20 (2): 307–321. doi:10.2307/2528399. JSTOR 2528399.
Jump up ^ Stanley, Julian C. (1966). "The Influence of Fisher's "The Design of Experiments" on Educational Research Thirty Years Later". American Educational Research Journal. 3 (3): 223–229. doi:10.3102/00028312003003223. JSTOR 1161806.
^ Jump up to: a b c Stigler (1986, Chapter 3: Inverse Probability)
Jump up ^ Hald (1998)[page needed]
Jump up ^ Lucien Le Cam (1986) Asymptotic Methods in Statistical Decision Theory: Pages 336 and 618–621 (von Mises and Bernstein).
^ Jump up to: a b c Stephen. E. Fienberg, (2006) When did Bayesian Inference become "Bayesian"? Archived 2014-09-10 at the Wayback Machine. Bayesian Analysis, 1 (1), 1–40. See page 5.
^ Jump up to: a b Aldrich, A. (2008) "R. A. Fisher on Bayes and Bayes' Theorem" Archived 2014-09-06 at the Wayback Machine., Bayesian analysis, 3 (1),161–170
Jump up ^ Neyman, J. (1977). "Frequentist probability and frequentist statistics". Synthese. 36 (1): 97–131. doi:10.1007/BF00485695.
Jump up ^ Jeff Miller, "Earliest Known Uses of Some of the Words of Mathematics (B)" "The term Bayesian entered circulation around 1950. R. A. Fisher used it in the notes he wrote to accompany the papers in his Contributions to Mathematical Statistics (1950). Fisher thought Bayes's argument was all but extinct for the only recent work to take it seriously was Harold Jeffreys's Theory of Probability (1939). In 1951 L. J. Savage, reviewing Wald's Statistical Decisions Functions, referred to "modern, or unBayesian, statistical theory" ("The Theory of Statistical Decision," Journal of the American Statistical Association, 46, p. 58.). Soon after, however, Savage changed from being an unBayesian to being a Bayesian."
^ Jump up to: a b c Bernardo J (2005). "Reference analysis". Handbook of statistics. Handbook of Statistics. 25: 17–90. doi:10.1016/S0169-7161(05)25002-2. ISBN 9780444515391.
Jump up ^ Gillies, D. (2000), Philosophical Theories of Probability. Routledge. ISBN 0-415-18276-X pp 50–1
Jump up ^ E. T. Jaynes. Probability Theory: The Logic of Science Cambridge University Press, (2003). ISBN 0-521-59271-2
Jump up ^ O'Connor, John J.; Robertson, Edmund F., "History of statistics", MacTutor History of Mathematics archive, University of St Andrews .
Jump up ^ Bernardo, J. M. and Smith, A. F. M. (1994). "Bayesian Theory". Chichester: Wiley.
Jump up ^ Wolpert, RL. (2004) "A conversation with James O. Berger", Statistical Science, 9, 205–218 doi:10.1214/088342304000000053 MR2082155
Jump up ^ Bernardo, J. M. (2006). "A Bayesian Mathematical Statistics Primer" (PDF). Proceedings of the Seventh International Conference on Teaching Statistics [CDROM]. Salvador (Bahia), Brazil: International Association for Statistical Education.
Jump up ^ Bishop, C.M. (2007) Pattern Recognition and Machine Learning. Springer ISBN 978-0387310732
Bibliography[edit]
Freedman, D. (1999). "From association to causation: Some remarks on the history of statistics". Statistical Science. 14 (3): 243–258. doi:10.1214/ss/1009212409. (Revised version, 2002)
Hald, Anders (2003). A History of Probability and Statistics and Their Applications before 1750. Hoboken, NJ: Wiley. ISBN 0-471-47129-1.
Hald, Anders (1998). A History of Mathematical Statistics from 1750 to 1930. New York: Wiley. ISBN 0-471-17912-4.
Kotz, S., Johnson, N.L. (1992,1992,1997). Breakthroughs in Statistics, Vols I, II, III. Springer ISBN 0-387-94037-5, ISBN 0-387-94039-1, ISBN 0-387-94989-5
Pearson, Egon (1978). The History of Statistics in the 17th and 18th Centuries against the changing background of intellectual, scientific and religious thought (Lectures by Karl Pearson given at University College London during the academic sessions 1921-1933). New York: MacMillan Publishing Co., Inc. p. 744. ISBN 0-02-850120-9.
Salsburg, David (2001). The Lady Tasting Tea: How Statistics Revolutionized Science in the Twentieth Century. ISBN 0-7167-4106-7
Stigler, Stephen M. (1986). The History of Statistics: The Measurement of Uncertainty before 1900. Belknap Press/Harvard University Press. ISBN 0-674-40341-X.
Stigler, Stephen M. (1999) Statistics on the Table: The History of Statistical Concepts and Methods. Harvard University Press. ISBN 0-674-83601-4
David, H. A. (1995). "First (?) Occurrence of Common Terms in Mathematical Statistics". The American Statistician. 49 (2): 121–133. doi:10.2307/2684625. JSTOR 2684625.
External links[edit]
Wikimedia Commons has media related to History of statistics.
JEHPS: Recent publications in the history of probability and statistics
Electronic Journ@l for History of Probability and Statistics/Journ@l Electronique d'Histoire des Probabilités et de la Statistique
Figures from the History of Probability and Statistics (Univ. of Southampton)
Materials for the History of Statistics (Univ. of York)
Probability and Statistics on the Earliest Uses Pages (Univ. of Southampton)
Earliest Uses of Symbols in Probability and Statistics on Earliest Uses of Various Mathematical Symbols
hide
v
t
e
Statistics
Outline
Index
show
Descriptive statistics
Continuous data
Center
Mean
arithmetic
geometric
harmonic
Median
Mode
Dispersion
Variance
Standard deviation
Coefficient of variation
Percentile
Range
Interquartile range
Shape
Central limit theorem
Moments
Skewness
Kurtosis
L-moments
Count data
Index of dispersion
Summary tables
Grouped data
Frequency distribution
Contingency table
Dependence
Pearson product-moment correlation
Rank correlation
Spearman's rho
Kendall's tau
Partial correlation
Scatter plot
Graphics
Bar chart
Biplot
Box plot
Control chart
Correlogram
Fan chart
Forest plot
Histogram
Pie chart
Q–Q plot
Run chart
Scatter plot
Stem-and-leaf display
Radar chart
show
Data collection
Study design
Population
Statistic
Effect size
Statistical power
Sample size determination
Missing data
Survey methodology
Sampling
stratified
cluster
Standard error
Opinion poll
Questionnaire
Controlled experiments
Design
control
optimal
Controlled trial
Randomized
Random assignment
Replication
Blocking
Interaction
Factorial experiment
Uncontrolled studies
Observational study
Natural experiment
Quasi-experiment
show
Statistical inference
Statistical theory
Population
Statistic
Probability distribution
Sampling distribution
Order statistic
Empirical distribution
Density estimation
Statistical model
Lp space
Parameter
location
scale
shape
Parametric family
Likelihood (monotone)
Location–scale family
Exponential family
Completeness
Sufficiency
Statistical functional
Bootstrap
U
V
Optimal decision
loss function
Efficiency
Statistical distance
divergence
Asymptotics
Robustness
Frequentist inference
Point estimation
Estimating equations
Maximum likelihood
Method of moments
M-estimator
Minimum distance
Unbiased estimators
Mean-unbiased minimum-variance
Rao–Blackwellization
Lehmann–Scheffé theorem
Median unbiased
Plug-in
Interval estimation
Confidence interval
Pivot
Likelihood interval
Prediction interval
Tolerance interval
Resampling
Bootstrap
Jackknife
Testing hypotheses
1- & 2-tails
Power
Uniformly most powerful test
Permutation test
Randomization test
Multiple comparisons
Parametric tests
Likelihood-ratio
Wald
Score
Specific tests
Z-test (normal)
Student's t-test
F-test
Goodness of fit
Chi-squared
G-test
Kolmogorov–Smirnov
Anderson–Darling
Lilliefors
Jarque–Bera
Normality (Shapiro–Wilk)
Likelihood-ratio test
Model selection
Cross validation
AIC
BIC
Rank statistics
Sign
Sample median
Signed rank (Wilcoxon)
Hodges–Lehmann estimator
Rank sum (Mann–Whitney)
Nonparametric anova
1-way (Kruskal–Wallis)
2-way (Friedman)
Ordered alternative (Jonckheere–Terpstra)
Bayesian inference
Bayesian probability
prior
posterior
Credible interval
Bayes factor
Bayesian estimator
Maximum posterior estimator
show
Correlation
Regression analysis
Correlation
Pearson product-moment
Partial correlation
Confounding variable
Coefficient of determination
Regression analysis
Errors and residuals
Regression model validation
Mixed effects models
Simultaneous equations models
Multivariate adaptive regression splines (MARS)
Linear regression
Simple linear regression
Ordinary least squares
General linear model
Bayesian regression
Non-standard predictors
Nonlinear regression
Nonparametric
Semiparametric
Isotonic
Robust
Heteroscedasticity
Homoscedasticity
Generalized linear model
Exponential families
Logistic (Bernoulli) / Binomial / Poisson regressions
Partition of variance
Analysis of variance (ANOVA, anova)
Analysis of covariance
Multivariate ANOVA
Degrees of freedom
show
Categorical / Multivariate / Time-series / Survival analysis
Categorical
Cohen's kappa
Contingency table
Graphical model
Log-linear model
McNemar's test
Multivariate
Regression
Manova
Principal components
Canonical correlation
Discriminant analysis
Cluster analysis
Classification
Structural equation model
Factor analysis
Multivariate distributions
Elliptical distributions
Normal
Time-series
General
Decomposition
Trend
Stationarity
Seasonal adjustment
Exponential smoothing
Cointegration
Structural break
Granger causality
Specific tests
Dickey–Fuller
Johansen
Q-statistic (Ljung–Box)
Durbin–Watson
Breusch–Godfrey
Time domain
Autocorrelation (ACF)
partial (PACF)
Cross-correlation (XCF)
ARMA model
ARIMA model (Box–Jenkins)
Autoregressive conditional heteroskedasticity (ARCH)
Vector autoregression (VAR)
Frequency domain
Spectral density estimation
Fourier analysis
Wavelet
Whittle likelihood
Survival
Survival function
Kaplan–Meier estimator (product limit)
Proportional hazards models
Accelerated failure time (AFT) model
First hitting time
Hazard function
Nelson–Aalen estimator
Test
Log-rank test
show
Applications
Biostatistics
Bioinformatics
Clinical trials / studies
Epidemiology
Medical statistics
Engineering statistics
Chemometrics
Methods engineering
Probabilistic design
Process / quality control
Reliability
System identification
Social statistics
Actuarial science
Census
Crime statistics
Demography
Econometrics
National accounts
Official statistics
Population statistics
Psychometrics
Spatial statistics
Cartography
Environmental statistics
Geographic information system
Geostatistics
Kriging
Category
Portal
Commons
WikiProject
show
v
t
e
History of science
Background
Theories and sociology
Historiography
Pseudoscience
By era
Early cultures
Classical Antiquity
The Golden Age of Islam
Renaissance
Scientific Revolution
Romanticism
By culture
African
Byzantine
Medieval European
Chinese
Indian
Medieval Islamic
Natural sciences
Astronomy
Biology
Botany
Chemistry
Ecology
Evolution
Geology
Geophysics
Paleontology
Physics
Mathematics
Algebra
Calculus
Combinatorics
Geometry
Logic
Probability
Statistics
Trigonometry
Social sciences
Anthropology
Economics
Geography
Linguistics
Political science
Psychology
Sociology
Sustainability
Technology
Agricultural science
Computer science
Materials science
Engineering
Medicine
Human medicine
Veterinary medicine
Anatomy
Neuroscience
Neurology and neurosurgery
Nutrition
Pathology
Pharmacy
Timelines
Portal
Category
Retrieved from "https://en.wikipedia.org/w/index.php?title=History_of_statistics&oldid=851302170"
Categories:
History of probability and statistics
History of science by discipline
Hidden categories:
Pages using web citations with no URL
Wikipedia articles needing page number citations from May 2012
Webarchive template wayback links
All articles with unsourced statements
Articles with unsourced statements from February 2012
Articles with unsourced statements from July 2012
Articles lacking reliable references from February 2012
All articles lacking reliable references
Articles with unsourced statements from May 2012
Articles with unsourced statements from September 2010
Navigation menu
Personal tools
Not logged in
Talk
Contributions
Create account
Log in
Namespaces
Article
Talk
Variants
Views
Read
Edit
View history
More
Search
Navigation
Main page
Contents
Featured content
Current events
Random article
Donate to Wikipedia
Wikipedia store
Interaction
Help
About Wikipedia
Community portal
Recent changes
Contact page
Tools
What links here
Related changes
Upload file
Special pages
Permanent link
Page information
Wikidata item
Cite this page
Print/export
Create a book
Download as PDF
Printable version
In other projects
Wikimedia Commons
Languages
Català
Español
Euskara
فارسی
Français
Italiano
Português
Tagalog
Edit links
This page was last edited on 21 July 2018, at 11:02 (UTC).
Text is available under the Creative Commons Attribution-ShareAlike License; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy. Wikipedia® is a registered trademark of the Wikimedia Foundation, Inc., a non-profit organization.
Privacy policy
About Wikipedia
Disclaimers
Contact Wikipedia
Developers
Cookie statement
Mobile view
Enable previews

values: mw-page-base noprint

values: mw-head-base noprint

values: firstHeading firstHeading en

values: siteSub noprint

values: mw-jump-link #mw-head

values: mw-jump-link #p-search

value: p

values:
/wiki/Temperature_record
mw-redirect
Temperature record

values: checkbox button toctogglecheckbox toctogglecheckbox display:none

values:
/wiki/Applied_statistics
mw-redirect
Applied statistics

values:
/wiki/Games_of_chance
mw-redirect
Games of chance

values:
/wiki/Method_of_least_squares
mw-redirect
Method of least squares

values:
/wiki/Inductive_logic
mw-redirect
Inductive logic

values:
/wiki/Mathematical_science
mw-redirect
Mathematical science

values:
/wiki/Decision_science
mw-redirect
Decision science

values:
/wiki/Sir_John_Sinclair
mw-redirect
Sir John Sinclair

values:
/wiki/Statistical_Account_of_Scotland
mw-redirect
Statistical Account of Scotland

values: List of national and international statistical services

values: This claim needs references to reliable sources. (February 2012)

values:
noprint Inline-Template Template-Fact
white-space:nowrap;

values: Edit section: Origins in probability theory

values:
/wiki/Jakob_Bernoulli
mw-redirect
Jakob Bernoulli

values:
/wiki/Significance_test
mw-redirect
Significance test

values:
/wiki/Non-parametric_test
mw-redirect
Non-parametric test

values:
/wiki/Theory_of_errors
mw-redirect
Theory of errors

values: vertical-align: -1.838ex; width:20.034ex; height:5.176ex;

values: Parabolic distribution (page does not exist)

values:
/wiki/Joseph_Louis_Lagrange
mw-redirect
Joseph Louis Lagrange

values: This claim needs references to reliable sources. (July 2012)

values: vertical-align: -0.338ex; width:1.049ex; height:1.676ex;

values:
/wiki/Sylvestre_Lacroix
mw-redirect
Sylvestre Lacroix

values:
/wiki/Hermann_Laurent
mw-redirect
Hermann Laurent

values:
/wiki/Gustav_Theodor_Fechner
mw-redirect
Gustav Theodor Fechner

values:
/wiki/Crime_rates
mw-redirect
Crime rates

values:
/wiki/Marriage_rates
mw-redirect
Marriage rates

values:
/wiki/Suicide_rates
mw-redirect
Suicide rates

values: Edit section: Development of modern statistics

values:
/wiki/William_Gosset
mw-redirect
William Gosset

values:
/wiki/Oxford_University
mw-redirect
Oxford University

values:
/wiki/Edgeworth_expansion
mw-redirect
Edgeworth expansion

values:
/wiki/Charles_Booth_(philanthropist)
mw-redirect
Charles Booth (philanthropist)

values:
/wiki/Random_sampling
mw-redirect
Random sampling

values:
/wiki/Walter_Frank_Raphael_Weldon
mw-redirect
Walter Frank Raphael Weldon

values: Pearson product-moment correlation coefficient

values: Statistical Methods for Research Workers

values:
/wiki/Rothamsted_Experimental_Station
mw-redirect
Rothamsted Experimental Station

values: The Genetical Theory of Natural Selection

values:
/wiki/Maximum_likelihood
mw-redirect
Maximum likelihood

values:
/wiki/Sufficiency_(statistics)
mw-redirect
Sufficiency (statistics)

values:
/wiki/Gaussian_distribution
mw-redirect
Gaussian distribution

values:
/wiki/F_distribution
mw-redirect
F distribution

values: plainlinks metadata ambox ambox-content ambox-Primary_sources

values:
/wiki/James_Lind_(physician)
mw-redirect
James Lind (physician)

values:
/wiki/Rothamsted_Research_Station
mw-redirect
Rothamsted Research Station

values:
/wiki/Blinding_(medicine)
mw-redirect
Blinding (medicine)

values:
/wiki/Joseph_Diaz_Gergonne
mw-redirect
Joseph Diaz Gergonne

values: This claim needs references to reliable sources. (May 2012)

values:
/wiki/Principle_of_insufficient_reason
mw-redirect
Principle of insufficient reason

values:
/wiki/S._N._Bernstein
mw-redirect
S. N. Bernstein

values:
/wiki/Ronald_A._Fisher
mw-redirect
Ronald A. Fisher

values:
/wiki/Frequentist_statistics
mw-redirect
Frequentist statistics

values: This claim needs references to reliable sources. (September 2010)

values:
/wiki/B.O._Koopman
mw-redirect
B.O. Koopman

values: Edit section: Important contributors to statistics

values:
/wiki/David_R._Cox
mw-redirect
David R. Cox

values:
/wiki/William_Sealey_Gosset
mw-redirect
William Sealey Gosset

values:
/wiki/Abraham_De_Moivre
mw-redirect
Abraham De Moivre

values:
/wiki/Charles_Stein_(statistician)
mw-redirect
Charles Stein (statistician)

values: border-collapse: collapse; padding: 0; border: 0; background:transparent; width:100%;

values: Encyclopædia Britannica 2006 Ultimate Reference Suite DVD

values: Philosophical Transactions of the Royal Society of London

values:
nofollow
external text
//doi.org/10.1098/rstl.1710.0011

values: Journal of the American Statistical Association

values:
nofollow
external text
https://www.jstor.org/stable/2965467

values:
nofollow
external text
//www.jstor.org/stable/27956805

values:
nofollow
external text
//doi.org/10.1214/ss/1177012580

values:
nofollow
external text
//doi.org/10.1007/s10260-005-0121-y

values: Journal of the Royal Statistical Society

values:
nofollow
external text
https://www.jstor.org/stable/2342192

values:
nofollow
external text
//doi.org/10.1136/fn.76.1.F64

values:
/wiki/PubMed_Identifier
mw-redirect
PubMed Identifier

values:
nofollow
external text
//www.ncbi.nlm.nih.gov/pubmed/9059193

values:
nofollow
external text
//doi.org/10.1086/354775

values:
nofollow
external text
//www.jstor.org/stable/234674

values:
/wiki/Stephen_M._Stigler
mw-redirect
Stephen M. Stigler

values:
nofollow
external text
//doi.org/10.1086/444032

values:
nofollow
external text
//doi.org/10.1086/383850

values:
nofollow
external text
//www.ncbi.nlm.nih.gov/pubmed/9519574

values:
nofollow
external text
//doi.org/10.1287/opre.15.4.643

values:
nofollow
external text
//www.jstor.org/stable/168276

values:
nofollow
external text
//doi.org/10.2307/2331929

values: Society for Industrial and Applied Mathematics

values: This citation requires a reference to the specific page or range of pages in which the material appears. (May 2012)

values:
nofollow
external text
//doi.org/10.2307/2682986

values:
nofollow
external text
//www.jstor.org/stable/2682986

values:
nofollow
external text
//doi.org/10.2307/2528399

values:
nofollow
external text
//www.jstor.org/stable/2528399

values:
nofollow
external text
//www.jstor.org/stable/1161806

values:
nofollow
external text
//doi.org/10.1007/BF00485695

values:
nofollow
external text
http://jeff560.tripod.com/b.html

values: -moz-column-width: 30em; -webkit-column-width: 30em; column-width: 30em; list-style-type: decimal;

values:
nofollow
external text
//doi.org/10.1214/ss/1009212409

values:
nofollow
external text
//doi.org/10.2307/2684625

values:
nofollow
external text
//www.jstor.org/stable/2684625

values:
nofollow
external text
http://www.jehps.net/publications.htm

values:
nofollow
external text
http://www.jehps.net/indexang.html

values:
nofollow
external text
http://jeff560.tripod.com/stat.html

values:
nofollow
external text
http://jeff560.tripod.com/mathsym.html

values:
/wiki/Shape_of_the_distribution
mw-redirect
Shape of the distribution

values: nowraplinks collapsible collapsed navbox-subgroup mw-collapsible mw-collapsed mw-made-collapsible

values:
/wiki/Population_(statistics)
mw-redirect
Population (statistics)

values:
/wiki/Statistical_power
mw-redirect
Statistical power

values:
/wiki/Median-unbiased_estimator
mw-redirect
Median-unbiased estimator

values:
/wiki/Likelihood_interval
mw-redirect
Likelihood interval

values:
/wiki/Permutation_test
mw-redirect
Permutation test

values:
/wiki/Randomization_test
mw-redirect
Randomization test

values:
/wiki/Multiple_comparisons
mw-redirect
Multiple comparisons

values:
/wiki/Rank_statistics
mw-redirect
Rank statistics

values:
/wiki/Sample_median
mw-redirect
Sample median

values: Kruskal–Wallis one-way analysis of variance

values:
CorrelationRegression_analysis
font-size:114%;margin:0 4em
hlist hlist-separated

values:
/wiki/Regression_model_validation
mw-redirect
Regression model validation

values: Multivariate adaptive regression splines

values:
/wiki/Multivariate_distribution
mw-redirect
Multivariate distribution

values:
/wiki/Trend_estimation
mw-redirect
Trend estimation

values:
/wiki/Log-rank_test
mw-redirect
Log-rank test

values: List of fields of application of statistics

values:
/wiki/Population_statistics
mw-redirect
Population statistics

values: nowraplinks hlist collapsible uncollapsed navbox-inner mw-collapsible mw-made-collapsible

values: navigation navbox Statistics padding:3px

values:
/wiki/Template_talk:History_of_science
mw-redirect
Template talk:History of science

values:
navbox-image
8
width:1px;padding:0px 0px 0px 2px

values: History of science in classical antiquity

values: History of science and technology in Africa

values: History of science and technology in China

values: History of science and technology in the Indian subcontinent

values:
/wiki/History_of_natural_science
mw-redirect
History of natural science

values:
/wiki/History_of_veterinary_medicine
mw-redirect
History of veterinary medicine

values:
/wiki/History_of_nutrition
mw-redirect
History of nutrition

values: margin-right:0.5em; padding:0.1em 0 0.4em;line-height:1.7em;

values: nowraplinks hlist collapsible autocollapse navbox-inner mw-collapsible mw-made-collapsible mw-collapsed

values: Category:History of probability and statistics

values: Category:History of science by discipline

values: Category:Pages using web citations with no URL

values: Category:Wikipedia articles needing page number citations from May 2012

values: Category:Webarchive template wayback links

values: Category:All articles with unsourced statements

values: Category:Articles with unsourced statements from February 2012

values: Category:Articles with unsourced statements from July 2012

values: Category:Articles lacking reliable references from February 2012

values: Category:All articles lacking reliable references

values: Category:Articles with unsourced statements from May 2012

values: Category:Articles with unsourced statements from September 2010

values: Discussion about edits from this IP address [ctrl-alt-n]

values: A list of edits made from this IP address [ctrl-alt-y]

values: You are encouraged to create an account and log in; however, it is not mandatory

values: You're encouraged to log in; however, it's not mandatory. [ctrl-alt-o]

values:
/wiki/History_of_statistics
View the content page [ctrl-alt-c]
c

values: Discussion about the content page [ctrl-alt-t]

values: p-namespaces navigation vectorTabs p-namespaces-label

values: Featured content – the best of Wikipedia

values: Find background information on current events

values:
/wiki/Special:Random
Load a random article [ctrl-alt-x]
x

values: portal navigation p-navigation p-navigation-label

values: Guidance on how to use and edit Wikipedia

values: About the project, what you can do, where to find things

values: A list of recent changes in the wiki [ctrl-alt-r]

values: portal navigation p-interaction p-interaction-label

values: List of all English Wikipedia pages containing links to this page [ctrl-alt-j]

values: Recent changes in pages linked from this page [ctrl-alt-k]

values:
/wiki/Wikipedia:File_Upload_Wizard
Upload files [ctrl-alt-u]
u

values: A list of all special pages [ctrl-alt-q]

values: portal navigation p-wikibase-otherprojects p-wikibase-otherprojects-label

values: تاریخچه آمار – Persian

values: /static/images/wikimedia-button-1.5x.png 1.5x, /static/images/wikimedia-button-2x.png 2x

values: /static/images/poweredby_mediawiki_132x47.png 1.5x, /static/images/poweredby_mediawiki_176x62.png 2x

values:
suggestions
display: none; font-size: 13px;

values: mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-0 ns-subject page-History_of_statistics rootpage-History_of_statistics skin-vector action-view