<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
    <channel>
        <title>Tukey on Visualizing.JP</title>
        <link>https://visualizing.jp/en/tags/tukey/</link>
        <description>Recent content in Tukey on Visualizing.JP</description>
        <generator>Hugo -- gohugo.io</generator>
        <language>en-US</language>
        <copyright>Yuichi Yazaki</copyright>
        <lastBuildDate>Sun, 23 Aug 2026 00:00:00 +0900</lastBuildDate><atom:link href="https://visualizing.jp/en/tags/tukey/index.xml" rel="self" type="application/rss+xml" /><item>
        <title>Data Analysis Is a Science: What Tukey Wrote to Mathematical Statistics in 1962</title>
        <link>https://visualizing.jp/en/tukey-future-of-data-analysis/</link>
        <pubDate>Sun, 23 Aug 2026 00:00:00 +0900</pubDate>
        
        <guid>https://visualizing.jp/en/tukey-future-of-data-analysis/</guid>
        <description>&lt;img src="https://visualizing.jp/tukey-future-of-data-analysis/images/cover.png" alt="Featured image of post Data Analysis Is a Science: What Tukey Wrote to Mathematical Statistics in 1962" /&gt;&lt;p&gt;In 1962, John W. Tukey published a 67-page paper in the central journal of mathematical statistics. Its title was &amp;ldquo;The Future of Data Analysis.&amp;rdquo; It has no theorems and no proofs. In the opening he writes that he had long thought himself a statistician, but that his central interest is data analysis. His main argument is that data analysis is a science.&lt;/p&gt;
&lt;p&gt;Half a century later, David Donoho rereads the paper as the starting point of a science that learns from data. David Hand calls Tukey &amp;ldquo;the first data scientist.&amp;rdquo; When people today speak of &amp;ldquo;the beginning of data science,&amp;rdquo; the event they point to is, first of all, this paper.&lt;/p&gt;
&lt;h2 id=&#34;the-paper-itself&#34;&gt;The paper itself
&lt;/h2&gt;&lt;p&gt;The bibliographic details are as follows. John W. Tukey, &amp;ldquo;The Future of Data Analysis,&amp;rdquo; &lt;em&gt;The Annals of Mathematical Statistics&lt;/em&gt;, Vol. 33, No. 1 (March 1962), pp. 1–67. DOI: &lt;a class=&#34;link&#34; href=&#34;https://doi.org/10.1214/aoms/1177704711&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;10.1214/aoms/1177704711&lt;/a&gt;. The journal was then at the front line of mathematical statistics. The other papers in the same issue are lined with definitions, theorems and proofs. Donoho writes that a public confession was published among them.&lt;/p&gt;
&lt;p&gt;The opening is two paragraphs that James R. Thompson called, in 2001, a &amp;ldquo;manifesto of an intellectual revolution.&amp;rdquo;&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;For a long time I have thought I was a statistician, interested in inferences from the particular to the general. But as I have watched mathematical statistics evolve, I have had cause to wonder and to doubt. [&amp;hellip;] All in all, I have come to feel that my central interest is in data analysis, which I take to include, among other things: procedures for analyzing data, techniques for interpreting the results of such procedures, ways of planning the gathering of data to make its analysis easier, more precise or more accurate, and all the machinery and results of (mathematical) statistics which apply to analyzing data.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;In short: he had long thought himself a statistician, interested in inference from the particular to the general. Watching mathematical statistics develop, he came to doubt. What lies at the center, he says, is data analysis, which includes (1) procedures for analyzing data, (2) techniques for interpreting their results, (3) plans for gathering data so that analysis is easier, more precise or more accurate, and (4) the machinery and results of mathematical statistics that apply to analyzing data.&lt;/p&gt;
&lt;p&gt;He goes on to write that inference from a sample to a population is a large part but not the whole. Work that picks out signs invisible in the raw data, and work that decides how to allocate effort, are also only parts. &amp;ldquo;Data analysis is a larger and more varied field than inference, or allocation.&amp;rdquo; He admits that he is stretching the term beyond its etymology. Peter Huber later judged that this stretching wrapped the whole of statistics inside it.&lt;/p&gt;
&lt;p&gt;On page 3, he asks: &amp;ldquo;Is it not time to seek out novelty in data analysis?&amp;rdquo;&lt;/p&gt;
&lt;h2 id=&#34;three-conditions-for-a-science&#34;&gt;Three conditions for a science
&lt;/h2&gt;&lt;p&gt;On pages 4–5, he lists three conditions for being a science. The passage below sets out that argument as he wrote it.&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;There are diverse views as to what makes a science, but three constituents will be judged essential by most, viz: (a1) intellectual content, (a2) organization into an understandable form, (a3) reliance upon the test of experience as the ultimate standard of validity. By these tests, mathematics is not a science, since its ultimate standard of validity is an agreed-upon sort of logical consistency and provability. As I see it, data analysis passes all three tests, and I would regard it as a science, one defined by a ubiquitous problem rather than by a concrete subject.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;Intellectual content. Organization into an understandable form. Reliance on the test of experience as the ultimate standard of validity. Data analysis meets all three. It is, in Tukey&amp;rsquo;s words, a science defined by a ubiquitous problem rather than by a concrete subject. By the same three conditions, mathematics falls outside science, because its ultimate standard is logical consistency and provability. Where statistics stands depends on whether statisticians side with data analysis or with pure mathematics. He even writes that the two cannot both be the ultimate standard at once.&lt;/p&gt;
&lt;p&gt;Standing on the side of science changes one&amp;rsquo;s attitude as well. These are the points Michael Friendly cites.&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;(b1) Seek scope and usefulness rather than security.&lt;/li&gt;
&lt;li&gt;(b2) Tolerate moderate error, to raise the chance that inadequate evidence will suggest the right answer.&lt;/li&gt;
&lt;li&gt;(b3) Use mathematical argument as a basis for judgment, not as a mark of proof or validity.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;A famous sentence on page 13 compresses this attitude.&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Far better an approximate answer to the right question, which is often vague, than an exact answer to the wrong question, which can always be made precise.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;An approximate answer to the right question is far better than an exact answer to the wrong question, which can always be made precise. Knowledge of data analysis is, at best, only an approximation as to what the problem is. So one has no choice but to proceed by approximation, he continues.&lt;/p&gt;
&lt;p&gt;The driving forces number four. Donoho called the list &amp;ldquo;surprisingly modern.&amp;rdquo;&lt;/p&gt;
&lt;figure class=&#34;vz-figure gallery-image vz-figure--captioned&#34;&gt;
&lt;a href=&#34;https://visualizing.jp/tukey-future-of-data-analysis/images/four-forces.png&#34; target=&#34;_blank&#34; rel=&#34;noopener&#34;&gt;&lt;img src=&#34;https://visualizing.jp/tukey-future-of-data-analysis/images/four-forces.png&#34; width=&#34;1600&#34; height=&#34;900&#34; srcset=&#34;https://visualizing.jp/tukey-future-of-data-analysis/images/four-forces_hu_71a5ce9a98db650f.png 480w, https://visualizing.jp/tukey-future-of-data-analysis/images/four-forces_hu_c4c50ea1fe0b0d1f.png 1024w&#34; sizes=&#34;(min-width: 768px) 700px, 100vw&#34; loading=&#34;lazy&#34; alt=&#34;Four forces driving data analysis. Statistical theory is only one part&#34;&gt;&lt;/a&gt;&lt;figcaption&gt;&lt;span class=&#34;vz-figure__no&#34; data-label=&#34;Fig. &#34;&gt;&lt;/span&gt;&lt;span class=&#34;vz-figure__text&#34;&gt;Four forces driving data analysis. Statistical theory is only one part&lt;/span&gt;&lt;/figcaption&gt;&lt;/figure&gt;&lt;p&gt;The four influences listed in Tukey 1962, translated from the English as reproduced in Donoho 2017&lt;/p&gt;
&lt;ol&gt;
&lt;li&gt;The formal theory of statistics&lt;/li&gt;
&lt;li&gt;Accelerating developments in computers and display devices&lt;/li&gt;
&lt;li&gt;The challenge, in many fields, of more and ever larger bodies of data&lt;/li&gt;
&lt;li&gt;The emphasis on quantification in a wider variety of disciplines&lt;/li&gt;
&lt;/ol&gt;
&lt;p&gt;Item 1 was the shock, Donoho writes, because it implies that statistical theory is one part of the new science, not the whole. Tukey goes as far as to say that data analysis can be more complex than the physical, biological or behavioral sciences, and that demanding dense guidance from formal structure is excessive. &amp;ldquo;Data analysis can gain much from formal statistics, but only if the connection is kept adequately loose.&amp;rdquo;&lt;/p&gt;
&lt;p&gt;On figures, he writes on page 49 as follows. If one technique had to be named for its power to make many models clear to the mind, it would be the simple graph. It brings out signs of unexpected phenomena. With a single stimulus and a single response, much of the qualitative and a good deal of the quantitative can be put in a graph. Including indirect graphs, the point is that graphs are not a means of avoiding computation but a means of making the results of computation present. Friendly calls 1900–1950 the &amp;ldquo;modern dark ages&amp;rdquo; of visualization, and places this paper among the turning points of the 1950–1975 rebirth.&lt;/p&gt;
&lt;h2 id=&#34;teaching-it-as-a-science&#34;&gt;Teaching it as a science
&lt;/h2&gt;&lt;p&gt;The paper&amp;rsquo;s argument on education is not only about transmitting facts. It is about returning to the way a science is taught.&lt;/p&gt;
&lt;p&gt;Statistics is taught as a part of mathematics (c1). When one studies statistics itself, attention to data analysis is limited (c2). Even in doctoral programs, there is less close contact with practitioners than in physics or mathematics (c3). So there is too little time to learn alongside people who are already analyzing. A science teaches not only facts and established structure but also that science&amp;rsquo;s way of thinking and its current beliefs and practice. Data analysis is no different, is Tukey&amp;rsquo;s demand.&lt;/p&gt;
&lt;p&gt;What makes the difficulty worse, he also writes, is the view that &amp;ldquo;the only way to avoid cookbookery and to develop understanding is a mathematical treatment emphasizing proof.&amp;rdquo; Cookbookery is not peculiar to data analysis. What is peculiar is concentrating the remedy on mathematics and proof. Biochemistry textbooks are written simply to put the facts in. He also proposes that experimental sampling lets a class check facts for itself.&lt;/p&gt;
&lt;p&gt;Convey what is known, show current practice, learn beside real data, and verify by experiment. The value of mathematical rigor is limited here.&lt;/p&gt;
&lt;h2 id=&#34;how-it-came-to-be-read-as-a-starting-point&#34;&gt;How it came to be read as a starting point
&lt;/h2&gt;&lt;p&gt;Tukey&amp;rsquo;s term is &lt;strong&gt;data analysis&lt;/strong&gt;. Mosteller and Tukey titled their 1968 chapter &amp;ldquo;Data Analysis, Including Statistics.&amp;rdquo; The name exploratory data analysis (EDA) spread with the preliminary editions around 1970 and the 1977 &amp;ldquo;orange book.&amp;rdquo; Friendly places the origin of EDA in the 1962 paper, as a matter of convenience.&lt;/p&gt;
&lt;p&gt;The name &lt;strong&gt;data science&lt;/strong&gt; came after that. In 1997, in his inaugural lecture as Carver Professor at the University of Michigan, &amp;ldquo;Statistics = Data Science?,&amp;rdquo; C. F. Jeff Wu argued that statistics should be renamed data science. In 2001, William S. Cleveland explicitly called the expanded field &amp;ldquo;data science&amp;rdquo; and proposed how universities should allocate resources. His criterion of value is how much a piece of work helps the learning of the data analyst. It is a text that translates Tukey&amp;rsquo;s &amp;ldquo;develop in step with practice&amp;rdquo; into an organizational plan.&lt;/p&gt;
&lt;p&gt;Reading the 1962 paper as the starting point of today&amp;rsquo;s data science is a verdict of much later years.&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Donoho (2017; the talk for Tukey&amp;rsquo;s 100th birthday was its prototype) writes that Tukey called for reform of academic statistics and pointed to the existence of an unrecognized science of learning from data. His reading is that Tukey foresaw today&amp;rsquo;s data science moment.&lt;/li&gt;
&lt;li&gt;Hand (2023, IMS) calls the 67 pages a tour de force and concludes that Tukey &amp;ldquo;may be regarded as the first data scientist.&amp;rdquo;&lt;/li&gt;
&lt;li&gt;Thompson (2001) judges it possibly Tukey&amp;rsquo;s most important work, a call for a revolution in statistical thinking.&lt;/li&gt;
&lt;li&gt;Mallows (2006) writes that it redefined the subject and introduced data analysis as the name of what applied statisticians do.&lt;/li&gt;
&lt;li&gt;Huber (2010) writes that the influence was ultimately huge but was not recognized immediately, and that it took him several years as well. Donoho sees academic statistics as a whole as not having followed Tukey&amp;rsquo;s path.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;In Donoho&amp;rsquo;s account of the history, Bell Labs colleagues (Chambers, Cleveland) found it easier than academic statistics to adopt Tukey&amp;rsquo;s broad view. University statistics kept to the frame of theory. The observation that the 20% Cleveland allotted to theory held 100% of the work of departments at the time is the core of that account. Donoho also notes that its appearance in the Annals was itself anomalous, and was the decision of the editor, Hodges.&lt;/p&gt;
&lt;p&gt;Hand picks up even the details of the body of the paper: iteration, new questions, multiple views of a summary, the warning against treating all data the same way, the rebuttal of automation, and the effect of computers as &amp;ldquo;important but not always fatal.&amp;rdquo; The context that S, Python and R came decades later is also there. The 1962 paper is not only a manifesto but also a catalog of methods.&lt;/p&gt;
&lt;p&gt;Friendly writes that it may have looked to the orthodoxy of the day like Luther&amp;rsquo;s 95 theses. In the history of visualization, Friendly&amp;rsquo;s placement is that it was a turn overturning half a century of neglect, the view that pictures cannot state facts to the decimal place. Stephen Stigler states that the direct effect of the EDA orange book itself was small. What had influence was the subject, spread by students and colleagues. We can assume the same structure for the 1962 paper. The manifesto came first, and implementation and education caught up later.&lt;/p&gt;
&lt;p&gt;In Friendly&amp;rsquo;s 2022 article, Huber also writes that today&amp;rsquo;s data science is distracted by data too large to explore, and leaves exploration to blind batch processing. Reading the paper as a starting point and today&amp;rsquo;s practice inheriting the paper&amp;rsquo;s attitude are separate matters. Donoho himself sees today&amp;rsquo;s university data science programs as a compromise between a statistics master&amp;rsquo;s and a database master&amp;rsquo;s rather than as Tukey&amp;rsquo;s science.&lt;/p&gt;
&lt;h2 id=&#34;takeaways&#34;&gt;Takeaways
&lt;/h2&gt;&lt;p&gt;What this paper leaves for visualization work is not the precision of area. It is how to pose a question.&lt;/p&gt;
&lt;p&gt;A figure is a device that brings out the unexpected, Tukey writes. Put a rough answer to the right question first. Put the precise wrong answer later. Mathematics is material for judgment, not a mark of validity. Education, too, means conveying what is known, showing current practice and letting students learn beside real data, rather than drilling proofs.&lt;/p&gt;
&lt;p&gt;What 1962 has is a declaration that treats the activity of learning from data as a science. The paper itself places the work of drawing figures at the center of that science.&lt;/p&gt;
&lt;h2 id=&#34;references&#34;&gt;References
&lt;/h2&gt;&lt;p&gt;&lt;strong&gt;Primary sources&lt;/strong&gt;&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;John W. Tukey, &amp;ldquo;The Future of Data Analysis,&amp;rdquo; &lt;em&gt;The Annals of Mathematical Statistics&lt;/em&gt;, 33(1), 1962, pp. 1–67. &lt;a class=&#34;link&#34; href=&#34;https://doi.org/10.1214/aoms/1177704711&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;doi:10.1214/aoms/1177704711&lt;/a&gt; / &lt;a class=&#34;link&#34; href=&#34;https://projecteuclid.org/journals/annals-of-mathematical-statistics/volume-33/issue-1/The-Future-of-Data-Analysis/10.1214/aoms/1177704711.full&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;Project Euclid&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;Frederick Mosteller and John W. Tukey, &amp;ldquo;Data Analysis, Including Statistics,&amp;rdquo; in &lt;em&gt;Handbook of Social Psychology&lt;/em&gt;, 2nd ed., 1968.&lt;/li&gt;
&lt;li&gt;John W. Tukey, &lt;em&gt;Exploratory Data Analysis&lt;/em&gt;, Addison-Wesley, 1977.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;strong&gt;Secondary sources&lt;/strong&gt;&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;David Donoho, &amp;ldquo;50 Years of Data Science,&amp;rdquo; &lt;em&gt;Journal of Computational and Graphical Statistics&lt;/em&gt;, 26(4), 2017, pp. 745–766. &lt;a class=&#34;link&#34; href=&#34;https://doi.org/10.1080/10618600.2017.1384734&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;doi:10.1080/10618600.2017.1384734&lt;/a&gt; (open access)&lt;/li&gt;
&lt;li&gt;David J. Hand, &amp;ldquo;Hand Writing: John Tukey, the first data scientist?,&amp;rdquo; &lt;em&gt;IMS Bulletin&lt;/em&gt;, 2023-09-30. &lt;a class=&#34;link&#34; href=&#34;https://imstat.org/2023/09/30/hand-writing-john-tukey-the-first-data-scientist/&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;IMS&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;James R. Thompson, &amp;ldquo;The Age of Tukey,&amp;rdquo; &lt;em&gt;Technometrics&lt;/em&gt;, 43(3), 2001, pp. 256–265. &lt;a class=&#34;link&#34; href=&#34;https://repository.rice.edu/bitstreams/a72fddf7-014a-4186-ab3a-25c3d7d208b3/download&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;Rice repository&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;Colin Mallows, &amp;ldquo;Tukey&amp;rsquo;s Paper After 40 Years,&amp;rdquo; &lt;em&gt;Technometrics&lt;/em&gt;, 48(3), 2006, pp. 319–325. &lt;a class=&#34;link&#34; href=&#34;https://doi.org/10.1198/004017006000000219&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;doi:10.1198/004017006000000219&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;Peter J. Huber, &lt;em&gt;Data Analysis: What Can Be Learned From the Past 50 Years&lt;/em&gt;, Wiley, 2010.&lt;/li&gt;
&lt;li&gt;William S. Cleveland, &amp;ldquo;Data Science: An Action Plan for Expanding the Technical Areas of the Field of Statistics,&amp;rdquo; &lt;em&gt;International Statistical Review&lt;/em&gt;, 69(1), 2001, pp. 21–26. &lt;a class=&#34;link&#34; href=&#34;https://doi.org/10.1111/j.1751-5823.2001.tb00477.x&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;doi:10.1111/j.1751-5823.2001.tb00477.x&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;C. F. Jeff Wu, &amp;ldquo;Statistics = Data Science?,&amp;rdquo; H. C. Carver Professor inaugural lecture, University of Michigan, 1997. &lt;a class=&#34;link&#34; href=&#34;https://www2.isye.gatech.edu/~jeffwu/presentations/datascience.pdf&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;Slides&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;Michael Friendly, &amp;ldquo;Remembrances of Things EDA,&amp;rdquo; &lt;em&gt;Nightingale&lt;/em&gt;, 2022-06-16. &lt;a class=&#34;link&#34; href=&#34;https://nightingaledvs.com/remembrances-of-things-eda/&#34;  target=&#34;_blank&#34; rel=&#34;noopener&#34;
    &gt;Article&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;John M. Chambers, &amp;ldquo;Greater or Lesser Statistics: A Choice for Future Research,&amp;rdquo; &lt;em&gt;Statistical Science&lt;/em&gt;, 8(2), 1993, pp. 182–186.&lt;/li&gt;
&lt;/ul&gt;</description>
        </item>
        
    </channel>
</rss>
