Tuesday, September 29, 2009

What makes it science?

Many people draw a division between the hard sciences and mathematics on the one hand, and everything else on the other. The implication being that one side is "really" science and the other is not. Which claim to upset members of "soft sciences" like psychology.

This post explores the question of how justified this division is.

The starting point for my thinking is something I learned from the wonderful essay In Oldenburg's Long Shadow about the serial pricing crisis.

To understand the serial pricing crisis you must first understand the science citation index. This is nothing more or less than an index of how many times a given paper has been cited by other published papers. When you look at it, you find that papers that appear in some journals are consistently cited more often than others. This is a direct measurement of how influential the journal is, and leads to the impact factor. When you look at journals across math and the hard sciences you find that there is a hierarchy of journals. At the bottom you have low impact journals that publish only for a small niche. But key papers from that niche are published in more prominent journals that are looked at by people in a wider range of subjects. And this goes all of the way to the highest impact journal of all, Nature, which is where people try to publish the absolute best work across all of math and the hard sciences. It doesn't matter whether you're a physicist or a biologist, the absolute best research goes to Nature.

So from the science citation index we can measure the impact factor of a journal, which in turn tells us its value to researchers. The value to researchers told publishers what universities were willing to pay, and so publishers have been steadily increasing the price of the most important journals. This costs universities more than they are happy with, and so is called a crisis. Librarians call journals "serials" (because you get a series of copies of a journal), hence this crisis is called the serial pricing crisis.

Now let's look at this in reverse. Across all of math and the hard sciences it is possible to make a somewhat reasonable comparison of how important any given paper is, and how good any given journal is. Furthermore there are small groups of editors whose judgment is regularly trusted to compare the best papers from different areas of science and select which are worthy to be in their journals. In the extreme example, the editors of Nature are trusted to draw comparison across all of the hard sciences. And for the most part, scientists agree with these decisions.

When you think about it, it is truly remarkable. It implies that there is a relatively well shared concept of relative value across all of the sciences. Of course people in the hard sciences seldom remark on it, it is just how things are.

To see how remarkable it is, compare with the humanities and social sciences. They have no such hierarchy. Instead of one grand hierarchy you get independent clumps of researchers who talk to each other but not the other groups. And they find this so natural that I have seen social scientists express disbelief that, say, a physicist in fluid mechanics can hear a key result in particle physics and will know that it is important. But it is true. If you ask one physicist, "What are the 10 most important results in physics in the last 30 years" and take that list to another, the other physicist will agree that those are all important. If you ask a psychologist for a similar list and take it to another, the other is likely to not even recognize many of the items.

What is going on here is a confirmation of one of Thomas Kuhn's key claims in The Structure of Scientific Revolutions. Which is that in a mature science (his term) researchers have come to share a paradigm about what would be progress. When a paradigm has become so compelling that virtually all researchers in the area accept it, then people who are not in that field can see the agreement that progress is happening. When no paradigm can compel general acceptance, then from a distance all that is visible is confusion.

Kuhn is careful to point out that within the field there will be groups of researchers who are doing good work and making progress. This is certainly is true. For instance I've brought up psychology. Yet if you read books like Parenting From the Inside Out you will find that solid research is being done, that comes up with valuable information. (I highly recommend this book to anyone, parent or not, who is willing to work through it carefully.) But the problem is that the case for this line of research is not compelling enough to convince other psychologists that this is the right way to try to understand the mind. So from a distance there isn't a clear impression of solid progress being made.

Therefore the hard/soft science division boils down to shared paradigms. In the hard sciences certain lines of research have become so compelling that everyone agrees that they are the right way to go. Because of this agreement, people in nearby fields get a clear picture of what progress looks like in that field. With clear pictures of what progress looks like in multiple fields, the ground is set for making comparisons between fields, which has evolved into a reasonably well shared value system across the entirety of the hard sciences.

The soft sciences share none of this structure. As a result there is no shared agreement within the soft science about what is important, let alone a shared agreement on the relative importance of different areas of science.

To close I would like to illustrate how much shared agreement there is within the hard science about what progress looks like. I'll do this by giving my personal top 10 lists of scientific advances in each century since science began to take off in the 1600s. I haven't tried to put them in any particular order. (They often are somewhat chronological.) While people may quibble with some of my specific choices, people who are well versed in the hard sciences will generally agree on the importance of these items.

  • 1600s
    1. Objects of different mass fall at the same rate (Galileo, physics)
    2. Telescope used for astronomy (Galileo, astronomy)
    3. Kepler's laws for planetary orbits (Kepler, astronomy)
    4. Circulatory system accurately described (Harvey, biology)
    5. Microbes discovered (Leeuwenhoek, biology)
    6. Hooke's law of elasticity (Hooke, physics)
    7. Newton's laws of motion (Newton, physics)
    8. Newton's law of gravity (Newton, physics)
    9. Speed of light first measured (Ole Römer, astronomy/physics)
    10. Calculus (Newton/Leibniz, mathematics)

  • 1700s
    1. Lightning explained as static electricity (Ben Franklin, physics)
    2. Fluid mechanics began to be analyzed (Bernoulli, physics)
    3. Linnaean taxonomy system created (Linnaeus, biology)
    4. Halley's comet's orbit predicted (Halley, astronomy)
    5. Coulomb's law for attraction of electric charges (Coulomb, physics)
    6. Oxygen discovered (Priestly/Scheele, chemistry) leading to the rejection of pholostigon (Lavoisier)
    7. Uranus discovered (William Herschel, astronomy)
    8. Conservation of mass demonstrated (Lavoisier, chemistry)
    9. Stability of solar system confirmed (Laplace, astronomy)
    10. Gravitational constant measured (Cavendish, physics)

  • 1800s
    1. Fourier series discovered, used to analyze heat transport (Joseph Fourier, mathematics/physics)
    2. Ice ages discovered, theory of The Flood rejected (Louis Agassiz, geology)
    3. Central Limit Theorem aka The Bell Curve (de Moivre/Laplace/Galton/Lyapunov etc, statistics) different versions were proven at different times, and Galton was making good use of it years before it was finally proven in generality by Lyapunov
    4. Thermodynamics (many people starting with Carnot, physics)
    5. Conservation of Energy (Joule/Mayer, physics)
    6. Descent with Modification aka Evolution (Darwin, biology)
    7. Germ theory (Pasteur, biology)
    8. Atomic theory (Avagadro/Loschmidt etc, chemistry)
    9. Maxwell's equations of electromagnetism (James Maxwell, physics)
    10. Periodic table (Mendeleev, chemistry)

  • 1900s
    1. Relativity (Einstein, physics)
    2. Radioactive Dating (Ernest Rutherford/Bertrand Boltwood, physics)
    3. Quantum Mechanics (Heisenberg/Schrödinger, physics)
    4. Gödel's Incompleteness Theorem (Kurt Gödel, mathematics)
    5. Hypothesis Testing (Ronald Fisher/Jerzy Neyman/Karl Pearson/Egon Pearson, statistics) - Egon was Karl's son
    6. The Structure of DNA (Watson/Crick/Franklin, biology)
    7. Continental Drift (proposed Wegener and confirmed by lots of people at once, geology)
    8. The Big Bang (Georges Lemaître/Edwin Hubble, astronomy) general acceptance followed the discovery of the CMBR by Arno Penzias and Robert Wilson
    9. Synthesis of the Elements in Stars aka B2FH (Geoffrey Burbidge/Margaret Burbidge/William Fowler/Fred Hoyle, astronomy/physics)
    10. Standard Model (Sheldon Glashow/Steven Weinberg/Abdus Salam, physics) tens of billions of dollars have been spent verifying this theory!
  • 2000s - There is likely more disagreement over these
    1. Human Genome Project
    2. Neutrino oscillation
    3. Rapidly improving knowledge of planets around other stars
    4. Poincare conjecture solved
    5. Age of universe measured to within 1% accuracy (it is 13.7 billion years old)
    6. FOXP2 critical for language
    7. Preserved soft tissue from dinosaur?
    8. Stem cells from skin cells
    9. New family of high temperature superconductors
    10. Molecular evolution is irreversible

5 comments:

zby said...

Just a related (and slightly in opposition) article: http://falkenblog.blogspot.com/2009/09/nonscientists-naive-about-science.html

Ben Tilly said...

If that blog is evidence, I would conclude that Eric Falkenstein doesn't know enough about science to comment.

OK, great, he has heard Karl Popper's criterion for what science is. He's right that science doesn't work like that. That's very old news. And is one of the reasons why I gave a very different criteria for science. So, for instance, you can ignore things like his economics section.

He's sadly right about string theory. On that point I can only say that science is a human endeavor and makes mistakes, sometimes for much longer than it should. However the existence of imperfection should not distract from the evidence that the scientific process generally works.

If you wish to put his arguments about evolution in context, I highly recommend visiting talk.origins. You will find all sorts of concrete evidence for evolution that he's ignoring. Just to name one example, long lists of intermediate forms have been found. Yes, there is evidence that there is a "minimum granularity" to most of the fossil record. But if you look at the original paper arguing for punctuated evolution, it followed the evolution of a type of trilobite through two speciation events with detailed fossils through both transitions! Even his evidence against evolution, if you look back at the research, is strong evidence for it!

Jeremy Leader said...

Three thoughts, related to your post and the comments, but not to each other:

1. Anyone (e.g. Falkenstein) who talks about "the scientists" as a monolithic group is probably far enough removed from science to not know much about it.

2. Where does math fit in, given what you've said elsewhere about its (relatively recent?) division into small cliques?

3. You list your candidates for the top 10 discoveries in each century, but in the 2000s we've only seen 1/10th of that span, so I wouldn't expect more than a fraction of your list to still be in the top 10 by 2099.

Ben Tilly said...

On #2 math seems to fit into the hard sciences fairly well, amazingly enough.

Yes, math is fragmented. However every little clique has its own shared paradigm. They have a shared vision of where their group came from, what problems they are working on, and how they hope that their line of research can lead to results of interest in related areas of mathematics.

For instance take Andrew Wiles' proof of Fermat's Last Theorem. (First announced in 1993, then retracted, then finalized in 1996.) While few could explain why that problem was of interest, mathematicians and a large part of the mathematically inclined public, no matter what their interest, knew that its proof was a significant result.

Furthermore the proof didn't come out of nowhere. It built on the work of mathematicians who had been motivated in part by the belief that their work could lead to a proof of Fermat's last theorem. Indeed the possibility that something they were conjecturing was true could some day lead to a proof of Fermat's Last Theorem was sufficient motivation for an entire line of research involving multiple mathematicians. Why? Because mathematical groups are motivated by the possibility that their work, no matter how obscure, could some day lead to wider mathematical recognition. And therefore groups seek lines of research that can plausibly be tied into goals that a wider mathematical audience has agreed are important.

On #3 you are absolutely right. The century is young.

Also influential work is not always obvious immediately. For instance I didn't include the CBOL project as one of the top ten discoveries in this century. But if they can deliver on their goal of a hand held scanner that can rapidly identify tissue from any species in the world, they will have a huge effect on everything from identifying new species to catching poachers.

Matt Brubeck said...

While I definitely see your point, I think it's amusing that your argument is itself based on evidence from "soft" sciences (e.g., Kuhn's work in philosophy and sociology).