Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

The Virtue of Narrowness

37Eliezer_Yudkowsky07 August 2007 05:57PM

What is true of one apple may not be true of another apple; thus more can be said about a single apple than about all the apples in the world.
       —Twelve Virtues of Rationality 

Within their own professions, people grasp the importance of narrowness; a car mechanic knows the difference between a carburetor and a radiator, and would not think of them both as "car parts".  A hunter-gatherer knows the difference between a lion and a panther.  A janitor does not wipe the floor with window cleaner, even if the bottles look similar to one who has not mastered the art.

Outside their own professions, people often commit the misstep of trying to broaden a word as widely as possible, to cover as much territory as possible.  Is it not more glorious, more wise, more impressive, to talk about all the apples in the world?  How much loftier it must be to explain human thought in general, without being distracted by smaller questions, such as how humans invent techniques for solving a Rubik's Cube.  Indeed, it scarcely seems necessary to consider specific questions at all; isn't a general theory a worthy enough accomplishment on its own?

It is the way of the curious to lift up one pebble from among a million pebbles on the shore, and see something new about it, something interesting, something different. You call these pebbles "diamonds", and ask what might be special about them—what inner qualities they might have in common, beyond the glitter you first noticed. And then someone else comes along and says: "Why not call this pebble a diamond too? And this one, and this one?" They are enthusiastic, and they mean well. For it seems undemocratic and exclusionary and elitist and unholistic to call some pebbles "diamonds", and others not. It seems... narrow-minded... if you'll pardon the phrase. Hardly open, hardly embracing, hardly communal.

You might think it poetic, to give one word many meanings, and thereby spread shades of connotation all around. But even poets, if they are good poets, must learn to see the world precisely. It is not enough to compare love to a flower. Hot jealous unconsummated love is not the same as the love of a couple married for decades. If you need a flower to symbolize jealous love, you must go into the garden, and look, and make subtle distinctions—find a flower with a heady scent, and a bright color, and thorns. Even if your intent is to shade meanings and cast connotations, you must keep precise track of exactly which meanings you shade and connote.

It is a necessary part of the rationalist's art—or even the poet's art!—to focus narrowly on unusual pebbles which possess some special quality. And look at the details which those pebbles—and those pebbles alone!—share among each other.  This is not a sin.

It is perfectly all right for modern evolutionary biologists to explain just the patterns of living creatures, and not the "evolution" of stars or the "evolution" of technology.  Alas, some unfortunate souls use the same word "evolution" to cover the naturally selected patterns of replicating life, and the strictly accidental structure of stars, and the intelligently configured structure of technology.  And as we all know, if people use the same word, it must all be the same thing.  You should automatically generalize anything you think you know about biological evolution to technology.  Anyone who tells you otherwise must be a mere pointless pedant.  It couldn't possibly be that your abysmal ignorance of modern evolutionary theory is so total that you can't tell the difference between a carburetor and a radiator.  That's unthinkable.  No, the other guy—you know, the one who's studied the math—is just too dumb to see the connections.

And what could be more virtuous than seeing connections?  Surely the wisest of all human beings are the New Age gurus who say "Everything is connected to everything else."  If you ever say this aloud, you should pause, so that everyone can absorb the sheer shock of this Deep Wisdom.

There is a trivial mapping between a graph and its complement.  A fully connected graph, with an edge between every two vertices, conveys the same amount of information as a graph with no edges at all.  The important graphs are the ones where some things are not connected to some other things.

When the unenlightened ones try to be profound, they draw endless verbal comparisons between this topic, and that topic, which is like this, which is like that; until their graph is fully connected and also totally useless. The remedy is specific knowledge and in-depth study. When you understand things in detail, you can see how they are not alike, and start enthusiastically subtracting edges off your graph.

Likewise, the important categories are the ones that do not contain everything in the universe.  Good hypotheses can only explain some possible outcomes, and not others.

It was perfectly all right for Isaac Newton to explain just gravity, just the way things fall down—and how planets orbit the Sun, and how the Moon generates the tides—but not the role of money in human society or how the heart pumps blood. Sneering at narrowness is rather reminiscent of ancient Greeks who thought that going out and actually looking at things was manual labor, and manual labor was for slaves.

As Plato put it (in The Republic, Book VII):

"If anyone should throw back his head and learn something by staring at the varied patterns on a ceiling, apparently you would think that he was contemplating with his reason, when he was only staring with his eyes... I cannot but believe that no study makes the soul look on high except that which is concerned with real being and the unseen. Whether he gape and stare upwards, or shut his mouth and stare downwards, if it be things of the senses that he tries to learn something about, I declare he never could learn, for none of these things admit of knowledge: I say his soul is looking down, not up, even if he is floating on his back on land or on sea!"

Many today make a similar mistake, and think that narrow concepts are as lowly and unlofty and unphilosophical as, say, going out and looking at things—an endeavor only suited to the underclass.  But rationalists—and also poets—need narrow words to express precise thoughts; they need categories which include only some things, and exclude others. There's nothing wrong with focusing your mind, narrowing your categories, excluding possibilities, and sharpening your propositions. Really, there isn't! If you make your words too broad, you end up with something that isn't true and doesn't even make good poetry.

And DON'T EVEN GET ME STARTED on people who think Wikipedia is an "Artificial Intelligence", the invention of LSD was a "Singularity" or that corporations are "superintelligent"!

 

Part of the sequence Mysterious Answers to Mysterious Questions

Next post: "Your Strength as a Rationalist"

Previous post: "Focus Your Uncertainty"

Article Navigation

Vote upVote down
Comments (31)
    Tags: philosophy seq_mamq virtues words constraint

    Comments (31)

    Sort By: Old
    Hopefully_Anonymous207 August 2007 06:46:32PM1 point [-]

    Eliezer, Actually, I'd like to read good critiques of descriptions of corporations as superintelligent (or more nuanced versions of that assertion/theory, such as that some corporations may be intelligent, and more intelligent than individual humans).

    Where can I find such critiques?

    • Vote up
    • Vote down
    • Reply
    • Permalink
    drnickbone13 February 2012 08:08:33PM3 points [-]

    Well I don't know about "super intelligent", but modern corporations do seem remarkably like "unfriendly AI" (as defined in the Sequences). They have a very simplified utility function (shareholder value) and tend to maximize it at the expense of all rival human values. They are also very powerful and potential immortal.

    The only open question is how intelligent they actually are. The naive answer is that any corporation is at least as intelligent as its most intelligent employee; but anyone who has actually worked for a modern corporation will know just how far from the truth this is. As stupid as their stupidest manager is maybe closer to the truth. So there's some hope there.

    I'm sure I'm not the first on LW to draw this parallel...

    • Vote up
    • Vote down
    • Parent
    • Reply
    • Permalink
    Jey_Kottalam07 August 2007 07:12:57PM3 points [-]

    HA: Shouldn't the burden be on the people claiming a corporation is "superintelligent" to justify their claim? It's not the job of the rest of us to write preemptive refutations of every possible incorrect argument. It's the job of the people making the claims to justify their claims. So, for what value of "superintelligent" are corporations superintelligent, and why?

    • Vote up
    • Vote down
    • Reply
    • Permalink
    wedrifid18 November 2009 03:04:24AM2 points [-]

    So, for what value of "superintelligent" are corporations superintelligent, and why?

    They can achieve complex optimisations that no individual could do by themselves. So I suppose the value of 'superintelligent' would be 'a little bit'.

    • Vote up
    • Vote down
    • Parent
    • Reply
    • Permalink
    Robin_Hanson207 August 2007 07:21:09PM0 points [-]

    Eliezer, I fear you are dangerously close to being labeled a "logical atomist" for being so fond of distinctions. :)

    • Vote up
    • Vote down
    • Reply
    • Permalink
    Andrew207 August 2007 08:29:35PM0 points [-]

    Eliezer,

    I agree with what you're saying. But there is something to this "everything is connected" idea. Almost every statistical problem I work on is connected to other statistical problems I've worked on, and realizing these connections has been helpful to me.

    • Vote up
    • Vote down
    • Reply
    • Permalink
    Elizabeth13 June 2010 03:42:14AM11 points [-]

    The problem with harping on everything is connected is that it is, but good systems are created bottom up instead of top down. You didn't sit down and say "All statistical problems are governed by overarching concept X, which leads to the inference of methods a, b, and c, which in turn lead to these problems." You said, "I have these problems, and certain similarities imply a larger system." It's like biology, Linnaeus did not come up with his classification system out of thin air, he first studied many individual animals and their properties and only subsequently noticed similarities and differences which he could classify. Narrowness is where we need to start, because it gives us the building blocks for broader ideas.

    • Vote up
    • Vote down
    • Parent
    • Reply
    • Permalink
    Peacewise30 October 2011 10:50:30PM0 points [-]

    Seems to me the ideal way for understanding systems is to analyse and then synthesise.

    • Vote up
    • Vote down
    • Parent
    • Reply
    • Permalink
    Hopefully_Anonymous207 August 2007 08:34:07PM0 points [-]

    Jeff Kottalam, I'd also like to be directed to such claims and claim justifications (there's a protean claim justification on my blog). I'll resist the temptation of the thread-jacking bait that constitutes your last sentence, and encourage you -and Eliezer- to join me on my blog to continue the conversation on this topic.

    • Vote up
    • Vote down
    • Reply
    • Permalink
    Aaron_Luchko07 August 2007 10:04:29PM3 points [-]

    I think the graph comparison isn't a completely valid metaphor. With the graph you describe the relationship between two nodes is binary, either it's present or absent. But between topics there are numerous types of connections, for sure the statement "everything is connected" conveys no useful information but I believe that it's very difficult to find two topics with no type of connection. For instance Wikipedia couldn't be considered an artificial intelligence but I would not be surprised if there are certain topics in artificial intelligence that could be applied to wikipedia (associations between topics could be a possibility though I don't know enough about AI to know if that would be useful). For instance simply drawing an edge from AI to Wikipedia tells little, but perhaps 3 unique edges describing the precise connections could be very informative. In this way one can achieve a connected graph that still is very informative.

    • Vote up
    • Vote down
    • Reply
    • Permalink
    guy_in_the_veal_calf_office08 August 2007 02:22:54AM1 point [-]

    I have little to contribute to furthering the discussion in the post, but the "importance of narrowness" leads me to an observation.

    Thousands of litigators litigate tens of thousands of cases before juries and those litigators, and their specialized vendors, focus much of their attention on biases. Billions of dollars are bet in this market, where highly intelligent people hotly contest one another in overcoming (or even better, seeding) bias and rationality (irrationality) among jurors, judges, media commentators and even scientific experts. Litigators grasp the importance of narrowness in this websites subject matter. Someone might look (or may already have looked) into that as a source of research material, although a lot of trade secrecy may need to be overcome.

    Scientific experts might be a fertile area. The law imposes a list of requirements for scientif evidence (guess if peer review is required) and litigators who discredit experts often expose biases. The legal system, of course, has its own entrenched biases- often judges prohibit expert testimony that eyewitness identifcation or finger printing have little credibility. Lie detectors have been successfully tossed from the court room. One odd development is that prosecutors have been hamstrung by, and defense attorneys taking advantage of, the expectations of jurors who watch lots of the procedure television shows.

    Thats my brain dump. I hope someone enjoyed it. Enjoy the website.

    • Vote up
    • Vote down
    • Reply
    • Permalink
    Scott_Aaronson08 August 2007 05:14:09PM2 points [-]

    Eliezer: Excellent post, but I wonder if what you're saying is related to impressionist painting or the French Revolution? :-)

    Seriously, I constantly meet people who ask me questions like: "could quantum algorithms have implications for biomechanical systems?" Or "could neural nets provide insight to the P versus NP problem?" And I struggle to get across to them what you've articulated so clearly here: that part of being a successful researcher is figuring out what isn't related to what else.

    • Vote up
    • Vote down
    • Reply
    • Permalink