Eliezer Yudkowsky Quotes

A comment on Memetic Hazards in Videogames (September 2010) http://lesswrong.com/lw/2pe/memetic_hazards_in_videogames/2l8y

We Change Our Minds Less Often Than We Think http://lesswrong.com/lw/jx/we_change_our_minds_less_often_than_we_think/ (October 2007)

Above-Average AI Scientists http://lesswrong.com/lw/uc/aboveaverage_ai_scientists/

a comment on Hacker News (April 2012) http://news.ycombinator.com/item?id=3834636

from a comment on reddit (January 2015) http://www.reddit.com/r/HPMOR/comments/2n3yh5/what_is_it_with_dark_lord_potter_and_hpmor/cmad6x3?context=3

Epistle to the New York Less Wrongians (April 2011) http://lesswrong.com/lw/5c0/epistle_to_the_new_york_less_wrongians/

Politics Is The Mind-Killer http://lesswrong.com/lw/gw/politics_is_the_mindkiller/ (February 2007)
Context: People go funny in the head when talking about politics. The evolutionary reasons for this are so obvious as to be worth belaboring: In the ancestral environment, politics was a matter of life and death. And sex, and wealth, and allies, and reputation... When, today, you get into an argument about whether "we" ought to raise the minimum wage, you're executing adaptations for an ancestral environment where being on the wrong side of the argument could get you killed... Politics is an extension of war by other means. Arguments are soldiers. Once you know which side you're on, you must support all arguments of that side, and attack all arguments that appear to favor the enemy side; otherwise it's like stabbing your soldiers in the back — providing aid and comfort to the enemy.

Harry Potter in Ch. 65 http://www.fanfiction.net/s/5782108/65/Harry_Potter_and_the_Methods_of_Rationality
Harry Potter and the Methods of Rationality (2010 - 2015)
Context: Lies propagate, that’s what I’m saying. You’ve got to tell more lies to cover them up, lie about every fact that’s connected to the first lie. And if you kept on lying, and you kept on trying to cover it up, sooner or later you’d even have to start lying about the general laws of thought. Like, someone is selling you some kind of alternative medicine that doesn’t work, and any double-blind experimental study will confirm that it doesn’t work. So if someone wants to go on defending the lie, they’ve got to get you to disbelieve in the experimental method. Like, the experimental method is just for merely scientific kinds of medicine, not amazing alternative medicine like theirs. Or a good and virtuous person should believe as strongly as they can, no matter what the evidence says. Or truth doesn’t exist and there’s no such thing as objective reality. A lot of common wisdom like that isn’t just mistaken, it’s anti-epistemology, it’s systematically wrong. Every rule of rationality that tells you how to find the truth, there’s someone out there who needs you to believe the opposite. If you once tell a lie, the truth is ever after your enemy; and there’s a lot of people out there telling lies.

Promoting "Crocker's Rules" at SL4 (c. 2000) http://www.sl4.org/crocker.html
Context: Declaring yourself to be operating by "Crocker's Rules" means that other people are allowed to optimize their messages for information, not for being nice to you. Crocker's Rules means that you have accepted full responsibility for the operation of your own mind — if you're offended, it's your fault. Anyone is allowed to call you a moron and claim to be doing you a favor. (Which, in point of fact, they would be. One of the big problems with this culture is that everyone's afraid to tell you you're wrong, or they think they have to dance around it.) Two people using Crocker's Rules should be able to communicate all relevant information in the minimum amount of time, without paraphrasing or social formatting. Obviously, don't declare yourself to be operating by Crocker's Rules unless you have that kind of mental discipline.
Note that Crocker's Rules does not mean you can insult people; it means that other people don't have to worry about whether they are insulting you. Crocker's Rules are a discipline, not a privilege. Furthermore, taking advantage of Crocker's Rules does not imply reciprocity. How could it? Crocker's Rules are something you do for yourself, to maximize information received — not something you grit your teeth over and do as a favor.

Promoting "Crocker's Rules" at SL4 (c. 2000) http://www.sl4.org/crocker.html
Context: Declaring yourself to be operating by "Crocker's Rules" means that other people are allowed to optimize their messages for information, not for being nice to you. Crocker's Rules means that you have accepted full responsibility for the operation of your own mind — if you're offended, it's your fault. Anyone is allowed to call you a moron and claim to be doing you a favor. (Which, in point of fact, they would be. One of the big problems with this culture is that everyone's afraid to tell you you're wrong, or they think they have to dance around it.) Two people using Crocker's Rules should be able to communicate all relevant information in the minimum amount of time, without paraphrasing or social formatting. Obviously, don't declare yourself to be operating by Crocker's Rules unless you have that kind of mental discipline.
Note that Crocker's Rules does not mean you can insult people; it means that other people don't have to worry about whether they are insulting you. Crocker's Rules are a discipline, not a privilege. Furthermore, taking advantage of Crocker's Rules does not imply reciprocity. How could it? Crocker's Rules are something you do for yourself, to maximize information received — not something you grit your teeth over and do as a favor.

How an Algorithm Feels from the Inside http://lesswrong.com/lw/no/how_an_algorithm_feels_from_inside/, (February 2008)
Context: People cling to their intuitions, I think, not so much because they believe their cognitive algorithms are perfectly reliable, but because they can't see their intuitions as the way their cognitive algorithms happen to look from the inside. And so everything you try to say about how the native cognitive algorithm goes astray, ends up being contrasted to their direct perception of the Way Things Really Are—and discarded as obviously wrong.

The summary of the Joy In The Merely Real sequence (October 2009) http://wiki.lesswrong.com/wiki/Joy_in_the_Merely_Real
Context: If dragons were common, and you could look at one in the zoo — but zebras were a rare legendary creature that had finally been decided to be mythical — then there's a certain sort of person who would ignore dragons, who would never bother to look at dragons, and chase after rumors of zebras. The grass is always greener on the other side of reality. Which is rather setting ourselves up for eternal disappointment, eh? If we cannot take joy in the merely real, our lives shall be empty indeed.

Quantum explanations http://lesswrong.com/lw/pc/quantum_explanations/ (April 2008), part of his Quantum Physics Sequence http://lesswrong.com/lw/r5/the_quantum_physics_sequence/.
Context: There are no surprising facts, only models that are surprised by facts; and if a model is surprised by the facts, it is no credit to that model.

Promoting "Crocker's Rules" at SL4 (c. 2000) http://www.sl4.org/crocker.html
Context: Declaring yourself to be operating by "Crocker's Rules" means that other people are allowed to optimize their messages for information, not for being nice to you. Crocker's Rules means that you have accepted full responsibility for the operation of your own mind — if you're offended, it's your fault. Anyone is allowed to call you a moron and claim to be doing you a favor. (Which, in point of fact, they would be. One of the big problems with this culture is that everyone's afraid to tell you you're wrong, or they think they have to dance around it.) Two people using Crocker's Rules should be able to communicate all relevant information in the minimum amount of time, without paraphrasing or social formatting. Obviously, don't declare yourself to be operating by Crocker's Rules unless you have that kind of mental discipline.
Note that Crocker's Rules does not mean you can insult people; it means that other people don't have to worry about whether they are insulting you. Crocker's Rules are a discipline, not a privilege. Furthermore, taking advantage of Crocker's Rules does not imply reciprocity. How could it? Crocker's Rules are something you do for yourself, to maximize information received — not something you grit your teeth over and do as a favor.

Cognitive Biases Potentially Affecting Judgment of Global Risks http://singularity.org/files/CognitiveBiases.pdf, a chapter of Global Catastrophic Risks, edited by Nick Bostrom and Milan M. Cirkovic (2008)
Context: The human brain cannot release enough neurotransmitters to feel emotion a thousand times as strong as the grief of one funeral. A prospective risk going from 10,000,000 deaths to 100,000,000 deaths does not multiply by ten the strength of our determination to stop it. It adds one more zero on paper for our eyes to glaze over.

Predictible Fakers (January 2009) http://www.overcomingbias.com/2009/01/predictible-fakers.html
Context: My experience is that journalists report on the nearest-cliche algorithm, which is extremely uninformative because there aren’t many cliches, the truth is often quite distant from any cliche, and the only thing you can infer about the actual event was that this was the closest cliche.... It is simply not possible to appreciate the sheer awfulness of mainstream media reporting until someone has actually reported on you. It is so much worse than you think.

Predictible Fakers (January 2009) http://www.overcomingbias.com/2009/01/predictible-fakers.html
Context: My experience is that journalists report on the nearest-cliche algorithm, which is extremely uninformative because there aren’t many cliches, the truth is often quite distant from any cliche, and the only thing you can infer about the actual event was that this was the closest cliche.... It is simply not possible to appreciate the sheer awfulness of mainstream media reporting until someone has actually reported on you. It is so much worse than you think.

A comment on Wrong Questions http://lesswrong.com/lw/og/wrong_questions/ (March 2008)
Context: Mystery exists in the mind, not in reality. If I am ignorant about a phenomenon, that is a fact about my state of mind, not a fact about the phenomenon itself. All the more so, if it seems like no possible answer can exist: Confusion exists in the map, not in the territory. Unanswerable questions do not mark places where magic enters the universe. They mark places where your mind runs skew to reality.

Twelve Virtues Of Rationality http://yudkowsky.net/rational/virtues
Context: Do not flinch from experiences that might destroy your beliefs. The thought you cannot think controls you more than thoughts you speak aloud. Submit yourself to ordeals and test yourself in fire. Relinquish the emotion which rests upon a mistaken belief, and seek to feel fully that emotion which fits the facts. If the iron approaches your face, and you believe it is hot, and it is cool, the Way opposes your fear. If the iron approaches your face, and you believe it is cool, and it is hot, the Way opposes your calm. Evaluate your beliefs first and then arrive at your emotions. Let yourself say: “If the iron is hot, I desire to believe it is hot, and if it is cool, I desire to believe it is cool.”

"Radical Honesty" at LessWrong.com (10 September 2007) http://lesswrong.com/lw/j9/radical_honesty/
Context: Crocker's Rules didn't give you the right to say anything offensive, but other people could say potentially offensive things to you, and it was your responsibility not to be offended. This was surprisingly hard to explain to people; many people would read the careful explanation and hear, "Crocker's Rules mean you can say offensive things to other people."

Promoting "Crocker's Rules" at SL4 (c. 2000) http://www.sl4.org/crocker.html
Context: Declaring yourself to be operating by "Crocker's Rules" means that other people are allowed to optimize their messages for information, not for being nice to you. Crocker's Rules means that you have accepted full responsibility for the operation of your own mind — if you're offended, it's your fault. Anyone is allowed to call you a moron and claim to be doing you a favor. (Which, in point of fact, they would be. One of the big problems with this culture is that everyone's afraid to tell you you're wrong, or they think they have to dance around it.) Two people using Crocker's Rules should be able to communicate all relevant information in the minimum amount of time, without paraphrasing or social formatting. Obviously, don't declare yourself to be operating by Crocker's Rules unless you have that kind of mental discipline.
Note that Crocker's Rules does not mean you can insult people; it means that other people don't have to worry about whether they are insulting you. Crocker's Rules are a discipline, not a privilege. Furthermore, taking advantage of Crocker's Rules does not imply reciprocity. How could it? Crocker's Rules are something you do for yourself, to maximize information received — not something you grit your teeth over and do as a favor.

Twelve Virtues Of Rationality http://yudkowsky.net/rational/virtues
Context: Do not flinch from experiences that might destroy your beliefs. The thought you cannot think controls you more than thoughts you speak aloud. Submit yourself to ordeals and test yourself in fire. Relinquish the emotion which rests upon a mistaken belief, and seek to feel fully that emotion which fits the facts. If the iron approaches your face, and you believe it is hot, and it is cool, the Way opposes your fear. If the iron approaches your face, and you believe it is cool, and it is hot, the Way opposes your calm. Evaluate your beliefs first and then arrive at your emotions. Let yourself say: “If the iron is hot, I desire to believe it is hot, and if it is cool, I desire to believe it is cool.”

Harry Potter in Ch. 65 http://www.fanfiction.net/s/5782108/65/Harry_Potter_and_the_Methods_of_Rationality
Harry Potter and the Methods of Rationality (2010 - 2015)
Context: Lies propagate, that’s what I’m saying. You’ve got to tell more lies to cover them up, lie about every fact that’s connected to the first lie. And if you kept on lying, and you kept on trying to cover it up, sooner or later you’d even have to start lying about the general laws of thought. Like, someone is selling you some kind of alternative medicine that doesn’t work, and any double-blind experimental study will confirm that it doesn’t work. So if someone wants to go on defending the lie, they’ve got to get you to disbelieve in the experimental method. Like, the experimental method is just for merely scientific kinds of medicine, not amazing alternative medicine like theirs. Or a good and virtuous person should believe as strongly as they can, no matter what the evidence says. Or truth doesn’t exist and there’s no such thing as objective reality. A lot of common wisdom like that isn’t just mistaken, it’s anti-epistemology, it’s systematically wrong. Every rule of rationality that tells you how to find the truth, there’s someone out there who needs you to believe the opposite. If you once tell a lie, the truth is ever after your enemy; and there’s a lot of people out there telling lies.

A comment on Wrong Questions http://lesswrong.com/lw/og/wrong_questions/ (March 2008)
Context: Mystery exists in the mind, not in reality. If I am ignorant about a phenomenon, that is a fact about my state of mind, not a fact about the phenomenon itself. All the more so, if it seems like no possible answer can exist: Confusion exists in the map, not in the territory. Unanswerable questions do not mark places where magic enters the universe. They mark places where your mind runs skew to reality.

Feeling Rational http://lesswrong.com/lw/hp/feeling_rational/ (April 2007)
Context: Ever since I adopted the rule of "That which can be destroyed by the truth should be," I've also come to realize "That which the truth nourishes should thrive." When something good happens, I am happy, and there is no confusion in my mind about whether it is rational for me to be happy. When something terrible happens, I do not flee my sadness by searching for fake consolations and false silver linings. I visualize the past and future of humankind, the tens of billions of deaths over our history, the misery and fear, the search for answers, the trembling hands reaching upward out of so much blood, what we could become someday when we make the stars our cities, all that darkness and all that light — I know that I can never truly understand it, and I haven't the words to say.

Politics Is The Mind-Killer http://lesswrong.com/lw/gw/politics_is_the_mindkiller/ (February 2007)
Context: People go funny in the head when talking about politics. The evolutionary reasons for this are so obvious as to be worth belaboring: In the ancestral environment, politics was a matter of life and death. And sex, and wealth, and allies, and reputation... When, today, you get into an argument about whether "we" ought to raise the minimum wage, you're executing adaptations for an ancestral environment where being on the wrong side of the argument could get you killed... Politics is an extension of war by other means. Arguments are soldiers. Once you know which side you're on, you must support all arguments of that side, and attack all arguments that appear to favor the enemy side; otherwise it's like stabbing your soldiers in the back — providing aid and comfort to the enemy.

When something good happens, I am happy, and there is no confusion in my mind about whether it is rational for me to be happy. When something terrible happens, I do not flee my sadness by searching for fake consolations and false silver linings. I visualize the past and future of humankind, the tens of billions of deaths over our history, the misery and fear, the search for answers, the trembling hands reaching upward out of so much blood, what we could become someday when we make the stars our cities, all that darkness and all that light — I know that I can never truly understand it, and I haven't the words to say.
Feeling Rational http://lesswrong.com/lw/hp/feeling_rational/ (April 2007)

Quantum Non-Realism http://lesswrong.com/lw/q5/quantum_nonrealism/ (May 2008)
Context: The nature of "reality" is something about which I'm still confused, which leaves open the possibility that there isn't any such thing. But Egan's Law still applies: "It all adds up to normality." Apples didn't stop falling when Einstein disproved Newton's theory of gravity. Sure, when the dust settles, it could turn out that apples don't exist, Earth doesn't exist, reality doesn't exist. But the nonexistent apples will still fall toward the nonexistent ground at a meaningless rate of 9.8 m/s2.

Promoting "Crocker's Rules" in "An Introduction to SL4" (2002) http://www.sl4.org/intro.html
Context: If you declare Crocker's Rules, other people don't need to worry about being tactful to you. (You still need to worry about being tactful to them — Crocker's Rules only work one way.)

Question 5 in Less Wrong Q&A with Eliezer Yudkowsky (January 2010) http://lesswrong.com/lw/1lq/less_wrong_qa_with_eliezer_yudkowsky_video_answers/
Context: This is crunch time for the whole human species, and not just for us but for the intergalactic civilization whose existence depends on us. This is the hour before the final exam and we're trying to get as much studying done as possible. It may be that you can't make yourself feel that for a decade or thirty years or however long this crunch time lasts, but the reality is one thing and the emotions are another... If you confront it full on, then you can't really justify trading off any part of intergalactic civilization for any intrinsic thing you could get nowadays, and at the same time, it's also true that there are very few people who can live like that (and I'm not one of them myself).

Lonely Dissent http://lesswrong.com/lw/mb/lonely_dissent/ (December 2007)

Question 12 in Less Wrong Q&A with Eliezer Yudkowsky (January 2010) http://lesswrong.com/lw/1lq/less_wrong_qa_with_eliezer_yudkowsky_video_answers/

Ch. 45 http://www.fanfiction.net/s/5782108/45/Harry_Potter_and_the_Methods_of_Rationality
Harry Potter and the Methods of Rationality (2010 - 2015)

Twelve Virtues Of Rationality http://yudkowsky.net/rational/virtues

Your Strength As A Rationalist http://lesswrong.com/lw/if/your_strength_as_a_rationalist/ (August 2007)

" Timeless Identity http://lesswrong.com/lw/qx/timeless_identity/" (June 2008)

Helpless Individuals (March 2009) http://lesswrong.com/lw/64/helpless_individuals/

Harry Potter in Ch. 2 http://www.hpmor.com/chapter/2
Harry Potter and the Methods of Rationality (2010 - 2015)

An Alien God http://lesswrong.com/lw/kr/an_alien_god/ (November 2007)

Mundane Magic http://lesswrong.com/lw/ve/mundane_magic/(October 2008)

A comment on reddit (2009) http://www.reddit.com/r/atheism/comments/7g5ea/if_you_dont_believe_in_god_or_an_afterlife_would/c06ktil

How to Seem (and Be) Deep http://lesswrong.com/lw/k8/how_to_seem_and_be_deep/ (October 2007)

Professor Quirrell in Ch. 73 http://hpmor.com/chapter/73
Harry Potter and the Methods of Rationality (2010 - 2015)

Artificial Intelligence as a Positive and Negative Factor in Global Risk http://singinst.org/upload/artificial-intelligence-risk.pdf (August 2006)

Beware of Other-Optimizing (April 2009) http://lesswrong.com/lw/9v/beware_of_otheroptimizing/

Rebelling Within Nature http://lesswrong.com/lw/s5/rebelling_within_nature/ (July 2008)

In reply to a comment on his The Proper Use of Doubt http://lesswrong.com/lw/ib/the_proper_use_of_doubt/ejw

Honesty: Beyond Internal Truth (June 2009) http://lesswrong.com/lw/101/honesty_beyond_internal_truth/

So You Want To Be A Seed AI Programmer http://web.archive.org/web/20101227203946/http://www.acceleratingfuture.com/wiki/So_You_Want_To_Be_A_Seed_AI_Programmer

Epistle to the New York Less Wrongians (April 2011) http://lesswrong.com/lw/5c0/epistle_to_the_new_york_less_wrongians/

Superhero Bias http://lesswrong.com/lw/lk/superhero_bias/ (December 2007)

a comment on Facebook (June 2012) http://www.facebook.com/julia.galef/posts/10100387951009862