“I know it's tedious, but you aren't SL4 until you appreciate the depth of human irrationality. Yes rationality is there, but at a level that just barely shows up when measured with precise instruments. This is important with respect to non-human intelligences, because super-rationality, almost as much as superintelligence, is potentially overwhelming and because intelligence bootstraping moves a system towards rationality. Appreciate how far humans are from rational and you appreciate how utterly transformed, and essentially recreated, they would be by haphazard bootstrapping. Appreciate how formidable rationality is and you see why a highly rational infrahuman GAI would still be a massive existential threat.”

— Michael Vassar

"Another reminder of irrationality" http://sl4.org/archive/0602/14276.html, February 2006

Adopted from Wikiquote. Last update June 3, 2021. History

Help us to complete the source, original and additional information

Do you have more details about the quote "I know it's tedious, but you aren't SL4 until you appreciate the depth of human irrationality. Yes rationality is there…" by Michael Vassar?

Michael Vassar photo

Michael Vassar 4

President of the Singularity Institute 1979

Related quotes

“Critique in its many manifestations puts up a common opposition to instrumental rationality, because such a rationality can be linked to control in the human condition in a similar way to the idea of power in the control of the natural world.”

Robert L. Flood (1959) British organizational scientist

Robert L. Flood (1990) Liberating Systems Theory p. 204; as cited in: Trudi Cooper (2003) Critical Management, Critical Systems Theory And System Dynamics http://www.mngt.waikato.ac.nz/ejrot/cmsconference/2003/proceedings/orsystems/Cooper.pdf.

“The development of rational thought actually seems to have impeded man's appreciation for the significance of time.”

Gerald James Whitrow (1912–2000) British mathematician

Time in History: Views of Time from Prehistory to the Present Day (1988)
Context: The development of rational thought actually seems to have impeded man's appreciation for the significance of time.... Belief that the ultimate reality is timeless is deeply rooted in human thinking, and the origin of rational investigation of the world was the search for permanent factors that lie behind the ever-changing pattern of events.<!--p.22

“… our inherent assumption is that you convince people with rational arguments. But all the data shows that most people are not influenced by rational arguments. They're influenced by social pressure. … That's just the human condition, and we just have to acknowledge it and accept it.”

Steven Novella (1964) American neurologist, skepticist

SGU Podcast #254, May 26th, 2010 http://www.theskepticsguide.org/podcast/sgu/254
The Skeptics' Guide to the Universe, Podcast, 2010s

“A rational, humane solution—for Gelvri, as Elgran Vrai, believed rationality and humaneness tautologies, different names for the same thing.”

Michael Bishop (1945) American writer

Source: A Funeral for the Eyes of Fire (1975), Chapter 14, “Denouement: Ascent to the Acropolis” (p. 266)

“Mechanical instruments, potentially a vehicle of rational human purposes, are scarcely a blessing when they enable the gossip of the village idiot and the deeds of the thug to be broadcast to a million people each day.”

Lewis Mumford book Technics and Civilization

Source: Technics and Civilization (1934), Chapter 6, § 9

“The point is that humans are rarely at their best when they use rational reasoning.”

Didier Sornette (1957) French scientist

Source: Why Stock Markets Crash - Critical Events in Complex Systems (2003), Chapter 4, Positive Feedbacks, p. 106.

“Rationality is not one of humanity’s strong points.”

John Scalzi book The Ghost Brigades

Source: The Ghost Brigades (2006), Chapter 5 (p. 88)

“Humanism is a great idea that opens up colossal possibilities and abilities of rationalism.”

Zafar Mirzo (1972)

“Even though principles of rationality seem as often violated as followed, we still cling to the notion that human thought should be rational, logical, and orderly. Much of law is based upon the concept of rational thought and behavior. Much of economic theory is based upon the model of the rational human who attempts to optimize personal benefit, utility, or comfort. Many scientists who study artificial intelligence use the mathematics of formal logic—the predicate calculus—as their major tool to simulate thought. […] Human thought is not like logic; it is fundamentally different in kind and spirit. The difference is neither worse nor better. But it is the difference that leads to creative discovery and to great robustness of behavior.”

Donald A. Norman book The Design of Everyday Things

Source: The Design of Everyday Things (1988, 2002), Ch. 5, pp. 114–115.

Related topics