“So one crazy analogy to how my morality might turn out to work, and the big point here is I don't know how my morality works, is we have a painting and the painting is very beautiful. There is some crap on the painting. Would I like the crap cleaned up? Yes, very much. That's like the suffering that's in the world today. Then there is making more of the painting, that's just a strange function. My utility with the size of the painting, it's just like a strange and complicated function. It may go up in any kind of reasonable term that I can actually foresee, but flatten out, at some point.”

In a conversation https://intelligence.org/wp-content/uploads/2014/01/01-16-2014-conversation-on-existential-risk.pdf with Luke Muehlhauser and Eliezer Yudkowsky, January 2014; part of this is quoted by Carl Shulman in "Population ethics and inaccessible populations" https://reflectivedisequilibrium.blogspot.com/2014/08/population-ethics-and-inaccessible.html
Context: So one crazy analogy to how my morality might turn out to work, and the big point here is I don't know how my morality works, is we have a painting and the painting is very beautiful. There is some crap on the painting. Would I like the crap cleaned up? Yes, very much. That's like the suffering that's in the world today. Then there is making more of the painting, that's just a strange function. My utility with the size of the painting, it's just like a strange and complicated function. It may go up in any kind of reasonable term that I can actually foresee, but flatten out, at some point. So to see the world as like a painting and my utility of it is that, I think that is somewhat of an analogy to how my morality may work, that it's not like there is this linear multiplier and the multiplier is one thing or another thing. It's: starting to talk about billions of future generations is just like going so far outside of where my morality has ever been stress-tested. I don't how it would respond. I actually suspect that it would flatten out the same way as with the painting.

Adopted from Wikiquote. Last update June 3, 2021. History

Help us to complete the source, original and additional information

Do you have more details about the quote "So one crazy analogy to how my morality might turn out to work, and the big point here is I don't know how my morality …" by Holden Karnofsky?
Holden Karnofsky photo
Holden Karnofsky 13
American nonprofit executive 1981

Related quotes

Jopie Huisman photo

“I worked for months on this painting [title 'The Stone-wheelbarrow of C. Adema', 1977], for instance that well-bucket on the wheelbarrow I painted a twenty times or more, and it is constructed exactly as nature has shaped it. I want to make it harder and harder for myself. 'That's how it is' doesn’t exist for me. Deepening, that's what it is all about. My wish is to make in due time a small painting in which I can hardly discover any longer that it is painted, that it is just there, like that. Just something very simple.”

Jopie Huisman (1922–2000) Dutch painter

translation, Fons Heijnsbroek, 2018
version in original Dutch / citaat van Jopie Huisman, in het Nederlands: Maandenlang heb ik aan dit schilderij [titel: 'De steenkruiwagen van C. Adema', 1977] gewerkt en die putemmer bijvoorbeeld op de kruiwagen, heb ik wel twintig keer geschilderd en is precies zo opgebouwd als de natuur hem gevormd heeft. Ik wil het mezelf steeds moeilijker maken. Zo kan het wel – bestaat niet voor mij. Verdieping, daar gaat het om. Ik wil nog eens een keer een schilderijtje zo maken, dat ik haast niet meer kan zien dat het geschilderd is, dat het er gewoon is, zo, zonder meer. Iets heel eenvoudigs.
Source: Jopie Huisman', 1981, p. 80

Nikita Khrushchev photo

“Don't you know how to paint? My grandson will paint it better! What is this? Are you men or damned pederasts? How can you paint like that? Do you have a conscience?”

Nikita Khrushchev (1894–1971) First Secretary of the Communist Party of the Soviet Union

Said to avant-garde artists Ely Bielutin and Ernst Neizvestny during a visit to their exhibition (1 December 1962)

Arshile Gorky photo
Arshile Gorky photo
Jackson Pollock photo
Gerhard Richter photo
Frank Stella photo

Related topics