In a conversation https://intelligence.org/wp-content/uploads/2014/01/01-16-2014-conversation-on-existential-risk.pdf with Luke Muehlhauser and Eliezer Yudkowsky, January 2014; part of this is quoted by Carl Shulman in "Population ethics and inaccessible populations" https://reflectivedisequilibrium.blogspot.com/2014/08/population-ethics-and-inaccessible.html <br class="br">Context: So one crazy analogy to how my morality might turn out to work, and the big point here is I don't know how my morality works, is we have a painting and the painting is very beautiful. There is some crap on the painting. Would I like the crap cleaned up? Yes, very much. That's like the suffering that's in the world today. Then there is making more of the painting, that's just a strange function. My utility with the size of the painting, it's just like a strange and complicated function. It may go up in any kind of reasonable term that I can actually foresee, but flatten out, at some point. So to see the world as like a painting and my utility of it is that, I think that is somewhat of an analogy to how my morality may work, that it's not like there is this linear multiplier and the multiplier is one thing or another thing. It's: starting to talk about billions of future generations is just like going so far outside of where my morality has ever been stress-tested. I don't how it would respond. I actually suspect that it would flatten out the same way as with the painting.
Holden Karnofsky: Making
Holden Karnofsky is American nonprofit executive. Explore interesting quotes on making.In an interview https://80000hours.org/podcast/episodes/holden-karnofsky-open-philanthropy/ with Robert Wiblin, February 2018; also quoted by Ben Pace in "Extended Quote on the Institution of Academia" https://www.lesswrong.com/posts/nXZi8efFArfk3u568/extended-quote-on-the-institution-of-academia and by Rob Bensinger in "Karnofsky on forecasting and what science does" https://www.lesswrong.com/posts/FhmWKE77qCPWJ63Y5/karnofsky-on-forecasting-and-what-science-does <br class="br">Context: I think it's somewhat of a happy coincidence so far that most breakthroughs have been good. To say, I see a breakthrough on the horizon. Is that good or bad? How can we prepare for it? That's another thing academia is really not set up to do. Academia is set up to get the breakthrough. That is a question I ask myself a lot is here's an intellectual activity. Why can't it be done in academia? These days, my answer is if it's really primarily of interest to a very cosmopolitan philanthropist trying to help the whole future, and there's no one client and it's not frontier advancing, then I think that does make it pretty plausible to me that there's no one doing it. We would love to change that, at least somewhat, by funding what we think is the most important work.
In an interview https://80000hours.org/2014/10/interview-holden-karnofsky-on-the-importance-of-personal-fit/ with Benjamin Todd, January 2014
In "Data Is Forever: The Engagement Gift I Gave" https://medium.com/@holden0/data-is-forever-the-engagement-gift-i-gave-123e75e1ca71, July 2016
In "Transparency, measurement, humility" https://blog.givewell.org/2007/12/27/transparency-measurement-humility/, December 2007; see "Some Thoughts on Public Discourse" http://effective-altruism.com/ea/17o/some_thoughts_on_public_discourse/ for an update to Karnofsky's thoughts
In an interview https://80000hours.org/2014/10/interview-holden-karnofsky-on-the-importance-of-personal-fit/ with Benjamin Todd, January 2014