In "Three Key Issues I've Changed My Mind About" https://www.openphilanthropy.org/blog/three-key-issues-ive-changed-my-mind-about, September 2016
Context: I now believe that there simply is no mainstream academic or other field (as of today) that can be considered to be "the locus of relevant expertise" regarding potential risks from advanced AI. These risks involve a combination of technical and social considerations that don't pertain directly to any recognizable near-term problems in the world, and aren't naturally relevant to any particular branch of computer science. This is a major update for me: I've been very surprised that an issue so potentially important has, to date, commanded so little attention – and that the attention it has received has been significantly (though not exclusively) due to people in the effective altruism community.
Holden Karnofsky: Quotes about the world
Holden Karnofsky is American nonprofit executive. Explore interesting quotes on world.
In a conversation https://intelligence.org/wp-content/uploads/2014/01/01-16-2014-conversation-on-existential-risk.pdf with Luke Muehlhauser and Eliezer Yudkowsky, January 2014; part of this is quoted by Carl Shulman in "Population ethics and inaccessible populations" https://reflectivedisequilibrium.blogspot.com/2014/08/population-ethics-and-inaccessible.html
Context: So one crazy analogy to how my morality might turn out to work, and the big point here is I don't know how my morality works, is we have a painting and the painting is very beautiful. There is some crap on the painting. Would I like the crap cleaned up? Yes, very much. That's like the suffering that's in the world today. Then there is making more of the painting, that's just a strange function. My utility with the size of the painting, it's just like a strange and complicated function. It may go up in any kind of reasonable term that I can actually foresee, but flatten out, at some point. So to see the world as like a painting and my utility of it is that, I think that is somewhat of an analogy to how my morality may work, that it's not like there is this linear multiplier and the multiplier is one thing or another thing. It's: starting to talk about billions of future generations is just like going so far outside of where my morality has ever been stress-tested. I don't how it would respond. I actually suspect that it would flatten out the same way as with the painting.
On the "Ethics" https://powersmoothie.org/ethics/ page of his Power Smoothie website
In an interview https://80000hours.org/2014/10/interview-holden-karnofsky-on-the-importance-of-personal-fit/ with Benjamin Todd, January 2014