“If you want to build a recursively self-improving AI, have it go through a billion sequential self-modifications, become vastly smarter than you, and not die, you've got to work to a pretty precise standard.”

Question 12 in Less Wrong Q&A with Eliezer Yudkowsky (January 2010) http://lesswrong.com/lw/1lq/less_wrong_qa_with_eliezer_yudkowsky_video_answers/

Adopted from Wikiquote. Last update June 3, 2021. History

Help us to complete the source, original and additional information

Do you have more details about the quote "If you want to build a recursively self-improving AI, have it go through a billion sequential self-modifications, becom…" by Eliezer Yudkowsky?
Eliezer Yudkowsky photo
Eliezer Yudkowsky 56
American blogger, writer, and artificial intelligence resea… 1979

Related quotes

Tupac Shakur photo
Don DeLillo photo
Fulton J. Sheen photo

“By denying any ultimate standard outside of self, one can escape all self-blame and go through life on a perpetual mission of face saving.”

Fulton J. Sheen (1895–1979) Catholic bishop and television presenter

Source: Peace of Soul (1949), Ch. 6, p. 103

Khalil Gibran photo

“You are your own forerunner, and the towers you have builded are but the foundation of your giant-self. And that self too shall be a foundation.”

Khalil Gibran (1883–1931) Lebanese artist, poet, and writer

The Forerunner (1920)
Context: You are your own forerunner, and the towers you have builded are but the foundation of your giant-self. And that self too shall be a foundation.
And I too am my own forerunner, for the long shadow stretching before me at sunrise shall gather under my feet at the noon hour. Yet another sunrise shall lay another shadow before me, and that also shall be gathered at another noon.
Always have we been our own forerunners, and always shall we be. And all that we have gathered and shall gather shall be but seeds for fields yet unploughed. We are the fields and the ploughmen, the gatherers and the gathered.

Will Smith photo
Ward Cunningham photo

“Accept that you've got a common goal that we're all working towards and that we're working towards the same goal. In other words, align and self-organize.”

Ward Cunningham (1949) American computer programmer who developed the first wiki

Podcast Interview with Ward Cunningham (2006)

“A self is not something static, tied up in a pretty parcel and handed to the child, finished and complete. A self is always becoming.”

Madeleine L'Engle (1918–2007) American writer

Section 1.10 <!-- p. 32 -->
Source: The Crosswicks Journal, A Circle of Quiet (1972)
Context: We do have to use our minds as far as they will take us, yet acknowledging that they cannot take us all the way.
We can give a child a self-image. But is this a good idea? Hitler did a devastating job at that kind of thing. So does Chairman Mao. … I haven't defined a self, nor do I want to. A self is not something static, tied up in a pretty parcel and handed to the child, finished and complete. A self is always becoming.

Lewis Pugh photo

“The most powerful form of self-belief comes from believing in something greater than you. Because when you’ve got purpose, everything becomes possible.”

Lewis Pugh (1969) Environmental campaigner, maritime lawyer and endurance swimmer

p 86
21 Yaks And A Speedo (2013)

Related topics