“Solving the value-loading problem is a research challenge worthy of some of the next generation’s best mathematical talent. We cannot postpone confronting this problem until the AI has developed enough reason to easily understand our intentions.”

— Nick Bostrom , book Superintelligence: Paths, Dangers, Strategies

Source: Superintelligence: Paths, Dangers, Strategies (2014), Ch. 12

Adopted from Wikiquote. Last update June 3, 2021. History

Help us to complete the source, original and additional information

Do you have more details about the quote "Solving the value-loading problem is a research challenge worthy of some of the next generation’s best mathematical tal…" by Nick Bostrom?

Nick Bostrom 24

Swedish philosopher 1973

Related quotes

“If we do not succeed in solving a mathematical problem, the reason frequently consists in our failure to recognize the more general standpoint from which the problem before us appears only as a single link in a chain of related problems. After finding this standpoint, not only is this problem frequently more accessible to our investigation, but at the same time we come into possession of a method which is applicable also to related problems.”

David Hilbert Mathematical Problems

Mathematical Problems (1900)

“Because of the fundamental character of these problems, and because Kant did not solve them, confronting them has been the most important challenge to philosophy ever since.”

Bryan Magee (1930–2019) British politician

Source: Confessions of a Philosopher (1997), p. 157
Context: As Voltaire once remarked, "It is the privilege of the real genius, especially one who opens up a new path, to make great mistakes with impunity." The Copernican revolution brought about by Kant was, I think, the most important single turning point in the history of philosophy. For that reason there has been, ever since, a watershed in understanding between those who have taken his work on board and those who have not. For a good many of the problems he uncovered, the solutions he put forward have not stood the test of time, but his uncovering of the problems remains the most illuminating thing a philosopher has ever done. Because of the fundamental character of these problems, and because Kant did not solve them, confronting them has been the most important challenge to philosophy ever since.

“[It was Andrew's intention to supply a] conceptual framework for thinking about the problems that confront the general manager, breaking his problems down into more manageable units, and proposing a sequence in which they might be reasonably ranked and considered.”

Kenneth R. Andrews (1916–2005) Business scholar

Source: Quote, The Concept of Strategy, 1971, p. 2

“Teachers need to be trained on how children learn, not only how to solve mathematical problems. They must know how to make learners well understand the New Math and enable them to solve mathematical problems.”

Sukavich Rangsitpol (1935) Thai politician

Teacher

“I hope that seeing the excitement of solving this problem will make young mathematicians realize that there are lots and lots of other problems in mathematics which are going to be just as challenging in the future.”

Andrew Wiles (1953) British mathematician

Nova Interview

“Art is this: art is the solution of a problem which cannot be expressed explicitly until it is solved.”

Piet Hein (1905–1996) Danish puzzle designer, mathematician, author, poet

As quoted in Man Creates Art Creates Man (1973) by Duane Preble, p. 14
Variant translation: Art is solving problems that cannot be formulated before they have been solved. The shaping of the question is part of the answer.
As quoted in Architecture: form, space, and order (2007) by Francis D.K. Ching, p. ix
Context: After all, what is art? Art is the creative process and it goes through all fields. Einstein’s theory of relativity — now that is a work of art! Einstein was more of an artist in physics than on his violin.
Art is this: art is the solution of a problem which cannot be expressed explicitly until it is solved.